2024-09-11T00:45:13.001 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T00:45:13.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T00:45:13.130 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865 branch: wip-hemanth-testing-2024-09-10-0723 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/ffsb}} email: hyelloji@redhat.com first_in_suite: false job_id: '7899865' kernel: client: branch: testing flavor: default kdb: 1 sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-hemanth-testing-2024-09-10-0723 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: ms die on skipped message: false mds: mds_export_ephemeral_random_max: 0.1 mgr: cephsqlite lock renewal timeout: 900000 client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 filestore flush min: 0 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd heartbeat grace: 60 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - SLOW_OPS - slow request sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=legacy - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-hemanth-testing-2024-09-10-0723 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 owner: scheduled_hyelloji@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6190 sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 sleep_before_teardown: 0 subset: 479/1024 suite: fs suite_branch: wip-hemanth-testing-2024-09-10-0723 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOSQQuDveQHJ63yxshXW8MzKTn2gxjt1Ff/1lDEqZtaQzXmQyxKOArHCdca0NpglHVgHA7AqPZhnwKVAzp8eIIA= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCcnRsxGRb1aSIKASMsHsoMMMLmoxKMp/QYb7t9FBpiaPrgMVCf2gKW9pzL0frDNwu6asaScLmbVtGZcTU2pISA= smithi183.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLEBqzJE+7f4a764w4gNsmUbWik9Y4lewmYrsNs8IRDb6L9AM3r7zHbtfiyAJRpBTYa3HZUT57Rxt5g9ncm6hOs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/ffsb.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_16:59:47 tube: smithi user: hyelloji verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T00:45:13.130 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa; will attempt to use it 2024-09-11T00:45:13.131 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_8f219c476cb4f26fc5719c661c0323719a45cb30/qa/tasks 2024-09-11T00:45:13.131 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T00:45:13.133 INFO:teuthology.task.internal:Checking packages... 2024-09-11T00:45:13.155 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f219c476cb4f26fc5719c661c0323719a45cb30' 2024-09-11T00:45:13.155 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T00:45:13.155 INFO:teuthology.packaging:ref: None 2024-09-11T00:45:13.155 INFO:teuthology.packaging:tag: None 2024-09-11T00:45:13.155 INFO:teuthology.packaging:branch: wip-hemanth-testing-2024-09-10-0723 2024-09-11T00:45:13.155 INFO:teuthology.packaging:sha1: 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:45:13.156 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-hemanth-testing-2024-09-10-0723 2024-09-11T00:45:13.310 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4854.g8f219c47 2024-09-11T00:45:13.311 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T00:45:13.317 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T00:45:13.317 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T00:45:13.380 INFO:teuthology.task.internal:Saving configuration 2024-09-11T00:45:13.400 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T00:45:13.408 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T00:45:13.439 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 00:39:56.227229', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOSQQuDveQHJ63yxshXW8MzKTn2gxjt1Ff/1lDEqZtaQzXmQyxKOArHCdca0NpglHVgHA7AqPZhnwKVAzp8eIIA='} 2024-09-11T00:45:13.467 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 00:39:56.225446', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCcnRsxGRb1aSIKASMsHsoMMMLmoxKMp/QYb7t9FBpiaPrgMVCf2gKW9pzL0frDNwu6asaScLmbVtGZcTU2pISA='} 2024-09-11T00:45:13.496 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi183.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 00:39:56.223040', 'locked_by': 'scheduled_hyelloji@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLEBqzJE+7f4a764w4gNsmUbWik9Y4lewmYrsNs8IRDb6L9AM3r7zHbtfiyAJRpBTYa3HZUT57Rxt5g9ncm6hOs='} 2024-09-11T00:45:13.496 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T00:45:13.502 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-11T00:45:13.503 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-11T00:45:13.503 INFO:teuthology.task.internal:roles: ubuntu@smithi183.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-11T00:45:13.503 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T00:45:13.701 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1a25153be0>, signals=[15]) 2024-09-11T00:45:13.701 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T00:45:13.783 INFO:teuthology.task.internal:Opening connections... 2024-09-11T00:45:13.783 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T00:45:13.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:45:13.871 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-09-11T00:45:13.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:45:13.955 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi183.front.sepia.ceph.com 2024-09-11T00:45:13.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:45:14.038 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T00:45:14.044 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-09-11T00:45:14.063 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-09-11T00:45:14.064 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-09-11T00:45:14.122 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-09-11T00:45:14.122 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-09-11T00:45:14.122 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-09-11T00:45:14.122 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-09-11T00:45:14.122 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-09-11T00:45:14.122 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-09-11T00:45:14.122 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T00:45:14.122 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-09-11T00:45:14.122 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-09-11T00:45:14.122 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T00:45:14.123 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-09-11T00:45:14.123 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T00:45:14.123 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T00:45:14.123 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T00:45:14.123 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-09-11T00:45:14.148 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-09-11T00:45:14.167 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-09-11T00:45:14.167 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-09-11T00:45:14.225 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-09-11T00:45:14.225 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="9" 2024-09-11T00:45:14.225 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-09-11T00:45:14.225 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-09-11T00:45:14.225 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="9" 2024-09-11T00:45:14.225 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el9" 2024-09-11T00:45:14.225 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T00:45:14.225 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-09-11T00:45:14.225 INFO:teuthology.orchestra.run.smithi117.stdout:LOGO="fedora-logo-icon" 2024-09-11T00:45:14.225 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T00:45:14.225 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-09-11T00:45:14.225 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T00:45:14.226 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T00:45:14.226 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T00:45:14.226 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-09-11T00:45:14.257 DEBUG:teuthology.orchestra.run.smithi183:> uname -m 2024-09-11T00:45:14.275 INFO:teuthology.orchestra.run.smithi183.stdout:x86_64 2024-09-11T00:45:14.276 DEBUG:teuthology.orchestra.run.smithi183:> cat /etc/os-release 2024-09-11T00:45:14.334 INFO:teuthology.orchestra.run.smithi183.stdout:NAME="CentOS Stream" 2024-09-11T00:45:14.334 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION="9" 2024-09-11T00:45:14.334 INFO:teuthology.orchestra.run.smithi183.stdout:ID="centos" 2024-09-11T00:45:14.334 INFO:teuthology.orchestra.run.smithi183.stdout:ID_LIKE="rhel fedora" 2024-09-11T00:45:14.334 INFO:teuthology.orchestra.run.smithi183.stdout:VERSION_ID="9" 2024-09-11T00:45:14.334 INFO:teuthology.orchestra.run.smithi183.stdout:PLATFORM_ID="platform:el9" 2024-09-11T00:45:14.334 INFO:teuthology.orchestra.run.smithi183.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-11T00:45:14.334 INFO:teuthology.orchestra.run.smithi183.stdout:ANSI_COLOR="0;31" 2024-09-11T00:45:14.335 INFO:teuthology.orchestra.run.smithi183.stdout:LOGO="fedora-logo-icon" 2024-09-11T00:45:14.335 INFO:teuthology.orchestra.run.smithi183.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-11T00:45:14.335 INFO:teuthology.orchestra.run.smithi183.stdout:HOME_URL="https://centos.org/" 2024-09-11T00:45:14.335 INFO:teuthology.orchestra.run.smithi183.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-11T00:45:14.335 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-11T00:45:14.335 INFO:teuthology.orchestra.run.smithi183.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-11T00:45:14.335 INFO:teuthology.lock.ops:Updating smithi183.front.sepia.ceph.com on lock server 2024-09-11T00:45:14.390 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T00:45:14.400 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T00:45:14.434 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T00:45:14.435 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-09-11T00:45:14.437 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-09-11T00:45:14.440 DEBUG:teuthology.orchestra.run.smithi183:> test '!' -e /home/ubuntu/cephtest 2024-09-11T00:45:14.457 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T00:45:14.498 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T00:45:14.498 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-09-11T00:45:14.500 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-09-11T00:45:14.503 DEBUG:teuthology.orchestra.run.smithi183:> test -z $(ls -A /var/lib/ceph) 2024-09-11T00:45:14.608 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T00:45:14.706 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T00:45:14.720 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': 1, 'sha1': '2ca44a2f35ca8f36983aaaa46d49312239ef519a'} 2024-09-11T00:45:14.720 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-09-11T00:45:14.720 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-09-11T00:45:14.720 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T00:45:14.737 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:45:14.738 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-11T00:45:14.930 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:45:14.930 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-11T00:45:14.930 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-11T00:45:14.948 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-503.el9.x86_64 2024-09-11T00:45:14.948 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:45:14.948 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-11T00:45:14.949 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum upgrade -y linux-firmware 2024-09-11T00:45:17.398 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.2 MB 00:00 2024-09-11T00:45:19.749 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-09-11T00:45:24.042 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-11T00:45:25.651 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 19 kB 00:00 2024-09-11T00:45:26.540 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-11T00:45:32.036 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-11T00:45:34.152 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T00:45:34.153 INFO:teuthology.orchestra.run.smithi103.stdout:Nothing to do. 2024-09-11T00:45:34.153 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T00:45:34.265 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-11T00:45:34.266 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-11T00:45:34.425 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-11T00:45:34.425 DEBUG:teuthology.orchestra.run.smithi103:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-11T00:45:34.428 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi103.front.sepia.ceph.com to complete... 2024-09-11T00:45:40.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11 00:45:40 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-11T00:45:40.720 INFO:teuthology.orchestra.run.smithi103.stderr:FINISHED --2024-09-11 00:45:40-- 2024-09-11T00:45:40.720 INFO:teuthology.orchestra.run.smithi103.stderr:Total wall clock time: 6.3s 2024-09-11T00:45:40.720 INFO:teuthology.orchestra.run.smithi103.stderr:Downloaded: 1 files, 343M in 6.0s (57.3 MB/s) 2024-09-11T00:45:40.723 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-11T00:45:40.723 DEBUG:teuthology.orchestra.run.smithi103:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-11T00:45:42.838 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying... ######################################## 2024-09-11T00:45:42.993 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing... ######################################## 2024-09-11T00:45:43.103 INFO:teuthology.orchestra.run.smithi103.stdout:Updating / installing... 2024-09-11T00:45:51.145 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-11T00:46:31.570 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi103.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-11T00:46:31.570 DEBUG:teuthology.orchestra.run.smithi103:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-11T00:46:31.699 INFO:teuthology.orchestra.run.smithi103.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:46:31.699 INFO:teuthology.orchestra.run.smithi103.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:46:31.699 INFO:teuthology.orchestra.run.smithi103.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:46:31.699 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:46:31.699 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-11T00:46:31.700 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-11T00:46:31.700 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-11T00:46:31.700 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-11T00:46:31.700 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-11T00:46:31.700 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-11T00:46:31.700 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-11T00:46:31.700 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-11T00:46:31.700 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-11T00:46:31.700 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-11T00:46:31.700 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-11T00:46:31.700 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-11T00:46:31.700 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-11T00:46:31.700 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-11T00:46:31.701 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-11T00:46:31.701 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-11T00:46:31.701 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-11T00:46:31.701 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-11T00:46:31.701 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-11T00:46:31.701 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-11T00:46:31.701 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-11T00:46:31.701 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-11T00:46:31.701 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-11T00:46:31.701 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-11T00:46:31.701 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-11T00:46:31.701 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-11T00:46:31.701 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-11T00:46:31.701 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-11T00:46:31.702 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-11T00:46:31.702 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-11T00:46:31.702 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-11T00:46:31.702 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-11T00:46:31.702 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-11T00:46:31.702 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-11T00:46:31.702 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-11T00:46:31.702 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-11T00:46:31.702 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-11T00:46:31.702 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-11T00:46:31.702 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-11T00:46:31.702 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-11T00:46:31.702 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-11T00:46:31.703 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-11T00:46:31.703 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-11T00:46:31.703 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-11T00:46:31.703 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-11T00:46:31.703 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-11T00:46:31.703 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-11T00:46:31.703 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-11T00:46:31.703 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-11T00:46:31.703 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-11T00:46:31.703 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-11T00:46:31.703 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-11T00:46:31.703 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-11T00:46:31.703 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-11T00:46:31.704 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-11T00:46:31.704 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-11T00:46:31.704 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-11T00:46:31.704 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-11T00:46:31.704 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-11T00:46:31.704 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-11T00:46:31.704 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-11T00:46:31.704 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-11T00:46:31.704 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-11T00:46:31.704 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-11T00:46:31.704 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-11T00:46:31.704 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-11T00:46:31.705 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-11T00:46:31.705 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-11T00:46:31.705 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-11T00:46:31.705 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-11T00:46:31.705 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-11T00:46:31.705 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-11T00:46:31.705 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-11T00:46:31.705 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-11T00:46:31.706 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-11T00:46:31.706 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-11T00:46:31.706 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-11T00:46:31.706 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-11T00:46:31.706 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-11T00:46:31.707 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-11T00:46:31.707 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-11T00:46:31.707 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-11T00:46:31.707 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-11T00:46:31.707 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-11T00:46:31.707 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-11T00:46:31.708 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-11T00:46:31.708 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-11T00:46:31.708 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-11T00:46:31.708 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-11T00:46:31.708 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-11T00:46:31.709 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-11T00:46:31.709 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-11T00:46:31.709 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-11T00:46:31.709 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-11T00:46:31.709 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-11T00:46:31.710 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-11T00:46:31.710 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-11T00:46:31.710 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-11T00:46:31.710 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-11T00:46:31.710 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-11T00:46:31.710 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-11T00:46:31.711 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-11T00:46:31.711 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-11T00:46:31.711 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-11T00:46:31.711 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-11T00:46:31.711 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-11T00:46:31.712 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-11T00:46:31.712 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-11T00:46:31.712 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-11T00:46:31.712 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-11T00:46:31.712 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-11T00:46:31.713 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-11T00:46:31.713 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-11T00:46:31.713 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-11T00:46:31.713 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-11T00:46:31.713 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-11T00:46:31.713 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-11T00:46:31.714 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-11T00:46:31.714 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-11T00:46:31.714 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-11T00:46:31.714 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-11T00:46:31.714 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-11T00:46:31.715 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-11T00:46:31.715 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-11T00:46:31.715 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-11T00:46:31.715 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-11T00:46:31.715 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-11T00:46:31.715 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-11T00:46:31.716 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-11T00:46:31.716 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-11T00:46:31.716 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-11T00:46:31.716 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-11T00:46:31.716 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-11T00:46:31.717 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-11T00:46:31.717 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-11T00:46:31.717 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-11T00:46:31.717 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-11T00:46:31.717 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-11T00:46:31.718 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-11T00:46:31.718 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-11T00:46:31.718 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-11T00:46:31.718 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-11T00:46:31.718 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-11T00:46:31.718 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-11T00:46:31.719 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-11T00:46:31.719 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-11T00:46:31.719 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-11T00:46:31.719 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-11T00:46:31.719 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-11T00:46:31.720 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-11T00:46:31.720 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-11T00:46:31.720 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-11T00:46:31.720 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-11T00:46:31.720 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-11T00:46:31.720 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-11T00:46:31.721 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-11T00:46:31.721 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-11T00:46:31.721 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-11T00:46:31.721 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-11T00:46:31.721 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-11T00:46:31.721 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-11T00:46:31.722 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-11T00:46:31.722 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-11T00:46:31.722 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-11T00:46:31.722 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-11T00:46:31.722 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-11T00:46:31.723 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-11T00:46:31.723 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-11T00:46:31.723 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-11T00:46:31.723 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-11T00:46:31.723 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-11T00:46:31.724 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-11T00:46:31.724 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-11T00:46:31.724 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-11T00:46:31.724 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-11T00:46:31.724 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-11T00:46:31.724 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-11T00:46:31.725 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-11T00:46:31.725 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-11T00:46:31.725 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-11T00:46:31.725 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-11T00:46:31.725 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-11T00:46:31.726 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-11T00:46:31.726 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-11T00:46:31.726 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-11T00:46:31.726 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-11T00:46:31.726 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-11T00:46:31.726 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-11T00:46:31.727 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-11T00:46:31.727 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-11T00:46:31.727 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-11T00:46:31.727 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-11T00:46:31.727 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-11T00:46:31.728 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-11T00:46:31.728 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-11T00:46:31.728 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-11T00:46:31.728 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-11T00:46:31.728 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-11T00:46:31.729 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-11T00:46:31.729 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-11T00:46:31.729 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-11T00:46:31.729 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-11T00:46:31.729 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-11T00:46:31.729 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-11T00:46:31.730 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-11T00:46:31.730 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-11T00:46:31.730 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-11T00:46:31.730 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-11T00:46:31.730 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-11T00:46:31.731 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-11T00:46:31.731 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-11T00:46:31.731 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-11T00:46:31.731 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-11T00:46:31.731 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-11T00:46:31.732 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-11T00:46:31.732 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-11T00:46:31.732 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-11T00:46:31.732 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-11T00:46:31.732 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-11T00:46:31.732 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-11T00:46:31.733 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-11T00:46:31.733 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-11T00:46:31.733 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-11T00:46:31.733 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-11T00:46:31.733 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-11T00:46:31.734 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-11T00:46:31.734 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-11T00:46:31.734 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-11T00:46:31.734 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-11T00:46:31.734 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-11T00:46:31.735 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-11T00:46:31.735 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-11T00:46:31.735 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-11T00:46:31.735 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-11T00:46:31.735 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-11T00:46:31.735 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-11T00:46:31.736 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-11T00:46:31.736 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-11T00:46:31.736 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-11T00:46:31.736 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-11T00:46:31.736 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-11T00:46:31.737 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-11T00:46:31.737 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-11T00:46:31.737 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-11T00:46:31.737 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-11T00:46:31.737 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-11T00:46:31.738 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-11T00:46:31.738 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-11T00:46:31.738 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-11T00:46:31.738 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-11T00:46:31.738 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-11T00:46:31.739 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-11T00:46:31.739 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-11T00:46:31.739 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-11T00:46:31.739 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-11T00:46:31.739 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-11T00:46:31.739 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-11T00:46:31.740 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-11T00:46:31.740 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-11T00:46:31.740 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-11T00:46:31.740 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-11T00:46:31.740 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-11T00:46:31.741 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-11T00:46:31.741 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-11T00:46:31.741 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-11T00:46:31.741 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-11T00:46:31.742 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-11T00:46:31.742 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-11T00:46:31.742 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-11T00:46:31.742 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-11T00:46:31.742 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-11T00:46:31.743 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-11T00:46:31.743 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-11T00:46:31.743 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-11T00:46:31.743 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-11T00:46:31.743 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-11T00:46:31.743 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-11T00:46:31.744 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-11T00:46:31.744 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-11T00:46:31.744 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-11T00:46:31.744 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-11T00:46:31.744 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-11T00:46:31.745 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-11T00:46:31.745 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-11T00:46:31.745 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-11T00:46:31.745 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-11T00:46:31.745 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-11T00:46:31.746 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-11T00:46:31.746 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-11T00:46:31.746 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-11T00:46:31.746 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-11T00:46:31.746 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-11T00:46:31.746 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-11T00:46:31.747 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-11T00:46:31.747 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-11T00:46:31.747 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-11T00:46:31.747 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-11T00:46:31.748 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-11T00:46:31.748 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-11T00:46:31.748 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-11T00:46:31.748 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-11T00:46:31.749 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-11T00:46:31.749 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-11T00:46:31.749 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-11T00:46:31.749 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-11T00:46:31.749 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-11T00:46:31.749 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-11T00:46:31.750 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-11T00:46:31.750 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-11T00:46:31.750 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-11T00:46:31.750 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-11T00:46:31.750 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-11T00:46:31.751 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-11T00:46:31.751 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-11T00:46:31.751 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-11T00:46:31.751 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-11T00:46:31.751 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-11T00:46:31.752 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-11T00:46:31.752 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-11T00:46:31.752 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-11T00:46:31.752 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-11T00:46:31.752 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-11T00:46:31.753 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-11T00:46:31.753 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-11T00:46:31.753 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-11T00:46:31.753 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-11T00:46:31.753 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-11T00:46:31.753 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-11T00:46:31.754 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-11T00:46:31.754 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-11T00:46:31.754 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-11T00:46:31.754 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-11T00:46:31.754 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-11T00:46:31.755 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-11T00:46:31.755 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-11T00:46:31.755 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-11T00:46:31.755 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-11T00:46:31.755 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-11T00:46:31.755 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-11T00:46:31.756 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-11T00:46:31.756 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-11T00:46:31.756 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-11T00:46:31.756 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-11T00:46:31.756 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-11T00:46:31.756 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-11T00:46:31.757 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-11T00:46:31.757 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-11T00:46:31.757 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-11T00:46:31.757 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-11T00:46:31.757 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-11T00:46:31.758 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-11T00:46:31.758 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-11T00:46:31.758 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-11T00:46:31.758 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-11T00:46:31.758 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-11T00:46:31.758 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-11T00:46:31.759 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-11T00:46:31.759 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-11T00:46:31.759 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-11T00:46:31.759 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-11T00:46:31.759 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-11T00:46:31.760 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-11T00:46:31.760 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-11T00:46:31.760 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-11T00:46:31.760 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-11T00:46:31.761 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-11T00:46:31.761 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-11T00:46:31.761 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-11T00:46:31.761 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-11T00:46:31.761 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-11T00:46:31.762 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-11T00:46:31.762 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-11T00:46:31.762 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-11T00:46:31.762 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-11T00:46:31.762 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-11T00:46:31.762 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-11T00:46:31.763 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-11T00:46:31.763 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-11T00:46:31.763 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-11T00:46:31.763 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-11T00:46:31.763 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-11T00:46:31.764 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-11T00:46:31.764 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-11T00:46:31.764 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-11T00:46:31.764 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-11T00:46:31.764 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-11T00:46:31.765 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-11T00:46:31.765 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-11T00:46:31.765 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-11T00:46:31.765 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-11T00:46:31.765 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-11T00:46:31.766 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-11T00:46:31.766 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-11T00:46:31.766 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-11T00:46:31.766 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-11T00:46:31.766 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-11T00:46:31.767 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-11T00:46:31.767 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-11T00:46:31.767 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-11T00:46:31.767 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-11T00:46:31.767 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-11T00:46:31.767 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-11T00:46:31.768 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-11T00:46:31.768 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-11T00:46:31.768 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-11T00:46:31.768 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-11T00:46:31.768 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-11T00:46:31.769 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-11T00:46:31.769 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-11T00:46:31.769 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-11T00:46:31.769 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-11T00:46:31.769 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-11T00:46:31.770 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-11T00:46:31.770 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-11T00:46:31.770 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-11T00:46:31.770 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-11T00:46:31.770 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-11T00:46:31.770 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-11T00:46:31.771 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-11T00:46:31.771 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-11T00:46:31.771 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-11T00:46:31.771 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-11T00:46:31.771 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-11T00:46:31.771 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-11T00:46:31.772 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-11T00:46:31.772 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-11T00:46:31.772 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-11T00:46:31.772 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-11T00:46:31.772 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-11T00:46:31.773 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-11T00:46:31.773 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-11T00:46:31.773 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-11T00:46:31.773 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-11T00:46:31.773 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-11T00:46:31.773 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-11T00:46:31.774 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-11T00:46:31.774 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-11T00:46:31.774 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-11T00:46:31.774 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-11T00:46:31.774 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-11T00:46:31.775 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-11T00:46:31.775 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-11T00:46:31.775 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-11T00:46:31.775 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-11T00:46:31.775 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-11T00:46:31.775 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-11T00:46:31.775 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-11T00:46:31.775 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-11T00:46:31.775 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-11T00:46:31.776 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-11T00:46:31.776 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-11T00:46:31.776 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-11T00:46:31.776 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-11T00:46:31.776 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-11T00:46:31.776 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-11T00:46:31.776 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-11T00:46:31.776 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-11T00:46:31.776 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-11T00:46:31.776 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-11T00:46:31.776 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-11T00:46:31.776 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-11T00:46:31.776 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-11T00:46:31.776 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-11T00:46:31.777 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-11T00:46:31.777 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-11T00:46:31.777 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-11T00:46:31.777 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-11T00:46:31.777 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-11T00:46:31.777 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-11T00:46:31.777 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-11T00:46:31.777 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-11T00:46:31.777 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-11T00:46:31.777 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-11T00:46:31.777 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-11T00:46:31.777 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-11T00:46:31.777 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-11T00:46:31.777 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-11T00:46:31.778 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-11T00:46:31.778 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-11T00:46:31.778 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-11T00:46:31.778 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-11T00:46:31.778 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-11T00:46:31.778 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-11T00:46:31.778 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-11T00:46:31.778 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-11T00:46:31.778 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-11T00:46:31.778 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-11T00:46:31.778 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-11T00:46:31.778 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-11T00:46:31.778 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-11T00:46:31.779 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-11T00:46:31.779 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-11T00:46:31.779 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-11T00:46:31.779 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-11T00:46:31.779 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-11T00:46:31.779 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-11T00:46:31.779 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-11T00:46:31.779 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-11T00:46:31.779 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-11T00:46:31.779 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-11T00:46:31.779 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-11T00:46:31.779 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-11T00:46:31.779 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-11T00:46:31.780 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-11T00:46:31.780 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-11T00:46:31.780 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-11T00:46:31.780 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-11T00:46:31.780 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-11T00:46:31.780 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-11T00:46:31.780 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-11T00:46:31.780 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-11T00:46:31.780 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-11T00:46:31.780 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-11T00:46:31.780 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-11T00:46:31.780 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-11T00:46:31.780 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-11T00:46:31.781 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-11T00:46:31.781 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-11T00:46:31.781 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-11T00:46:31.781 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-11T00:46:31.781 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-11T00:46:31.781 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-11T00:46:31.781 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-11T00:46:31.781 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-11T00:46:31.781 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-11T00:46:31.781 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-11T00:46:31.781 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-11T00:46:31.781 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-11T00:46:31.781 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-11T00:46:31.782 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-11T00:46:31.783 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-11T00:46:31.783 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-11T00:46:31.783 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-11T00:46:31.783 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-11T00:46:31.783 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-11T00:46:31.783 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-11T00:46:31.783 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-11T00:46:31.783 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-11T00:46:31.783 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-11T00:46:31.783 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-11T00:46:31.783 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-11T00:46:31.783 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-11T00:46:31.783 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-11T00:46:31.783 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-11T00:46:31.784 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-11T00:46:31.784 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-11T00:46:31.784 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-11T00:46:31.784 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-11T00:46:31.784 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-11T00:46:31.784 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-11T00:46:31.784 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-11T00:46:31.784 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-11T00:46:31.784 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-11T00:46:31.784 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-11T00:46:31.784 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-11T00:46:31.784 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-11T00:46:31.784 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-11T00:46:31.785 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-11T00:46:31.785 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-11T00:46:31.785 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-11T00:46:31.785 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-11T00:46:31.785 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-11T00:46:31.785 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-11T00:46:31.785 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-11T00:46:31.785 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-11T00:46:31.785 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-11T00:46:31.785 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-11T00:46:31.785 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-11T00:46:31.785 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-11T00:46:31.785 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-11T00:46:31.785 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-11T00:46:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-11T00:46:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-11T00:46:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-11T00:46:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-11T00:46:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-11T00:46:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-11T00:46:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-11T00:46:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-11T00:46:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-11T00:46:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-11T00:46:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-11T00:46:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-11T00:46:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-11T00:46:31.786 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-11T00:46:31.787 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-11T00:46:31.788 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-11T00:46:31.788 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-11T00:46:31.788 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-11T00:46:31.788 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-11T00:46:31.788 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-11T00:46:31.788 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-11T00:46:31.788 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-11T00:46:31.788 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-11T00:46:31.788 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-11T00:46:31.788 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-11T00:46:31.788 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-11T00:46:31.788 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-11T00:46:31.788 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-11T00:46:31.788 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-11T00:46:31.789 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-11T00:46:31.789 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-11T00:46:31.789 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-11T00:46:31.789 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-11T00:46:31.789 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-11T00:46:31.789 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-11T00:46:31.789 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-11T00:46:31.789 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-11T00:46:31.789 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-11T00:46:31.789 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-11T00:46:31.789 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-11T00:46:31.789 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-11T00:46:31.789 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-11T00:46:31.789 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-11T00:46:31.790 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-11T00:46:31.791 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-11T00:46:31.791 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-11T00:46:31.791 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-11T00:46:31.791 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-11T00:46:31.791 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-11T00:46:31.791 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-11T00:46:31.791 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-11T00:46:31.791 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-11T00:46:31.791 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-11T00:46:31.791 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-11T00:46:31.791 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-11T00:46:31.791 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-11T00:46:31.791 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-11T00:46:31.791 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-11T00:46:31.792 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-11T00:46:31.792 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-11T00:46:31.792 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-11T00:46:31.792 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-11T00:46:31.792 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-11T00:46:31.792 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-11T00:46:31.792 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-11T00:46:31.792 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-11T00:46:31.792 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-11T00:46:31.792 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-11T00:46:31.792 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-11T00:46:31.792 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-11T00:46:31.792 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-11T00:46:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-11T00:46:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-11T00:46:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-11T00:46:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-11T00:46:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-11T00:46:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-11T00:46:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-11T00:46:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-11T00:46:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-11T00:46:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-11T00:46:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-11T00:46:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-11T00:46:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-11T00:46:31.793 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-11T00:46:31.794 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-11T00:46:31.795 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-11T00:46:31.795 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-11T00:46:31.795 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-11T00:46:31.795 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-11T00:46:31.795 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-11T00:46:31.795 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-11T00:46:31.795 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-11T00:46:31.795 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-11T00:46:31.795 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-11T00:46:31.795 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-11T00:46:31.795 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-11T00:46:31.795 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-11T00:46:31.795 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-11T00:46:31.795 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-11T00:46:31.796 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-11T00:46:31.796 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-11T00:46:31.796 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-11T00:46:31.796 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-11T00:46:31.796 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-11T00:46:31.796 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-11T00:46:31.796 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-11T00:46:31.796 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-11T00:46:31.796 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-11T00:46:31.796 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-11T00:46:31.796 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-11T00:46:31.796 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-11T00:46:31.796 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-11T00:46:31.796 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-11T00:46:31.797 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-11T00:46:31.797 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-11T00:46:31.797 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-11T00:46:31.797 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-11T00:46:31.797 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-11T00:46:31.797 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-11T00:46:31.797 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-11T00:46:31.797 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-11T00:46:31.797 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-11T00:46:31.797 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-11T00:46:31.797 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-11T00:46:31.797 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-11T00:46:31.797 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-11T00:46:31.798 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-11T00:46:31.798 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-11T00:46:31.798 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-11T00:46:31.798 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-11T00:46:31.798 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-11T00:46:31.798 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-11T00:46:31.798 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-11T00:46:31.798 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-11T00:46:31.798 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-11T00:46:31.798 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-11T00:46:31.798 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-11T00:46:31.799 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-11T00:46:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-11T00:46:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-11T00:46:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-11T00:46:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-11T00:46:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-11T00:46:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-11T00:46:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-11T00:46:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-11T00:46:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-11T00:46:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-11T00:46:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-11T00:46:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-11T00:46:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-11T00:46:31.800 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-11T00:46:31.801 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-11T00:46:31.802 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-11T00:46:31.803 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-11T00:46:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-11T00:46:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-11T00:46:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-11T00:46:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-11T00:46:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-11T00:46:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-11T00:46:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-11T00:46:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-11T00:46:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-11T00:46:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-11T00:46:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-11T00:46:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-11T00:46:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-11T00:46:31.804 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-11T00:46:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-11T00:46:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-11T00:46:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-11T00:46:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-11T00:46:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-11T00:46:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-11T00:46:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-11T00:46:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-11T00:46:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-11T00:46:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-11T00:46:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-11T00:46:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-11T00:46:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-11T00:46:31.805 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-11T00:46:31.806 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-11T00:46:31.806 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-11T00:46:31.806 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-11T00:46:31.806 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-11T00:46:31.806 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-11T00:46:31.806 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-11T00:46:31.806 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-11T00:46:31.806 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-11T00:46:31.806 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-11T00:46:31.806 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-11T00:46:31.806 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-11T00:46:31.806 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-11T00:46:31.806 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-11T00:46:31.807 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-11T00:46:31.807 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-11T00:46:31.807 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-11T00:46:31.807 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-11T00:46:31.807 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-11T00:46:31.807 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-11T00:46:31.807 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-11T00:46:31.807 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-11T00:46:31.807 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-11T00:46:31.807 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-11T00:46:31.807 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-11T00:46:31.807 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-11T00:46:31.807 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-11T00:46:31.807 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-11T00:46:31.808 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-11T00:46:31.809 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-11T00:46:31.810 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-11T00:46:31.810 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-11T00:46:31.810 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-11T00:46:31.810 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-11T00:46:31.810 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-11T00:46:31.810 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-11T00:46:31.810 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-11T00:46:31.810 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-11T00:46:31.810 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-11T00:46:31.810 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-11T00:46:31.810 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-11T00:46:31.810 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-11T00:46:31.810 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-11T00:46:31.810 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-11T00:46:31.811 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-11T00:46:31.812 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-11T00:46:31.813 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-11T00:46:31.814 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-11T00:46:31.815 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-11T00:46:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-11T00:46:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-11T00:46:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-11T00:46:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-11T00:46:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-11T00:46:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-11T00:46:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-11T00:46:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-11T00:46:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-11T00:46:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-11T00:46:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-11T00:46:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-11T00:46:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-11T00:46:31.816 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-11T00:46:31.817 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-11T00:46:31.817 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-11T00:46:31.817 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-11T00:46:31.817 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-11T00:46:31.817 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-11T00:46:31.817 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-11T00:46:31.817 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-11T00:46:31.817 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-11T00:46:31.817 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-11T00:46:31.817 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-11T00:46:31.817 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-11T00:46:31.817 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-11T00:46:31.817 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-11T00:46:31.817 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-11T00:46:31.818 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-11T00:46:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-11T00:46:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-11T00:46:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-11T00:46:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-11T00:46:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-11T00:46:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-11T00:46:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-11T00:46:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-11T00:46:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-11T00:46:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-11T00:46:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-11T00:46:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-11T00:46:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-11T00:46:31.819 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-11T00:46:31.820 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-11T00:46:31.820 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-11T00:46:31.820 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-11T00:46:31.820 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-11T00:46:31.820 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-11T00:46:31.820 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-11T00:46:31.820 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-11T00:46:31.820 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-11T00:46:31.820 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-11T00:46:31.820 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-11T00:46:31.820 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-11T00:46:31.820 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-11T00:46:31.820 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-11T00:46:31.821 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-11T00:46:31.822 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-11T00:46:31.822 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-11T00:46:31.822 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-11T00:46:31.822 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-11T00:46:31.822 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-11T00:46:31.822 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-11T00:46:31.822 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-11T00:46:31.822 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-11T00:46:31.822 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-11T00:46:31.822 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-11T00:46:31.822 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-11T00:46:31.822 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-11T00:46:31.822 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-11T00:46:31.822 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-11T00:46:31.823 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-11T00:46:31.823 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-11T00:46:31.823 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-11T00:46:31.823 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-11T00:46:31.823 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-11T00:46:31.823 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-11T00:46:31.823 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-11T00:46:31.823 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-11T00:46:31.823 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-11T00:46:31.823 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-11T00:46:31.823 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-11T00:46:31.823 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-11T00:46:31.823 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-11T00:46:31.824 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-11T00:46:31.824 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-11T00:46:31.824 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-11T00:46:31.824 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-11T00:46:31.824 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-11T00:46:31.824 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-11T00:46:31.824 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-11T00:46:31.824 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-11T00:46:31.824 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-11T00:46:31.824 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-11T00:46:31.824 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-11T00:46:31.824 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-11T00:46:31.824 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-11T00:46:31.824 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-11T00:46:31.825 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-11T00:46:31.825 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-11T00:46:31.825 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-11T00:46:31.825 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-11T00:46:31.825 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-11T00:46:31.825 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-11T00:46:31.825 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-11T00:46:31.825 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-11T00:46:31.825 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-11T00:46:31.825 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-11T00:46:31.825 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-11T00:46:31.825 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-11T00:46:31.825 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-11T00:46:31.825 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-11T00:46:31.826 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-11T00:46:31.826 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-11T00:46:31.826 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-11T00:46:31.826 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-11T00:46:31.826 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-11T00:46:31.826 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-11T00:46:31.826 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-11T00:46:31.826 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-11T00:46:31.826 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-11T00:46:31.826 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-11T00:46:31.826 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-11T00:46:31.826 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-11T00:46:31.826 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-11T00:46:31.826 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-11T00:46:31.827 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-11T00:46:31.828 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-11T00:46:31.829 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-11T00:46:31.829 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-11T00:46:31.829 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-11T00:46:31.829 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-11T00:46:31.829 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-11T00:46:31.829 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-11T00:46:31.829 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-11T00:46:31.829 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-11T00:46:31.829 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-11T00:46:31.829 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-11T00:46:31.829 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-11T00:46:31.829 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-11T00:46:31.829 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-11T00:46:31.829 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-11T00:46:31.830 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-11T00:46:31.830 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-11T00:46:31.830 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-11T00:46:31.830 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-11T00:46:31.830 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-11T00:46:31.830 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-11T00:46:31.830 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-11T00:46:31.830 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-11T00:46:31.830 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-11T00:46:31.830 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-11T00:46:31.830 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-11T00:46:31.830 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-11T00:46:31.830 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-11T00:46:31.830 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-11T00:46:31.831 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-11T00:46:31.832 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-11T00:46:31.832 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-11T00:46:31.832 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-11T00:46:31.832 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-11T00:46:31.832 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-11T00:46:31.832 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-11T00:46:31.832 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-11T00:46:31.832 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-11T00:46:31.832 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-11T00:46:31.832 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-11T00:46:31.832 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-11T00:46:31.832 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-11T00:46:31.832 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-11T00:46:31.833 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-11T00:46:31.833 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-11T00:46:31.833 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-11T00:46:31.833 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-11T00:46:31.833 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-11T00:46:31.833 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-11T00:46:31.833 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-11T00:46:31.833 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-11T00:46:31.833 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-11T00:46:31.833 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-11T00:46:31.833 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-11T00:46:31.833 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-11T00:46:31.834 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-11T00:46:31.834 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-11T00:46:31.834 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-11T00:46:31.834 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-11T00:46:31.834 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-11T00:46:31.834 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-11T00:46:31.834 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-11T00:46:31.834 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-11T00:46:31.834 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-11T00:46:31.834 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-11T00:46:31.834 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-11T00:46:31.834 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-11T00:46:31.834 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-11T00:46:31.835 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-11T00:46:31.835 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-11T00:46:31.835 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-11T00:46:31.835 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-11T00:46:31.835 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-11T00:46:31.835 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-11T00:46:31.835 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-11T00:46:31.835 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-11T00:46:31.835 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-11T00:46:31.835 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-11T00:46:31.835 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-11T00:46:31.835 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-11T00:46:31.835 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-11T00:46:31.835 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-11T00:46:31.836 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-11T00:46:31.836 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-11T00:46:31.836 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-11T00:46:31.836 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-11T00:46:31.836 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-11T00:46:31.836 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-11T00:46:31.836 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-11T00:46:31.836 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-11T00:46:31.836 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-11T00:46:31.836 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-11T00:46:31.837 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-11T00:46:31.838 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-11T00:46:31.838 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-11T00:46:31.838 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-11T00:46:31.838 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-11T00:46:31.838 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-11T00:46:31.838 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-11T00:46:31.838 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-11T00:46:31.838 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-11T00:46:31.838 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-11T00:46:31.838 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-11T00:46:31.838 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-11T00:46:31.838 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-11T00:46:31.839 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-11T00:46:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-11T00:46:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-11T00:46:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-11T00:46:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-11T00:46:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-11T00:46:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-11T00:46:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-11T00:46:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-11T00:46:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-11T00:46:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-11T00:46:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-11T00:46:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-11T00:46:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-11T00:46:31.840 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-11T00:46:31.841 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-11T00:46:31.842 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-11T00:46:31.843 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-11T00:46:31.843 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-11T00:46:31.843 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-11T00:46:31.843 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-11T00:46:31.843 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-11T00:46:31.843 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-11T00:46:31.843 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-11T00:46:31.843 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-11T00:46:31.843 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-11T00:46:31.843 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-11T00:46:31.843 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-11T00:46:31.843 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-11T00:46:31.843 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-11T00:46:31.843 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-11T00:46:31.844 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-11T00:46:31.844 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-11T00:46:31.844 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-11T00:46:31.844 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-11T00:46:31.844 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-11T00:46:31.844 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-11T00:46:31.844 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-11T00:46:31.844 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-11T00:46:31.844 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-11T00:46:31.844 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-11T00:46:31.844 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-11T00:46:31.844 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-11T00:46:31.844 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-11T00:46:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-11T00:46:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-11T00:46:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-11T00:46:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-11T00:46:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-11T00:46:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-11T00:46:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-11T00:46:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-11T00:46:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-11T00:46:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-11T00:46:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-11T00:46:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-11T00:46:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-11T00:46:31.845 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-11T00:46:31.846 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-11T00:46:31.847 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-11T00:46:31.847 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-11T00:46:31.847 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-11T00:46:31.847 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-11T00:46:31.847 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-11T00:46:31.847 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-11T00:46:31.847 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-11T00:46:31.847 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-11T00:46:31.847 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-11T00:46:31.847 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-11T00:46:31.847 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-11T00:46:31.847 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-11T00:46:31.847 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-11T00:46:31.847 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-11T00:46:31.848 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-11T00:46:31.848 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-11T00:46:31.848 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-11T00:46:31.848 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-11T00:46:31.848 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-11T00:46:31.848 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-11T00:46:31.848 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-11T00:46:31.848 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-11T00:46:31.848 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-11T00:46:31.848 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-11T00:46:31.848 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-11T00:46:31.848 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-11T00:46:31.848 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-11T00:46:31.848 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-11T00:46:31.849 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-11T00:46:31.849 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-11T00:46:31.849 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-11T00:46:31.849 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-11T00:46:31.849 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-11T00:46:31.849 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-11T00:46:31.849 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-11T00:46:31.849 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-11T00:46:31.849 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-11T00:46:31.849 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-11T00:46:31.849 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-11T00:46:31.849 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-11T00:46:31.849 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-11T00:46:31.850 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-11T00:46:31.851 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-11T00:46:31.851 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-11T00:46:31.851 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-11T00:46:31.851 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-11T00:46:31.851 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-11T00:46:31.851 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-11T00:46:31.851 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-11T00:46:31.851 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-11T00:46:31.851 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-11T00:46:31.851 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-11T00:46:31.851 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-11T00:46:31.851 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-11T00:46:31.851 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-11T00:46:31.852 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-11T00:46:31.852 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-11T00:46:31.852 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-11T00:46:31.852 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-11T00:46:31.852 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-11T00:46:31.852 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-11T00:46:31.852 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-11T00:46:31.852 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-11T00:46:31.852 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-11T00:46:31.852 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-11T00:46:31.852 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-11T00:46:31.852 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-11T00:46:31.852 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-11T00:46:31.852 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-11T00:46:31.853 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-11T00:46:31.853 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-11T00:46:31.853 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-11T00:46:31.853 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-11T00:46:31.853 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-11T00:46:31.853 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-11T00:46:31.853 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-11T00:46:31.853 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-11T00:46:31.853 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-11T00:46:31.853 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-11T00:46:31.853 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-11T00:46:31.853 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-11T00:46:31.853 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-11T00:46:31.854 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-11T00:46:31.854 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-11T00:46:31.854 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-11T00:46:31.854 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-11T00:46:31.854 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-11T00:46:31.854 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-11T00:46:31.854 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-11T00:46:31.854 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-11T00:46:31.854 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-11T00:46:31.854 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-11T00:46:31.854 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-11T00:46:31.854 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-11T00:46:31.854 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-11T00:46:31.854 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-11T00:46:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-11T00:46:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-11T00:46:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-11T00:46:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-11T00:46:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-11T00:46:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-11T00:46:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-11T00:46:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-11T00:46:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-11T00:46:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-11T00:46:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-11T00:46:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-11T00:46:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-11T00:46:31.855 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-11T00:46:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-11T00:46:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-11T00:46:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-11T00:46:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-11T00:46:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-11T00:46:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-11T00:46:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-11T00:46:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-11T00:46:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-11T00:46:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-11T00:46:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-11T00:46:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-11T00:46:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-11T00:46:31.856 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-11T00:46:31.857 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-11T00:46:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-11T00:46:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-11T00:46:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-11T00:46:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-11T00:46:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-11T00:46:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-11T00:46:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-11T00:46:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-11T00:46:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-11T00:46:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-11T00:46:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-11T00:46:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-11T00:46:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-11T00:46:31.858 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-11T00:46:31.859 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-11T00:46:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-11T00:46:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-11T00:46:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-11T00:46:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-11T00:46:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-11T00:46:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-11T00:46:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-11T00:46:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-11T00:46:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-11T00:46:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-11T00:46:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-11T00:46:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-11T00:46:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-11T00:46:31.860 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-11T00:46:31.861 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-11T00:46:31.862 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-11T00:46:31.862 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-11T00:46:31.862 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-11T00:46:31.862 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-11T00:46:31.862 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-11T00:46:31.862 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-11T00:46:31.862 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-11T00:46:31.862 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-11T00:46:31.862 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-11T00:46:31.862 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-11T00:46:31.862 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-11T00:46:31.862 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-11T00:46:31.862 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-11T00:46:31.862 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-11T00:46:31.863 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-11T00:46:31.863 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-11T00:46:31.863 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-11T00:46:31.863 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-11T00:46:31.863 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-11T00:46:31.863 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-11T00:46:31.863 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-11T00:46:31.863 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-11T00:46:31.863 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-11T00:46:31.863 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-11T00:46:31.863 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-11T00:46:31.863 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-11T00:46:31.863 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-11T00:46:31.864 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-11T00:46:31.864 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-11T00:46:31.864 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-11T00:46:31.864 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-11T00:46:31.864 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-11T00:46:31.864 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-11T00:46:31.864 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-11T00:46:31.864 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-11T00:46:31.864 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-11T00:46:31.864 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-11T00:46:31.864 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-11T00:46:31.864 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-11T00:46:31.864 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-11T00:46:31.864 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-11T00:46:31.865 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-11T00:46:31.865 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-11T00:46:31.865 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-11T00:46:31.865 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-11T00:46:31.865 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-11T00:46:31.865 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-11T00:46:31.865 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-11T00:46:31.865 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-11T00:46:31.865 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-11T00:46:31.865 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-11T00:46:31.865 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-11T00:46:31.865 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-11T00:46:31.865 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-11T00:46:31.865 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-11T00:46:31.866 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-11T00:46:31.867 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-11T00:46:31.868 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-11T00:46:31.869 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-11T00:46:31.870 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-11T00:46:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-11T00:46:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-11T00:46:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-11T00:46:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-11T00:46:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-11T00:46:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-11T00:46:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-11T00:46:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-11T00:46:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-11T00:46:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-11T00:46:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-11T00:46:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-11T00:46:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-11T00:46:31.871 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-11T00:46:31.872 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-11T00:46:31.873 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-11T00:46:31.873 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-11T00:46:31.873 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-11T00:46:31.873 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-11T00:46:31.873 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-11T00:46:31.873 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-11T00:46:31.873 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-11T00:46:31.873 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-11T00:46:31.873 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-11T00:46:31.873 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-11T00:46:31.873 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-11T00:46:31.873 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-11T00:46:31.873 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-11T00:46:31.874 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-11T00:46:31.874 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-11T00:46:31.874 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-11T00:46:31.874 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-11T00:46:31.874 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-11T00:46:31.874 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-11T00:46:31.874 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-11T00:46:31.874 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-11T00:46:31.874 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-11T00:46:31.874 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-11T00:46:31.874 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-11T00:46:31.874 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-11T00:46:31.874 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-11T00:46:31.875 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-11T00:46:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-11T00:46:31.877 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-11T00:46:31.878 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-11T00:46:31.879 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-11T00:46:31.879 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-11T00:46:31.879 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-11T00:46:31.879 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-11T00:46:31.879 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-11T00:46:31.879 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-11T00:46:31.879 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-11T00:46:31.879 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-11T00:46:31.879 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-11T00:46:31.879 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-11T00:46:31.879 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-11T00:46:31.879 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-11T00:46:31.879 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-11T00:46:31.879 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-11T00:46:31.880 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-11T00:46:31.880 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-11T00:46:31.880 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-11T00:46:31.880 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-11T00:46:31.880 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-11T00:46:31.880 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-11T00:46:31.880 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-11T00:46:31.880 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-11T00:46:31.880 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-11T00:46:31.880 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-11T00:46:31.880 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-11T00:46:31.880 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-11T00:46:31.880 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-11T00:46:31.880 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-11T00:46:31.881 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-11T00:46:31.881 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-11T00:46:31.881 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-11T00:46:31.881 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-11T00:46:31.881 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-11T00:46:31.881 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-11T00:46:31.881 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-11T00:46:31.881 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-11T00:46:31.881 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-11T00:46:31.881 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-11T00:46:31.881 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-11T00:46:31.881 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-11T00:46:31.881 INFO:teuthology.orchestra.run.smithi103.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T00:46:31.885 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:46:31.886 DEBUG:teuthology.orchestra.run.smithi103:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-11T00:46:31.910 INFO:teuthology.orchestra.run.smithi103.stdout:postinstall scriptlet (using /bin/sh): 2024-09-11T00:46:31.910 INFO:teuthology.orchestra.run.smithi103.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T00:46:31.910 INFO:teuthology.orchestra.run.smithi103.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-11T00:46:31.910 INFO:teuthology.orchestra.run.smithi103.stdout:fi 2024-09-11T00:46:31.910 INFO:teuthology.orchestra.run.smithi103.stdout:for file in vmlinuz System.map config; do 2024-09-11T00:46:31.910 INFO:teuthology.orchestra.run.smithi103.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-11T00:46:31.910 INFO:teuthology.orchestra.run.smithi103.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:46:31.910 INFO:teuthology.orchestra.run.smithi103.stdout: fi 2024-09-11T00:46:31.910 INFO:teuthology.orchestra.run.smithi103.stdout:done 2024-09-11T00:46:31.911 INFO:teuthology.orchestra.run.smithi103.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-11T00:46:31.911 INFO:teuthology.orchestra.run.smithi103.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-11T00:46:31.911 INFO:teuthology.orchestra.run.smithi103.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:46:31.911 INFO:teuthology.orchestra.run.smithi103.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-11T00:46:31.911 INFO:teuthology.orchestra.run.smithi103.stdout:fi 2024-09-11T00:46:31.911 INFO:teuthology.orchestra.run.smithi103.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-11T00:46:31.911 INFO:teuthology.orchestra.run.smithi103.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:46:31.911 INFO:teuthology.orchestra.run.smithi103.stdout:fi 2024-09-11T00:46:31.911 INFO:teuthology.orchestra.run.smithi103.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-11T00:46:31.911 INFO:teuthology.orchestra.run.smithi103.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-11T00:46:31.911 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:46:31.911 INFO:teuthology.orchestra.run.smithi103.stdout:fi 2024-09-11T00:46:31.912 DEBUG:teuthology.orchestra.run.smithi103:> sudo rpm -qi grub2-tools 2024-09-11T00:46:31.986 INFO:teuthology.orchestra.run.smithi103.stdout:Name : grub2-tools 2024-09-11T00:46:31.986 INFO:teuthology.orchestra.run.smithi103.stdout:Epoch : 1 2024-09-11T00:46:31.986 INFO:teuthology.orchestra.run.smithi103.stdout:Version : 2.06 2024-09-11T00:46:31.986 INFO:teuthology.orchestra.run.smithi103.stdout:Release : 82.el9 2024-09-11T00:46:31.986 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: x86_64 2024-09-11T00:46:31.986 INFO:teuthology.orchestra.run.smithi103.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-11T00:46:31.986 INFO:teuthology.orchestra.run.smithi103.stdout:Group : Unspecified 2024-09-11T00:46:31.986 INFO:teuthology.orchestra.run.smithi103.stdout:Size : 8274670 2024-09-11T00:46:31.986 INFO:teuthology.orchestra.run.smithi103.stdout:License : GPLv3+ 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout:Packager : builder@centos.org 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout:Vendor : CentOS 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout:Summary : Support tools for GRUB. 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout:Description : 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout:hardware devices. 2024-09-11T00:46:31.987 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:46:31.988 INFO:teuthology.orchestra.run.smithi103.stdout:This subpackage provides tools for support of all platforms. 2024-09-11T00:46:31.989 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-11T00:46:31.989 INFO:teuthology.task.kernel:Updating grub on smithi103 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:46:31.989 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-11T00:46:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2024-09-11T00:46:33.951 INFO:teuthology.orchestra.run.smithi103.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-11T00:46:33.977 INFO:teuthology.orchestra.run.smithi103.stderr:done 2024-09-11T00:46:33.984 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-11T00:46:34.000 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.SUyw3M1DZU 2024-09-11T00:46:34.000 DEBUG:teuthology.orchestra.run.smithi103:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.SUyw3M1DZU 2024-09-11T00:46:34.074 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.SUyw3M1DZU 2024-09-11T00:46:34.216 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.SUyw3M1DZU is 6KB 2024-09-11T00:46:34.265 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.SUyw3M1DZU 2024-09-11T00:46:34.280 DEBUG:teuthology.orchestra.run.smithi103:> sudo /bin/ls /boot/loader/entries || true 2024-09-11T00:46:34.342 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-11T00:46:34.342 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-11T00:46:34.342 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-11T00:46:34.342 INFO:teuthology.orchestra.run.smithi103.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-11T00:46:34.344 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:46:34.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo shutdown -r now 2024-09-11T00:47:04.498 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-11T00:47:04.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-11T00:47:04.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:47:22.945 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-11T00:47:31.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-11T00:47:31.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:47:35.037 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-11T00:47:47.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-11T00:47:47.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:48:47.049 DEBUG:teuthology.orchestra.remote:timed out 2024-09-11T00:49:02.050 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-11T00:49:02.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:49:02.344 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-11T00:49:02.888 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-11T00:49:02.889 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-11T00:49:02.889 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-11T00:49:02.923 INFO:teuthology.orchestra.run.smithi103.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:49:02.923 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-11T00:49:02.924 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T00:49:02.924 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-11T00:49:03.925 DEBUG:teuthology.parallel:result is None 2024-09-11T00:49:03.925 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T00:49:03.936 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T00:49:03.936 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T00:49:03.940 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T00:49:03.943 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T00:49:03.975 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T00:49:03.986 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T00:49:04.001 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T00:49:04.001 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T00:49:04.019 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T00:49:04.022 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T00:49:04.113 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T00:49:04.124 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T00:49:04.124 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T00:49:04.144 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:49:04.144 DEBUG:teuthology.orchestra.run.smithi183:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T00:49:04.162 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:49:04.162 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T00:49:04.166 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T00:49:04.187 DEBUG:teuthology.orchestra.run.smithi183:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T00:49:04.240 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:49:04.240 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:49:04.255 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:49:04.262 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:49:04.264 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:49:04.292 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T00:49:04.295 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T00:49:04.307 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T00:49:04.307 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T00:49:04.311 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T00:49:04.315 DEBUG:teuthology.orchestra.run.smithi183:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T00:49:04.363 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T00:49:04.376 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T00:49:04.377 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T00:49:04.380 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T00:49:04.384 DEBUG:teuthology.orchestra.run.smithi183:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T00:49:04.410 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:49:04.521 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:49:04.601 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:49:04.675 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:49:04.745 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T00:49:04.745 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T00:49:04.799 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:49:04.849 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:49:04.914 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:49:04.966 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:49:05.003 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T00:49:05.003 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T00:49:05.071 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:49:05.120 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T00:49:05.175 DEBUG:teuthology.orchestra.run.smithi183:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:49:05.265 DEBUG:teuthology.orchestra.run.smithi183:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T00:49:05.304 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-11T00:49:05.304 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T00:49:05.372 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-09-11T00:49:05.376 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-09-11T00:49:05.379 DEBUG:teuthology.orchestra.run.smithi183:> sudo service rsyslog restart 2024-09-11T00:49:05.418 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:49:05.449 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:49:05.450 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T00:49:05.960 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T00:49:05.970 INFO:teuthology.task.internal:Starting timer... 2024-09-11T00:49:05.970 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T00:49:06.020 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T00:49:06.052 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-11T00:49:06.052 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-09-11T00:49:06.143 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-09-11T00:49:06.146 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-09-11T00:49:06.199 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-09-11T00:49:06.201 DEBUG:teuthology.orchestra.run.smithi183:> sudo service auditd rotate 2024-09-11T00:49:06.267 INFO:teuthology.orchestra.run.smithi183.stdout:Rotating logs: 2024-09-11T00:49:06.269 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T00:49:06.269 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-09-11T00:49:06.313 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-09-11T00:49:06.314 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-09-11T00:49:06.335 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-09-11T00:49:06.336 DEBUG:teuthology.orchestra.run.smithi183:> /usr/sbin/getenforce 2024-09-11T00:49:06.356 INFO:teuthology.orchestra.run.smithi183.stdout:Permissive 2024-09-11T00:49:06.356 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi103.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi183.front.sepia.ceph.com': 'permissive'} 2024-09-11T00:49:06.356 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T00:49:06.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:49:06.415 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T00:49:06.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:49:06.445 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T00:49:06.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T00:49:06.474 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T00:49:06.475 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-09-11T00:49:06.540 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-09-11T00:49:06.575 DEBUG:teuthology.orchestra.run.smithi183:> sudo /usr/sbin/setenforce permissive 2024-09-11T00:49:06.612 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T00:49:06.622 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T00:49:06.635 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T00:49:06.636 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi103.front.sepia.ceph.com,smithi117.front.sepia.ceph.com,smithi183.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T00:53:41.553 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com'), Remote(name='ubuntu@smithi183.front.sepia.ceph.com')] 2024-09-11T00:53:41.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-11T00:53:41.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:53:41.652 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-11T00:53:41.754 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-11T00:53:41.754 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-11T00:53:41.755 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:53:41.838 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-09-11T00:53:41.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-09-11T00:53:41.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-09-11T00:53:41.917 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi183.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T00:53:42.022 DEBUG:teuthology.orchestra.run.smithi183:> true 2024-09-11T00:53:42.097 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi183.front.sepia.ceph.com' 2024-09-11T00:53:42.098 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T00:53:42.110 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T00:53:42.111 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T00:53:42.111 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:53:42.116 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T00:53:42.116 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:53:42.118 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T00:53:42.118 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T00:53:42.146 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T00:53:42.160 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T00:53:42.168 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T00:53:42.173 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-11T00:53:42.183 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T00:53:42.185 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-09-11T00:53:42.196 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-09-11T00:53:42.202 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-11T00:53:42.209 INFO:teuthology.orchestra.run.smithi183.stderr:sudo: ntpd: command not found 2024-09-11T00:53:42.210 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T00:53:42.220 INFO:teuthology.orchestra.run.smithi183.stdout:506 Cannot talk to daemon 2024-09-11T00:53:42.224 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T00:53:42.235 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T00:53:42.249 INFO:teuthology.orchestra.run.smithi183.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T00:53:42.253 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-09-11T00:53:42.278 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-09-11T00:53:42.281 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:53:42.285 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:53:42.285 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-11T00:53:42.285 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:53:42.285 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:53:42.285 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:53:42.285 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:53:42.305 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:53:42.306 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-11T00:53:42.309 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:53:42.310 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-09-11T00:53:42.310 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:53:42.310 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:53:42.310 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:53:42.310 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:53:42.336 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-11T00:53:42.440 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-11T00:53:42.447 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T00:53:42.447 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-11T00:53:42.447 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:53:42.447 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:53:42.447 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:53:42.447 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T00:53:42.448 INFO:teuthology.run_tasks:Running task install... 2024-09-11T00:53:42.457 DEBUG:teuthology.task.install:project ceph 2024-09-11T00:53:42.458 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'}} 2024-09-11T00:53:42.458 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30'} 2024-09-11T00:53:42.458 INFO:teuthology.task.install:Using flavor: default 2024-09-11T00:53:42.464 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T00:53:42.464 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-11T00:53:42.464 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-11T00:53:42.465 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:53:42.467 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-11T00:53:42.467 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:53:42.468 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'tag': None, 'wait_for_package': False} 2024-09-11T00:53:42.468 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:53:42.612 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-11T00:53:42.613 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-11T00:53:42.628 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-11T00:53:42.628 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-11T00:53:42.629 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/ 2024-09-11T00:53:42.629 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4854.g8f219c47 2024-09-11T00:53:42.739 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T00:53:42.739 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T00:53:42.739 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T00:53:42.746 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T00:53:42.746 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-11T00:53:42.746 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T00:53:42.757 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-11T00:53:42.758 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T00:53:42.758 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-11T00:53:42.772 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T00:53:42.772 DEBUG:teuthology.orchestra.run.smithi183:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T00:53:42.784 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T00:53:42.785 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T00:53:42.796 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-11T00:53:42.796 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f219c476cb4f26fc5719c661c0323719a45cb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-11T00:53:42.838 DEBUG:teuthology.orchestra.run.smithi183:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T00:53:42.852 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T00:53:42.894 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-11T00:53:42.916 DEBUG:teuthology.orchestra.run.smithi183:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T00:53:42.926 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T00:53:42.972 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-11T00:53:42.980 INFO:teuthology.orchestra.run.smithi183.stdout:check_obsoletes = 1 2024-09-11T00:53:42.982 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum clean all 2024-09-11T00:53:42.990 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-09-11T00:53:42.992 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-09-11T00:53:43.027 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-09-11T00:53:43.031 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-09-11T00:53:43.209 INFO:teuthology.orchestra.run.smithi183.stdout:45 files removed 2024-09-11T00:53:43.217 INFO:teuthology.orchestra.run.smithi117.stdout:45 files removed 2024-09-11T00:53:43.236 DEBUG:teuthology.orchestra.run.smithi183:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T00:53:43.244 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T00:53:43.299 INFO:teuthology.orchestra.run.smithi103.stdout:45 files removed 2024-09-11T00:53:43.332 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-11T00:53:43.787 INFO:teuthology.orchestra.run.smithi183.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-11T00:53:43.803 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-11T00:53:44.009 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 297 kB/s | 84 kB 00:00 2024-09-11T00:53:44.087 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 100 kB/s | 24 kB 00:00 2024-09-11T00:53:44.171 INFO:teuthology.orchestra.run.smithi183.stdout:ceph noarch packages 70 kB/s | 24 kB 00:00 2024-09-11T00:53:44.326 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 89 kB/s | 24 kB 00:00 2024-09-11T00:53:44.362 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-11T00:53:44.447 INFO:teuthology.orchestra.run.smithi183.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-11T00:53:44.610 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-11T00:53:45.189 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-11T00:53:46.612 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.2 MB 00:02 2024-09-11T00:53:49.931 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - AppStream 5.6 MB/s | 20 MB 00:03 2024-09-11T00:53:50.452 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 1.4 MB/s | 8.2 MB 00:05 2024-09-11T00:53:52.513 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - AppStream 4.3 MB/s | 20 MB 00:04 2024-09-11T00:53:54.140 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-09-11T00:53:54.953 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 20 MB 00:03 2024-09-11T00:53:55.615 INFO:teuthology.orchestra.run.smithi183.stdout:CentOS Stream 9 - Extras packages 70 kB/s | 19 kB 00:00 2024-09-11T00:53:56.528 INFO:teuthology.orchestra.run.smithi183.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-11T00:53:57.071 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 6.5 MB 00:00 2024-09-11T00:53:58.472 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 19 kB 00:00 2024-09-11T00:53:59.276 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-11T00:54:00.796 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 3.7 MB/s | 6.5 MB 00:01 2024-09-11T00:54:01.967 INFO:teuthology.orchestra.run.smithi183.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-11T00:54:02.805 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 19 kB 00:00 2024-09-11T00:54:03.810 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-11T00:54:04.235 INFO:teuthology.orchestra.run.smithi183.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:54:04.236 INFO:teuthology.orchestra.run.smithi183.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:54:04.247 INFO:teuthology.orchestra.run.smithi183.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T00:54:04.248 INFO:teuthology.orchestra.run.smithi183.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T00:54:04.249 INFO:teuthology.orchestra.run.smithi183.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T00:54:04.250 INFO:teuthology.orchestra.run.smithi183.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:54:04.251 INFO:teuthology.orchestra.run.smithi183.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T00:54:04.254 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T00:54:04.254 INFO:teuthology.orchestra.run.smithi183.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T00:54:04.317 INFO:teuthology.orchestra.run.smithi183.stdout:Dependencies resolved. 2024-09-11T00:54:04.344 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-09-11T00:54:04.344 INFO:teuthology.orchestra.run.smithi183.stdout: Package Arch Version Repository Size 2024-09-11T00:54:04.344 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-09-11T00:54:04.344 INFO:teuthology.orchestra.run.smithi183.stdout:Installing: 2024-09-11T00:54:04.344 INFO:teuthology.orchestra.run.smithi183.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T00:54:04.344 INFO:teuthology.orchestra.run.smithi183.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-11T00:54:04.344 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:54:04.344 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-11T00:54:04.344 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-11T00:54:04.345 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-11T00:54:04.345 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-11T00:54:04.345 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-11T00:54:04.345 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-11T00:54:04.345 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-11T00:54:04.346 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-11T00:54:04.346 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-11T00:54:04.346 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-11T00:54:04.346 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-11T00:54:04.346 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-11T00:54:04.346 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-11T00:54:04.346 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-11T00:54:04.346 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T00:54:04.346 INFO:teuthology.orchestra.run.smithi183.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T00:54:04.346 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T00:54:04.346 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-11T00:54:04.346 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-11T00:54:04.346 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-11T00:54:04.347 INFO:teuthology.orchestra.run.smithi183.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T00:54:04.347 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T00:54:04.347 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T00:54:04.347 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T00:54:04.347 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T00:54:04.347 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T00:54:04.347 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-11T00:54:04.347 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-11T00:54:04.347 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-11T00:54:04.347 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-11T00:54:04.347 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-11T00:54:04.347 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:54:04.347 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-11T00:54:04.348 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T00:54:04.348 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrading: 2024-09-11T00:54:04.348 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T00:54:04.348 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T00:54:04.348 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T00:54:04.348 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T00:54:04.348 INFO:teuthology.orchestra.run.smithi183.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-11T00:54:04.348 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:54:04.348 INFO:teuthology.orchestra.run.smithi183.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T00:54:04.348 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T00:54:04.348 INFO:teuthology.orchestra.run.smithi183.stdout:Installing dependencies: 2024-09-11T00:54:04.348 INFO:teuthology.orchestra.run.smithi183.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T00:54:04.349 INFO:teuthology.orchestra.run.smithi183.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T00:54:04.349 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T00:54:04.349 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-11T00:54:04.349 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-11T00:54:04.349 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-11T00:54:04.349 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-11T00:54:04.349 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-11T00:54:04.349 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-11T00:54:04.349 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-11T00:54:04.349 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-11T00:54:04.349 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T00:54:04.349 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T00:54:04.349 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T00:54:04.349 INFO:teuthology.orchestra.run.smithi183.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T00:54:04.350 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T00:54:04.350 INFO:teuthology.orchestra.run.smithi183.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T00:54:04.350 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T00:54:04.350 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T00:54:04.350 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-11T00:54:04.350 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T00:54:04.350 INFO:teuthology.orchestra.run.smithi183.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T00:54:04.350 INFO:teuthology.orchestra.run.smithi183.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T00:54:04.350 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T00:54:04.350 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T00:54:04.350 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T00:54:04.350 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-11T00:54:04.350 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T00:54:04.350 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:54:04.351 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T00:54:04.351 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T00:54:04.351 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T00:54:04.351 INFO:teuthology.orchestra.run.smithi183.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T00:54:04.351 INFO:teuthology.orchestra.run.smithi183.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T00:54:04.351 INFO:teuthology.orchestra.run.smithi183.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T00:54:04.351 INFO:teuthology.orchestra.run.smithi183.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T00:54:04.351 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T00:54:04.351 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T00:54:04.351 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T00:54:04.351 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T00:54:04.351 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T00:54:04.351 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T00:54:04.351 INFO:teuthology.orchestra.run.smithi183.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T00:54:04.352 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T00:54:04.352 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T00:54:04.352 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T00:54:04.352 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-11T00:54:04.352 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-11T00:54:04.352 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T00:54:04.352 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T00:54:04.352 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T00:54:04.352 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T00:54:04.352 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T00:54:04.352 INFO:teuthology.orchestra.run.smithi183.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T00:54:04.352 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T00:54:04.352 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T00:54:04.353 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T00:54:04.353 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T00:54:04.353 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T00:54:04.353 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T00:54:04.353 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T00:54:04.353 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T00:54:04.353 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T00:54:04.353 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T00:54:04.353 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T00:54:04.353 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T00:54:04.353 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T00:54:04.353 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T00:54:04.353 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T00:54:04.353 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T00:54:04.354 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T00:54:04.354 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T00:54:04.354 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T00:54:04.354 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T00:54:04.354 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T00:54:04.354 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T00:54:04.354 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T00:54:04.354 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T00:54:04.354 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T00:54:04.354 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T00:54:04.354 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T00:54:04.354 INFO:teuthology.orchestra.run.smithi183.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T00:54:04.354 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T00:54:04.355 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T00:54:04.356 INFO:teuthology.orchestra.run.smithi183.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T00:54:04.356 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T00:54:04.356 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T00:54:04.356 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T00:54:04.356 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T00:54:04.356 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T00:54:04.356 INFO:teuthology.orchestra.run.smithi183.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T00:54:04.356 INFO:teuthology.orchestra.run.smithi183.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T00:54:04.356 INFO:teuthology.orchestra.run.smithi183.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T00:54:04.356 INFO:teuthology.orchestra.run.smithi183.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T00:54:04.356 INFO:teuthology.orchestra.run.smithi183.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T00:54:04.356 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T00:54:04.357 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T00:54:04.357 INFO:teuthology.orchestra.run.smithi183.stdout:Installing weak dependencies: 2024-09-11T00:54:04.357 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T00:54:04.357 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:54:04.357 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction Summary 2024-09-11T00:54:04.357 INFO:teuthology.orchestra.run.smithi183.stdout:======================================================================================= 2024-09-11T00:54:04.357 INFO:teuthology.orchestra.run.smithi183.stdout:Install 149 Packages 2024-09-11T00:54:04.357 INFO:teuthology.orchestra.run.smithi183.stdout:Upgrade 8 Packages 2024-09-11T00:54:04.357 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:54:04.358 INFO:teuthology.orchestra.run.smithi183.stdout:Total download size: 240 M 2024-09-11T00:54:04.358 INFO:teuthology.orchestra.run.smithi183.stdout:Downloading Packages: 2024-09-11T00:54:04.806 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-09-11T00:54:04.935 INFO:teuthology.orchestra.run.smithi183.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-11T00:54:05.185 INFO:teuthology.orchestra.run.smithi183.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 3.5 MB/s | 900 kB 00:00 2024-09-11T00:54:05.269 INFO:teuthology.orchestra.run.smithi183.stdout:(3/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-11T00:54:05.294 INFO:teuthology.orchestra.run.smithi183.stdout:(4/157): ceph-immutable-object-cache-19.3.0-485 1.3 MB/s | 145 kB 00:00 2024-09-11T00:54:05.403 INFO:teuthology.orchestra.run.smithi183.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 18 MB/s | 2.4 MB 00:00 2024-09-11T00:54:05.536 INFO:teuthology.orchestra.run.smithi183.stdout:(6/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 6.3 MB/s | 1.5 MB 00:00 2024-09-11T00:54:05.661 INFO:teuthology.orchestra.run.smithi183.stdout:(7/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 19 MB/s | 4.8 MB 00:00 2024-09-11T00:54:05.937 INFO:teuthology.orchestra.run.smithi183.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 19 MB/s | 22 MB 00:01 2024-09-11T00:54:05.979 INFO:teuthology.orchestra.run.smithi183.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 607 kB/s | 25 kB 00:00 2024-09-11T00:54:06.246 INFO:teuthology.orchestra.run.smithi183.stdout:(10/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 19 MB/s | 11 MB 00:00 2024-09-11T00:54:06.313 INFO:teuthology.orchestra.run.smithi183.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 3.3 MB/s | 225 kB 00:00 2024-09-11T00:54:06.379 INFO:teuthology.orchestra.run.smithi183.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 405 kB/s | 27 kB 00:00 2024-09-11T00:54:06.455 INFO:teuthology.orchestra.run.smithi183.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 424 kB/s | 32 kB 00:00 2024-09-11T00:54:06.555 INFO:teuthology.orchestra.run.smithi183.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 7.4 MB/s | 755 kB 00:00 2024-09-11T00:54:06.764 INFO:teuthology.orchestra.run.smithi183.stdout:(15/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 14 MB/s | 17 MB 00:01 2024-09-11T00:54:06.789 INFO:teuthology.orchestra.run.smithi183.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 692 kB/s | 162 kB 00:00 2024-09-11T00:54:06.814 INFO:teuthology.orchestra.run.smithi183.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-11T00:54:06.839 INFO:teuthology.orchestra.run.smithi183.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 9.9 MB/s | 507 kB 00:00 2024-09-11T00:54:06.898 INFO:teuthology.orchestra.run.smithi183.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 772 kB/s | 45 kB 00:00 2024-09-11T00:54:06.982 INFO:teuthology.orchestra.run.smithi183.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.7 MB/s | 143 kB 00:00 2024-09-11T00:54:07.074 INFO:teuthology.orchestra.run.smithi183.stdout:(21/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 21 MB/s | 5.5 MB 00:00 2024-09-11T00:54:07.099 INFO:teuthology.orchestra.run.smithi183.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.4 MB/s | 161 kB 00:00 2024-09-11T00:54:07.102 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:54:07.103 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:54:07.117 INFO:teuthology.orchestra.run.smithi117.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T00:54:07.118 INFO:teuthology.orchestra.run.smithi117.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T00:54:07.119 INFO:teuthology.orchestra.run.smithi117.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T00:54:07.120 INFO:teuthology.orchestra.run.smithi117.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:54:07.122 INFO:teuthology.orchestra.run.smithi117.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T00:54:07.124 INFO:teuthology.orchestra.run.smithi183.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 6.3 MB/s | 321 kB 00:00 2024-09-11T00:54:07.125 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T00:54:07.125 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T00:54:07.158 INFO:teuthology.orchestra.run.smithi183.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 5.1 MB/s | 306 kB 00:00 2024-09-11T00:54:07.183 INFO:teuthology.orchestra.run.smithi183.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.7 MB/s | 99 kB 00:00 2024-09-11T00:54:07.189 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-09-11T00:54:07.209 INFO:teuthology.orchestra.run.smithi183.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-11T00:54:07.216 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2024-09-11T00:54:07.216 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-09-11T00:54:07.216 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2024-09-11T00:54:07.216 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-09-11T00:54:07.216 INFO:teuthology.orchestra.run.smithi117.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T00:54:07.216 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-11T00:54:07.216 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:54:07.216 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-11T00:54:07.216 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-11T00:54:07.216 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-11T00:54:07.216 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-11T00:54:07.216 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-11T00:54:07.217 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-11T00:54:07.217 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-11T00:54:07.217 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-11T00:54:07.217 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-11T00:54:07.217 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-11T00:54:07.217 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-11T00:54:07.217 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-11T00:54:07.217 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-11T00:54:07.217 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-11T00:54:07.217 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T00:54:07.217 INFO:teuthology.orchestra.run.smithi117.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T00:54:07.217 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T00:54:07.217 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:54:07.218 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-11T00:54:07.219 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T00:54:07.219 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-09-11T00:54:07.219 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T00:54:07.219 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T00:54:07.219 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T00:54:07.219 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T00:54:07.219 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-11T00:54:07.219 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:54:07.219 INFO:teuthology.orchestra.run.smithi117.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T00:54:07.219 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T00:54:07.219 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-09-11T00:54:07.219 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T00:54:07.219 INFO:teuthology.orchestra.run.smithi117.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T00:54:07.219 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T00:54:07.220 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T00:54:07.221 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T00:54:07.221 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-11T00:54:07.221 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T00:54:07.221 INFO:teuthology.orchestra.run.smithi117.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T00:54:07.221 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T00:54:07.221 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T00:54:07.221 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T00:54:07.221 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T00:54:07.221 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-11T00:54:07.221 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T00:54:07.221 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:54:07.221 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T00:54:07.221 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T00:54:07.222 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T00:54:07.223 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T00:54:07.224 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T00:54:07.225 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T00:54:07.225 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T00:54:07.225 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T00:54:07.225 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T00:54:07.225 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T00:54:07.225 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T00:54:07.225 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T00:54:07.225 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T00:54:07.225 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T00:54:07.225 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T00:54:07.225 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T00:54:07.225 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T00:54:07.225 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T00:54:07.225 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T00:54:07.226 INFO:teuthology.orchestra.run.smithi117.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T00:54:07.227 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T00:54:07.227 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T00:54:07.227 INFO:teuthology.orchestra.run.smithi117.stdout:Installing weak dependencies: 2024-09-11T00:54:07.227 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T00:54:07.227 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:54:07.227 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-09-11T00:54:07.227 INFO:teuthology.orchestra.run.smithi117.stdout:======================================================================================= 2024-09-11T00:54:07.227 INFO:teuthology.orchestra.run.smithi117.stdout:Install 149 Packages 2024-09-11T00:54:07.227 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 8 Packages 2024-09-11T00:54:07.227 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:54:07.227 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 240 M 2024-09-11T00:54:07.228 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-09-11T00:54:07.267 INFO:teuthology.orchestra.run.smithi183.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 2.9 MB/s | 171 kB 00:00 2024-09-11T00:54:07.334 INFO:teuthology.orchestra.run.smithi183.stdout:(28/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 21 MB/s | 3.2 MB 00:00 2024-09-11T00:54:07.359 INFO:teuthology.orchestra.run.smithi183.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 373 kB/s | 34 kB 00:00 2024-09-11T00:54:07.385 INFO:teuthology.orchestra.run.smithi183.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 3.0 MB/s | 154 kB 00:00 2024-09-11T00:54:07.791 INFO:teuthology.orchestra.run.smithi117.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-09-11T00:54:07.810 INFO:teuthology.orchestra.run.smithi183.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 17 MB/s | 7.4 MB 00:00 2024-09-11T00:54:07.877 INFO:teuthology.orchestra.run.smithi183.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 4.3 MB/s | 291 kB 00:00 2024-09-11T00:54:07.952 INFO:teuthology.orchestra.run.smithi183.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 658 kB/s | 49 kB 00:00 2024-09-11T00:54:08.153 INFO:teuthology.orchestra.run.smithi183.stdout:(34/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 18 MB/s | 14 MB 00:00 2024-09-11T00:54:08.178 INFO:teuthology.orchestra.run.smithi183.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 73 kB/s | 16 kB 00:00 2024-09-11T00:54:08.199 INFO:teuthology.orchestra.run.smithi117.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 2.2 MB/s | 900 kB 00:00 2024-09-11T00:54:08.203 INFO:teuthology.orchestra.run.smithi183.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 5.6 MB/s | 285 kB 00:00 2024-09-11T00:54:08.237 INFO:teuthology.orchestra.run.smithi183.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 13 MB/s | 783 kB 00:00 2024-09-11T00:54:08.262 INFO:teuthology.orchestra.run.smithi183.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 312 kB/s | 18 kB 00:00 2024-09-11T00:54:08.274 INFO:teuthology.orchestra.run.smithi117.stdout:(3/157): ceph-immutable-object-cache-19.3.0-485 1.9 MB/s | 145 kB 00:00 2024-09-11T00:54:08.391 INFO:teuthology.orchestra.run.smithi117.stdout:(4/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 6.0 MB/s | 5.5 MB 00:00 2024-09-11T00:54:08.508 INFO:teuthology.orchestra.run.smithi117.stdout:(5/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 13 MB/s | 1.5 MB 00:00 2024-09-11T00:54:08.688 INFO:teuthology.orchestra.run.smithi183.stdout:(39/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 19 MB/s | 50 MB 00:02 2024-09-11T00:54:08.817 INFO:teuthology.orchestra.run.smithi117.stdout:(6/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 16 MB/s | 4.8 MB 00:00 2024-09-11T00:54:08.821 INFO:teuthology.orchestra.run.smithi183.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 137 kB/s | 80 kB 00:00 2024-09-11T00:54:08.867 INFO:teuthology.orchestra.run.smithi117.stdout:(7/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 4.0 MB/s | 2.4 MB 00:00 2024-09-11T00:54:08.887 INFO:teuthology.orchestra.run.smithi183.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 957 kB/s | 191 kB 00:00 2024-09-11T00:54:08.921 INFO:teuthology.orchestra.run.smithi183.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 1.2 MB/s | 801 kB 00:00 2024-09-11T00:54:08.947 INFO:teuthology.orchestra.run.smithi183.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-09-11T00:54:08.972 INFO:teuthology.orchestra.run.smithi183.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-11T00:54:09.006 INFO:teuthology.orchestra.run.smithi183.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-09-11T00:54:09.031 INFO:teuthology.orchestra.run.smithi183.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-11T00:54:09.065 INFO:teuthology.orchestra.run.smithi183.stdout:(47/157): python3-cryptography-36.0.1-4.el9.x86 6.9 MB/s | 1.2 MB 00:00 2024-09-11T00:54:09.090 INFO:teuthology.orchestra.run.smithi183.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-11T00:54:09.101 INFO:teuthology.orchestra.run.smithi117.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 13 MB/s | 22 MB 00:01 2024-09-11T00:54:09.151 INFO:teuthology.orchestra.run.smithi117.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 506 kB/s | 25 kB 00:00 2024-09-11T00:54:09.785 INFO:teuthology.orchestra.run.smithi117.stdout:(10/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 18 MB/s | 17 MB 00:00 2024-09-11T00:54:09.843 INFO:teuthology.orchestra.run.smithi117.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 3.8 MB/s | 225 kB 00:00 2024-09-11T00:54:09.857 INFO:teuthology.orchestra.run.smithi183.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 139 kB/s | 107 kB 00:00 2024-09-11T00:54:09.919 INFO:teuthology.orchestra.run.smithi117.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 360 kB/s | 27 kB 00:00 2024-09-11T00:54:09.985 INFO:teuthology.orchestra.run.smithi117.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 478 kB/s | 32 kB 00:00 2024-09-11T00:54:10.111 INFO:teuthology.orchestra.run.smithi117.stdout:(14/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 8.8 MB/s | 11 MB 00:01 2024-09-11T00:54:10.124 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-11T00:54:10.153 INFO:teuthology.orchestra.run.smithi117.stdout:(15/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 4.4 MB/s | 755 kB 00:00 2024-09-11T00:54:10.178 INFO:teuthology.orchestra.run.smithi117.stdout:(16/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.4 MB/s | 162 kB 00:00 2024-09-11T00:54:10.203 INFO:teuthology.orchestra.run.smithi117.stdout:(17/157): librados-devel-19.3.0-4854.g8f219c47. 2.5 MB/s | 127 kB 00:00 2024-09-11T00:54:10.228 INFO:teuthology.orchestra.run.smithi117.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 9.9 MB/s | 507 kB 00:00 2024-09-11T00:54:10.287 INFO:teuthology.orchestra.run.smithi117.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 772 kB/s | 45 kB 00:00 2024-09-11T00:54:10.357 INFO:teuthology.orchestra.run.smithi183.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 520 kB/s | 689 kB 00:01 2024-09-11T00:54:10.387 INFO:teuthology.orchestra.run.smithi117.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 1.4 MB/s | 143 kB 00:00 2024-09-11T00:54:10.390 INFO:teuthology.orchestra.run.smithi183.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 41 kB/s | 22 kB 00:00 2024-09-11T00:54:10.479 INFO:teuthology.orchestra.run.smithi117.stdout:(21/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 20 MB/s | 5.5 MB 00:00 2024-09-11T00:54:10.505 INFO:teuthology.orchestra.run.smithi117.stdout:(22/157): python3-cephfs-19.3.0-4854.g8f219c47. 1.3 MB/s | 161 kB 00:00 2024-09-11T00:54:10.530 INFO:teuthology.orchestra.run.smithi117.stdout:(23/157): python3-rados-19.3.0-4854.g8f219c47.e 6.3 MB/s | 321 kB 00:00 2024-09-11T00:54:10.555 INFO:teuthology.orchestra.run.smithi117.stdout:(24/157): python3-rbd-19.3.0-4854.g8f219c47.el9 6.0 MB/s | 306 kB 00:00 2024-09-11T00:54:10.572 INFO:teuthology.orchestra.run.smithi117.stdout:(25/157): python3-rgw-19.3.0-4854.g8f219c47.el9 2.3 MB/s | 99 kB 00:00 2024-09-11T00:54:10.597 INFO:teuthology.orchestra.run.smithi117.stdout:(26/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 2.0 MB/s | 85 kB 00:00 2024-09-11T00:54:10.689 INFO:teuthology.orchestra.run.smithi117.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 1.8 MB/s | 171 kB 00:00 2024-09-11T00:54:10.707 INFO:teuthology.orchestra.run.smithi183.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 574 kB/s | 943 kB 00:01 2024-09-11T00:54:10.748 INFO:teuthology.orchestra.run.smithi117.stdout:(28/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 18 MB/s | 3.2 MB 00:00 2024-09-11T00:54:10.773 INFO:teuthology.orchestra.run.smithi117.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 410 kB/s | 34 kB 00:00 2024-09-11T00:54:10.798 INFO:teuthology.orchestra.run.smithi117.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 3.0 MB/s | 154 kB 00:00 2024-09-11T00:54:10.966 INFO:teuthology.orchestra.run.smithi183.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 57 kB/s | 33 kB 00:00 2024-09-11T00:54:11.199 INFO:teuthology.orchestra.run.smithi117.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 18 MB/s | 7.4 MB 00:00 2024-09-11T00:54:11.300 INFO:teuthology.orchestra.run.smithi183.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 333 kB/s | 313 kB 00:00 2024-09-11T00:54:11.433 INFO:teuthology.orchestra.run.smithi183.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 39 kB/s | 18 kB 00:00 2024-09-11T00:54:11.624 INFO:teuthology.orchestra.run.smithi117.stdout:(32/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 20 MB/s | 50 MB 00:02 2024-09-11T00:54:11.649 INFO:teuthology.orchestra.run.smithi117.stdout:(33/157): ceph-mgr-modules-core-19.3.0-4854.g8f 646 kB/s | 291 kB 00:00 2024-09-11T00:54:11.675 INFO:teuthology.orchestra.run.smithi117.stdout:(34/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 987 kB/s | 49 kB 00:00 2024-09-11T00:54:11.700 INFO:teuthology.orchestra.run.smithi117.stdout:(35/157): ceph-prometheus-alerts-19.3.0-4854.g8 328 kB/s | 16 kB 00:00 2024-09-11T00:54:11.734 INFO:teuthology.orchestra.run.smithi117.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 4.7 MB/s | 285 kB 00:00 2024-09-11T00:54:11.767 INFO:teuthology.orchestra.run.smithi117.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 11 MB/s | 783 kB 00:00 2024-09-11T00:54:11.792 INFO:teuthology.orchestra.run.smithi183.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-11T00:54:11.792 INFO:teuthology.orchestra.run.smithi117.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 312 kB/s | 18 kB 00:00 2024-09-11T00:54:11.893 INFO:teuthology.orchestra.run.smithi117.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 637 kB/s | 80 kB 00:00 2024-09-11T00:54:11.943 INFO:teuthology.orchestra.run.smithi117.stdout:(40/157): libgfortran-11.5.0-2.el9.x86_64.rpm 5.2 MB/s | 801 kB 00:00 2024-09-11T00:54:11.968 INFO:teuthology.orchestra.run.smithi117.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-11T00:54:11.993 INFO:teuthology.orchestra.run.smithi117.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-11T00:54:12.136 INFO:teuthology.orchestra.run.smithi117.stdout:(43/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 10 MB/s | 14 MB 00:01 2024-09-11T00:54:12.161 INFO:teuthology.orchestra.run.smithi117.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 638 kB/s | 106 kB 00:00 2024-09-11T00:54:12.200 INFO:teuthology.orchestra.run.smithi183.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 222 kB/s | 171 kB 00:00 2024-09-11T00:54:12.219 INFO:teuthology.orchestra.run.smithi117.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 4.9 MB/s | 1.2 MB 00:00 2024-09-11T00:54:12.244 INFO:teuthology.orchestra.run.smithi117.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-11T00:54:12.270 INFO:teuthology.orchestra.run.smithi117.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-11T00:54:12.295 INFO:teuthology.orchestra.run.smithi117.stdout:(48/157): python3-pycparser-2.20-6.el9.noarch.r 850 kB/s | 135 kB 00:00 2024-09-11T00:54:12.525 INFO:teuthology.orchestra.run.smithi183.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 218 kB/s | 160 kB 00:00 2024-09-11T00:54:12.619 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:54:12.620 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-11T00:54:12.631 INFO:teuthology.orchestra.run.smithi103.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-11T00:54:12.633 INFO:teuthology.orchestra.run.smithi103.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-11T00:54:12.633 INFO:teuthology.orchestra.run.smithi103.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-11T00:54:12.634 INFO:teuthology.orchestra.run.smithi103.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-11T00:54:12.636 INFO:teuthology.orchestra.run.smithi103.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-11T00:54:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-11T00:54:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-11T00:54:12.706 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-09-11T00:54:12.739 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-09-11T00:54:12.739 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-09-11T00:54:12.739 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-09-11T00:54:12.739 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-09-11T00:54:12.739 INFO:teuthology.orchestra.run.smithi103.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-11T00:54:12.739 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 6.6 k 2024-09-11T00:54:12.739 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:54:12.739 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 900 k 2024-09-11T00:54:12.739 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 145 k 2024-09-11T00:54:12.739 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 1.5 M 2024-09-11T00:54:12.739 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 154 k 2024-09-11T00:54:12.739 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 14 M 2024-09-11T00:54:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 7.4 M 2024-09-11T00:54:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 49 k 2024-09-11T00:54:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 11 M 2024-09-11T00:54:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 50 M 2024-09-11T00:54:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 285 k 2024-09-11T00:54:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 783 k 2024-09-11T00:54:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 225 k 2024-09-11T00:54:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 27 k 2024-09-11T00:54:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 18 k 2024-09-11T00:54:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-11T00:54:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-11T00:54:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-11T00:54:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 32 k 2024-09-11T00:54:12.740 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 755 k 2024-09-11T00:54:12.741 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 127 k 2024-09-11T00:54:12.741 INFO:teuthology.orchestra.run.smithi103.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-11T00:54:12.741 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-11T00:54:12.741 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-11T00:54:12.741 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-11T00:54:12.741 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-11T00:54:12.741 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-11T00:54:12.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 161 k 2024-09-11T00:54:12.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 321 k 2024-09-11T00:54:12.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 306 k 2024-09-11T00:54:12.741 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 99 k 2024-09-11T00:54:12.741 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 85 k 2024-09-11T00:54:12.741 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:54:12.741 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 171 k 2024-09-11T00:54:12.742 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-11T00:54:12.742 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-09-11T00:54:12.742 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-11T00:54:12.742 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-11T00:54:12.742 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-11T00:54:12.742 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-11T00:54:12.742 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.5 M 2024-09-11T00:54:12.742 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 3.2 M 2024-09-11T00:54:12.742 INFO:teuthology.orchestra.run.smithi103.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-11T00:54:12.742 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-11T00:54:12.742 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-09-11T00:54:12.743 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-11T00:54:12.743 INFO:teuthology.orchestra.run.smithi103.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-11T00:54:12.743 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-11T00:54:12.743 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 22 M 2024-09-11T00:54:12.743 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 34 k 2024-09-11T00:54:12.743 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 2.4 M 2024-09-11T00:54:12.743 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 291 k 2024-09-11T00:54:12.743 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 4.8 M 2024-09-11T00:54:12.743 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 17 M 2024-09-11T00:54:12.743 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4854.g8f219c47.el9 ceph-noarch 16 k 2024-09-11T00:54:12.743 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 25 k 2024-09-11T00:54:12.743 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-11T00:54:12.743 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-11T00:54:12.743 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 162 k 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 507 k 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-11T00:54:12.744 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 5.5 M 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-11T00:54:12.745 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-11T00:54:12.746 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-11T00:54:12.746 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-11T00:54:12.746 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 45 k 2024-09-11T00:54:12.746 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:19.3.0-4854.g8f219c47.el9 ceph 143 k 2024-09-11T00:54:12.746 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-11T00:54:12.746 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-11T00:54:12.746 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-11T00:54:12.746 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-11T00:54:12.746 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-11T00:54:12.746 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-11T00:54:12.746 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-11T00:54:12.746 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-11T00:54:12.746 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-11T00:54:12.746 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-11T00:54:12.747 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-11T00:54:12.748 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-11T00:54:12.749 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-11T00:54:12.750 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-11T00:54:12.750 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-11T00:54:12.750 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-11T00:54:12.750 INFO:teuthology.orchestra.run.smithi103.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-11T00:54:12.750 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-11T00:54:12.750 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-11T00:54:12.750 INFO:teuthology.orchestra.run.smithi103.stdout:Installing weak dependencies: 2024-09-11T00:54:12.750 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-11T00:54:12.750 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:54:12.750 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-09-11T00:54:12.750 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-09-11T00:54:12.750 INFO:teuthology.orchestra.run.smithi103.stdout:Install 149 Packages 2024-09-11T00:54:12.750 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 8 Packages 2024-09-11T00:54:12.750 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:54:12.751 INFO:teuthology.orchestra.run.smithi183.stdout:(59/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.5 MB/s | 3.0 MB 00:02 2024-09-11T00:54:12.751 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 240 M 2024-09-11T00:54:12.751 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-09-11T00:54:12.776 INFO:teuthology.orchestra.run.smithi183.stdout:(60/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-09-11T00:54:12.979 INFO:teuthology.orchestra.run.smithi117.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 156 kB/s | 107 kB 00:00 2024-09-11T00:54:13.254 INFO:teuthology.orchestra.run.smithi117.stdout:(50/157): bison-3.7.4-5.el9.x86_64.rpm 958 kB/s | 943 kB 00:00 2024-09-11T00:54:13.334 INFO:teuthology.orchestra.run.smithi183.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 44 kB/s | 24 kB 00:00 2024-09-11T00:54:13.392 INFO:teuthology.orchestra.run.smithi103.stdout:(1/157): ceph-19.3.0-4854.g8f219c47.el9.x86_64. 45 kB/s | 6.6 kB 00:00 2024-09-11T00:54:13.504 INFO:teuthology.orchestra.run.smithi117.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 41 kB/s | 22 kB 00:00 2024-09-11T00:54:13.526 INFO:teuthology.orchestra.run.smithi183.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 662 kB/s | 662 kB 00:01 2024-09-11T00:54:13.554 INFO:teuthology.orchestra.run.smithi117.stdout:(52/157): automake-1.16.2-8.el9.noarch.rpm 526 kB/s | 689 kB 00:01 2024-09-11T00:54:13.626 INFO:teuthology.orchestra.run.smithi103.stdout:(2/157): ceph-fuse-19.3.0-4854.g8f219c47.el9.x8 3.8 MB/s | 900 kB 00:00 2024-09-11T00:54:13.626 INFO:teuthology.orchestra.run.smithi183.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 663 kB/s | 581 kB 00:00 2024-09-11T00:54:13.743 INFO:teuthology.orchestra.run.smithi103.stdout:(3/157): ceph-base-19.3.0-4854.g8f219c47.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-11T00:54:13.768 INFO:teuthology.orchestra.run.smithi103.stdout:(4/157): ceph-immutable-object-cache-19.3.0-485 1.0 MB/s | 145 kB 00:00 2024-09-11T00:54:13.861 INFO:teuthology.orchestra.run.smithi103.stdout:(5/157): ceph-mds-19.3.0-4854.g8f219c47.el9.x86 20 MB/s | 2.4 MB 00:00 2024-09-11T00:54:13.953 INFO:teuthology.orchestra.run.smithi183.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 77 kB/s | 47 kB 00:00 2024-09-11T00:54:14.038 INFO:teuthology.orchestra.run.smithi117.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 400 kB/s | 313 kB 00:00 2024-09-11T00:54:14.055 INFO:teuthology.orchestra.run.smithi117.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 59 kB/s | 33 kB 00:00 2024-09-11T00:54:14.145 INFO:teuthology.orchestra.run.smithi103.stdout:(6/157): ceph-mon-19.3.0-4854.g8f219c47.el9.x86 17 MB/s | 4.8 MB 00:00 2024-09-11T00:54:14.187 INFO:teuthology.orchestra.run.smithi103.stdout:(7/157): ceph-mgr-19.3.0-4854.g8f219c47.el9.x86 3.7 MB/s | 1.5 MB 00:00 2024-09-11T00:54:14.335 INFO:teuthology.orchestra.run.smithi183.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 362 kB/s | 292 kB 00:00 2024-09-11T00:54:14.353 INFO:teuthology.orchestra.run.smithi183.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 260 kB/s | 188 kB 00:00 2024-09-11T00:54:14.522 INFO:teuthology.orchestra.run.smithi117.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 38 kB/s | 18 kB 00:00 2024-09-11T00:54:14.553 INFO:teuthology.orchestra.run.smithi183.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 64 kB/s | 38 kB 00:00 2024-09-11T00:54:14.553 INFO:teuthology.orchestra.run.smithi103.stdout:(8/157): ceph-common-19.3.0-4854.g8f219c47.el9. 17 MB/s | 22 MB 00:01 2024-09-11T00:54:14.555 INFO:teuthology.orchestra.run.smithi117.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 22 kB/s | 11 kB 00:00 2024-09-11T00:54:14.604 INFO:teuthology.orchestra.run.smithi103.stdout:(9/157): ceph-selinux-19.3.0-4854.g8f219c47.el9 506 kB/s | 25 kB 00:00 2024-09-11T00:54:14.614 INFO:teuthology.orchestra.run.smithi117.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-11T00:54:15.107 INFO:teuthology.orchestra.run.smithi103.stdout:(10/157): ceph-osd-19.3.0-4854.g8f219c47.el9.x8 18 MB/s | 17 MB 00:00 2024-09-11T00:54:15.162 INFO:teuthology.orchestra.run.smithi103.stdout:(11/157): cephfs-mirror-19.3.0-4854.g8f219c47.e 4.0 MB/s | 225 kB 00:00 2024-09-11T00:54:15.221 INFO:teuthology.orchestra.run.smithi103.stdout:(12/157): cephfs-shell-19.3.0-4854.g8f219c47.el 464 kB/s | 27 kB 00:00 2024-09-11T00:54:15.247 INFO:teuthology.orchestra.run.smithi117.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 71 kB/s | 45 kB 00:00 2024-09-11T00:54:15.272 INFO:teuthology.orchestra.run.smithi117.stdout:(59/157): libnbd-1.20.2-2.el9.x86_64.rpm 227 kB/s | 171 kB 00:00 2024-09-11T00:54:15.288 INFO:teuthology.orchestra.run.smithi103.stdout:(13/157): libcephfs-devel-19.3.0-4854.g8f219c47 477 kB/s | 32 kB 00:00 2024-09-11T00:54:15.314 INFO:teuthology.orchestra.run.smithi117.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 211 kB/s | 160 kB 00:00 2024-09-11T00:54:15.372 INFO:teuthology.orchestra.run.smithi103.stdout:(14/157): libcephfs2-19.3.0-4854.g8f219c47.el9. 8.9 MB/s | 755 kB 00:00 2024-09-11T00:54:15.439 INFO:teuthology.orchestra.run.smithi103.stdout:(15/157): libcephsqlite-19.3.0-4854.g8f219c47.e 2.4 MB/s | 162 kB 00:00 2024-09-11T00:54:15.506 INFO:teuthology.orchestra.run.smithi103.stdout:(16/157): librados-devel-19.3.0-4854.g8f219c47. 1.9 MB/s | 127 kB 00:00 2024-09-11T00:54:15.561 INFO:teuthology.orchestra.run.smithi183.stdout:(68/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.0 MB/s | 4.9 MB 00:01 2024-09-11T00:54:15.603 INFO:teuthology.orchestra.run.smithi183.stdout:(69/157): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-09-11T00:54:15.648 INFO:teuthology.orchestra.run.smithi103.stdout:(17/157): ceph-radosgw-19.3.0-4854.g8f219c47.el 7.5 MB/s | 11 MB 00:01 2024-09-11T00:54:15.670 INFO:teuthology.orchestra.run.smithi183.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 4.4 MB 00:01 2024-09-11T00:54:15.681 INFO:teuthology.orchestra.run.smithi103.stdout:(18/157): libradosstriper1-19.3.0-4854.g8f219c4 2.8 MB/s | 507 kB 00:00 2024-09-11T00:54:15.731 INFO:teuthology.orchestra.run.smithi103.stdout:(19/157): python3-ceph-argparse-19.3.0-4854.g8f 905 kB/s | 45 kB 00:00 2024-09-11T00:54:15.798 INFO:teuthology.orchestra.run.smithi103.stdout:(20/157): python3-ceph-common-19.3.0-4854.g8f21 2.1 MB/s | 143 kB 00:00 2024-09-11T00:54:15.856 INFO:teuthology.orchestra.run.smithi117.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 45 kB/s | 24 kB 00:00 2024-09-11T00:54:15.874 INFO:teuthology.orchestra.run.smithi103.stdout:(21/157): python3-cephfs-19.3.0-4854.g8f219c47. 2.1 MB/s | 161 kB 00:00 2024-09-11T00:54:15.949 INFO:teuthology.orchestra.run.smithi103.stdout:(22/157): python3-rados-19.3.0-4854.g8f219c47.e 4.2 MB/s | 321 kB 00:00 2024-09-11T00:54:16.025 INFO:teuthology.orchestra.run.smithi103.stdout:(23/157): python3-rbd-19.3.0-4854.g8f219c47.el9 4.0 MB/s | 306 kB 00:00 2024-09-11T00:54:16.100 INFO:teuthology.orchestra.run.smithi103.stdout:(24/157): python3-rgw-19.3.0-4854.g8f219c47.el9 1.3 MB/s | 99 kB 00:00 2024-09-11T00:54:16.148 INFO:teuthology.orchestra.run.smithi117.stdout:(62/157): librdkafka-1.6.1-102.el9.x86_64.rpm 736 kB/s | 662 kB 00:00 2024-09-11T00:54:16.192 INFO:teuthology.orchestra.run.smithi103.stdout:(25/157): rbd-fuse-19.3.0-4854.g8f219c47.el9.x8 931 kB/s | 85 kB 00:00 2024-09-11T00:54:16.292 INFO:teuthology.orchestra.run.smithi103.stdout:(26/157): librgw2-19.3.0-4854.g8f219c47.el9.x86 8.6 MB/s | 5.5 MB 00:00 2024-09-11T00:54:16.311 INFO:teuthology.orchestra.run.smithi183.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 194 kB/s | 137 kB 00:00 2024-09-11T00:54:16.342 INFO:teuthology.orchestra.run.smithi103.stdout:(27/157): rbd-nbd-19.3.0-4854.g8f219c47.el9.x86 3.4 MB/s | 171 kB 00:00 2024-09-11T00:54:16.448 INFO:teuthology.orchestra.run.smithi117.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 80 kB/s | 47 kB 00:00 2024-09-11T00:54:16.557 INFO:teuthology.orchestra.run.smithi117.stdout:(64/157): libtool-2.4.6-46.el9.x86_64.rpm 468 kB/s | 581 kB 00:01 2024-09-11T00:54:16.712 INFO:teuthology.orchestra.run.smithi183.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 792 kB/s | 910 kB 00:01 2024-09-11T00:54:16.843 INFO:teuthology.orchestra.run.smithi103.stdout:(28/157): ceph-test-19.3.0-4854.g8f219c47.el9.x 22 MB/s | 50 MB 00:02 2024-09-11T00:54:16.868 INFO:teuthology.orchestra.run.smithi103.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4854.g 65 kB/s | 34 kB 00:00 2024-09-11T00:54:16.932 INFO:teuthology.orchestra.run.smithi117.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 374 kB/s | 292 kB 00:00 2024-09-11T00:54:16.935 INFO:teuthology.orchestra.run.smithi103.stdout:(30/157): rbd-mirror-19.3.0-4854.g8f219c47.el9. 4.3 MB/s | 3.2 MB 00:00 2024-09-11T00:54:16.961 INFO:teuthology.orchestra.run.smithi103.stdout:(31/157): ceph-mgr-cephadm-19.3.0-4854.g8f219c4 1.3 MB/s | 154 kB 00:00 2024-09-11T00:54:16.970 INFO:teuthology.orchestra.run.smithi183.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 4.4 MB/s | 5.8 MB 00:01 2024-09-11T00:54:17.020 INFO:teuthology.orchestra.run.smithi103.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4854.g8f 4.9 MB/s | 291 kB 00:00 2024-09-11T00:54:17.086 INFO:teuthology.orchestra.run.smithi103.stdout:(33/157): ceph-mgr-rook-19.3.0-4854.g8f219c47.e 747 kB/s | 49 kB 00:00 2024-09-11T00:54:17.132 INFO:teuthology.orchestra.run.smithi117.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 67 kB/s | 38 kB 00:00 2024-09-11T00:54:17.170 INFO:teuthology.orchestra.run.smithi103.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4854.g8 198 kB/s | 16 kB 00:00 2024-09-11T00:54:17.249 INFO:teuthology.orchestra.run.smithi117.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 236 kB/s | 188 kB 00:00 2024-09-11T00:54:17.270 INFO:teuthology.orchestra.run.smithi103.stdout:(35/157): ceph-mgr-diskprediction-local-19.3.0- 22 MB/s | 7.4 MB 00:00 2024-09-11T00:54:17.296 INFO:teuthology.orchestra.run.smithi103.stdout:(36/157): ceph-volume-19.3.0-4854.g8f219c47.el9 2.2 MB/s | 285 kB 00:00 2024-09-11T00:54:17.338 INFO:teuthology.orchestra.run.smithi103.stdout:(37/157): cephadm-19.3.0-4854.g8f219c47.el9.noa 11 MB/s | 783 kB 00:00 2024-09-11T00:54:17.363 INFO:teuthology.orchestra.run.smithi103.stdout:(38/157): cephfs-top-19.3.0-4854.g8f219c47.el9. 273 kB/s | 18 kB 00:00 2024-09-11T00:54:17.429 INFO:teuthology.orchestra.run.smithi183.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 122 kB/s | 87 kB 00:00 2024-09-11T00:54:17.479 INFO:teuthology.orchestra.run.smithi183.stdout:(75/157): protobuf-3.14.0-13.el9.x86_64.rpm 885 kB/s | 1.0 MB 00:01 2024-09-11T00:54:17.955 INFO:teuthology.orchestra.run.smithi103.stdout:(39/157): ceph-mgr-dashboard-19.3.0-4854.g8f219 13 MB/s | 14 MB 00:01 2024-09-11T00:54:17.980 INFO:teuthology.orchestra.run.smithi103.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 124 kB/s | 80 kB 00:00 2024-09-11T00:54:18.046 INFO:teuthology.orchestra.run.smithi183.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 99 kB/s | 61 kB 00:00 2024-09-11T00:54:18.181 INFO:teuthology.orchestra.run.smithi103.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 981 kB/s | 801 kB 00:00 2024-09-11T00:54:18.239 INFO:teuthology.orchestra.run.smithi103.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 673 kB/s | 191 kB 00:00 2024-09-11T00:54:18.322 INFO:teuthology.orchestra.run.smithi183.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 291 kB/s | 245 kB 00:00 2024-09-11T00:54:18.356 INFO:teuthology.orchestra.run.smithi103.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 913 kB/s | 106 kB 00:00 2024-09-11T00:54:18.490 INFO:teuthology.orchestra.run.smithi103.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 4.0 MB/s | 1.2 MB 00:00 2024-09-11T00:54:18.515 INFO:teuthology.orchestra.run.smithi103.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 853 kB/s | 135 kB 00:00 2024-09-11T00:54:18.557 INFO:teuthology.orchestra.run.smithi103.stdout:(46/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 439 kB/s | 253 kB 00:00 2024-09-11T00:54:18.616 INFO:teuthology.orchestra.run.smithi103.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 995 kB/s | 125 kB 00:00 2024-09-11T00:54:18.641 INFO:teuthology.orchestra.run.smithi103.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-09-11T00:54:18.750 INFO:teuthology.orchestra.run.smithi103.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 988 kB/s | 107 kB 00:00 2024-09-11T00:54:18.792 INFO:teuthology.orchestra.run.smithi103.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 523 kB/s | 22 kB 00:00 2024-09-11T00:54:18.859 INFO:teuthology.orchestra.run.smithi103.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-11T00:54:18.872 INFO:teuthology.orchestra.run.smithi183.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 47 kB/s | 26 kB 00:00 2024-09-11T00:54:18.897 INFO:teuthology.orchestra.run.smithi183.stdout:(79/157): python3-jinja2-2.11.3-6.el9.noarch.rp 292 kB/s | 248 kB 00:00 2024-09-11T00:54:18.909 INFO:teuthology.orchestra.run.smithi103.stdout:(52/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-11T00:54:18.933 INFO:teuthology.orchestra.run.smithi117.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 965 kB/s | 1.6 MB 00:01 2024-09-11T00:54:18.934 INFO:teuthology.orchestra.run.smithi103.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 435 kB/s | 33 kB 00:00 2024-09-11T00:54:18.968 INFO:teuthology.orchestra.run.smithi103.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-09-11T00:54:19.002 INFO:teuthology.orchestra.run.smithi103.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 269 kB/s | 18 kB 00:00 2024-09-11T00:54:19.045 INFO:teuthology.orchestra.run.smithi103.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 146 kB/s | 11 kB 00:00 2024-09-11T00:54:19.103 INFO:teuthology.orchestra.run.smithi103.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.7 MB/s | 171 kB 00:00 2024-09-11T00:54:19.136 INFO:teuthology.orchestra.run.smithi103.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.7 MB/s | 160 kB 00:00 2024-09-11T00:54:19.162 INFO:teuthology.orchestra.run.smithi103.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 774 kB/s | 45 kB 00:00 2024-09-11T00:54:19.328 INFO:teuthology.orchestra.run.smithi103.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 3.4 MB/s | 581 kB 00:00 2024-09-11T00:54:19.356 INFO:teuthology.orchestra.run.smithi183.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 40 kB/s | 19 kB 00:00 2024-09-11T00:54:19.362 INFO:teuthology.orchestra.run.smithi103.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.9 MB/s | 662 kB 00:00 2024-09-11T00:54:19.388 INFO:teuthology.orchestra.run.smithi103.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-11T00:54:19.429 INFO:teuthology.orchestra.run.smithi103.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 711 kB/s | 47 kB 00:00 2024-09-11T00:54:19.513 INFO:teuthology.orchestra.run.smithi103.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-11T00:54:19.538 INFO:teuthology.orchestra.run.smithi103.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-11T00:54:19.564 INFO:teuthology.orchestra.run.smithi103.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-11T00:54:19.739 INFO:teuthology.orchestra.run.smithi103.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.6 MB/s | 3.0 MB 00:00 2024-09-11T00:54:19.740 INFO:teuthology.orchestra.run.smithi183.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 204 kB/s | 172 kB 00:00 2024-09-11T00:54:19.931 INFO:teuthology.orchestra.run.smithi183.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 60 kB/s | 35 kB 00:00 2024-09-11T00:54:19.957 INFO:teuthology.orchestra.run.smithi117.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 888 kB/s | 910 kB 00:01 2024-09-11T00:54:20.125 INFO:teuthology.orchestra.run.smithi117.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.5 MB/s | 4.4 MB 00:02 2024-09-11T00:54:20.191 INFO:teuthology.orchestra.run.smithi117.stdout:(71/157): openblas-openmp-0.3.26-2.el9.x86_64.r 1.5 MB/s | 4.9 MB 00:03 2024-09-11T00:54:20.223 INFO:teuthology.orchestra.run.smithi103.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 3.3 MB/s | 1.6 MB 00:00 2024-09-11T00:54:20.273 INFO:teuthology.orchestra.run.smithi183.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 1.8 MB/s | 6.0 MB 00:03 2024-09-11T00:54:20.565 INFO:teuthology.orchestra.run.smithi103.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.4 MB/s | 4.4 MB 00:01 2024-09-11T00:54:20.598 INFO:teuthology.orchestra.run.smithi103.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 2.4 MB/s | 910 kB 00:00 2024-09-11T00:54:20.623 INFO:teuthology.orchestra.run.smithi103.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-11T00:54:20.675 INFO:teuthology.orchestra.run.smithi117.stdout:(72/157): postgresql-private-libs-13.16-1.el9.x 192 kB/s | 137 kB 00:00 2024-09-11T00:54:20.699 INFO:teuthology.orchestra.run.smithi103.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 4.3 MB/s | 4.9 MB 00:01 2024-09-11T00:54:20.740 INFO:teuthology.orchestra.run.smithi183.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 310 kB/s | 250 kB 00:00 2024-09-11T00:54:20.749 INFO:teuthology.orchestra.run.smithi103.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-11T00:54:20.866 INFO:teuthology.orchestra.run.smithi103.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 4.2 MB/s | 1.0 MB 00:00 2024-09-11T00:54:20.950 INFO:teuthology.orchestra.run.smithi103.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 735 kB/s | 61 kB 00:00 2024-09-11T00:54:20.990 INFO:teuthology.orchestra.run.smithi183.stdout:(85/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-09-11T00:54:21.033 INFO:teuthology.orchestra.run.smithi103.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-11T00:54:21.082 INFO:teuthology.orchestra.run.smithi183.stdout:(86/157): python3-oauthlib-3.1.1-5.el9.noarch.r 275 kB/s | 222 kB 00:00 2024-09-11T00:54:21.109 INFO:teuthology.orchestra.run.smithi117.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 1.1 MB/s | 1.0 MB 00:00 2024-09-11T00:54:21.117 INFO:teuthology.orchestra.run.smithi103.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-11T00:54:21.167 INFO:teuthology.orchestra.run.smithi103.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-11T00:54:21.209 INFO:teuthology.orchestra.run.smithi103.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 462 kB/s | 19 kB 00:00 2024-09-11T00:54:21.268 INFO:teuthology.orchestra.run.smithi103.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-11T00:54:21.326 INFO:teuthology.orchestra.run.smithi103.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 598 kB/s | 35 kB 00:00 2024-09-11T00:54:21.400 INFO:teuthology.orchestra.run.smithi117.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 4.5 MB/s | 5.8 MB 00:01 2024-09-11T00:54:21.426 INFO:teuthology.orchestra.run.smithi117.stdout:(75/157): python3-attrs-20.3.0-7.el9.noarch.rpm 117 kB/s | 87 kB 00:00 2024-09-11T00:54:21.432 INFO:teuthology.orchestra.run.smithi183.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 112 kB/s | 77 kB 00:00 2024-09-11T00:54:21.583 INFO:teuthology.orchestra.run.smithi183.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 72 kB/s | 42 kB 00:00 2024-09-11T00:54:21.859 INFO:teuthology.orchestra.run.smithi183.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 347 kB/s | 269 kB 00:00 2024-09-11T00:54:21.869 INFO:teuthology.orchestra.run.smithi103.stdout:(82/157): python3-babel-2.9.1-2.el9.noarch.rpm 5.3 MB/s | 6.0 MB 00:01 2024-09-11T00:54:21.952 INFO:teuthology.orchestra.run.smithi103.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.0 MB/s | 250 kB 00:00 2024-09-11T00:54:22.018 INFO:teuthology.orchestra.run.smithi117.stdout:(76/157): python3-colorama-0.4.6-3.el9.noarch.r 99 kB/s | 61 kB 00:00 2024-09-11T00:54:22.053 INFO:teuthology.orchestra.run.smithi103.stdout:(84/157): postgresql-server-13.16-1.el9.x86_64. 4.0 MB/s | 5.8 MB 00:01 2024-09-11T00:54:22.078 INFO:teuthology.orchestra.run.smithi103.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.7 MB/s | 222 kB 00:00 2024-09-11T00:54:22.112 INFO:teuthology.orchestra.run.smithi103.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-11T00:54:22.137 INFO:teuthology.orchestra.run.smithi103.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 724 kB/s | 42 kB 00:00 2024-09-11T00:54:22.176 INFO:teuthology.orchestra.run.smithi117.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 326 kB/s | 245 kB 00:00 2024-09-11T00:54:22.212 INFO:teuthology.orchestra.run.smithi103.stdout:(88/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.8 MB/s | 5.1 MB 00:00 2024-09-11T00:54:22.237 INFO:teuthology.orchestra.run.smithi103.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-11T00:54:22.243 INFO:teuthology.orchestra.run.smithi183.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 196 kB/s | 159 kB 00:00 2024-09-11T00:54:22.262 INFO:teuthology.orchestra.run.smithi103.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-09-11T00:54:22.268 INFO:teuthology.orchestra.run.smithi117.stdout:(78/157): python3-babel-2.9.1-2.el9.noarch.rpm 5.1 MB/s | 6.0 MB 00:01 2024-09-11T00:54:22.305 INFO:teuthology.orchestra.run.smithi103.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 3.0 MB/s | 279 kB 00:00 2024-09-11T00:54:22.330 INFO:teuthology.orchestra.run.smithi103.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 764 kB/s | 51 kB 00:00 2024-09-11T00:54:22.351 INFO:teuthology.orchestra.run.smithi183.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 363 kB/s | 279 kB 00:00 2024-09-11T00:54:22.355 INFO:teuthology.orchestra.run.smithi103.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 584 kB/s | 54 kB 00:00 2024-09-11T00:54:22.422 INFO:teuthology.orchestra.run.smithi103.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 628 kB/s | 42 kB 00:00 2024-09-11T00:54:22.447 INFO:teuthology.orchestra.run.smithi103.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 483 kB/s | 44 kB 00:00 2024-09-11T00:54:22.497 INFO:teuthology.orchestra.run.smithi103.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-09-11T00:54:22.523 INFO:teuthology.orchestra.run.smithi103.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-09-11T00:54:22.548 INFO:teuthology.orchestra.run.smithi103.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-11T00:54:22.551 INFO:teuthology.orchestra.run.smithi183.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 74 kB/s | 51 kB 00:00 2024-09-11T00:54:22.599 INFO:teuthology.orchestra.run.smithi103.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-11T00:54:22.632 INFO:teuthology.orchestra.run.smithi103.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-11T00:54:22.657 INFO:teuthology.orchestra.run.smithi103.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-09-11T00:54:22.691 INFO:teuthology.orchestra.run.smithi103.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-11T00:54:22.716 INFO:teuthology.orchestra.run.smithi103.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-09-11T00:54:22.743 INFO:teuthology.orchestra.run.smithi117.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 45 kB/s | 26 kB 00:00 2024-09-11T00:54:22.777 INFO:teuthology.orchestra.run.smithi117.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 38 kB/s | 19 kB 00:00 2024-09-11T00:54:22.819 INFO:teuthology.orchestra.run.smithi117.stdout:(81/157): python3-jinja2-2.11.3-6.el9.noarch.rp 310 kB/s | 248 kB 00:00 2024-09-11T00:54:22.860 INFO:teuthology.orchestra.run.smithi183.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 87 kB/s | 54 kB 00:00 2024-09-11T00:54:22.892 INFO:teuthology.orchestra.run.smithi103.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 111 kB/s | 22 kB 00:00 2024-09-11T00:54:22.950 INFO:teuthology.orchestra.run.smithi103.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-11T00:54:22.993 INFO:teuthology.orchestra.run.smithi103.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 7.2 MB/s | 309 kB 00:00 2024-09-11T00:54:23.018 INFO:teuthology.orchestra.run.smithi103.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-11T00:54:23.135 INFO:teuthology.orchestra.run.smithi183.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 71 kB/s | 42 kB 00:00 2024-09-11T00:54:23.177 INFO:teuthology.orchestra.run.smithi103.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 28 MB/s | 4.4 MB 00:00 2024-09-11T00:54:23.202 INFO:teuthology.orchestra.run.smithi103.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T00:54:23.227 INFO:teuthology.orchestra.run.smithi103.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-11T00:54:23.261 INFO:teuthology.orchestra.run.smithi103.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-11T00:54:23.286 INFO:teuthology.orchestra.run.smithi103.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-11T00:54:23.319 INFO:teuthology.orchestra.run.smithi117.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 64 kB/s | 35 kB 00:00 2024-09-11T00:54:23.337 INFO:teuthology.orchestra.run.smithi103.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 16 MB/s | 839 kB 00:00 2024-09-11T00:54:23.370 INFO:teuthology.orchestra.run.smithi103.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-11T00:54:23.387 INFO:teuthology.orchestra.run.smithi103.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-11T00:54:23.413 INFO:teuthology.orchestra.run.smithi103.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T00:54:23.427 INFO:teuthology.orchestra.run.smithi183.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 78 kB/s | 44 kB 00:00 2024-09-11T00:54:23.438 INFO:teuthology.orchestra.run.smithi103.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-11T00:54:23.471 INFO:teuthology.orchestra.run.smithi103.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 5.1 MB/s | 172 kB 00:00 2024-09-11T00:54:23.536 INFO:teuthology.orchestra.run.smithi117.stdout:(83/157): python3-mako-1.1.4-6.el9.noarch.rpm 217 kB/s | 172 kB 00:00 2024-09-11T00:54:23.538 INFO:teuthology.orchestra.run.smithi103.stdout:(119/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.0 MB/s | 863 kB 00:00 2024-09-11T00:54:23.589 INFO:teuthology.orchestra.run.smithi103.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-09-11T00:54:23.623 INFO:teuthology.orchestra.run.smithi103.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 6.9 MB/s | 220 kB 00:00 2024-09-11T00:54:23.670 INFO:teuthology.orchestra.run.smithi103.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.3 MB/s | 303 kB 00:00 2024-09-11T00:54:23.704 INFO:teuthology.orchestra.run.smithi103.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-11T00:54:23.721 INFO:teuthology.orchestra.run.smithi103.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 656 kB/s | 11 kB 00:00 2024-09-11T00:54:23.737 INFO:teuthology.orchestra.run.smithi103.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-11T00:54:23.754 INFO:teuthology.orchestra.run.smithi103.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-11T00:54:23.780 INFO:teuthology.orchestra.run.smithi103.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-11T00:54:23.805 INFO:teuthology.orchestra.run.smithi103.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 793 kB/s | 20 kB 00:00 2024-09-11T00:54:23.864 INFO:teuthology.orchestra.run.smithi103.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 8.5 MB/s | 2.0 MB 00:00 2024-09-11T00:54:23.923 INFO:teuthology.orchestra.run.smithi103.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 800 kB/s | 46 kB 00:00 2024-09-11T00:54:23.948 INFO:teuthology.orchestra.run.smithi103.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T00:54:23.973 INFO:teuthology.orchestra.run.smithi103.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T00:54:24.007 INFO:teuthology.orchestra.run.smithi103.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-09-11T00:54:24.033 INFO:teuthology.orchestra.run.smithi103.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-11T00:54:24.057 INFO:teuthology.orchestra.run.smithi103.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-11T00:54:24.083 INFO:teuthology.orchestra.run.smithi103.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-11T00:54:24.094 INFO:teuthology.orchestra.run.smithi183.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 230 kB/s | 221 kB 00:00 2024-09-11T00:54:24.108 INFO:teuthology.orchestra.run.smithi103.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-11T00:54:24.119 INFO:teuthology.orchestra.run.smithi183.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 52 kB/s | 36 kB 00:00 2024-09-11T00:54:24.134 INFO:teuthology.orchestra.run.smithi103.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-11T00:54:24.153 INFO:teuthology.orchestra.run.smithi117.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 301 kB/s | 250 kB 00:00 2024-09-11T00:54:24.159 INFO:teuthology.orchestra.run.smithi103.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T00:54:24.351 INFO:teuthology.orchestra.run.smithi103.stdout:(140/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.9 MB/s | 16 MB 00:02 2024-09-11T00:54:24.376 INFO:teuthology.orchestra.run.smithi103.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 165 kB/s | 36 kB 00:00 2024-09-11T00:54:24.378 INFO:teuthology.orchestra.run.smithi117.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 266 kB/s | 222 kB 00:00 2024-09-11T00:54:24.410 INFO:teuthology.orchestra.run.smithi103.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 626 kB/s | 188 kB 00:00 2024-09-11T00:54:24.444 INFO:teuthology.orchestra.run.smithi103.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 2.8 MB/s | 90 kB 00:00 2024-09-11T00:54:24.469 INFO:teuthology.orchestra.run.smithi103.stdout:(144/157): python3-typing-extensions-4.12.2-2.e 636 kB/s | 74 kB 00:00 2024-09-11T00:54:24.494 INFO:teuthology.orchestra.run.smithi103.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-09-11T00:54:24.520 INFO:teuthology.orchestra.run.smithi103.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-11T00:54:24.553 INFO:teuthology.orchestra.run.smithi103.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-11T00:54:24.579 INFO:teuthology.orchestra.run.smithi103.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-11T00:54:24.620 INFO:teuthology.orchestra.run.smithi117.stdout:(86/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.8 MB/s | 5.1 MB 00:01 2024-09-11T00:54:24.637 INFO:teuthology.orchestra.run.smithi103.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-11T00:54:24.720 INFO:teuthology.orchestra.run.smithi183.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-09-11T00:54:24.820 INFO:teuthology.orchestra.run.smithi117.stdout:(87/157): python3-packaging-20.9-5.el9.noarch.r 116 kB/s | 77 kB 00:00 2024-09-11T00:54:24.829 INFO:teuthology.orchestra.run.smithi103.stdout:(150/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-11T00:54:24.921 INFO:teuthology.orchestra.run.smithi103.stdout:(151/157): librados2-19.3.0-4854.g8f219c47.el9. 9.4 MB/s | 3.5 MB 00:00 2024-09-11T00:54:24.987 INFO:teuthology.orchestra.run.smithi117.stdout:(88/157): python3-prettytable-0.7.2-27.el9.noar 70 kB/s | 42 kB 00:00 2024-09-11T00:54:25.061 INFO:teuthology.orchestra.run.smithi183.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 323 kB/s | 304 kB 00:00 2024-09-11T00:54:25.213 INFO:teuthology.orchestra.run.smithi103.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 140 kB/s | 41 kB 00:00 2024-09-11T00:54:25.328 INFO:teuthology.orchestra.run.smithi183.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 95 kB/s | 58 kB 00:00 2024-09-11T00:54:25.495 INFO:teuthology.orchestra.run.smithi117.stdout:(89/157): python3-protobuf-3.14.0-13.el9.noarch 310 kB/s | 269 kB 00:00 2024-09-11T00:54:25.580 INFO:teuthology.orchestra.run.smithi103.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 678 kB/s | 249 kB 00:00 2024-09-11T00:54:25.595 INFO:teuthology.orchestra.run.smithi117.stdout:(90/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 205 kB/s | 159 kB 00:00 2024-09-11T00:54:25.714 INFO:teuthology.orchestra.run.smithi103.stdout:(154/157): NetworkManager-1.49.90-1.el9.x86_64. 2.2 MB/s | 2.3 MB 00:01 2024-09-11T00:54:25.737 INFO:teuthology.orchestra.run.smithi183.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 142 kB/s | 96 kB 00:00 2024-09-11T00:54:25.756 INFO:teuthology.orchestra.run.smithi103.stdout:(155/157): NetworkManager-libnm-1.49.90-1.el9.x 1.9 MB/s | 1.8 MB 00:00 2024-09-11T00:54:25.879 INFO:teuthology.orchestra.run.smithi117.stdout:(91/157): python3-pyasn1-modules-0.4.8-6.el9.no 313 kB/s | 279 kB 00:00 2024-09-11T00:54:25.946 INFO:teuthology.orchestra.run.smithi183.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 103 kB/s | 64 kB 00:00 2024-09-11T00:54:25.989 INFO:teuthology.orchestra.run.smithi103.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 3.3 MB/s | 1.4 MB 00:00 2024-09-11T00:54:26.039 INFO:teuthology.orchestra.run.smithi103.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 7.4 MB/s | 2.4 MB 00:00 2024-09-11T00:54:26.047 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:54:26.047 INFO:teuthology.orchestra.run.smithi103.stdout:Total 18 MB/s | 240 MB 00:13 2024-09-11T00:54:26.138 INFO:teuthology.orchestra.run.smithi117.stdout:(92/157): python3-pytz-2021.1-5.el9.noarch.rpm 79 kB/s | 51 kB 00:00 2024-09-11T00:54:26.154 INFO:teuthology.orchestra.run.smithi183.stdout:(103/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.3 MB/s | 16 MB 00:03 2024-09-11T00:54:26.188 INFO:teuthology.orchestra.run.smithi183.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 92 kB/s | 22 kB 00:00 2024-09-11T00:54:26.213 INFO:teuthology.orchestra.run.smithi117.stdout:(93/157): python3-requests-oauthlib-1.3.0-12.el 87 kB/s | 54 kB 00:00 2024-09-11T00:54:26.255 INFO:teuthology.orchestra.run.smithi183.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-11T00:54:26.289 INFO:teuthology.orchestra.run.smithi183.stdout:(106/157): gperftools-libs-2.9.1-2.el9.x86_64.r 9.1 MB/s | 309 kB 00:00 2024-09-11T00:54:26.314 INFO:teuthology.orchestra.run.smithi183.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-11T00:54:26.347 INFO:teuthology.orchestra.run.smithi183.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.4 MB/s | 863 kB 00:00 2024-09-11T00:54:26.381 INFO:teuthology.orchestra.run.smithi183.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 778 kB/s | 26 kB 00:00 2024-09-11T00:54:26.398 INFO:teuthology.orchestra.run.smithi183.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-11T00:54:26.431 INFO:teuthology.orchestra.run.smithi183.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-11T00:54:26.457 INFO:teuthology.orchestra.run.smithi183.stdout:(112/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 62 kB/s | 45 kB 00:00 2024-09-11T00:54:26.482 INFO:teuthology.orchestra.run.smithi183.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-11T00:54:26.566 INFO:teuthology.orchestra.run.smithi183.stdout:(114/157): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-11T00:54:26.582 INFO:teuthology.orchestra.run.smithi183.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-11T00:54:26.599 INFO:teuthology.orchestra.run.smithi183.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-11T00:54:26.616 INFO:teuthology.orchestra.run.smithi183.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 858 kB/s | 14 kB 00:00 2024-09-11T00:54:26.641 INFO:teuthology.orchestra.run.smithi183.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 3.5 MB/s | 548 kB 00:00 2024-09-11T00:54:26.667 INFO:teuthology.orchestra.run.smithi183.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T00:54:26.700 INFO:teuthology.orchestra.run.smithi183.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-11T00:54:26.721 INFO:teuthology.orchestra.run.smithi117.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 71 kB/s | 42 kB 00:00 2024-09-11T00:54:26.725 INFO:teuthology.orchestra.run.smithi183.stdout:(121/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.1 MB/s | 839 kB 00:00 2024-09-11T00:54:26.759 INFO:teuthology.orchestra.run.smithi183.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-09-11T00:54:26.780 INFO:teuthology.orchestra.run.smithi117.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 78 kB/s | 44 kB 00:00 2024-09-11T00:54:26.784 INFO:teuthology.orchestra.run.smithi183.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 2.6 MB/s | 220 kB 00:00 2024-09-11T00:54:26.810 INFO:teuthology.orchestra.run.smithi183.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-11T00:54:26.835 INFO:teuthology.orchestra.run.smithi183.stdout:(125/157): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-09-11T00:54:26.860 INFO:teuthology.orchestra.run.smithi183.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-11T00:54:26.886 INFO:teuthology.orchestra.run.smithi183.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-11T00:54:26.911 INFO:teuthology.orchestra.run.smithi183.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-11T00:54:26.936 INFO:teuthology.orchestra.run.smithi183.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-11T00:54:26.961 INFO:teuthology.orchestra.run.smithi183.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-11T00:54:26.995 INFO:teuthology.orchestra.run.smithi183.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-11T00:54:27.020 INFO:teuthology.orchestra.run.smithi183.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-11T00:54:27.054 INFO:teuthology.orchestra.run.smithi183.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-11T00:54:27.088 INFO:teuthology.orchestra.run.smithi183.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 490 kB/s | 16 kB 00:00 2024-09-11T00:54:27.122 INFO:teuthology.orchestra.run.smithi183.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-11T00:54:27.147 INFO:teuthology.orchestra.run.smithi183.stdout:(136/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-11T00:54:27.172 INFO:teuthology.orchestra.run.smithi183.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 564 kB/s | 28 kB 00:00 2024-09-11T00:54:27.197 INFO:teuthology.orchestra.run.smithi183.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-11T00:54:27.223 INFO:teuthology.orchestra.run.smithi183.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-11T00:54:27.248 INFO:teuthology.orchestra.run.smithi183.stdout:(140/157): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-11T00:54:27.273 INFO:teuthology.orchestra.run.smithi183.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-11T00:54:27.298 INFO:teuthology.orchestra.run.smithi183.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-11T00:54:27.339 INFO:teuthology.orchestra.run.smithi117.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 64 kB/s | 36 kB 00:00 2024-09-11T00:54:27.349 INFO:teuthology.orchestra.run.smithi183.stdout:(143/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.3 MB/s | 2.0 MB 00:00 2024-09-11T00:54:27.374 INFO:teuthology.orchestra.run.smithi183.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-09-11T00:54:27.399 INFO:teuthology.orchestra.run.smithi183.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-11T00:54:27.425 INFO:teuthology.orchestra.run.smithi183.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 400 kB/s | 20 kB 00:00 2024-09-11T00:54:27.450 INFO:teuthology.orchestra.run.smithi183.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-11T00:54:27.475 INFO:teuthology.orchestra.run.smithi183.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-09-11T00:54:27.525 INFO:teuthology.orchestra.run.smithi183.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-11T00:54:27.581 INFO:teuthology.orchestra.run.smithi117.stdout:(97/157): qatlib-24.02.0-1.el9.x86_64.rpm 257 kB/s | 221 kB 00:00 2024-09-11T00:54:27.692 INFO:teuthology.orchestra.run.smithi183.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 14 MB/s | 3.5 MB 00:00 2024-09-11T00:54:27.785 INFO:teuthology.orchestra.run.smithi183.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 10 MB/s | 3.2 MB 00:00 2024-09-11T00:54:27.901 INFO:teuthology.orchestra.run.smithi183.stdout:(152/157): NetworkManager-team-1.49.90-1.el9.x8 350 kB/s | 41 kB 00:00 2024-09-11T00:54:27.965 INFO:teuthology.orchestra.run.smithi117.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 76 kB/s | 47 kB 00:00 2024-09-11T00:54:28.018 INFO:teuthology.orchestra.run.smithi183.stdout:(153/157): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-11T00:54:28.110 INFO:teuthology.orchestra.run.smithi183.stdout:(154/157): NetworkManager-libnm-1.49.90-1.el9.x 4.3 MB/s | 1.8 MB 00:00 2024-09-11T00:54:28.124 INFO:teuthology.orchestra.run.smithi117.stdout:(99/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.2 MB/s | 16 MB 00:02 2024-09-11T00:54:28.127 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-09-11T00:54:28.210 INFO:teuthology.orchestra.run.smithi183.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 7.1 MB/s | 1.4 MB 00:00 2024-09-11T00:54:28.310 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-09-11T00:54:28.311 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-09-11T00:54:28.311 INFO:teuthology.orchestra.run.smithi183.stdout:(156/157): NetworkManager-1.49.90-1.el9.x86_64. 3.0 MB/s | 2.3 MB 00:00 2024-09-11T00:54:28.566 INFO:teuthology.orchestra.run.smithi117.stdout:(100/157): socat-1.7.4.1-6.el9.x86_64.rpm 312 kB/s | 304 kB 00:00 2024-09-11T00:54:28.699 INFO:teuthology.orchestra.run.smithi117.stdout:(101/157): uuid-1.6.2-55.el9.x86_64.rpm 79 kB/s | 58 kB 00:00 2024-09-11T00:54:28.816 INFO:teuthology.orchestra.run.smithi117.stdout:(102/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 139 kB/s | 96 kB 00:00 2024-09-11T00:54:29.175 INFO:teuthology.orchestra.run.smithi117.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 105 kB/s | 64 kB 00:00 2024-09-11T00:54:29.275 INFO:teuthology.orchestra.run.smithi117.stdout:(104/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 78 kB/s | 45 kB 00:00 2024-09-11T00:54:29.325 INFO:teuthology.orchestra.run.smithi117.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-11T00:54:29.327 INFO:teuthology.orchestra.run.smithi183.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-09-11T00:54:29.334 INFO:teuthology.orchestra.run.smithi183.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:54:29.334 INFO:teuthology.orchestra.run.smithi183.stdout:Total 9.6 MB/s | 240 MB 00:24 2024-09-11T00:54:29.350 INFO:teuthology.orchestra.run.smithi117.stdout:(106/157): lua-devel-5.4.4-4.el9.x86_64.rpm 42 kB/s | 22 kB 00:00 2024-09-11T00:54:29.393 INFO:teuthology.orchestra.run.smithi117.stdout:(107/157): gperftools-libs-2.9.1-2.el9.x86_64.r 4.6 MB/s | 309 kB 00:00 2024-09-11T00:54:29.426 INFO:teuthology.orchestra.run.smithi117.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 258 kB/s | 19 kB 00:00 2024-09-11T00:54:29.451 INFO:teuthology.orchestra.run.smithi117.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-11T00:54:29.486 INFO:teuthology.orchestra.run.smithi117.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-11T00:54:29.519 INFO:teuthology.orchestra.run.smithi117.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-11T00:54:29.554 INFO:teuthology.orchestra.run.smithi117.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-11T00:54:29.617 INFO:teuthology.orchestra.run.smithi117.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-11T00:54:29.670 INFO:teuthology.orchestra.run.smithi117.stdout:(114/157): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-11T00:54:29.695 INFO:teuthology.orchestra.run.smithi117.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-11T00:54:29.720 INFO:teuthology.orchestra.run.smithi117.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-11T00:54:29.746 INFO:teuthology.orchestra.run.smithi117.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-11T00:54:29.770 INFO:teuthology.orchestra.run.smithi117.stdout:(118/157): python3-asyncssh-2.13.2-5.el9.noarch 3.4 MB/s | 548 kB 00:00 2024-09-11T00:54:29.796 INFO:teuthology.orchestra.run.smithi117.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-11T00:54:29.821 INFO:teuthology.orchestra.run.smithi117.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-11T00:54:29.855 INFO:teuthology.orchestra.run.smithi117.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-11T00:54:29.880 INFO:teuthology.orchestra.run.smithi117.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-11T00:54:29.913 INFO:teuthology.orchestra.run.smithi117.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-11T00:54:29.941 INFO:teuthology.orchestra.run.smithi117.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 433 kB/s | 11 kB 00:00 2024-09-11T00:54:29.964 INFO:teuthology.orchestra.run.smithi117.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 703 kB/s | 18 kB 00:00 2024-09-11T00:54:29.989 INFO:teuthology.orchestra.run.smithi117.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-11T00:54:30.015 INFO:teuthology.orchestra.run.smithi117.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 776 kB/s | 19 kB 00:00 2024-09-11T00:54:30.040 INFO:teuthology.orchestra.run.smithi117.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 784 kB/s | 20 kB 00:00 2024-09-11T00:54:30.082 INFO:teuthology.orchestra.run.smithi117.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-11T00:54:30.099 INFO:teuthology.orchestra.run.smithi117.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-11T00:54:30.124 INFO:teuthology.orchestra.run.smithi117.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-11T00:54:30.141 INFO:teuthology.orchestra.run.smithi117.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 3.4 MB/s | 58 kB 00:00 2024-09-11T00:54:30.175 INFO:teuthology.orchestra.run.smithi117.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-11T00:54:30.192 INFO:teuthology.orchestra.run.smithi117.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 992 kB/s | 16 kB 00:00 2024-09-11T00:54:30.237 INFO:teuthology.orchestra.run.smithi117.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.8 MB/s | 272 kB 00:00 2024-09-11T00:54:30.259 INFO:teuthology.orchestra.run.smithi117.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.3 MB/s | 28 kB 00:00 2024-09-11T00:54:30.276 INFO:teuthology.orchestra.run.smithi117.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-11T00:54:30.302 INFO:teuthology.orchestra.run.smithi117.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 736 kB/s | 31 kB 00:00 2024-09-11T00:54:30.335 INFO:teuthology.orchestra.run.smithi117.stdout:(139/157): protobuf-compiler-3.14.0-13.el9.x86_ 744 kB/s | 863 kB 00:01 2024-09-11T00:54:30.360 INFO:teuthology.orchestra.run.smithi117.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-11T00:54:30.394 INFO:teuthology.orchestra.run.smithi117.stdout:(141/157): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-09-11T00:54:30.419 INFO:teuthology.orchestra.run.smithi117.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-11T00:54:30.444 INFO:teuthology.orchestra.run.smithi117.stdout:(143/157): python3-tempora-5.0.0-2.el9.noarch.r 328 kB/s | 36 kB 00:00 2024-09-11T00:54:30.469 INFO:teuthology.orchestra.run.smithi117.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-11T00:54:30.494 INFO:teuthology.orchestra.run.smithi117.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.3 MB/s | 230 kB 00:00 2024-09-11T00:54:30.520 INFO:teuthology.orchestra.run.smithi117.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-11T00:54:30.569 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction check 2024-09-11T00:54:30.721 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction check succeeded. 2024-09-11T00:54:30.721 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction test 2024-09-11T00:54:30.762 INFO:teuthology.orchestra.run.smithi117.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 717 kB/s | 191 kB 00:00 2024-09-11T00:54:30.787 INFO:teuthology.orchestra.run.smithi117.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 1.2 MB/s | 427 kB 00:00 2024-09-11T00:54:30.837 INFO:teuthology.orchestra.run.smithi117.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2024-09-11T00:54:30.894 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-09-11T00:54:30.895 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-09-11T00:54:31.029 INFO:teuthology.orchestra.run.smithi117.stdout:(150/157): librados2-19.3.0-4854.g8f219c47.el9. 13 MB/s | 3.5 MB 00:00 2024-09-11T00:54:31.088 INFO:teuthology.orchestra.run.smithi117.stdout:(151/157): librbd1-19.3.0-4854.g8f219c47.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-11T00:54:31.180 INFO:teuthology.orchestra.run.smithi117.stdout:(152/157): NetworkManager-1.49.90-1.el9.x86_64. 6.8 MB/s | 2.3 MB 00:00 2024-09-11T00:54:31.205 INFO:teuthology.orchestra.run.smithi117.stdout:(153/157): NetworkManager-team-1.49.90-1.el9.x8 349 kB/s | 41 kB 00:00 2024-09-11T00:54:31.230 INFO:teuthology.orchestra.run.smithi117.stdout:(154/157): NetworkManager-tui-1.49.90-1.el9.x86 4.9 MB/s | 249 kB 00:00 2024-09-11T00:54:31.364 INFO:teuthology.orchestra.run.smithi117.stdout:(155/157): NetworkManager-libnm-1.49.90-1.el9.x 5.4 MB/s | 1.8 MB 00:00 2024-09-11T00:54:31.414 INFO:teuthology.orchestra.run.smithi117.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 13 MB/s | 2.4 MB 00:00 2024-09-11T00:54:31.456 INFO:teuthology.orchestra.run.smithi117.stdout:(157/157): openssl-3.2.2-6.el9.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2024-09-11T00:54:31.462 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:54:31.462 INFO:teuthology.orchestra.run.smithi117.stdout:Total 9.9 MB/s | 240 MB 00:24 2024-09-11T00:54:32.603 INFO:teuthology.orchestra.run.smithi183.stdout:Transaction test succeeded. 2024-09-11T00:54:32.603 INFO:teuthology.orchestra.run.smithi183.stdout:Running transaction 2024-09-11T00:54:32.711 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-09-11T00:54:32.864 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-09-11T00:54:32.865 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-09-11T00:54:34.760 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-09-11T00:54:34.760 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-09-11T00:54:37.774 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-09-11T00:54:37.924 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-11T00:54:38.121 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-11T00:54:38.328 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-11T00:54:38.373 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-11T00:54:38.404 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-11T00:54:38.464 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-11T00:54:38.857 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-11T00:54:38.972 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:54:39.117 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:54:39.120 INFO:teuthology.orchestra.run.smithi183.stdout: Preparing : 1/1 2024-09-11T00:54:39.157 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:54:39.239 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-11T00:54:39.278 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-11T00:54:39.293 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:54:39.331 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-11T00:54:39.335 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:54:39.365 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-11T00:54:39.378 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-11T00:54:39.390 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-11T00:54:39.433 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-11T00:54:39.598 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-11T00:54:39.674 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-11T00:54:39.704 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:54:39.758 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-11T00:54:39.833 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:54:39.858 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:54:39.881 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:54:39.963 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:54:39.980 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:54:40.009 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:54:40.015 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:54:40.060 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:54:40.100 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:54:40.155 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:54:40.184 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-11T00:54:40.305 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:54:40.341 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-11T00:54:40.394 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-11T00:54:40.422 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:54:40.509 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:54:40.518 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:54:40.531 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:54:40.577 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:54:40.607 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:54:40.628 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:54:40.691 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-11T00:54:40.817 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:54:40.826 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:54:40.916 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:54:40.944 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:54:41.081 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-11T00:54:41.176 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:54:41.197 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:54:41.266 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:54:41.316 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-09-11T00:54:41.343 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-11T00:54:41.381 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-11T00:54:41.424 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-11T00:54:41.434 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-11T00:54:41.472 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-11T00:54:41.479 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:54:41.534 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-11T00:54:41.537 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-11T00:54:41.568 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-11T00:54:41.593 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-11T00:54:41.594 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-11T00:54:41.598 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-11T00:54:41.628 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-11T00:54:41.645 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-11T00:54:41.658 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-11T00:54:41.663 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-11T00:54:41.720 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-11T00:54:41.736 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-11T00:54:41.759 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-11T00:54:41.780 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-11T00:54:41.801 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-11T00:54:41.821 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-11T00:54:41.865 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-11T00:54:41.897 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-11T00:54:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-11T00:54:41.925 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-11T00:54:41.978 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-11T00:54:41.993 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-11T00:54:41.994 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-11T00:54:42.014 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-11T00:54:42.055 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-11T00:54:42.060 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-11T00:54:42.086 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-11T00:54:42.111 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:54:42.121 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-11T00:54:42.150 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-11T00:54:42.184 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-11T00:54:42.197 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-11T00:54:42.232 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-11T00:54:42.235 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:54:42.253 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-11T00:54:42.271 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:54:42.275 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-11T00:54:42.298 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-11T00:54:42.304 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-11T00:54:42.363 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:54:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-11T00:54:42.382 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-11T00:54:42.392 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:54:42.421 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-11T00:54:42.434 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-11T00:54:42.435 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-11T00:54:42.509 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-11T00:54:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-11T00:54:42.575 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-11T00:54:42.631 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-11T00:54:42.643 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-11T00:54:42.659 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:54:42.690 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-11T00:54:42.695 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-11T00:54:42.762 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-11T00:54:42.765 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:54:42.785 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:54:42.848 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 15/165 2024-09-11T00:54:42.861 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:54:42.887 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-11T00:54:43.038 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:54:43.182 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-11T00:54:43.224 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-11T00:54:43.284 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 18/165 2024-09-11T00:54:43.307 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-11T00:54:43.337 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-11T00:54:43.380 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-11T00:54:43.385 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:54:43.394 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-11T00:54:43.417 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-11T00:54:43.459 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-11T00:54:43.461 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:54:43.495 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-11T00:54:43.541 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-11T00:54:43.593 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-11T00:54:43.631 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-11T00:54:43.637 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-11T00:54:43.665 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 19/165 2024-09-11T00:54:43.684 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-11T00:54:43.691 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-11T00:54:43.773 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-11T00:54:43.783 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-11T00:54:43.798 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-11T00:54:43.833 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-11T00:54:43.847 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-11T00:54:43.894 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-11T00:54:43.897 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-11T00:54:43.928 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-11T00:54:43.942 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-11T00:54:43.960 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-11T00:54:43.960 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-11T00:54:43.974 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-11T00:54:44.012 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-11T00:54:44.018 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-11T00:54:44.050 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-11T00:54:44.059 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-11T00:54:44.065 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-11T00:54:44.078 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-11T00:54:44.095 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-11T00:54:44.146 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-11T00:54:44.147 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-11T00:54:44.180 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-11T00:54:44.189 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-11T00:54:44.200 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-11T00:54:44.239 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-11T00:54:44.263 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-11T00:54:44.274 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-11T00:54:44.299 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-11T00:54:44.327 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-11T00:54:44.335 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-11T00:54:44.351 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-11T00:54:44.365 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-11T00:54:44.394 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 34/165 2024-09-11T00:54:44.394 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-11T00:54:44.407 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-11T00:54:44.437 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 35/165 2024-09-11T00:54:44.459 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-11T00:54:44.465 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 36/165 2024-09-11T00:54:44.513 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-11T00:54:44.518 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-11T00:54:44.535 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-11T00:54:44.548 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-11T00:54:44.564 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-11T00:54:44.580 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-11T00:54:44.588 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-11T00:54:44.614 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-11T00:54:44.638 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-11T00:54:44.654 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-11T00:54:44.723 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-11T00:54:44.733 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-11T00:54:44.780 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-11T00:54:44.787 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-11T00:54:44.841 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-11T00:54:44.850 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-11T00:54:44.855 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-11T00:54:44.889 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-11T00:54:44.917 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-11T00:54:44.951 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-11T00:54:44.982 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-11T00:54:44.998 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-11T00:54:45.022 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-11T00:54:45.030 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-11T00:54:45.061 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-11T00:54:45.066 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-11T00:54:45.095 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-11T00:54:45.514 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-11T00:54:45.514 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-11T00:54:45.514 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-11T00:54:45.515 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-11T00:54:45.515 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-11T00:54:45.515 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-11T00:54:45.515 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-11T00:54:45.515 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-11T00:54:45.516 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-11T00:54:45.516 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-11T00:54:45.516 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-11T00:54:45.516 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-11T00:54:45.516 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-11T00:54:45.516 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-11T00:54:45.516 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-11T00:54:45.516 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-11T00:54:45.520 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-11T00:54:45.526 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-11T00:54:45.539 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-11T00:54:45.557 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 46/165 2024-09-11T00:54:45.597 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-11T00:54:45.606 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-11T00:54:45.646 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-11T00:54:45.683 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-11T00:54:45.717 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-11T00:54:45.751 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-11T00:54:45.757 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-11T00:54:45.801 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-11T00:54:45.820 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-11T00:54:45.834 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-11T00:54:45.911 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-11T00:54:45.925 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-11T00:54:45.983 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-11T00:54:46.000 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-11T00:54:46.038 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-11T00:54:46.065 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-11T00:54:46.097 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-11T00:54:46.133 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-11T00:54:46.169 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-11T00:54:46.179 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-11T00:54:46.215 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-11T00:54:46.243 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-11T00:54:46.258 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-11T00:54:46.259 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-11T00:54:46.300 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-11T00:54:46.306 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-11T00:54:46.341 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-11T00:54:46.437 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-11T00:54:46.441 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-11T00:54:46.477 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-11T00:54:46.518 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-11T00:54:46.571 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-11T00:54:46.620 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-11T00:54:46.661 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-11T00:54:46.700 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-11T00:54:46.726 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 65/165 2024-09-11T00:54:46.751 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-11T00:54:46.826 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-11T00:54:46.835 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-11T00:54:46.953 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-11T00:54:46.991 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-11T00:54:47.021 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-11T00:54:47.029 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-11T00:54:47.055 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-11T00:54:47.060 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-11T00:54:47.094 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-11T00:54:47.118 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-11T00:54:47.125 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-11T00:54:47.155 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-11T00:54:47.178 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-11T00:54:47.189 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-11T00:54:47.212 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-11T00:54:47.223 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-11T00:54:47.244 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-11T00:54:47.264 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-11T00:54:47.274 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-11T00:54:47.299 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-11T00:54:47.325 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-11T00:54:47.352 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-11T00:54:47.387 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-11T00:54:47.387 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-11T00:54:47.438 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-11T00:54:47.464 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-11T00:54:47.469 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-11T00:54:47.563 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-11T00:54:47.571 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-11T00:54:47.606 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-11T00:54:47.620 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-11T00:54:47.842 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-11T00:54:47.878 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-11T00:54:47.972 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-11T00:54:47.990 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-11T00:54:48.097 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-11T00:54:48.341 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-11T00:54:48.392 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-11T00:54:48.425 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-11T00:54:48.524 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-11T00:54:48.580 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-11T00:54:48.625 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-11T00:54:48.712 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-11T00:54:48.753 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-11T00:54:48.786 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-11T00:54:48.925 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-11T00:54:48.939 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-11T00:54:48.969 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-11T00:54:49.047 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-11T00:54:49.331 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-11T00:54:49.428 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-11T00:54:49.455 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-11T00:54:49.489 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-11T00:54:49.683 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-11T00:54:49.792 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-11T00:54:49.809 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-11T00:54:49.860 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:54:49.951 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:54:49.981 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-11T00:54:50.017 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-11T00:54:50.484 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-11T00:54:50.520 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-11T00:54:50.547 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:54:50.602 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-11T00:54:50.617 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:54:50.638 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-11T00:54:50.648 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-11T00:54:50.671 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-11T00:54:51.017 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-11T00:54:51.021 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-11T00:54:51.075 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:54:51.098 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-11T00:54:51.126 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-11T00:54:51.159 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-11T00:54:51.196 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:54:51.247 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-11T00:54:51.479 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-11T00:54:51.514 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:54:51.605 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 102/165 2024-09-11T00:54:51.619 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-11T00:54:51.627 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 103/165 2024-09-11T00:54:51.679 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-11T00:54:52.156 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-11T00:54:52.171 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-11T00:54:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:54:52.199 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:54:52.277 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:54:52.284 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 106/165 2024-09-11T00:54:52.304 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-11T00:54:52.310 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 107/165 2024-09-11T00:54:53.008 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:54:53.052 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:54:53.605 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:54:53.647 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:54:53.757 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:54:53.757 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T00:54:53.757 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T00:54:53.757 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:54:53.791 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:54:54.637 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:54:54.882 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:54:54.955 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:54:54.956 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:54:55.510 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:54:55.551 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:54:55.638 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 108/165 2024-09-11T00:54:55.677 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:54:55.677 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T00:54:55.677 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T00:54:55.677 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:54:55.704 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:54:55.710 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:54:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 109/165 2024-09-11T00:54:55.846 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-11T00:54:55.846 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-11T00:54:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:54:55.890 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:55:05.642 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:55:05.642 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /sys 2024-09-11T00:55:05.642 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /proc 2024-09-11T00:55:05.642 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /mnt 2024-09-11T00:55:05.643 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /var/tmp 2024-09-11T00:55:05.643 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /home 2024-09-11T00:55:05.643 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /root 2024-09-11T00:55:05.643 INFO:teuthology.orchestra.run.smithi183.stdout:skipping the directory /tmp 2024-09-11T00:55:05.643 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:55:05.819 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:55:05.836 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:55:05.836 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:05.836 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T00:55:05.837 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:55:07.339 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:55:07.366 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:55:07.366 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:07.366 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T00:55:07.366 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:55:07.367 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:55:07.367 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:55:07.598 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:55:07.622 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:55:07.622 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:07.622 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T00:55:07.622 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:55:07.622 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:55:07.622 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:55:07.734 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:55:07.734 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-09-11T00:55:07.734 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-09-11T00:55:07.734 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-09-11T00:55:07.734 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-09-11T00:55:07.734 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-09-11T00:55:07.734 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /root 2024-09-11T00:55:07.734 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-09-11T00:55:07.734 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:55:07.909 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:55:07.925 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:55:07.925 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:07.925 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T00:55:07.925 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:55:08.074 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:55:08.097 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:55:08.098 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:08.098 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T00:55:08.098 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:55:08.098 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:55:08.098 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:55:08.204 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-11T00:55:08.261 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-11T00:55:08.317 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-11T00:55:08.512 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-11T00:55:08.558 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-11T00:55:08.637 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-11T00:55:08.733 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-11T00:55:08.887 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 110/165 2024-09-11T00:55:08.887 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-09-11T00:55:08.887 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-09-11T00:55:08.887 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-09-11T00:55:08.887 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-09-11T00:55:08.887 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-09-11T00:55:08.887 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-09-11T00:55:08.887 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-09-11T00:55:08.887 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:55:08.891 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-11T00:55:08.933 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-11T00:55:08.965 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-11T00:55:08.993 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-11T00:55:09.080 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:55:09.116 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 111/165 2024-09-11T00:55:09.117 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:09.117 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-11T00:55:09.117 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:55:09.415 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:55:09.433 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:55:09.441 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:55:09.460 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:55:09.460 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:09.460 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T00:55:09.461 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:55:09.461 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:55:09.461 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:55:09.490 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-11T00:55:09.541 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-11T00:55:09.565 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:55:09.684 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:55:09.707 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:55:09.707 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:09.707 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T00:55:09.707 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:55:09.707 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:55:09.707 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:55:10.159 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:55:10.182 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:55:10.182 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:10.183 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T00:55:10.183 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:55:10.183 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:55:10.183 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:55:10.289 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-11T00:55:10.346 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-11T00:55:10.401 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-11T00:55:10.586 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-11T00:55:10.651 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-11T00:55:10.729 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-11T00:55:10.785 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:55:10.817 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-11T00:55:10.843 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 112/165 2024-09-11T00:55:10.843 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:10.843 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-11T00:55:10.843 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:55:10.843 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-11T00:55:10.843 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:55:10.965 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-11T00:55:11.001 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-11T00:55:11.033 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-11T00:55:11.061 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-11T00:55:11.094 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:55:11.145 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 113/165 2024-09-11T00:55:11.145 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:11.145 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-11T00:55:11.145 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:55:11.145 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-11T00:55:11.146 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:55:11.482 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:55:11.510 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:55:11.560 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-11T00:55:11.633 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-11T00:55:11.653 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:55:11.658 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:55:11.703 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 114/165 2024-09-11T00:55:11.704 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:11.704 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-11T00:55:11.704 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:55:11.704 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-11T00:55:11.704 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:55:11.862 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-11T00:55:11.922 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-11T00:55:11.986 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-11T00:55:12.211 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-11T00:55:12.282 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-11T00:55:12.360 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-11T00:55:12.469 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-11T00:55:12.643 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-11T00:55:12.695 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-11T00:55:12.738 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-11T00:55:12.764 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-11T00:55:12.788 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:55:12.846 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:55:13.474 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:55:13.507 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 126/165 2024-09-11T00:55:13.540 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 127/165 2024-09-11T00:55:13.620 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 128/165 2024-09-11T00:55:13.710 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:55:13.815 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:55:13.846 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:55:13.962 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:55:14.125 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-11T00:55:14.148 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:55:14.172 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:55:14.172 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:14.172 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T00:55:14.172 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:55:14.172 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:55:14.173 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:55:14.232 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:55:14.244 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:55:14.342 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-11T00:55:14.389 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-11T00:55:14.835 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:55:14.888 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:55:15.348 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-11T00:55:15.377 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:55:15.400 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:55:15.400 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:15.400 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T00:55:15.401 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:55:15.401 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:55:15.401 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:55:15.444 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:55:15.466 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:55:15.467 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:15.467 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T00:55:15.467 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:55:15.511 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:55:15.535 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:55:15.535 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:15.535 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T00:55:15.535 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:55:15.535 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:55:15.535 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:55:15.845 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:55:15.851 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:55:15.868 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:55:15.868 INFO:teuthology.orchestra.run.smithi183.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:15.869 INFO:teuthology.orchestra.run.smithi183.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T00:55:15.869 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:55:15.869 INFO:teuthology.orchestra.run.smithi183.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:55:15.869 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:55:15.880 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:55:15.993 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:55:16.167 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-11T00:55:16.199 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:55:16.223 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:55:16.223 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:16.223 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T00:55:16.223 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:55:16.224 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:55:16.224 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:55:16.274 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:55:16.286 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:55:16.385 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-11T00:55:16.439 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-11T00:55:17.328 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 129/165 2024-09-11T00:55:17.388 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-11T00:55:17.419 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:55:17.420 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:55:17.443 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:55:17.443 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:17.443 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T00:55:17.443 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:55:17.443 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:55:17.443 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:55:17.486 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:55:17.509 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:55:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:17.509 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T00:55:17.509 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:55:17.545 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:55:17.568 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:55:17.568 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:17.568 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T00:55:17.568 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:55:17.568 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:55:17.568 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:55:17.879 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:55:17.902 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:55:17.902 INFO:teuthology.orchestra.run.smithi117.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:17.902 INFO:teuthology.orchestra.run.smithi117.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T00:55:17.902 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:55:17.902 INFO:teuthology.orchestra.run.smithi117.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:55:17.902 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:55:18.506 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 130/165 2024-09-11T00:55:18.552 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:55:18.703 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 131/165 2024-09-11T00:55:18.875 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 132/165 2024-09-11T00:55:18.921 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:55:18.972 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 133/165 2024-09-11T00:55:18.973 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:18.973 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-11T00:55:18.973 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:55:18.973 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-11T00:55:18.973 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:55:19.030 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:55:19.056 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 134/165 2024-09-11T00:55:19.172 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 135/165 2024-09-11T00:55:19.233 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 136/165 2024-09-11T00:55:20.298 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-11T00:55:20.333 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:55:20.384 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 138/165 2024-09-11T00:55:20.384 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:20.384 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-11T00:55:20.384 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:55:20.384 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-11T00:55:20.384 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:55:20.433 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:55:20.484 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4854.g8f219 139/165 2024-09-11T00:55:20.484 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:20.484 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-11T00:55:20.484 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:55:20.542 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:55:20.557 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-11T00:55:20.595 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 140/165 2024-09-11T00:55:20.595 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:20.595 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-11T00:55:20.595 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:55:20.595 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-11T00:55:20.595 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:55:20.598 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-11T00:55:20.648 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-11T00:55:20.688 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-11T00:55:20.715 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-11T00:55:20.904 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-11T00:55:20.935 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:55:20.946 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-11T00:55:20.976 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-11T00:55:20.986 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 141/165 2024-09-11T00:55:20.986 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-11T00:55:20.986 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-11T00:55:20.986 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:55:20.986 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-11T00:55:20.987 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:55:21.006 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-11T00:55:21.043 INFO:teuthology.orchestra.run.smithi183.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-11T00:55:21.665 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:55:21.700 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:55:21.720 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:55:22.546 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-11T00:55:22.582 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-11T00:55:22.623 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-11T00:55:22.629 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-11T00:55:22.664 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-11T00:55:22.670 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-11T00:55:22.696 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-11T00:55:22.723 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-11T00:55:22.752 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-11T00:55:22.783 INFO:teuthology.orchestra.run.smithi183.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-11T00:55:22.809 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-11T00:55:22.834 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-11T00:55:22.835 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:55:22.902 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:55:22.902 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:55:22.902 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-11T00:55:22.962 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-11T00:55:22.986 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:55:22.992 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-11T00:55:23.011 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-11T00:55:23.016 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:55:23.016 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:55:23.022 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-11T00:55:23.068 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-11T00:55:23.196 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:55:23.196 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:55:23.280 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:55:23.343 INFO:teuthology.orchestra.run.smithi183.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:55:23.682 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:55:23.724 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:55:23.745 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:55:24.571 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-11T00:55:24.662 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-11T00:55:24.703 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-11T00:55:24.784 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-11T00:55:24.815 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-11T00:55:24.841 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-11T00:55:24.866 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-11T00:55:24.866 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:55:24.942 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:55:24.942 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:55:25.051 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:55:25.076 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-11T00:55:25.082 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:55:25.082 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:55:25.261 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:55:25.261 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:55:25.329 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:55:25.400 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:55:26.092 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 142/165 2024-09-11T00:55:26.132 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 143/165 2024-09-11T00:55:26.176 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 144/165 2024-09-11T00:55:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-11T00:55:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-11T00:55:26.509 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 147/165 2024-09-11T00:55:26.563 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-11T00:55:26.594 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 149/165 2024-09-11T00:55:26.651 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 150/165 2024-09-11T00:55:26.711 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 151/165 2024-09-11T00:55:27.478 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:55:27.526 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:55:27.567 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-11T00:55:28.832 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 153/165 2024-09-11T00:55:28.941 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-11T00:55:29.002 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-11T00:55:29.104 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-11T00:55:29.135 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-11T00:55:29.160 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-11T00:55:29.205 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-11T00:55:29.206 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:55:29.330 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-11T00:55:29.330 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:55:29.439 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-11T00:55:29.463 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-11T00:55:29.479 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:55:29.479 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:55:29.732 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-11T00:55:29.732 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:55:29.808 INFO:teuthology.orchestra.run.smithi183.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:55:29.809 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-11T00:55:29.809 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-11T00:55:29.809 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-11T00:55:29.809 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-11T00:55:29.809 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-11T00:55:29.809 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-11T00:55:29.809 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-11T00:55:29.809 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:55:29.809 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:55:29.809 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:55:29.809 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-11T00:55:29.809 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-11T00:55:29.809 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-11T00:55:29.809 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:55:29.810 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-11T00:55:29.810 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-11T00:55:29.810 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-11T00:55:29.810 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-11T00:55:29.810 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-11T00:55:29.810 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-11T00:55:29.810 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-11T00:55:29.810 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-11T00:55:29.810 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-11T00:55:29.810 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-11T00:55:29.810 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-11T00:55:29.810 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-11T00:55:29.810 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-11T00:55:29.811 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-11T00:55:29.811 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-11T00:55:29.811 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-11T00:55:29.811 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-11T00:55:29.822 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-11T00:55:29.822 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-11T00:55:29.823 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-11T00:55:29.823 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-11T00:55:29.823 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-11T00:55:29.823 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-11T00:55:29.823 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-11T00:55:29.823 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-11T00:55:29.823 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-11T00:55:29.823 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-11T00:55:29.823 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-11T00:55:29.823 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-11T00:55:29.823 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-11T00:55:29.823 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-11T00:55:29.824 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-11T00:55:29.824 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-11T00:55:29.824 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-11T00:55:29.824 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-11T00:55:29.824 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-11T00:55:29.824 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-11T00:55:29.824 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-11T00:55:29.824 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-11T00:55:29.824 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-11T00:55:29.824 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-11T00:55:29.824 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-11T00:55:29.824 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-11T00:55:29.824 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-11T00:55:29.824 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-11T00:55:29.825 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-11T00:55:29.825 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-11T00:55:29.825 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-11T00:55:29.825 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-11T00:55:29.825 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-11T00:55:29.825 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-11T00:55:29.825 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-11T00:55:29.825 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-11T00:55:29.825 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-11T00:55:29.825 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-11T00:55:29.825 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-11T00:55:29.825 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-11T00:55:29.825 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-11T00:55:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-11T00:55:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-11T00:55:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-11T00:55:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-11T00:55:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-11T00:55:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-11T00:55:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-11T00:55:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-11T00:55:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-11T00:55:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-11T00:55:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-11T00:55:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-11T00:55:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-11T00:55:29.826 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-11T00:55:29.827 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-11T00:55:29.827 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-11T00:55:29.827 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-11T00:55:29.827 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-11T00:55:29.827 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-11T00:55:29.827 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-11T00:55:29.827 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-11T00:55:29.827 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-11T00:55:29.827 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-11T00:55:29.827 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-11T00:55:29.827 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-11T00:55:29.827 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-11T00:55:29.827 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-11T00:55:29.827 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-11T00:55:29.828 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-11T00:55:29.829 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-11T00:55:29.829 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-11T00:55:29.829 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-11T00:55:29.829 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-11T00:55:29.829 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-11T00:55:29.829 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-11T00:55:29.829 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-11T00:55:29.829 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-11T00:55:29.829 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-11T00:55:29.829 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-11T00:55:29.829 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-11T00:55:29.829 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-11T00:55:29.829 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-11T00:55:29.829 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-11T00:55:29.830 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-11T00:55:29.830 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-11T00:55:29.830 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-11T00:55:29.830 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-11T00:55:29.830 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-11T00:55:29.830 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-11T00:55:29.830 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-11T00:55:29.830 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-11T00:55:29.830 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-11T00:55:29.830 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-11T00:55:29.830 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-11T00:55:29.830 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-11T00:55:29.830 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-11T00:55:29.830 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-11T00:55:29.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-11T00:55:29.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-11T00:55:29.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-11T00:55:29.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-11T00:55:29.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-11T00:55:29.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-11T00:55:29.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-11T00:55:29.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-11T00:55:29.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-11T00:55:29.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-11T00:55:29.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-11T00:55:29.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-11T00:55:29.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-11T00:55:29.831 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-11T00:55:29.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-11T00:55:29.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-11T00:55:29.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-11T00:55:29.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-11T00:55:29.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-11T00:55:29.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-11T00:55:29.832 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-11T00:55:29.876 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-11T00:55:29.957 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:55:30.168 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:55:30.169 INFO:teuthology.orchestra.run.smithi103.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-11T00:55:30.169 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:55:31.491 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:55:31.491 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-11T00:55:31.491 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-11T00:55:31.491 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-11T00:55:31.492 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-11T00:55:31.492 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-11T00:55:31.492 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-11T00:55:31.492 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-11T00:55:31.492 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:55:31.492 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:55:31.492 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:55:31.492 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-11T00:55:31.492 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-11T00:55:31.492 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-11T00:55:31.492 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:55:31.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-11T00:55:31.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-11T00:55:31.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-11T00:55:31.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-11T00:55:31.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-11T00:55:31.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-11T00:55:31.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-11T00:55:31.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-11T00:55:31.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-11T00:55:31.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-11T00:55:31.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-11T00:55:31.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-11T00:55:31.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-11T00:55:31.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-11T00:55:31.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-11T00:55:31.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-11T00:55:31.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-11T00:55:31.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-11T00:55:31.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-11T00:55:31.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-11T00:55:31.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-11T00:55:31.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-11T00:55:31.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-11T00:55:31.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-11T00:55:31.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-11T00:55:31.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-11T00:55:31.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-11T00:55:31.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-11T00:55:31.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-11T00:55:31.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-11T00:55:31.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-11T00:55:31.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-11T00:55:31.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-11T00:55:31.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-11T00:55:31.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-11T00:55:31.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-11T00:55:31.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-11T00:55:31.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-11T00:55:31.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-11T00:55:31.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-11T00:55:31.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-11T00:55:31.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-11T00:55:31.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-11T00:55:31.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-11T00:55:31.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-11T00:55:31.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-11T00:55:31.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-11T00:55:31.497 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-11T00:55:31.497 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-11T00:55:31.497 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-11T00:55:31.497 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-11T00:55:31.497 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-11T00:55:31.497 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-11T00:55:31.497 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-11T00:55:31.497 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-11T00:55:31.497 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-11T00:55:31.497 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-11T00:55:31.497 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-11T00:55:31.498 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-11T00:55:31.498 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-11T00:55:31.498 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-11T00:55:31.498 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-11T00:55:31.498 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-11T00:55:31.498 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-11T00:55:31.498 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-11T00:55:31.498 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-11T00:55:31.498 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-11T00:55:31.498 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-11T00:55:31.498 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-11T00:55:31.498 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-11T00:55:31.499 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-11T00:55:31.499 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-11T00:55:31.499 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-11T00:55:31.499 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-11T00:55:31.499 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-11T00:55:31.499 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-11T00:55:31.499 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-11T00:55:31.499 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-11T00:55:31.499 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-11T00:55:31.499 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-11T00:55:31.499 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-11T00:55:31.499 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-11T00:55:31.500 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-11T00:55:31.500 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-11T00:55:31.500 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-11T00:55:31.500 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-11T00:55:31.500 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-11T00:55:31.500 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-11T00:55:31.500 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-11T00:55:31.500 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-11T00:55:31.500 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-11T00:55:31.500 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-11T00:55:31.500 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-11T00:55:31.500 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-11T00:55:31.501 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-11T00:55:31.501 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-11T00:55:31.501 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-11T00:55:31.501 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-11T00:55:31.501 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-11T00:55:31.501 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-11T00:55:31.501 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-11T00:55:31.501 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-11T00:55:31.501 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-11T00:55:31.501 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-11T00:55:31.501 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-11T00:55:31.502 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-11T00:55:31.502 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-11T00:55:31.502 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-11T00:55:31.502 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-11T00:55:31.502 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-11T00:55:31.502 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-11T00:55:31.502 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-11T00:55:31.502 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-11T00:55:31.503 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-11T00:55:31.503 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-11T00:55:31.503 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-11T00:55:31.503 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-11T00:55:31.503 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-11T00:55:31.503 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-11T00:55:31.503 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-11T00:55:31.503 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-11T00:55:31.503 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-11T00:55:31.503 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-11T00:55:31.503 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-11T00:55:31.504 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-11T00:55:31.504 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-11T00:55:31.504 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-11T00:55:31.504 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-11T00:55:31.504 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-11T00:55:31.504 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-11T00:55:31.504 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-11T00:55:31.504 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-11T00:55:31.504 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-11T00:55:31.504 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-11T00:55:31.504 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-11T00:55:31.504 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-11T00:55:31.505 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-11T00:55:31.505 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-11T00:55:31.505 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-11T00:55:31.505 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-11T00:55:31.505 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-11T00:55:31.505 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-11T00:55:31.505 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-11T00:55:31.505 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-11T00:55:31.505 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-11T00:55:31.505 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-11T00:55:31.505 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-11T00:55:31.506 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-11T00:55:31.506 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-11T00:55:31.506 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-11T00:55:32.431 INFO:teuthology.orchestra.run.smithi183.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:55:32.431 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:55:32.431 INFO:teuthology.orchestra.run.smithi183.stdout:Upgraded: 2024-09-11T00:55:32.431 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T00:55:32.431 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T00:55:32.431 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T00:55:32.432 INFO:teuthology.orchestra.run.smithi183.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T00:55:32.432 INFO:teuthology.orchestra.run.smithi183.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.432 INFO:teuthology.orchestra.run.smithi183.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.432 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T00:55:32.432 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T00:55:32.432 INFO:teuthology.orchestra.run.smithi183.stdout:Installed: 2024-09-11T00:55:32.432 INFO:teuthology.orchestra.run.smithi183.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T00:55:32.432 INFO:teuthology.orchestra.run.smithi183.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T00:55:32.432 INFO:teuthology.orchestra.run.smithi183.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T00:55:32.432 INFO:teuthology.orchestra.run.smithi183.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T00:55:32.432 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.433 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.433 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.433 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.433 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:32.433 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.433 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.433 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.433 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:32.433 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:32.433 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:32.433 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:32.434 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:32.434 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.434 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.434 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:32.434 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.434 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.434 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.434 INFO:teuthology.orchestra.run.smithi183.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:32.434 INFO:teuthology.orchestra.run.smithi183.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:32.434 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.434 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.435 INFO:teuthology.orchestra.run.smithi183.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:32.435 INFO:teuthology.orchestra.run.smithi183.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T00:55:32.435 INFO:teuthology.orchestra.run.smithi183.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T00:55:32.435 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T00:55:32.435 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T00:55:32.435 INFO:teuthology.orchestra.run.smithi183.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T00:55:32.435 INFO:teuthology.orchestra.run.smithi183.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T00:55:32.435 INFO:teuthology.orchestra.run.smithi183.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T00:55:32.435 INFO:teuthology.orchestra.run.smithi183.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T00:55:32.435 INFO:teuthology.orchestra.run.smithi183.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T00:55:32.435 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T00:55:32.435 INFO:teuthology.orchestra.run.smithi183.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T00:55:32.436 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.436 INFO:teuthology.orchestra.run.smithi183.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.436 INFO:teuthology.orchestra.run.smithi183.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.436 INFO:teuthology.orchestra.run.smithi183.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T00:55:32.436 INFO:teuthology.orchestra.run.smithi183.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T00:55:32.436 INFO:teuthology.orchestra.run.smithi183.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T00:55:32.436 INFO:teuthology.orchestra.run.smithi183.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T00:55:32.436 INFO:teuthology.orchestra.run.smithi183.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T00:55:32.436 INFO:teuthology.orchestra.run.smithi183.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T00:55:32.436 INFO:teuthology.orchestra.run.smithi183.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.436 INFO:teuthology.orchestra.run.smithi183.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.437 INFO:teuthology.orchestra.run.smithi183.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T00:55:32.437 INFO:teuthology.orchestra.run.smithi183.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.437 INFO:teuthology.orchestra.run.smithi183.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T00:55:32.437 INFO:teuthology.orchestra.run.smithi183.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T00:55:32.437 INFO:teuthology.orchestra.run.smithi183.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T00:55:32.437 INFO:teuthology.orchestra.run.smithi183.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T00:55:32.437 INFO:teuthology.orchestra.run.smithi183.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T00:55:32.437 INFO:teuthology.orchestra.run.smithi183.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T00:55:32.438 INFO:teuthology.orchestra.run.smithi183.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T00:55:32.438 INFO:teuthology.orchestra.run.smithi183.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T00:55:32.438 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T00:55:32.438 INFO:teuthology.orchestra.run.smithi183.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T00:55:32.438 INFO:teuthology.orchestra.run.smithi183.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T00:55:32.438 INFO:teuthology.orchestra.run.smithi183.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T00:55:32.438 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T00:55:32.438 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T00:55:32.438 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T00:55:32.438 INFO:teuthology.orchestra.run.smithi183.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T00:55:32.438 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T00:55:32.439 INFO:teuthology.orchestra.run.smithi183.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T00:55:32.439 INFO:teuthology.orchestra.run.smithi183.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T00:55:32.439 INFO:teuthology.orchestra.run.smithi183.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T00:55:32.439 INFO:teuthology.orchestra.run.smithi183.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T00:55:32.439 INFO:teuthology.orchestra.run.smithi183.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T00:55:32.439 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T00:55:32.439 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.439 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.439 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.439 INFO:teuthology.orchestra.run.smithi183.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T00:55:32.440 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T00:55:32.440 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T00:55:32.440 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T00:55:32.440 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T00:55:32.440 INFO:teuthology.orchestra.run.smithi183.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T00:55:32.440 INFO:teuthology.orchestra.run.smithi183.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T00:55:32.440 INFO:teuthology.orchestra.run.smithi183.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T00:55:32.440 INFO:teuthology.orchestra.run.smithi183.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T00:55:32.440 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T00:55:32.440 INFO:teuthology.orchestra.run.smithi183.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T00:55:32.441 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T00:55:32.441 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T00:55:32.441 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T00:55:32.441 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T00:55:32.441 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T00:55:32.441 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T00:55:32.441 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T00:55:32.441 INFO:teuthology.orchestra.run.smithi183.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T00:55:32.442 INFO:teuthology.orchestra.run.smithi183.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T00:55:32.442 INFO:teuthology.orchestra.run.smithi183.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T00:55:32.442 INFO:teuthology.orchestra.run.smithi183.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T00:55:32.442 INFO:teuthology.orchestra.run.smithi183.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T00:55:32.442 INFO:teuthology.orchestra.run.smithi183.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T00:55:32.442 INFO:teuthology.orchestra.run.smithi183.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T00:55:32.442 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T00:55:32.442 INFO:teuthology.orchestra.run.smithi183.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T00:55:32.442 INFO:teuthology.orchestra.run.smithi183.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T00:55:32.442 INFO:teuthology.orchestra.run.smithi183.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T00:55:32.442 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T00:55:32.443 INFO:teuthology.orchestra.run.smithi183.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T00:55:32.443 INFO:teuthology.orchestra.run.smithi183.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T00:55:32.443 INFO:teuthology.orchestra.run.smithi183.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T00:55:32.443 INFO:teuthology.orchestra.run.smithi183.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T00:55:32.443 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T00:55:32.443 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T00:55:32.443 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T00:55:32.443 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T00:55:32.443 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T00:55:32.443 INFO:teuthology.orchestra.run.smithi183.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T00:55:32.443 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.443 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.443 INFO:teuthology.orchestra.run.smithi183.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T00:55:32.443 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T00:55:32.444 INFO:teuthology.orchestra.run.smithi183.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T00:55:32.444 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.444 INFO:teuthology.orchestra.run.smithi183.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T00:55:32.444 INFO:teuthology.orchestra.run.smithi183.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T00:55:32.444 INFO:teuthology.orchestra.run.smithi183.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T00:55:32.444 INFO:teuthology.orchestra.run.smithi183.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T00:55:32.444 INFO:teuthology.orchestra.run.smithi183.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T00:55:32.444 INFO:teuthology.orchestra.run.smithi183.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T00:55:32.444 INFO:teuthology.orchestra.run.smithi183.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T00:55:32.444 INFO:teuthology.orchestra.run.smithi183.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T00:55:32.444 INFO:teuthology.orchestra.run.smithi183.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T00:55:32.444 INFO:teuthology.orchestra.run.smithi183.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T00:55:32.444 INFO:teuthology.orchestra.run.smithi183.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T00:55:32.445 INFO:teuthology.orchestra.run.smithi183.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T00:55:32.445 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T00:55:32.445 INFO:teuthology.orchestra.run.smithi183.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T00:55:32.445 INFO:teuthology.orchestra.run.smithi183.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T00:55:32.445 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.445 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.445 INFO:teuthology.orchestra.run.smithi183.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:32.445 INFO:teuthology.orchestra.run.smithi183.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T00:55:32.445 INFO:teuthology.orchestra.run.smithi183.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T00:55:32.445 INFO:teuthology.orchestra.run.smithi183.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T00:55:32.445 INFO:teuthology.orchestra.run.smithi183.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T00:55:32.445 INFO:teuthology.orchestra.run.smithi183.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T00:55:32.445 INFO:teuthology.orchestra.run.smithi183.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T00:55:32.446 INFO:teuthology.orchestra.run.smithi183.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T00:55:32.446 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:55:32.446 INFO:teuthology.orchestra.run.smithi183.stdout:Complete! 2024-09-11T00:55:32.853 DEBUG:teuthology.parallel:result is None 2024-09-11T00:55:34.057 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:55:34.057 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:55:34.057 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-09-11T00:55:34.057 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T00:55:34.057 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T00:55:34.057 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T00:55:34.057 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T00:55:34.057 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.057 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T00:55:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T00:55:34.058 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-09-11T00:55:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T00:55:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T00:55:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T00:55:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T00:55:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.058 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.059 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T00:55:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T00:55:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T00:55:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T00:55:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T00:55:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T00:55:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T00:55:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T00:55:34.060 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T00:55:34.061 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T00:55:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T00:55:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T00:55:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T00:55:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T00:55:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T00:55:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T00:55:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T00:55:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T00:55:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T00:55:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T00:55:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T00:55:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T00:55:34.062 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T00:55:34.063 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T00:55:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T00:55:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T00:55:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T00:55:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T00:55:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T00:55:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T00:55:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T00:55:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T00:55:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T00:55:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T00:55:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T00:55:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T00:55:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T00:55:34.064 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T00:55:34.065 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T00:55:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T00:55:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T00:55:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T00:55:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T00:55:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T00:55:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T00:55:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T00:55:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T00:55:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T00:55:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T00:55:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T00:55:34.066 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T00:55:34.067 INFO:teuthology.orchestra.run.smithi117.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T00:55:34.068 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.068 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.068 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:34.068 INFO:teuthology.orchestra.run.smithi117.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T00:55:34.068 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T00:55:34.068 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T00:55:34.068 INFO:teuthology.orchestra.run.smithi117.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T00:55:34.068 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T00:55:34.068 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T00:55:34.069 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T00:55:34.069 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:55:34.069 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-09-11T00:55:34.476 DEBUG:teuthology.parallel:result is None 2024-09-11T00:55:36.749 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 1/165 2024-09-11T00:55:36.749 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2/165 2024-09-11T00:55:36.749 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 3/165 2024-09-11T00:55:36.749 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 4/165 2024-09-11T00:55:36.749 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4854.g8f219 5/165 2024-09-11T00:55:36.749 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 6/165 2024-09-11T00:55:36.749 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 7/165 2024-09-11T00:55:36.749 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 8/165 2024-09-11T00:55:36.750 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 9/165 2024-09-11T00:55:36.750 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 10/165 2024-09-11T00:55:36.764 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 11/165 2024-09-11T00:55:36.764 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 12/165 2024-09-11T00:55:36.765 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 13/165 2024-09-11T00:55:36.765 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 14/165 2024-09-11T00:55:36.765 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_ 15/165 2024-09-11T00:55:36.765 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 16/165 2024-09-11T00:55:36.765 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 17/165 2024-09-11T00:55:36.765 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_6 18/165 2024-09-11T00:55:36.765 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86 19/165 2024-09-11T00:55:36.765 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 20/165 2024-09-11T00:55:36.765 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el 21/165 2024-09-11T00:55:36.765 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:19.3.0-4854.g8f219c47.el9. 22/165 2024-09-11T00:55:36.765 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_6 23/165 2024-09-11T00:55:36.765 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 24/165 2024-09-11T00:55:36.766 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 25/165 2024-09-11T00:55:36.766 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 26/165 2024-09-11T00:55:36.766 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 27/165 2024-09-11T00:55:36.766 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 28/165 2024-09-11T00:55:36.766 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 29/165 2024-09-11T00:55:36.766 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47. 30/165 2024-09-11T00:55:36.766 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noa 31/165 2024-09-11T00:55:36.766 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.n 32/165 2024-09-11T00:55:36.766 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f2 33/165 2024-09-11T00:55:36.766 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el 34/165 2024-09-11T00:55:36.766 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 35/165 2024-09-11T00:55:36.766 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.e 36/165 2024-09-11T00:55:36.766 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 37/165 2024-09-11T00:55:36.766 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 38/165 2024-09-11T00:55:36.767 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 39/165 2024-09-11T00:55:36.767 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-11T00:55:36.767 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-11T00:55:36.767 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-11T00:55:36.767 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-11T00:55:36.767 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-11T00:55:36.767 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-11T00:55:36.767 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-11T00:55:36.767 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-11T00:55:36.767 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-11T00:55:36.767 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-11T00:55:36.767 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-11T00:55:36.767 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-11T00:55:36.767 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-11T00:55:36.768 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-11T00:55:36.768 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-11T00:55:36.768 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-11T00:55:36.768 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-11T00:55:36.768 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-11T00:55:36.768 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-11T00:55:36.768 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-11T00:55:36.768 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-11T00:55:36.768 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-11T00:55:36.768 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-11T00:55:36.768 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-11T00:55:36.768 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-11T00:55:36.768 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-11T00:55:36.769 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-11T00:55:36.769 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-11T00:55:36.769 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-11T00:55:36.769 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-11T00:55:36.769 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-11T00:55:36.769 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-11T00:55:36.769 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-11T00:55:36.769 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-11T00:55:36.769 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-11T00:55:36.769 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-11T00:55:36.769 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-11T00:55:36.769 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-11T00:55:36.769 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-11T00:55:36.770 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-11T00:55:36.770 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-11T00:55:36.770 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-11T00:55:36.770 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-11T00:55:36.770 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-11T00:55:36.770 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-11T00:55:36.770 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-11T00:55:36.770 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-11T00:55:36.770 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-11T00:55:36.770 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-11T00:55:36.770 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-11T00:55:36.770 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-11T00:55:36.771 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-11T00:55:36.771 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-11T00:55:36.771 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-11T00:55:36.771 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-11T00:55:36.771 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-11T00:55:36.771 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-11T00:55:36.771 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-11T00:55:36.771 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-11T00:55:36.771 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-11T00:55:36.771 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-11T00:55:36.771 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-11T00:55:36.771 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-11T00:55:36.771 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-11T00:55:36.772 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-11T00:55:36.772 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-11T00:55:36.772 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-11T00:55:36.772 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-11T00:55:36.772 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/165 2024-09-11T00:55:36.772 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-11T00:55:36.772 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-11T00:55:36.772 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-11T00:55:36.772 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-11T00:55:36.772 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-11T00:55:36.772 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-11T00:55:36.772 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-11T00:55:36.772 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-11T00:55:36.772 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-11T00:55:36.773 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-11T00:55:36.773 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-11T00:55:36.773 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-11T00:55:36.773 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-11T00:55:36.773 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-11T00:55:36.773 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-11T00:55:36.773 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-11T00:55:36.773 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-11T00:55:36.773 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-11T00:55:36.773 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-11T00:55:36.773 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-11T00:55:36.773 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-11T00:55:36.773 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-11T00:55:36.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-11T00:55:36.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-11T00:55:36.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-11T00:55:36.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-11T00:55:36.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-11T00:55:36.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-11T00:55:36.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-11T00:55:36.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-11T00:55:36.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-11T00:55:36.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-11T00:55:36.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-11T00:55:36.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-11T00:55:36.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-11T00:55:36.774 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-11T00:55:36.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-11T00:55:36.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-11T00:55:36.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-11T00:55:36.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-11T00:55:36.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-11T00:55:36.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 150/165 2024-09-11T00:55:36.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-11T00:55:36.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 152/165 2024-09-11T00:55:36.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-11T00:55:36.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 154/165 2024-09-11T00:55:36.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-11T00:55:36.775 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 156/165 2024-09-11T00:55:36.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-11T00:55:36.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 158/165 2024-09-11T00:55:36.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-11T00:55:36.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 160/165 2024-09-11T00:55:36.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-11T00:55:36.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-11T00:55:36.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-11T00:55:36.776 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-11T00:55:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-11T00:55:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:55:39.023 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-09-11T00:55:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-11T00:55:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-11T00:55:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-11T00:55:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-11T00:55:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-11T00:55:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-11T00:55:39.024 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-09-11T00:55:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-11T00:55:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: automake-1.16.2-8.el9.noarch 2024-09-11T00:55:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: bison-3.7.4-5.el9.x86_64 2024-09-11T00:55:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-11T00:55:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top-2:19.3.0-4854.g8f219c47.el9.noarch 2024-09-11T00:55:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-11T00:55:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: flex-2.6.4-9.el9.x86_64 2024-09-11T00:55:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-11T00:55:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-11T00:55:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-11T00:55:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-11T00:55:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-11T00:55:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-11T00:55:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-11T00:55:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-11T00:55:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-11T00:55:39.028 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.028 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.028 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.028 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-11T00:55:39.028 INFO:teuthology.orchestra.run.smithi103.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-11T00:55:39.028 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-11T00:55:39.028 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-11T00:55:39.029 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-11T00:55:39.029 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-11T00:55:39.029 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.029 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.030 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-11T00:55:39.030 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.030 INFO:teuthology.orchestra.run.smithi103.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-11T00:55:39.030 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-11T00:55:39.030 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-11T00:55:39.031 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-11T00:55:39.031 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-11T00:55:39.031 INFO:teuthology.orchestra.run.smithi103.stdout: lua-5.4.4-4.el9.x86_64 2024-09-11T00:55:39.031 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-11T00:55:39.032 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-11T00:55:39.032 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-11T00:55:39.032 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-11T00:55:39.032 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-11T00:55:39.032 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-11T00:55:39.033 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-13.16-1.el9.x86_64 2024-09-11T00:55:39.033 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-11T00:55:39.033 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-11T00:55:39.033 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-11T00:55:39.033 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-11T00:55:39.034 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-11T00:55:39.034 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-11T00:55:39.034 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-11T00:55:39.034 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-11T00:55:39.034 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-11T00:55:39.035 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-11T00:55:39.035 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.035 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.035 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.035 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-11T00:55:39.036 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-11T00:55:39.036 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-11T00:55:39.036 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-11T00:55:39.036 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-11T00:55:39.036 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-11T00:55:39.036 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-11T00:55:39.037 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-11T00:55:39.037 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-11T00:55:39.037 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-11T00:55:39.037 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-11T00:55:39.037 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-11T00:55:39.038 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-11T00:55:39.038 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-11T00:55:39.038 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-11T00:55:39.038 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-11T00:55:39.038 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-11T00:55:39.039 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-11T00:55:39.039 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-11T00:55:39.039 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-11T00:55:39.039 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-11T00:55:39.039 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-11T00:55:39.039 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-11T00:55:39.040 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-11T00:55:39.040 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-11T00:55:39.040 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-11T00:55:39.040 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-11T00:55:39.040 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-11T00:55:39.040 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-11T00:55:39.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-11T00:55:39.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-09-11T00:55:39.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-11T00:55:39.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-11T00:55:39.041 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-11T00:55:39.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-11T00:55:39.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-11T00:55:39.042 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-11T00:55:39.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-11T00:55:39.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-11T00:55:39.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-11T00:55:39.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-11T00:55:39.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-11T00:55:39.043 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-11T00:55:39.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-11T00:55:39.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-11T00:55:39.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-11T00:55:39.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-11T00:55:39.044 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-11T00:55:39.045 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-11T00:55:39.045 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-11T00:55:39.045 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-11T00:55:39.045 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-11T00:55:39.045 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-11T00:55:39.045 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-11T00:55:39.045 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-11T00:55:39.045 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-11T00:55:39.045 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-11T00:55:39.045 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-11T00:55:39.045 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.045 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.045 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:19.3.0-4854.g8f219c47.el9.x86_64 2024-09-11T00:55:39.046 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-20.el9.x86_64 2024-09-11T00:55:39.046 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-11T00:55:39.046 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-11T00:55:39.046 INFO:teuthology.orchestra.run.smithi103.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-11T00:55:39.046 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-11T00:55:39.046 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-11T00:55:39.047 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-11T00:55:39.047 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:55:39.047 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-09-11T00:55:39.700 DEBUG:teuthology.parallel:result is None 2024-09-11T00:55:39.700 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:55:39.853 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T00:55:39.899 INFO:teuthology.orchestra.run.smithi103.stdout:19.3.0-4854.g8f219c47.el9 2024-09-11T00:55:39.900 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-11T00:55:39.900 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-11T00:55:39.902 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:55:40.048 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T00:55:40.075 INFO:teuthology.orchestra.run.smithi117.stdout:19.3.0-4854.g8f219c47.el9 2024-09-11T00:55:40.075 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-11T00:55:40.075 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-11T00:55:40.077 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:55:40.227 DEBUG:teuthology.orchestra.run.smithi183:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-11T00:55:40.254 INFO:teuthology.orchestra.run.smithi183.stdout:19.3.0-4854.g8f219c47.el9 2024-09-11T00:55:40.254 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4854.g8f219c47.el9 2024-09-11T00:55:40.254 INFO:teuthology.task.install:The correct ceph version 19.3.0-4854.g8f219c47 is installed. 2024-09-11T00:55:40.256 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T00:55:40.256 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T00:55:40.256 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T00:55:40.321 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T00:55:40.321 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T00:55:40.353 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-11T00:55:40.353 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T00:55:40.386 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T00:55:40.387 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T00:55:40.387 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T00:55:40.451 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T00:55:40.551 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T00:55:40.551 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T00:55:40.581 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T00:55:40.651 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-11T00:55:40.652 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T00:55:40.682 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T00:55:40.750 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T00:55:40.750 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T00:55:40.751 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T00:55:40.807 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T00:55:40.905 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T00:55:40.905 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T00:55:40.934 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T00:55:41.003 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-11T00:55:41.003 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T00:55:41.033 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T00:55:41.102 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T00:55:41.102 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T00:55:41.102 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T00:55:41.159 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T00:55:41.257 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T00:55:41.257 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T00:55:41.287 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T00:55:41.354 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-11T00:55:41.354 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T00:55:41.384 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T00:55:41.453 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-11T00:55:41.558 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'global': {'ms die on skipped message': False}, 'mds': {'mds_export_ephemeral_random_max': 0.1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'filestore flush min': 0, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd heartbeat grace': 60, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'SLOW_OPS', 'slow request'], 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-11T00:55:41.559 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:55:41.559 INFO:tasks.cephadm:Cluster fsid is 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:55:41.559 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-11T00:55:41.560 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.103', 'mon.b': '172.21.15.117', 'mon.c': '172.21.15.183'} 2024-09-11T00:55:41.560 INFO:tasks.cephadm:First mon is mon.a on smithi103 2024-09-11T00:55:41.560 INFO:tasks.cephadm:First mgr is x 2024-09-11T00:55:41.560 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-11T00:55:41.560 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname $(hostname -s) 2024-09-11T00:55:41.618 DEBUG:teuthology.orchestra.run.smithi117:> sudo hostname $(hostname -s) 2024-09-11T00:55:41.644 DEBUG:teuthology.orchestra.run.smithi183:> sudo hostname $(hostname -s) 2024-09-11T00:55:41.674 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-11T00:55:41.674 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:55:41.827 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8f219c476cb4f26fc5719c661c0323719a45cb30', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/82938/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-4854-g8f219c47', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-4854.g8f219c47'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-10 09:27:13.215997', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-hemanth-testing-2024-09-10-0723', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-11T00:55:41.981 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-hemanth-testing-2024-09-10-0723, sha1 8f219c476cb4f26fc5719c661c0323719a45cb30 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:55:41.982 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-11T00:55:41.982 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm 2024-09-11T00:55:41.982 DEBUG:teuthology.orchestra.run.smithi103:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T00:55:42.411 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 11 00:55 /home/ubuntu/cephtest/cephadm 2024-09-11T00:55:42.412 DEBUG:teuthology.orchestra.run.smithi117:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T00:55:42.775 INFO:teuthology.orchestra.run.smithi117.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 11 00:55 /home/ubuntu/cephtest/cephadm 2024-09-11T00:55:42.775 DEBUG:teuthology.orchestra.run.smithi183:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-hemanth-testing-2024-09-10-0723/8f219c476cb4f26fc5719c661c0323719a45cb30/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-11T00:55:43.145 INFO:teuthology.orchestra.run.smithi183.stdout:-rw-r--r--. 1 ubuntu ubuntu 803561 Sep 11 00:55 /home/ubuntu/cephtest/cephadm 2024-09-11T00:55:43.145 DEBUG:teuthology.orchestra.run.smithi103:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T00:55:43.184 DEBUG:teuthology.orchestra.run.smithi117:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T00:55:43.201 DEBUG:teuthology.orchestra.run.smithi183:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-11T00:55:43.237 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 on all hosts... 2024-09-11T00:55:43.237 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-11T00:55:43.241 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-11T00:55:43.243 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 pull 2024-09-11T00:55:44.745 INFO:teuthology.orchestra.run.smithi117.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-11T00:55:45.009 INFO:teuthology.orchestra.run.smithi183.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-11T00:55:45.247 INFO:teuthology.orchestra.run.smithi103.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-11T00:56:15.349 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-11T00:56:15.349 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T00:56:15.349 INFO:teuthology.orchestra.run.smithi183.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-11T00:56:15.349 INFO:teuthology.orchestra.run.smithi183.stdout: "repo_digests": [ 2024-09-11T00:56:15.349 INFO:teuthology.orchestra.run.smithi183.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-11T00:56:15.349 INFO:teuthology.orchestra.run.smithi183.stdout: ] 2024-09-11T00:56:15.350 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-11T00:56:17.682 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-11T00:56:17.682 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T00:56:17.683 INFO:teuthology.orchestra.run.smithi117.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-11T00:56:17.683 INFO:teuthology.orchestra.run.smithi117.stdout: "repo_digests": [ 2024-09-11T00:56:17.683 INFO:teuthology.orchestra.run.smithi117.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-11T00:56:17.683 INFO:teuthology.orchestra.run.smithi117.stdout: ] 2024-09-11T00:56:17.683 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-11T00:56:22.865 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T00:56:22.865 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T00:56:22.865 INFO:teuthology.orchestra.run.smithi103.stdout: "image_id": "589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480", 2024-09-11T00:56:22.866 INFO:teuthology.orchestra.run.smithi103.stdout: "repo_digests": [ 2024-09-11T00:56:22.866 INFO:teuthology.orchestra.run.smithi103.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e" 2024-09-11T00:56:22.866 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-11T00:56:22.866 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T00:56:22.899 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph 2024-09-11T00:56:22.958 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph 2024-09-11T00:56:22.991 DEBUG:teuthology.orchestra.run.smithi183:> sudo mkdir -p /etc/ceph 2024-09-11T00:56:23.025 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /etc/ceph 2024-09-11T00:56:23.081 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /etc/ceph 2024-09-11T00:56:23.111 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 777 /etc/ceph 2024-09-11T00:56:23.140 INFO:tasks.cephadm:Writing seed config... 2024-09-11T00:56:23.141 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-11T00:56:23.141 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-11T00:56:23.142 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-11T00:56:23.142 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-11T00:56:23.142 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-11T00:56:23.142 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-11T00:56:23.142 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-11T00:56:23.142 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-11T00:56:23.142 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-11T00:56:23.142 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-11T00:56:23.142 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-11T00:56:23.142 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-11T00:56:23.142 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-11T00:56:23.142 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-11T00:56:23.142 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-11T00:56:23.143 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-11T00:56:23.143 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-11T00:56:23.143 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-11T00:56:23.143 INFO:tasks.cephadm: override: [osd] filestore flush min = 0 2024-09-11T00:56:23.143 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-11T00:56:23.143 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-11T00:56:23.143 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-11T00:56:23.143 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-11T00:56:23.143 INFO:tasks.cephadm: override: [osd] osd heartbeat grace = 60 2024-09-11T00:56:23.143 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-11T00:56:23.143 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-11T00:56:23.143 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-11T00:56:23.144 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T00:56:23.144 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-11T00:56:23.179 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 917288bc-6fd8-11ef-bcea-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 filestore flush min = 0 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd heartbeat grace = 60 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_export_ephemeral_random_max = 0.1 2024-09-11T00:56:23.180 DEBUG:teuthology.orchestra.run.smithi103:mon.a> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.a.service 2024-09-11T00:56:23.225 DEBUG:teuthology.orchestra.run.smithi103:mgr.x> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mgr.x.service 2024-09-11T00:56:23.271 INFO:tasks.cephadm:Bootstrapping... 2024-09-11T00:56:23.271 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 -v bootstrap --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.103 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:56:23.529 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-09-11T00:56:23.529 INFO:teuthology.orchestra.run.smithi103.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', '-v', 'bootstrap', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.103', '--skip-admin-label'] 2024-09-11T00:56:23.530 INFO:teuthology.orchestra.run.smithi103.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-11T00:56:23.530 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying podman|docker is present... 2024-09-11T00:56:23.573 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stdout 5.2.2 2024-09-11T00:56:23.573 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying lvm2 is present... 2024-09-11T00:56:23.573 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying time synchronization is in place... 2024-09-11T00:56:23.587 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T00:56:23.587 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T00:56:23.599 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T00:56:23.600 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-11T00:56:23.613 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout enabled 2024-09-11T00:56:23.625 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout active 2024-09-11T00:56:23.626 INFO:teuthology.orchestra.run.smithi103.stdout:Unit chronyd.service is enabled and running 2024-09-11T00:56:23.626 INFO:teuthology.orchestra.run.smithi103.stdout:Repeating the final host check... 2024-09-11T00:56:23.669 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stdout 5.2.2 2024-09-11T00:56:23.669 INFO:teuthology.orchestra.run.smithi103.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-11T00:56:23.669 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl is present 2024-09-11T00:56:23.669 INFO:teuthology.orchestra.run.smithi103.stdout:lvcreate is present 2024-09-11T00:56:23.682 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-11T00:56:23.682 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-11T00:56:23.694 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-11T00:56:23.694 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-11T00:56:23.708 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout enabled 2024-09-11T00:56:23.720 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout active 2024-09-11T00:56:23.720 INFO:teuthology.orchestra.run.smithi103.stdout:Unit chronyd.service is enabled and running 2024-09-11T00:56:23.720 INFO:teuthology.orchestra.run.smithi103.stdout:Host looks OK 2024-09-11T00:56:23.721 INFO:teuthology.orchestra.run.smithi103.stdout:Cluster fsid: 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:56:23.721 INFO:teuthology.orchestra.run.smithi103.stdout:Acquiring lock 140525622350704 on /run/cephadm/917288bc-6fd8-11ef-bcea-c7b262605968.lock 2024-09-11T00:56:23.721 INFO:teuthology.orchestra.run.smithi103.stdout:Lock 140525622350704 acquired on /run/cephadm/917288bc-6fd8-11ef-bcea-c7b262605968.lock 2024-09-11T00:56:23.721 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying IP 172.21.15.103 port 3300 ... 2024-09-11T00:56:23.721 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying IP 172.21.15.103 port 6789 ... 2024-09-11T00:56:23.722 INFO:teuthology.orchestra.run.smithi103.stdout:Base mon IP(s) is [172.21.15.103:3300, 172.21.15.103:6789], mon addrv is [v2:172.21.15.103:3300,v1:172.21.15.103:6789] 2024-09-11T00:56:23.728 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.103 metric 100 2024-09-11T00:56:23.728 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.103 metric 100 2024-09-11T00:56:23.734 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-11T00:56:23.735 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-11T00:56:23.735 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-11T00:56:23.741 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-11T00:56:23.742 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-11T00:56:23.742 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T00:56:23.742 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-11T00:56:23.742 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-11T00:56:23.742 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-11T00:56:23.742 INFO:teuthology.orchestra.run.smithi103.stdout:Mon IP `172.21.15.103` is in CIDR network `172.21.0.0/20` 2024-09-11T00:56:23.742 INFO:teuthology.orchestra.run.smithi103.stdout:Mon IP `172.21.15.103` is in CIDR network `172.21.0.0/20` 2024-09-11T00:56:23.742 INFO:teuthology.orchestra.run.smithi103.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-11T00:56:23.743 INFO:teuthology.orchestra.run.smithi103.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-11T00:56:23.743 INFO:teuthology.orchestra.run.smithi103.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-11T00:56:24.293 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stdout 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-11T00:56:24.293 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30... 2024-09-11T00:56:24.294 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Getting image source signatures 2024-09-11T00:56:24.294 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Copying blob sha256:edd8cbe4deb828f809e8d76f308301dd93e971948e909d25cc03015fed1fd796 2024-09-11T00:56:24.294 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-11T00:56:24.294 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Copying config sha256:589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 2024-09-11T00:56:24.294 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-11T00:56:36.977 INFO:teuthology.orchestra.run.smithi103.stdout:ceph: stdout ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-11T00:56:36.977 INFO:teuthology.orchestra.run.smithi103.stdout:Ceph version: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev) 2024-09-11T00:56:36.977 INFO:teuthology.orchestra.run.smithi103.stdout:Extracting ceph user uid/gid from container image... 2024-09-11T00:56:38.147 INFO:teuthology.orchestra.run.smithi103.stdout:stat: stdout 167 167 2024-09-11T00:56:38.147 INFO:teuthology.orchestra.run.smithi103.stdout:Creating initial keys... 2024-09-11T00:56:39.252 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph-authtool: stdout AQDG6uBmVRx1IhAA63idSNtxNjlttWIsfELc8g== 2024-09-11T00:56:40.400 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph-authtool: stdout AQDH6uBmaFbAJRAAXRfRjbkkOefrQNq3QnE/0A== 2024-09-11T00:56:42.030 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph-authtool: stdout AQDI6uBmkg6QLxAA0Kb1I1qQTeoKQtm4491chg== 2024-09-11T00:56:42.031 INFO:teuthology.orchestra.run.smithi103.stdout:Creating initial monmap... 2024-09-11T00:56:43.133 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T00:56:43.133 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-11T00:56:43.133 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:56:43.133 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T00:56:43.134 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool for a [v2:172.21.15.103:3300,v1:172.21.15.103:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-11T00:56:43.134 INFO:teuthology.orchestra.run.smithi103.stdout:setting min_mon_release = quincy 2024-09-11T00:56:43.134 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: set fsid to 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:56:43.134 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-11T00:56:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:56:43.134 INFO:teuthology.orchestra.run.smithi103.stdout:Creating mon... 2024-09-11T00:56:44.247 INFO:teuthology.orchestra.run.smithi103.stdout:create mon.a on 2024-09-11T00:56:44.529 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-11T00:56:44.742 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-11T00:56:44.991 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-917288bc-6fd8-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-917288bc-6fd8-11ef-bcea-c7b262605968.target. 2024-09-11T00:56:44.991 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-917288bc-6fd8-11ef-bcea-c7b262605968.target → /etc/systemd/system/ceph-917288bc-6fd8-11ef-bcea-c7b262605968.target. 2024-09-11T00:56:45.312 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.a 2024-09-11T00:56:45.312 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to reset failed state of unit ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.a.service: Unit ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.a.service not loaded. 2024-09-11T00:56:45.574 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-917288bc-6fd8-11ef-bcea-c7b262605968.target.wants/ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.a.service → /etc/systemd/system/ceph-917288bc-6fd8-11ef-bcea-c7b262605968@.service. 2024-09-11T00:56:46.178 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:45 smithi103 podman[30187]: 2024-09-11 00:56:45.949341617 +0000 UTC m=+0.150985595 container create cd01ef0a0c9a3ab2a80e090462ebeeb33de87c8c66cd7a6e7090c6c93a70d7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-11T00:56:46.179 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:46 smithi103 podman[30187]: 2024-09-11 00:56:46.177205928 +0000 UTC m=+0.378849917 container init cd01ef0a0c9a3ab2a80e090462ebeeb33de87c8c66cd7a6e7090c6c93a70d7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T00:56:46.288 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T00:56:46.288 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-09-11T00:56:46.301 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T00:56:46.301 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-11T00:56:46.301 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-09-11T00:56:46.301 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T00:56:46.302 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mon to start... 2024-09-11T00:56:46.302 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mon... 2024-09-11T00:56:46.443 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:46 smithi103 podman[30187]: 2024-09-11 00:56:46.183746785 +0000 UTC m=+0.385390763 container start cd01ef0a0c9a3ab2a80e090462ebeeb33de87c8c66cd7a6e7090c6c93a70d7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-11T00:56:46.443 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:46 smithi103 ceph-mon[30206]: mkfs 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:56:46.443 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:46 smithi103 ceph-mon[30206]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T00:56:46.443 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:46 smithi103 bash[30187]: cd01ef0a0c9a3ab2a80e090462ebeeb33de87c8c66cd7a6e7090c6c93a70d7b4 2024-09-11T00:56:46.443 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:46 smithi103 systemd[1]: Started Ceph mon.a for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T00:56:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:47 smithi103 ceph-mon[30206]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T00:56:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:47 smithi103 ceph-mon[30206]: monmap epoch 1 2024-09-11T00:56:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:47 smithi103 ceph-mon[30206]: fsid 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:56:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:47 smithi103 ceph-mon[30206]: last_changed 2024-09-11T00:56:42.463809+0000 2024-09-11T00:56:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:47 smithi103 ceph-mon[30206]: created 2024-09-11T00:56:42.463809+0000 2024-09-11T00:56:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:47 smithi103 ceph-mon[30206]: min_mon_release 19 (squid) 2024-09-11T00:56:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:47 smithi103 ceph-mon[30206]: election_strategy: 1 2024-09-11T00:56:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:47 smithi103 ceph-mon[30206]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-11T00:56:47.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:47 smithi103 ceph-mon[30206]: fsmap 2024-09-11T00:56:47.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:47 smithi103 ceph-mon[30206]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T00:56:47.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:47 smithi103 ceph-mon[30206]: mgrmap e1: no daemons active 2024-09-11T00:56:47.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:47 smithi103 ceph-mon[30206]: from='client.? 172.21.15.103:0/3594356226' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-11T00:56:47.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout cluster: 2024-09-11T00:56:47.631 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout id: 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:56:47.631 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-11T00:56:47.631 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-11T00:56:47.631 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout services: 2024-09-11T00:56:47.631 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.73788s) 2024-09-11T00:56:47.631 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-11T00:56:47.631 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-11T00:56:47.631 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-11T00:56:47.632 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout data: 2024-09-11T00:56:47.632 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-11T00:56:47.632 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-11T00:56:47.632 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-11T00:56:47.632 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout pgs: 2024-09-11T00:56:47.632 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-11T00:56:47.632 INFO:teuthology.orchestra.run.smithi103.stdout:mon is available 2024-09-11T00:56:47.632 INFO:teuthology.orchestra.run.smithi103.stdout:Assimilating anything we can from ceph.conf... 2024-09-11T00:56:48.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:48 smithi103 ceph-mon[30206]: from='client.? 172.21.15.103:0/3035980126' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-11T00:56:48.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:48 smithi103 ceph-mon[30206]: from='client.? 172.21.15.103:0/3035980126' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-11T00:56:48.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-11T00:56:48.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T00:56:48.928 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout fsid = 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:56:48.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-11T00:56:48.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.103:3300,v1:172.21.15.103:6789] 2024-09-11T00:56:48.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T00:56:48.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T00:56:48.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T00:56:48.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T00:56:48.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-11T00:56:48.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T00:56:48.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T00:56:48.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-11T00:56:48.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T00:56:48.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-11T00:56:48.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T00:56:48.929 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T00:56:48.930 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T00:56:48.930 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T00:56:48.930 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T00:56:48.930 INFO:teuthology.orchestra.run.smithi103.stdout:Generating new minimal ceph.conf... 2024-09-11T00:56:49.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:49 smithi103 ceph-mon[30206]: from='client.? 172.21.15.103:0/1912423364' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:56:50.177 INFO:teuthology.orchestra.run.smithi103.stdout:Restarting the monitor... 2024-09-11T00:56:50.521 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:50 smithi103 systemd[1]: Stopping Ceph mon.a for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T00:56:50.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:50 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a[30202]: 2024-09-11T00:56:50.518+0000 7feb66c00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T00:56:50.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:50 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a[30202]: 2024-09-11T00:56:50.518+0000 7feb66c00640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-11T00:56:50.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:50 smithi103 podman[30446]: 2024-09-11 00:56:50.539425519 +0000 UTC m=+0.133142482 container died cd01ef0a0c9a3ab2a80e090462ebeeb33de87c8c66cd7a6e7090c6c93a70d7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-11T00:56:51.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:50 smithi103 podman[30446]: 2024-09-11 00:56:50.956238871 +0000 UTC m=+0.549955838 container cleanup cd01ef0a0c9a3ab2a80e090462ebeeb33de87c8c66cd7a6e7090c6c93a70d7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-11T00:56:51.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:50 smithi103 bash[30446]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a 2024-09-11T00:56:51.462 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:51 smithi103 podman[30458]: 2024-09-11 00:56:51.206381319 +0000 UTC m=+0.662684228 container remove cd01ef0a0c9a3ab2a80e090462ebeeb33de87c8c66cd7a6e7090c6c93a70d7b4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-11T00:56:51.788 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:51 smithi103 systemd[1]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-11T00:56:51.788 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:51 smithi103 systemd[1]: Stopped Ceph mon.a for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T00:56:51.788 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:51 smithi103 systemd[1]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.a.service: Consumed 1.193s CPU time. 2024-09-11T00:56:51.788 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:51 smithi103 systemd[1]: Starting Ceph mon.a for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T00:56:52.047 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:51 smithi103 podman[30543]: 2024-09-11 00:56:51.691530721 +0000 UTC m=+0.028319153 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:56:52.047 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:51 smithi103 podman[30543]: 2024-09-11 00:56:51.844203949 +0000 UTC m=+0.180992385 container create 9ef09c26e51e62cf9225a1b2257e3051c0a2ecb2fc2227af9f8dc2a74f511975 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T00:56:52.048 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 podman[30543]: 2024-09-11 00:56:52.04654492 +0000 UTC m=+0.383333353 container init 9ef09c26e51e62cf9225a1b2257e3051c0a2ecb2fc2227af9f8dc2a74f511975 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T00:56:52.148 INFO:teuthology.orchestra.run.smithi103.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-11T00:56:52.318 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 podman[30543]: 2024-09-11 00:56:52.053237654 +0000 UTC m=+0.390026087 container start 9ef09c26e51e62cf9225a1b2257e3051c0a2ecb2fc2227af9f8dc2a74f511975 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T00:56:52.318 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: set uid:gid to 167:167 (ceph:ceph) 2024-09-11T00:56:52.318 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev), process ceph-mon, pid 2 2024-09-11T00:56:52.319 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: pidfile_write: ignore empty --pid-file 2024-09-11T00:56:52.319 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: load: jerasure load: lrc 2024-09-11T00:56:52.319 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: RocksDB version: 7.9.2 2024-09-11T00:56:52.319 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Git sha 0 2024-09-11T00:56:52.319 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Compile date 2024-09-10 08:02:51 2024-09-11T00:56:52.319 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: DB SUMMARY 2024-09-11T00:56:52.319 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: DB Session ID: 3NITNPG8TQU49Q1VRKMB 2024-09-11T00:56:52.319 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: CURRENT file: CURRENT 2024-09-11T00:56:52.319 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: IDENTITY file: IDENTITY 2024-09-11T00:56:52.319 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-11T00:56:52.319 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-11T00:56:52.320 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 95656 ; 2024-09-11T00:56:52.320 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.error_if_exists: 0 2024-09-11T00:56:52.320 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.create_if_missing: 0 2024-09-11T00:56:52.320 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.paranoid_checks: 1 2024-09-11T00:56:52.320 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-11T00:56:52.320 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-11T00:56:52.320 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-11T00:56:52.320 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.env: 0x559817af2180 2024-09-11T00:56:52.320 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.fs: PosixFileSystem 2024-09-11T00:56:52.320 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.info_log: 0x55983d1ff6e0 2024-09-11T00:56:52.320 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_file_opening_threads: 16 2024-09-11T00:56:52.321 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.statistics: (nil) 2024-09-11T00:56:52.321 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.use_fsync: 0 2024-09-11T00:56:52.321 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_log_file_size: 0 2024-09-11T00:56:52.321 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-11T00:56:52.321 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-11T00:56:52.321 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.keep_log_file_num: 1000 2024-09-11T00:56:52.321 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.recycle_log_file_num: 0 2024-09-11T00:56:52.321 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.allow_fallocate: 1 2024-09-11T00:56:52.321 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.allow_mmap_reads: 0 2024-09-11T00:56:52.321 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.allow_mmap_writes: 0 2024-09-11T00:56:52.321 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.use_direct_reads: 0 2024-09-11T00:56:52.321 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-11T00:56:52.321 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.create_missing_column_families: 0 2024-09-11T00:56:52.322 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.db_log_dir: 2024-09-11T00:56:52.322 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.wal_dir: 2024-09-11T00:56:52.322 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-11T00:56:52.322 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-11T00:56:52.322 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-11T00:56:52.322 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-11T00:56:52.322 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-11T00:56:52.322 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-11T00:56:52.322 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.advise_random_on_open: 1 2024-09-11T00:56:52.322 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.db_write_buffer_size: 0 2024-09-11T00:56:52.322 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.write_buffer_manager: 0x55983d203b80 2024-09-11T00:56:52.322 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-11T00:56:52.322 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.rate_limiter: (nil) 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.wal_recovery_mode: 2 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.enable_thread_tracking: 0 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.enable_pipelined_write: 0 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.unordered_write: 0 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.row_cache: None 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.wal_filter: None 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-11T00:56:52.323 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.allow_ingest_behind: 0 2024-09-11T00:56:52.324 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.two_write_queues: 0 2024-09-11T00:56:52.324 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.manual_wal_flush: 0 2024-09-11T00:56:52.324 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.wal_compression: 0 2024-09-11T00:56:52.324 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.atomic_flush: 0 2024-09-11T00:56:52.324 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-11T00:56:52.324 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-11T00:56:52.324 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-11T00:56:52.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.log_readahead_size: 0 2024-09-11T00:56:52.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-11T00:56:52.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.best_efforts_recovery: 0 2024-09-11T00:56:52.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-11T00:56:52.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-11T00:56:52.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.allow_data_in_errors: 0 2024-09-11T00:56:52.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.db_host_id: __hostname__ 2024-09-11T00:56:52.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-11T00:56:52.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_background_jobs: 2 2024-09-11T00:56:52.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_background_compactions: -1 2024-09-11T00:56:52.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_subcompactions: 1 2024-09-11T00:56:52.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-11T00:56:52.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-11T00:56:52.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-11T00:56:52.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_total_wal_size: 0 2024-09-11T00:56:52.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-11T00:56:52.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-11T00:56:52.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-11T00:56:52.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-11T00:56:52.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_open_files: -1 2024-09-11T00:56:52.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.bytes_per_sync: 0 2024-09-11T00:56:52.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-11T00:56:52.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-11T00:56:52.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compaction_readahead_size: 0 2024-09-11T00:56:52.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_background_flushes: -1 2024-09-11T00:56:52.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Compression algorithms supported: 2024-09-11T00:56:52.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: kZSTD supported: 0 2024-09-11T00:56:52.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: kXpressCompression supported: 0 2024-09-11T00:56:52.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: kBZip2Compression supported: 0 2024-09-11T00:56:52.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-11T00:56:52.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: kLZ4Compression supported: 1 2024-09-11T00:56:52.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: kZlibCompression supported: 1 2024-09-11T00:56:52.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: kLZ4HCCompression supported: 1 2024-09-11T00:56:52.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: kSnappyCompression supported: 1 2024-09-11T00:56:52.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-11T00:56:52.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-11T00:56:52.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-11T00:56:52.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-11T00:56:52.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-11T00:56:52.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.merge_operator: 2024-09-11T00:56:52.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compaction_filter: None 2024-09-11T00:56:52.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compaction_filter_factory: None 2024-09-11T00:56:52.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.sst_partitioner_factory: None 2024-09-11T00:56:52.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-11T00:56:52.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-11T00:56:52.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55983d1ff300) 2024-09-11T00:56:52.328 INFO:journalctl@ceph.mon.a.smithi103.stdout: cache_index_and_filter_blocks: 1 2024-09-11T00:56:52.328 INFO:journalctl@ceph.mon.a.smithi103.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-11T00:56:52.329 INFO:journalctl@ceph.mon.a.smithi103.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-11T00:56:52.329 INFO:journalctl@ceph.mon.a.smithi103.stdout: pin_top_level_index_and_filter: 1 2024-09-11T00:56:52.329 INFO:journalctl@ceph.mon.a.smithi103.stdout: index_type: 0 2024-09-11T00:56:52.329 INFO:journalctl@ceph.mon.a.smithi103.stdout: data_block_index_type: 0 2024-09-11T00:56:52.329 INFO:journalctl@ceph.mon.a.smithi103.stdout: index_shortening: 1 2024-09-11T00:56:52.329 INFO:journalctl@ceph.mon.a.smithi103.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-11T00:56:52.329 INFO:journalctl@ceph.mon.a.smithi103.stdout: checksum: 4 2024-09-11T00:56:52.329 INFO:journalctl@ceph.mon.a.smithi103.stdout: no_block_cache: 0 2024-09-11T00:56:52.329 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_cache: 0x55983d1f3610 2024-09-11T00:56:52.329 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_cache_name: BinnedLRUCache 2024-09-11T00:56:52.329 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_cache_options: 2024-09-11T00:56:52.329 INFO:journalctl@ceph.mon.a.smithi103.stdout: capacity : 536870912 2024-09-11T00:56:52.329 INFO:journalctl@ceph.mon.a.smithi103.stdout: num_shard_bits : 4 2024-09-11T00:56:52.330 INFO:journalctl@ceph.mon.a.smithi103.stdout: strict_capacity_limit : 0 2024-09-11T00:56:52.330 INFO:journalctl@ceph.mon.a.smithi103.stdout: high_pri_pool_ratio: 0.000 2024-09-11T00:56:52.330 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_cache_compressed: (nil) 2024-09-11T00:56:52.330 INFO:journalctl@ceph.mon.a.smithi103.stdout: persistent_cache: (nil) 2024-09-11T00:56:52.330 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_size: 4096 2024-09-11T00:56:52.330 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_size_deviation: 10 2024-09-11T00:56:52.330 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_restart_interval: 16 2024-09-11T00:56:52.330 INFO:journalctl@ceph.mon.a.smithi103.stdout: index_block_restart_interval: 1 2024-09-11T00:56:52.330 INFO:journalctl@ceph.mon.a.smithi103.stdout: metadata_block_size: 4096 2024-09-11T00:56:52.330 INFO:journalctl@ceph.mon.a.smithi103.stdout: partition_filters: 0 2024-09-11T00:56:52.330 INFO:journalctl@ceph.mon.a.smithi103.stdout: use_delta_encoding: 1 2024-09-11T00:56:52.330 INFO:journalctl@ceph.mon.a.smithi103.stdout: filter_policy: bloomfilter 2024-09-11T00:56:52.330 INFO:journalctl@ceph.mon.a.smithi103.stdout: whole_key_filtering: 1 2024-09-11T00:56:52.330 INFO:journalctl@ceph.mon.a.smithi103.stdout: verify_compression: 0 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout: read_amp_bytes_per_bit: 0 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout: format_version: 5 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout: enable_index_compression: 1 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_align: 0 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout: max_auto_readahead_size: 262144 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout: prepopulate_block_cache: 0 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout: initial_auto_readahead_size: 8192 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout: num_file_reads_for_auto_readahead: 2 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.write_buffer_size: 33554432 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_write_buffer_number: 2 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compression: NoCompression 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.bottommost_compression: Disabled 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.prefix_extractor: nullptr 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-11T00:56:52.331 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.num_levels: 7 2024-09-11T00:56:52.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-11T00:56:52.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-11T00:56:52.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-11T00:56:52.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-11T00:56:52.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-11T00:56:52.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-11T00:56:52.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-11T00:56:52.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-11T00:56:52.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-11T00:56:52.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-11T00:56:52.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-11T00:56:52.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-11T00:56:52.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-11T00:56:52.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compression_opts.level: 32767 2024-09-11T00:56:52.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compression_opts.strategy: 0 2024-09-11T00:56:52.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-11T00:56:52.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-11T00:56:52.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-11T00:56:52.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-11T00:56:52.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compression_opts.enabled: false 2024-09-11T00:56:52.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-11T00:56:52.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-11T00:56:52.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-11T00:56:52.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-11T00:56:52.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.target_file_size_base: 67108864 2024-09-11T00:56:52.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-11T00:56:52.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-11T00:56:52.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-11T00:56:52.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-11T00:56:52.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-11T00:56:52.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-11T00:56:52.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-11T00:56:52.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-11T00:56:52.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-11T00:56:52.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-11T00:56:52.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-11T00:56:52.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-11T00:56:52.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-11T00:56:52.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-11T00:56:52.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.arena_block_size: 1048576 2024-09-11T00:56:52.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.disable_auto_compactions: 0 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.inplace_update_support: 0 2024-09-11T00:56:52.335 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-11T00:56:52.336 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-11T00:56:52.336 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-11T00:56:52.336 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-11T00:56:52.336 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.bloom_locality: 0 2024-09-11T00:56:52.336 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.max_successive_merges: 0 2024-09-11T00:56:52.336 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-11T00:56:52.336 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.paranoid_file_checks: 0 2024-09-11T00:56:52.336 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.force_consistency_checks: 1 2024-09-11T00:56:52.336 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.report_bg_io_stats: 0 2024-09-11T00:56:52.336 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.ttl: 2592000 2024-09-11T00:56:52.336 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-11T00:56:52.336 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-11T00:56:52.336 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-11T00:56:52.336 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.enable_blob_files: false 2024-09-11T00:56:52.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.min_blob_size: 0 2024-09-11T00:56:52.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.blob_file_size: 268435456 2024-09-11T00:56:52.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-11T00:56:52.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-11T00:56:52.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-11T00:56:52.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-11T00:56:52.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-11T00:56:52.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.blob_file_starting_level: 0 2024-09-11T00:56:52.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-11T00:56:52.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-11T00:56:52.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-11T00:56:52.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0d4cf9b8-1562-4488-adaa-e14051d75f0b 2024-09-11T00:56:52.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726016212095087, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-11T00:56:52.338 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-11T00:56:52.338 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726016212096737, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91804, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 287, "table_properties": {"data_size": 89845, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11813, "raw_average_key_size": 48, "raw_value_size": 83160, "raw_average_value_size": 338, "num_data_blocks": 12, "num_entries": 246, "num_filter_entries": 246, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726016212, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0d4cf9b8-1562-4488-adaa-e14051d75f0b", "db_session_id": "3NITNPG8TQU49Q1VRKMB", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-11T00:56:52.338 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726016212096922, "job": 1, "event": "recovery_finished"} 2024-09-11T00:56:52.338 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-11T00:56:52.338 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-11T00:56:52.338 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55983d224e00 2024-09-11T00:56:52.338 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: DB pointer 0x55983d324000 2024-09-11T00:56:52.338 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-11T00:56:52.338 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-11T00:56:52.338 INFO:journalctl@ceph.mon.a.smithi103.stdout: ** DB Stats ** 2024-09-11T00:56:52.338 INFO:journalctl@ceph.mon.a.smithi103.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T00:56:52.338 INFO:journalctl@ceph.mon.a.smithi103.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-11T00:56:52.338 INFO:journalctl@ceph.mon.a.smithi103.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: ** Compaction Stats [default] ** 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: L0 2/0 91.51 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 78.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: Sum 2/0 91.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 78.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 78.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: ** Compaction Stats [default] ** 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-11T00:56:52.339 INFO:journalctl@ceph.mon.a.smithi103.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-11T00:56:52.340 INFO:journalctl@ceph.mon.a.smithi103.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 78.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-11T00:56:52.340 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-09-11T00:56:52.340 INFO:journalctl@ceph.mon.a.smithi103.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-11T00:56:52.340 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-09-11T00:56:52.340 INFO:journalctl@ceph.mon.a.smithi103.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-11T00:56:52.340 INFO:journalctl@ceph.mon.a.smithi103.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-11T00:56:52.340 INFO:journalctl@ceph.mon.a.smithi103.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-11T00:56:52.340 INFO:journalctl@ceph.mon.a.smithi103.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-11T00:56:52.340 INFO:journalctl@ceph.mon.a.smithi103.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-11T00:56:52.340 INFO:journalctl@ceph.mon.a.smithi103.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-11T00:56:52.340 INFO:journalctl@ceph.mon.a.smithi103.stdout: Cumulative compaction: 0.00 GB write, 15.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T00:56:52.340 INFO:journalctl@ceph.mon.a.smithi103.stdout: Interval compaction: 0.00 GB write, 15.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-11T00:56:52.340 INFO:journalctl@ceph.mon.a.smithi103.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-11T00:56:52.341 INFO:journalctl@ceph.mon.a.smithi103.stdout: Block cache BinnedLRUCache@0x55983d1f3610#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-11T00:56:52.341 INFO:journalctl@ceph.mon.a.smithi103.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-11T00:56:52.341 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-09-11T00:56:52.341 INFO:journalctl@ceph.mon.a.smithi103.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-11T00:56:52.341 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: starting mon.a rank 0 at public addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] at bind addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:56:52.341 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: mon.a@-1(???) e1 preinit fsid 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:56:52.341 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: mon.a@-1(???).mds e1 new map 2024-09-11T00:56:52.341 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: mon.a@-1(???).mds e1 print_map 2024-09-11T00:56:52.341 INFO:journalctl@ceph.mon.a.smithi103.stdout: e1 2024-09-11T00:56:52.341 INFO:journalctl@ceph.mon.a.smithi103.stdout: btime 2024-09-11T00:56:46:242635+0000 2024-09-11T00:56:52.341 INFO:journalctl@ceph.mon.a.smithi103.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T00:56:52.341 INFO:journalctl@ceph.mon.a.smithi103.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T00:56:52.341 INFO:journalctl@ceph.mon.a.smithi103.stdout: legacy client fscid: -1 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout: No filesystems configured 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 bash[30543]: 9ef09c26e51e62cf9225a1b2257e3051c0a2ecb2fc2227af9f8dc2a74f511975 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 systemd[1]: Started Ceph mon.a for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: monmap epoch 1 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: fsid 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: last_changed 2024-09-11T00:56:42.463809+0000 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: created 2024-09-11T00:56:42.463809+0000 2024-09-11T00:56:52.342 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: min_mon_release 19 (squid) 2024-09-11T00:56:52.343 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: election_strategy: 1 2024-09-11T00:56:52.343 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-11T00:56:52.343 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: fsmap 2024-09-11T00:56:52.343 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: osdmap e1: 0 total, 0 up, 0 in 2024-09-11T00:56:52.343 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:52 smithi103 ceph-mon[30562]: mgrmap e1: no daemons active 2024-09-11T00:56:53.553 INFO:teuthology.orchestra.run.smithi103.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-11T00:56:53.588 INFO:teuthology.orchestra.run.smithi103.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:56:53.588 INFO:teuthology.orchestra.run.smithi103.stdout:Creating mgr... 2024-09-11T00:56:53.588 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-11T00:56:53.589 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-11T00:56:53.957 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mgr.x 2024-09-11T00:56:53.957 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to reset failed state of unit ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mgr.x.service: Unit ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mgr.x.service not loaded. 2024-09-11T00:56:54.172 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:53 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3397075373' entity='client.admin' 2024-09-11T00:56:54.192 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-917288bc-6fd8-11ef-bcea-c7b262605968.target.wants/ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-917288bc-6fd8-11ef-bcea-c7b262605968@.service. 2024-09-11T00:56:54.546 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:56:54 smithi103 systemd[1]: Starting Ceph mgr.x for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T00:56:54.818 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:56:54 smithi103 podman[30782]: 2024-09-11 00:56:54.448824221 +0000 UTC m=+0.027203382 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T00:56:54.818 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:56:54 smithi103 podman[30782]: 2024-09-11 00:56:54.551919921 +0000 UTC m=+0.130299072 container create f460f1556e77ed13ba2e20ef73cd90e052bd162ebccff957076aab084d0a9bd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-11T00:56:54.818 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:56:54 smithi103 podman[30782]: 2024-09-11 00:56:54.733653133 +0000 UTC m=+0.312032294 container init f460f1556e77ed13ba2e20ef73cd90e052bd162ebccff957076aab084d0a9bd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-11T00:56:54.818 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:56:54 smithi103 podman[30782]: 2024-09-11 00:56:54.739483018 +0000 UTC m=+0.317862170 container start f460f1556e77ed13ba2e20ef73cd90e052bd162ebccff957076aab084d0a9bd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T00:56:54.818 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:56:54 smithi103 bash[30782]: f460f1556e77ed13ba2e20ef73cd90e052bd162ebccff957076aab084d0a9bd0 2024-09-11T00:56:54.844 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T00:56:54.844 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-09-11T00:56:54.858 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T00:56:54.858 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-11T00:56:54.858 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-09-11T00:56:54.858 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to enable service . firewalld.service is not available 2024-09-11T00:56:54.875 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T00:56:54.875 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-09-11T00:56:54.889 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T00:56:54.889 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-11T00:56:54.889 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-09-11T00:56:54.889 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-11T00:56:54.889 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr to start... 2024-09-11T00:56:54.889 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr... 2024-09-11T00:56:55.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:56:54 smithi103 systemd[1]: Started Ceph mgr.x for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T00:56:55.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:55 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/296167841' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-11T00:56:56.335 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-11T00:56:56.335 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-11T00:56:56.335 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsid": "917288bc-6fd8-11ef-bcea-c7b262605968", 2024-09-11T00:56:56.335 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T00:56:56.336 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T00:56:56.336 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T00:56:56.336 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T00:56:56.336 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:56:56.336 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T00:56:56.336 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T00:56:56.337 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 0 2024-09-11T00:56:56.337 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:56:56.337 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T00:56:56.337 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T00:56:56.337 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:56:56.337 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-09-11T00:56:56.337 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T00:56:56.338 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:56:56.338 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T00:56:56.338 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T00:56:56.338 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:56:56.338 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T00:56:56.338 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:56:56.338 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T00:56:56.339 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T00:56:56.339 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T00:56:56.339 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T00:56:56.339 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T00:56:56.339 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T00:56:56.339 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:56:56.339 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T00:56:56.340 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T00:56:56.340 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T00:56:56.340 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T00:56:56.340 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T00:56:56.340 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T00:56:56.340 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T00:56:56.341 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T00:56:56.341 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T00:56:56.341 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:56:56.341 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T00:56:56.341 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:56:56.341 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T00:56:46:242635+0000", 2024-09-11T00:56:56.342 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T00:56:56.342 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T00:56:56.342 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:56:56.342 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T00:56:56.342 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T00:56:56.342 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T00:56:56.342 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T00:56:56.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T00:56:56.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T00:56:56.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T00:56:56.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:56:56.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T00:56:56.343 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:56:56.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T00:56:56.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:56:56.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T00:56:46.243400+0000", 2024-09-11T00:56:56.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T00:56:56.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:56:56.344 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T00:56:56.345 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-11T00:56:56.345 INFO:teuthology.orchestra.run.smithi103.stdout:mgr not available, waiting (1/15)... 2024-09-11T00:56:59.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:56:59 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2813574631' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-11T00:56:59.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-11T00:56:59.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-11T00:56:59.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsid": "917288bc-6fd8-11ef-bcea-c7b262605968", 2024-09-11T00:56:59.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T00:56:59.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T00:56:59.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T00:56:59.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T00:56:59.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:56:59.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T00:56:59.623 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T00:56:59.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 0 2024-09-11T00:56:59.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:56:59.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T00:56:59.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T00:56:59.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:56:59.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-11T00:56:59.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T00:56:59.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:56:59.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T00:56:59.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T00:56:59.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:56:59.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T00:56:59.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:56:59.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T00:56:59.625 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T00:56:59.625 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T00:56:59.625 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T00:56:59.625 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T00:56:59.625 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T00:56:59.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:56:59.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T00:56:59.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T00:56:59.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T00:56:59.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T00:56:59.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T00:56:59.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T00:56:59.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T00:56:59.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T00:56:59.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T00:56:59.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:56:59.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T00:56:59.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:56:59.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T00:56:46:242635+0000", 2024-09-11T00:56:59.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T00:56:59.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T00:56:59.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:56:59.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T00:56:59.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-11T00:56:59.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T00:56:59.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T00:56:59.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T00:56:59.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T00:56:59.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T00:56:59.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:56:59.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T00:56:59.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:56:59.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T00:56:59.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:56:59.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T00:56:46.243400+0000", 2024-09-11T00:56:59.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T00:56:59.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:56:59.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T00:56:59.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-11T00:56:59.630 INFO:teuthology.orchestra.run.smithi103.stdout:mgr not available, waiting (2/15)... 2024-09-11T00:57:01.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:00 smithi103 ceph-mon[30562]: Activating manager daemon x 2024-09-11T00:57:01.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:00 smithi103 ceph-mon[30562]: mgrmap e2: x(active, starting, since 0.0048457s) 2024-09-11T00:57:01.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:00 smithi103 ceph-mon[30562]: from='mgr.14100 172.21.15.103:0/2865279937' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-11T00:57:01.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:00 smithi103 ceph-mon[30562]: from='mgr.14100 172.21.15.103:0/2865279937' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-11T00:57:01.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:00 smithi103 ceph-mon[30562]: from='mgr.14100 172.21.15.103:0/2865279937' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-11T00:57:01.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:00 smithi103 ceph-mon[30562]: from='mgr.14100 172.21.15.103:0/2865279937' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:57:01.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:00 smithi103 ceph-mon[30562]: from='mgr.14100 172.21.15.103:0/2865279937' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-11T00:57:01.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:00 smithi103 ceph-mon[30562]: Manager daemon x is now available 2024-09-11T00:57:01.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:00 smithi103 ceph-mon[30562]: from='mgr.14100 172.21.15.103:0/2865279937' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-11T00:57:01.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:00 smithi103 ceph-mon[30562]: from='mgr.14100 172.21.15.103:0/2865279937' entity='mgr.x' 2024-09-11T00:57:01.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:00 smithi103 ceph-mon[30562]: from='mgr.14100 172.21.15.103:0/2865279937' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-11T00:57:01.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:00 smithi103 ceph-mon[30562]: from='mgr.14100 172.21.15.103:0/2865279937' entity='mgr.x' 2024-09-11T00:57:01.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:00 smithi103 ceph-mon[30562]: from='mgr.14100 172.21.15.103:0/2865279937' entity='mgr.x' 2024-09-11T00:57:03.063 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:02 smithi103 ceph-mon[30562]: mgrmap e3: x(active, since 1.00871s) 2024-09-11T00:57:03.063 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:02 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3831425276' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-11T00:57:03.072 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-11T00:57:03.072 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-11T00:57:03.072 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsid": "917288bc-6fd8-11ef-bcea-c7b262605968", 2024-09-11T00:57:03.072 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "health": { 2024-09-11T00:57:03.072 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-11T00:57:03.072 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-11T00:57:03.072 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-11T00:57:03.072 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:57:03.072 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-11T00:57:03.072 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-11T00:57:03.072 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 0 2024-09-11T00:57:03.073 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:57:03.073 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-11T00:57:03.073 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "a" 2024-09-11T00:57:03.073 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:57:03.073 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-11T00:57:03.073 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-11T00:57:03.073 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:57:03.073 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-11T00:57:03.073 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-11T00:57:03.073 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:57:03.073 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-11T00:57:03.073 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:57:03.073 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-11T00:57:03.073 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-11T00:57:03.074 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-11T00:57:03.074 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-11T00:57:03.074 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-11T00:57:03.074 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-11T00:57:03.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:57:03.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-11T00:57:03.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-11T00:57:03.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-11T00:57:03.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-11T00:57:03.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-11T00:57:03.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-11T00:57:03.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-11T00:57:03.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-11T00:57:03.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-11T00:57:03.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:57:03.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-11T00:57:03.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:57:03.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "btime": "2024-09-11T00:56:46:242635+0000", 2024-09-11T00:57:03.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-11T00:57:03.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-11T00:57:03.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:57:03.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-11T00:57:03.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T00:57:03.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "restful" 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modified": "2024-09-11T00:56:46.243400+0000", 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-11T00:57:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:mgr is available 2024-09-11T00:57:04.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:03 smithi103 ceph-mon[30562]: mgrmap e4: x(active, since 2s) 2024-09-11T00:57:04.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:03 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2937597387' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-11T00:57:04.452 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-11T00:57:04.452 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [global] 2024-09-11T00:57:04.452 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout fsid = 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:57:04.452 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-11T00:57:04.452 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.103:3300,v1:172.21.15.103:6789] 2024-09-11T00:57:04.452 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-11T00:57:04.452 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-11T00:57:04.452 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-11T00:57:04.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-11T00:57:04.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-11T00:57:04.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-11T00:57:04.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-11T00:57:04.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-09-11T00:57:04.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [osd] 2024-09-11T00:57:04.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout filestore_flush_min = 0 2024-09-11T00:57:04.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-11T00:57:04.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-11T00:57:04.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-11T00:57:04.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-11T00:57:04.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-11T00:57:04.453 INFO:teuthology.orchestra.run.smithi103.stdout:Enabling cephadm module... 2024-09-11T00:57:05.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:05 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2975927670' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-11T00:57:05.582 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:05 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: ignoring --setuser ceph since I am not root 2024-09-11T00:57:05.582 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:05 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: ignoring --setgroup ceph since I am not root 2024-09-11T00:57:06.545 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:06 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2975927670' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-11T00:57:06.545 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:06 smithi103 ceph-mon[30562]: mgrmap e5: x(active, since 4s) 2024-09-11T00:57:07.499 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:07 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2226158332' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-11T00:57:07.506 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-11T00:57:07.506 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-11T00:57:07.506 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T00:57:07.506 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T00:57:07.506 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T00:57:07.506 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-11T00:57:07.506 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for the mgr to restart... 2024-09-11T00:57:07.506 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr epoch 5... 2024-09-11T00:57:11.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:11 smithi103 ceph-mon[30562]: Active manager daemon x restarted 2024-09-11T00:57:11.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:11 smithi103 ceph-mon[30562]: Activating manager daemon x 2024-09-11T00:57:11.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:11 smithi103 ceph-mon[30562]: osdmap e2: 0 total, 0 up, 0 in 2024-09-11T00:57:11.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:11 smithi103 ceph-mon[30562]: mgrmap e6: x(active, starting, since 0.00429021s) 2024-09-11T00:57:11.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:11 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:57:11.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:11 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-11T00:57:11.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:11 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-11T00:57:11.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:11 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-11T00:57:11.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:11 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-11T00:57:11.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:11 smithi103 ceph-mon[30562]: Manager daemon x is now available 2024-09-11T00:57:13.037 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-11T00:57:13.037 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-11T00:57:13.038 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T00:57:13.038 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-11T00:57:13.038 INFO:teuthology.orchestra.run.smithi103.stdout:mgr epoch 5 is available 2024-09-11T00:57:13.038 INFO:teuthology.orchestra.run.smithi103.stdout:Setting orchestrator backend to cephadm... 2024-09-11T00:57:13.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' 2024-09-11T00:57:13.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' 2024-09-11T00:57:13.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-mon[30562]: Found migration_current of "None". Setting to last migration. 2024-09-11T00:57:13.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' 2024-09-11T00:57:13.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' 2024-09-11T00:57:13.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:57:13.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:57:13.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-11T00:57:13.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-11T00:57:13.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-mon[30562]: mgrmap e7: x(active, since 1.0071s) 2024-09-11T00:57:14.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T00:57:13.883+0000 7f9034400640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:00:57:13] ENGINE Error in HTTPServer.serve 2024-09-11T00:57:14.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: Traceback (most recent call last): 2024-09-11T00:57:14.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:57:14.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: self._connections.run(self.expiration_interval) 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: self._run(expiration_interval) 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: s = self.context.wrap_socket( 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: return self.sslsocket_class._create( 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: self.do_handshake() 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: self._sslobj.do_handshake() 2024-09-11T00:57:14.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:57:14.084 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T00:57:14.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:14 smithi103 ceph-mon[30562]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T00:57:14.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:14 smithi103 ceph-mon[30562]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T00:57:14.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:14 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' 2024-09-11T00:57:14.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:14 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:57:14.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:14 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:57:15.548 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:15 smithi103 ceph-mon[30562]: [11/Sep/2024:00:57:13] ENGINE Bus STARTING 2024-09-11T00:57:15.548 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:15 smithi103 ceph-mon[30562]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:57:15.548 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:15 smithi103 ceph-mon[30562]: [11/Sep/2024:00:57:13] ENGINE Serving on https://172.21.15.103:7150 2024-09-11T00:57:15.549 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:15 smithi103 ceph-mon[30562]: [11/Sep/2024:00:57:13] ENGINE Error in HTTPServer.serve 2024-09-11T00:57:15.549 INFO:journalctl@ceph.mon.a.smithi103.stdout: Traceback (most recent call last): 2024-09-11T00:57:15.549 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:57:15.549 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-11T00:57:15.549 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:57:15.549 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._run(expiration_interval) 2024-09-11T00:57:15.549 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:57:15.549 INFO:journalctl@ceph.mon.a.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:57:15.549 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:57:15.549 INFO:journalctl@ceph.mon.a.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:57:15.549 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:57:15.550 INFO:journalctl@ceph.mon.a.smithi103.stdout: s = self.context.wrap_socket( 2024-09-11T00:57:15.550 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:57:15.550 INFO:journalctl@ceph.mon.a.smithi103.stdout: return self.sslsocket_class._create( 2024-09-11T00:57:15.550 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:57:15.550 INFO:journalctl@ceph.mon.a.smithi103.stdout: self.do_handshake() 2024-09-11T00:57:15.550 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:57:15.550 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._sslobj.do_handshake() 2024-09-11T00:57:15.550 INFO:journalctl@ceph.mon.a.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:57:15.550 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:15 smithi103 ceph-mon[30562]: [11/Sep/2024:00:57:13] ENGINE Serving on http://172.21.15.103:8765 2024-09-11T00:57:15.550 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:15 smithi103 ceph-mon[30562]: [11/Sep/2024:00:57:13] ENGINE Bus STARTED 2024-09-11T00:57:15.550 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:15 smithi103 ceph-mon[30562]: mgrmap e8: x(active, since 2s) 2024-09-11T00:57:15.883 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-11T00:57:15.884 INFO:teuthology.orchestra.run.smithi103.stdout:Generating ssh key... 2024-09-11T00:57:16.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-mon[30562]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:57:16.999 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: Generating public/private rsa key pair. 2024-09-11T00:57:17.000 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: Your identification has been saved in /tmp/tmpxaumimlk/key 2024-09-11T00:57:17.000 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: Your public key has been saved in /tmp/tmpxaumimlk/key.pub 2024-09-11T00:57:17.000 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: The key fingerprint is: 2024-09-11T00:57:17.000 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: SHA256:tblY1s8ABWfO7YgtG04Ul0xAvwuZEz0z2AiUCwMroF0 ceph-917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:57:17.000 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: The key's randomart image is: 2024-09-11T00:57:17.000 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: +---[RSA 3072]----+ 2024-09-11T00:57:17.000 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: |. E. .oo==*. | 2024-09-11T00:57:17.000 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: |.o . .o .. #o. | 2024-09-11T00:57:17.000 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: |. o . o .B X . | 2024-09-11T00:57:17.001 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: | . .o @ B | 2024-09-11T00:57:17.001 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: | S # * . | 2024-09-11T00:57:17.001 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: | * B = | 2024-09-11T00:57:17.001 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: | . + . o | 2024-09-11T00:57:17.001 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: | | 2024-09-11T00:57:17.001 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: | | 2024-09-11T00:57:17.001 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:16 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: +----[SHA256]-----+ 2024-09-11T00:57:17.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:17 smithi103 ceph-mon[30562]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:57:17.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:17 smithi103 ceph-mon[30562]: Generating ssh key... 2024-09-11T00:57:17.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:17 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' 2024-09-11T00:57:17.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:17 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' 2024-09-11T00:57:18.689 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:18 smithi103 ceph-mon[30562]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:57:18.694 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5MDvNPn53bhDAcR2aou3ThgBUewpLRjmQG78xAKQ9NEJxIbjl1XenwAUTLe68iVOfB7eB6eG9j4n9sRU6/3wexgJNGGZg1O4de5EZvrG0HB5BpVDU5Z8IFytpLeNrE0odk1NZ9Pa+Ea/Oj8zBPoMIJyesidyqgO7svtFSEd8VBgddXkAs5DHHpcht+vn5/i7H5heyuF3N/Sor3qihCU4KTwZhpIPjTNEUlcUR2W999eAWnfhSxD7A4JO2VZJ6tfnmkuaOHdxv9yoTbY3zWA0PByqDfqEY7m8Tgz18e/wKt8qC01HdTPtnUzGkL4DTPJwCnLLGq6SE+Ximk5ZqAVSdaEieVYTX7Bj2xnoBZ/lBkYNJ2EDBET2V9dbDrNUDK9j+Ri2DUJkfpALGNf3+kBk20GPHa0C3RJFFubKuAA26jo+Z4TxzApOgXa8paTgq94P+yY6Bh5nh4ov/ZKiFLK6QMC5S5UXZgIril8TnZvyL1KCGc/AC1CidVEAvSi7GTJs= ceph-917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:57:18.694 INFO:teuthology.orchestra.run.smithi103.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-11T00:57:18.695 INFO:teuthology.orchestra.run.smithi103.stdout:Adding key to root@localhost authorized_keys... 2024-09-11T00:57:18.705 INFO:teuthology.orchestra.run.smithi103.stdout:Adding host smithi103... 2024-09-11T00:57:19.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:19 smithi103 ceph-mon[30562]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi103", "addr": "172.21.15.103", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:57:21.521 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:21 smithi103 ceph-mon[30562]: Deploying cephadm binary to smithi103 2024-09-11T00:57:24.011 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Added host 'smithi103' with addr '172.21.15.103' 2024-09-11T00:57:24.011 INFO:teuthology.orchestra.run.smithi103.stdout:Deploying unmanaged mon service... 2024-09-11T00:57:24.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:24 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' 2024-09-11T00:57:24.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:24 smithi103 ceph-mon[30562]: Added host smithi103 2024-09-11T00:57:24.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:24 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:57:25.624 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-11T00:57:25.624 INFO:teuthology.orchestra.run.smithi103.stdout:Deploying unmanaged mgr service... 2024-09-11T00:57:26.178 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:25 smithi103 ceph-mon[30562]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:57:26.179 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:25 smithi103 ceph-mon[30562]: Saving service mon spec with placement count:5 2024-09-11T00:57:26.179 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:25 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' 2024-09-11T00:57:27.988 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:27 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' 2024-09-11T00:57:27.988 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:27 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' 2024-09-11T00:57:27.988 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:27 smithi103 ceph-mon[30562]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:57:27.988 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:27 smithi103 ceph-mon[30562]: Saving service mgr spec with placement count:2 2024-09-11T00:57:27.989 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:27 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' 2024-09-11T00:57:27.992 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-11T00:57:29.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:29 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/858953047' entity='client.admin' 2024-09-11T00:57:31.314 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:31 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' 2024-09-11T00:57:31.315 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:31 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3957622083' entity='client.admin' 2024-09-11T00:57:31.702 INFO:teuthology.orchestra.run.smithi103.stdout:Enabling the dashboard module... 2024-09-11T00:57:32.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:32 smithi103 ceph-mon[30562]: from='mgr.14118 172.21.15.103:0/882597285' entity='mgr.x' 2024-09-11T00:57:33.423 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:33 smithi103 ceph-mon[30562]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:57:33.423 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:33 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1661403055' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-11T00:57:33.809 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:33 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: ignoring --setuser ceph since I am not root 2024-09-11T00:57:33.809 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:33 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: ignoring --setgroup ceph since I am not root 2024-09-11T00:57:34.688 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:34 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1661403055' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-11T00:57:34.688 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:34 smithi103 ceph-mon[30562]: mgrmap e9: x(active, since 21s) 2024-09-11T00:57:35.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:35 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3213470336' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-11T00:57:35.722 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-11T00:57:35.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-11T00:57:35.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-11T00:57:35.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-11T00:57:35.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-11T00:57:35.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-11T00:57:35.723 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for the mgr to restart... 2024-09-11T00:57:35.723 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr epoch 9... 2024-09-11T00:57:39.807 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:39 smithi103 ceph-mon[30562]: Active manager daemon x restarted 2024-09-11T00:57:39.807 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:39 smithi103 ceph-mon[30562]: Activating manager daemon x 2024-09-11T00:57:39.807 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:39 smithi103 ceph-mon[30562]: osdmap e3: 0 total, 0 up, 0 in 2024-09-11T00:57:39.807 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:39 smithi103 ceph-mon[30562]: mgrmap e10: x(active, starting, since 0.00443419s) 2024-09-11T00:57:39.807 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:57:39.807 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-11T00:57:39.807 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-11T00:57:39.807 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-11T00:57:39.807 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-11T00:57:39.807 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:39 smithi103 ceph-mon[30562]: Manager daemon x is now available 2024-09-11T00:57:40.775 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:57:40.775 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-11T00:57:40.775 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-11T00:57:40.775 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-mon[30562]: mgrmap e11: x(active, since 1.00805s) 2024-09-11T00:57:41.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T00:57:40.878+0000 7f1fe8200640 -1 log_channel(cephadm) log [ERR] : [11/Sep/2024:00:57:40] ENGINE Error in HTTPServer.serve 2024-09-11T00:57:41.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: Traceback (most recent call last): 2024-09-11T00:57:41.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:57:41.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: self._connections.run(self.expiration_interval) 2024-09-11T00:57:41.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:57:41.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: self._run(expiration_interval) 2024-09-11T00:57:41.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:57:41.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:57:41.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:57:41.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:57:41.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:57:41.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: s = self.context.wrap_socket( 2024-09-11T00:57:41.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:57:41.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: return self.sslsocket_class._create( 2024-09-11T00:57:41.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:57:41.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: self.do_handshake() 2024-09-11T00:57:41.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:57:41.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: self._sslobj.do_handshake() 2024-09-11T00:57:41.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:57:41.083 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:57:40 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T00:57:41.397 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-09-11T00:57:41.397 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-11T00:57:41.397 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-11T00:57:41.397 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-09-11T00:57:41.398 INFO:teuthology.orchestra.run.smithi103.stdout:mgr epoch 9 is available 2024-09-11T00:57:41.398 INFO:teuthology.orchestra.run.smithi103.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-11T00:57:41.677 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:41 smithi103 ceph-mon[30562]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-11T00:57:41.678 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:41 smithi103 ceph-mon[30562]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-11T00:57:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:42 smithi103 ceph-mon[30562]: [11/Sep/2024:00:57:40] ENGINE Bus STARTING 2024-09-11T00:57:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:42 smithi103 ceph-mon[30562]: [11/Sep/2024:00:57:40] ENGINE Serving on https://172.21.15.103:7150 2024-09-11T00:57:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:42 smithi103 ceph-mon[30562]: [11/Sep/2024:00:57:40] ENGINE Error in HTTPServer.serve 2024-09-11T00:57:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout: Traceback (most recent call last): 2024-09-11T00:57:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-11T00:57:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-09-11T00:57:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-11T00:57:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._run(expiration_interval) 2024-09-11T00:57:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-11T00:57:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-11T00:57:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-11T00:57:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-11T00:57:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-11T00:57:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout: s = self.context.wrap_socket( 2024-09-11T00:57:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-11T00:57:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout: return self.sslsocket_class._create( 2024-09-11T00:57:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-11T00:57:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout: self.do_handshake() 2024-09-11T00:57:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-11T00:57:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._sslobj.do_handshake() 2024-09-11T00:57:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-11T00:57:42.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:42 smithi103 ceph-mon[30562]: [11/Sep/2024:00:57:40] ENGINE Serving on http://172.21.15.103:8765 2024-09-11T00:57:42.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:42 smithi103 ceph-mon[30562]: [11/Sep/2024:00:57:40] ENGINE Bus STARTED 2024-09-11T00:57:42.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:42 smithi103 ceph-mon[30562]: mgrmap e12: x(active, since 2s) 2024-09-11T00:57:42.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:57:43.531 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE/DCCAuSgAwIBAgIUESPYuWn/VBwtpbRReAGMwhughxwwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkxMTAwNTc0MloXDTM0\nMDkxMjAwNTc0MlowGDEWMBQGA1UEAwwNMTcyLjIxLjE1LjEwMzCCAiIwDQYJKoZI\nhvcNAQEBBQADggIPADCCAgoCggIBAI9sJD2vZZBKaLzAYp/8HjNhL4RQUwAPcTkE\nXruhzklgWHYVy4ef+CwyBvXlc1XG1FZo2ooixT362Yv4MbGDnhNIe0t6ZIiss1wU\nWyPImOzzby0OLQ7q/rrJZ4lOVwxssYm/IHV5mXJBnvdqQ+w9PyfM7JMjhCahhjDv\n5AMlCjSSpDNV6mQqZBeT8ZEfnrPcux23iu4PvNfGPgHpXASBsxn/ZJfG+nkVqzld\nE44GBhvtTulnuLQofo4D9Jt//+KUbzce9aYQpxEUvVdMQ05zL4P5CuBvPAO8JM/C\nj5ulNgLvdmHLxg+eSmIQTzCgivOO9mGeHhoZrKvzpWZnLMM7Q9ho8/SbCCob/OxW\nfhREY+++JI3inoDW3IFuSj8VNAyJGEqpRDrmS9ULuTjBtdYpEVgGDNXfzww11PnM\nd09pB+lU7ILZAd1PZgP9B0prQZ7QY+tYLI5M2TLBFZo3enEdK/7Rlad7V2Y7jx9U\nQsAfOsSDheXvF083rEzgUMniUWW5joa1IQcmMU1X9iYJKUW4+4lxxKTJu7CXtjKm\nazSRA07QmmZ7WeHH9Nabs7bVlVGARlZzREL0h16NL2wb4N7VXuC5yagm3lPqu0Zw\nNcBYB2q5Jy6mnmEV/vgFqiNPhamBi1eWYWFdF5JZAJWkv0naCOMyrWFkiGZtWwt9\nrFXpnKE7AgMBAAGjPzA9MC0GA1UdEQQmMCSCCXNtaXRoaTEwM4IRZGFzaGJvYXJk\nX3NlcnZlcnOHBKwVD2cwDAYDVR0TAQH/BAIwADANBgkqhkiG9w0BAQsFAAOCAgEA\nTmWcRUjJCIXXJ6rWsWu7lL7lA62dmcr7Dk1CJf9GQ32wbgJMV2pLu0aetT3M/iHE\n5GeGujrvO3stYPLFvjGXgonSN/2AbaINgbyCx3jPW1znRSMy5iACLyaVWgKFjYHh\n4JsXpTBMCAYK0NVx0FboNE+XoM+smRtb2GGeI9+EoOkjl8MCXuW+cP0VjdyfDZvj\nWoyKGPpNRGTgdA86Qgc9fcsCgjZjU+rSJxvuscbm9vtyDXtPhfZqSImxREgv0isb\neJ4twyWFu6oaicldYil1bBYPY1vtZ5PNR1F3SQty3u5KvJetLkMW5V+XsFLyb411\njF+JyHQhbDyEokZFIyyLl3nsCJ4XMV5eesqXiw3trHzCJkd0XF/IwHWK8ziCMeBR\nrA2qEo/9I0qlxvF7XvXQlWNLSgu3CnsCWeCbyf75o9qXkqJ27CPh8D+DXrVHJLAG\nWuZlKCbF0gh7xyIWQ6A+s7tk2vIkwr9McdZg2IzVxSkdlO5rUNgbZXhOI3gaQ9l0\ntXElRCDycKS6DYeWj5w1YnRuYVsqnz4sTTn0r2Fb13qdqKBfgnowha/b0gcRTmgO\nAa3XycuUT0NJWKX9UACvzCG9r0H2cubFGkcqKqvlqK1xVqfFmcoVkFfQR5OjEp29\nlhhomPY2sjpkX51WNAjRDmxtb6PjlWCKARLpHJcJ/R0=\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAj2wkPa9lkEpovMBin/weM2EvhFBTAA9xOQReu6HOSWBYdhXL\nh5/4LDIG9eVzVcbUVmjaiiLFPfrZi/gxsYOeE0h7S3pkiKyzXBRbI8iY7PNvLQ4t\nDur+uslniU5XDGyxib8gdXmZckGe92pD7D0/J8zskyOEJqGGMO/kAyUKNJKkM1Xq\nZCpkF5PxkR+es9y7HbeK7g+818Y+AelcBIGzGf9kl8b6eRWrOV0TjgYGG+1O6We4\ntCh+jgP0m3//4pRvNx71phCnERS9V0xDTnMvg/kK4G88A7wkz8KPm6U2Au92YcvG\nD55KYhBPMKCK8472YZ4eGhmsq/OlZmcswztD2Gjz9JsIKhv87FZ+FERj774kjeKe\ngNbcgW5KPxU0DIkYSqlEOuZL1Qu5OMG11ikRWAYM1d/PDDXU+cx3T2kH6VTsgtkB\n3U9mA/0HSmtBntBj61gsjkzZMsEVmjd6cR0r/tGVp3tXZjuPH1RCwB86xIOF5e8X\nTzesTOBQyeJRZbmOhrUhByYxTVf2JgkpRbj7iXHEpMm7sJe2MqZrNJEDTtCaZntZ\n4cf01puzttWVUYBGVnNEQvSHXo0vbBvg3tVe4LnJqCbeU+q7RnA1wFgHarknLqae\nYRX++AWqI0+FqYGLV5ZhYV0XklkAlaS/SdoI4zKtYWSIZm1bC32sVemcoTsCAwEA\nAQKCAgAza9leiGlIn3UH3448v/7v+vM3ZDkt91tnzupMKYo1gqaUx+GuIauv5Mvc\nE8UTRvNQe82G40qGm06uQXFHrOHbFgymlh4/ZnP0GpRGsyApLGp64+9Bvv1PaPCH\nKSBKoxnQQkdX9x4N+fsNx/rMU3U2RuG3K2+xDg53szqz6e7LxJu8kBw2h4BVd8SP\nfJ/A6u3njKvyCJBzaG9I7isArqPROWEOjde13BAExBtDu2MrVh0J0BdH+JDPSBnG\nOtE6om9xetcmEChmFmKATyZ+lQu/LGY664a/7A/isWYdrtE7ojF2hMHhTaZrnF9Y\nFudaxbIOc8tlHjlreTKfEXTaFoCPKCdd1ybVlJ7mEVxIx1uw04Lppm6NmsWDkTDD\nM0rF/vrCSkymhww+Aime/VXfUdW+6w6/biJG8P1D2gJzUgmzlNysrxvmF6ZiF90J\n2q2NEJUzTsmt25qQ/5TOddff6LVKdHzx35puYBeRlh2iSxmRIW2JVDLc6/QQU3v4\ntF2G1Payqq2lu52EuaXOEiaootxmG139X/KBdhb6vEzOq/4Xw3NjcCWYWZnpytNL\nZOPydaCdhWd5RcfGcIo2zZa5wIInpQ35itxLrv9cbg88EIQ50SDPXwn15Hk6ZEQc\nqxq/zvS7tCzXXDQGgHfk51CqHh+9HONxWl5J9hMAjHnbsTlcMQKCAQEAx2Sz/eGb\n/54+jmMuuMEmte1Vm70tlWXhqYJfOtCA2LPN7ZCpb0G+HwjSlkSvCTDrqoYy+qks\n9KkJK8uqZYqa7nsURHf7jl5T4BfvP1lWudEnalkACIL/XPpco0XJT73z8kybMnKx\nj7qfo60olVbPmRlFrSAlTKrEDL/NA+7QR2/m4tZ35+9EHzOn8dil1PCkb7kOfb1W\nuwpE2AsPOtkbMmmB8bciEV6elJx2zWSjjr4H/rogUBWCFxEPb8nSkejyzEknDEFK\nRofW61lsRX2JNyRdO+ARCEAm3VwT7jE21T15Wf7k341V8okygOBqGnM+YRCX0uKR\nBQJSA+W4K9FScwKCAQEAuCOkeMwpgyMhTztlG6x1QhfDoZQy9ZmjD+uHjzEZQCTY\nuBiIvctKRLErxd6NqR7Pjwe/a2Y/93b0LSiHzH3B0NR+izTEkjsVHjKG5XHmNLpQ\nv0LigQoBYZ/dcfhMweaYDVhXNCgoL251q3jhD6DRs/8Z5HZiKPdP2bgC+iSfKKYY\ny6cbsBje+BTJHVT5WBLyQkUxGs3MZQzt2MCqPzj3jwjM4PV4IYHtlb/FjydfDq/J\n0ba4oZQwXw7BsWEWL7K4zSipiYEsVrynUZIT3CXGH/XCp+eEtFyGExY8GhJs1igq\nCI/m2NM2wxz59+RkoE55nP6RQ/34fE5/iq4y2X0cGQKCAQA4bOUKqXet5KgrPyIP\noolD3n/lbKmjp4sunvg3+p0btfZGjjOEioQ04BhH8fPek/t87DEtAgb4zYUM4bu8\ntHaXmjjoD1Qeu87ckalgsfV67BdNXxZFUlzVgPwKMEuBx21rWgZpRk+9LsDSXsQn\nTsO8vYwcLAaiJYkJWpW30TMbpC0gcDTKa8lJUyLpq7dyBQ9jlmjlaFlM4OEOikKr\nEplBsN3W+04mwDH8ODLeeOZYFKrKiP1v7EY+JNPLfL+cDuH2sZTdQPS19Ob6/vlG\nyPm1oxLHSOdJAG5/Ifl55G9x9M2MjDdUk/iIhA7IrbkY9xfl+/4a7YbAdiGjfLSb\nocbFAoIBAQCgiPJrHhNS8N2pZe7QIZpY9L7pr3p+BGPVDVIx1GxfL8CBP2J3lTQ6\njvvKliyKtQHfgLGxwIMkC+D1PdCmxzyiA6APXQHDOx8+JG7WumYosgaTuIwgU8jA\ng89b/U1t/suxVsMwBZKDR5nu1IPiTCKG+nBobY1GidZjyblOu37GwYf8hMPu0sAR\nKI3ttJdt4Zazj/8vjxwTPSJfRhkm5VNusA1uUpNZIx0u4PIry/djpn4dB2AP/lHt\njb/wFORy0S2sLzcfWi59sBtvUhteYtBILMp397AKTl/VZB0h3c5lJr7+l/Z6Mioc\nELcdF1FjMQd1h7q9vD1WolkvXo+WbSyBAoIBAEtuxJbTiX4XxrAOZtuYjvXr/Jjx\nLOm7QN423bdSkzyyMRJiHriYmAVKn9MCOLTyrsyb0g73T3p2FwzC2fvLaBcGpSQH\nE2JJK++l3ub06GFGbq9nt9eAM2n5IRDybJAZkSynw1pBW2ewFsT0tQ2TA4o4PYmV\nhlzv36AlDrKBSicwlaOF2cgtClP/tQrtu5nCOObNQ32uv3lY4stpo0NO/4pageQE\nngBAdlHxW+I8iujPePwwB0R8gDqy8jGL9xiR4dTyXymZ3YQBduRKwb0rfRN9shsz\nh2GeeH6ORSMFFTmbr6nZAQUkO8F33eVc3Cr/5BZ8y6MOKCPKJ7d9UUscEPE=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-11T00:57:43.726 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:43 smithi103 ceph-mon[30562]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:57:44.941 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:57:44.942 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:44 smithi103 ceph-mon[30562]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:57:44.942 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:57:45.550 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-11T00:57:47.043 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-11T00:57:47.043 INFO:teuthology.orchestra.run.smithi103.stdout:Creating initial admin user... 2024-09-11T00:57:47.581 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:47 smithi103 ceph-mon[30562]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:57:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:57:48.678 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$zp81Xs1WkWQiIsRxBYtKx.0GWHBGvzhY.9WopP1mV/3ln7fcymHIa", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726016268, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-11T00:57:48.678 INFO:teuthology.orchestra.run.smithi103.stdout:Fetching dashboard port number... 2024-09-11T00:57:49.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:49 smithi103 ceph-mon[30562]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:57:49.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:57:49.983 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 8443 2024-09-11T00:57:50.002 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-11T00:57:50.002 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-09-11T00:57:50.016 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-11T00:57:50.016 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-09-11T00:57:50.016 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-09-11T00:57:50.016 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-11T00:57:50.018 INFO:teuthology.orchestra.run.smithi103.stdout:Ceph Dashboard is now available at: 2024-09-11T00:57:50.018 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:57:50.019 INFO:teuthology.orchestra.run.smithi103.stdout: URL: https://smithi103.front.sepia.ceph.com:8443/ 2024-09-11T00:57:50.019 INFO:teuthology.orchestra.run.smithi103.stdout: User: admin 2024-09-11T00:57:50.019 INFO:teuthology.orchestra.run.smithi103.stdout: Password: ht0zj54rcs 2024-09-11T00:57:50.019 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:57:50.019 INFO:teuthology.orchestra.run.smithi103.stdout:Saving cluster configuration to /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config directory 2024-09-11T00:57:50.310 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:50 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2681475099' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-11T00:57:51.514 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-11T00:57:51.514 INFO:teuthology.orchestra.run.smithi103.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-11T00:57:51.514 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:57:51.514 INFO:teuthology.orchestra.run.smithi103.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-11T00:57:51.514 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:57:51.515 INFO:teuthology.orchestra.run.smithi103.stdout:Or, if you are only running a single cluster on this host: 2024-09-11T00:57:51.515 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:57:51.515 INFO:teuthology.orchestra.run.smithi103.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-11T00:57:51.515 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:57:51.515 INFO:teuthology.orchestra.run.smithi103.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-11T00:57:51.515 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:57:51.515 INFO:teuthology.orchestra.run.smithi103.stdout: ceph telemetry on 2024-09-11T00:57:51.515 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:57:51.515 INFO:teuthology.orchestra.run.smithi103.stdout:For more information see: 2024-09-11T00:57:51.515 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:57:51.515 INFO:teuthology.orchestra.run.smithi103.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-11T00:57:51.515 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:57:51.515 INFO:teuthology.orchestra.run.smithi103.stdout:Bootstrap complete. 2024-09-11T00:57:51.573 INFO:tasks.cephadm:Fetching config... 2024-09-11T00:57:51.573 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T00:57:51.573 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-11T00:57:51.609 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-11T00:57:51.609 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T00:57:51.609 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-11T00:57:51.686 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-11T00:57:51.686 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T00:57:51.686 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-11T00:57:51.783 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-11T00:57:51.783 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T00:57:51.784 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-11T00:57:51.859 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-11T00:57:51.859 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5MDvNPn53bhDAcR2aou3ThgBUewpLRjmQG78xAKQ9NEJxIbjl1XenwAUTLe68iVOfB7eB6eG9j4n9sRU6/3wexgJNGGZg1O4de5EZvrG0HB5BpVDU5Z8IFytpLeNrE0odk1NZ9Pa+Ea/Oj8zBPoMIJyesidyqgO7svtFSEd8VBgddXkAs5DHHpcht+vn5/i7H5heyuF3N/Sor3qihCU4KTwZhpIPjTNEUlcUR2W999eAWnfhSxD7A4JO2VZJ6tfnmkuaOHdxv9yoTbY3zWA0PByqDfqEY7m8Tgz18e/wKt8qC01HdTPtnUzGkL4DTPJwCnLLGq6SE+Ximk5ZqAVSdaEieVYTX7Bj2xnoBZ/lBkYNJ2EDBET2V9dbDrNUDK9j+Ri2DUJkfpALGNf3+kBk20GPHa0C3RJFFubKuAA26jo+Z4TxzApOgXa8paTgq94P+yY6Bh5nh4ov/ZKiFLK6QMC5S5UXZgIril8TnZvyL1KCGc/AC1CidVEAvSi7GTJs= ceph-917288bc-6fd8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T00:57:51.983 INFO:teuthology.orchestra.run.smithi103.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5MDvNPn53bhDAcR2aou3ThgBUewpLRjmQG78xAKQ9NEJxIbjl1XenwAUTLe68iVOfB7eB6eG9j4n9sRU6/3wexgJNGGZg1O4de5EZvrG0HB5BpVDU5Z8IFytpLeNrE0odk1NZ9Pa+Ea/Oj8zBPoMIJyesidyqgO7svtFSEd8VBgddXkAs5DHHpcht+vn5/i7H5heyuF3N/Sor3qihCU4KTwZhpIPjTNEUlcUR2W999eAWnfhSxD7A4JO2VZJ6tfnmkuaOHdxv9yoTbY3zWA0PByqDfqEY7m8Tgz18e/wKt8qC01HdTPtnUzGkL4DTPJwCnLLGq6SE+Ximk5ZqAVSdaEieVYTX7Bj2xnoBZ/lBkYNJ2EDBET2V9dbDrNUDK9j+Ri2DUJkfpALGNf3+kBk20GPHa0C3RJFFubKuAA26jo+Z4TxzApOgXa8paTgq94P+yY6Bh5nh4ov/ZKiFLK6QMC5S5UXZgIril8TnZvyL1KCGc/AC1CidVEAvSi7GTJs= ceph-917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:57:52.008 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5MDvNPn53bhDAcR2aou3ThgBUewpLRjmQG78xAKQ9NEJxIbjl1XenwAUTLe68iVOfB7eB6eG9j4n9sRU6/3wexgJNGGZg1O4de5EZvrG0HB5BpVDU5Z8IFytpLeNrE0odk1NZ9Pa+Ea/Oj8zBPoMIJyesidyqgO7svtFSEd8VBgddXkAs5DHHpcht+vn5/i7H5heyuF3N/Sor3qihCU4KTwZhpIPjTNEUlcUR2W999eAWnfhSxD7A4JO2VZJ6tfnmkuaOHdxv9yoTbY3zWA0PByqDfqEY7m8Tgz18e/wKt8qC01HdTPtnUzGkL4DTPJwCnLLGq6SE+Ximk5ZqAVSdaEieVYTX7Bj2xnoBZ/lBkYNJ2EDBET2V9dbDrNUDK9j+Ri2DUJkfpALGNf3+kBk20GPHa0C3RJFFubKuAA26jo+Z4TxzApOgXa8paTgq94P+yY6Bh5nh4ov/ZKiFLK6QMC5S5UXZgIril8TnZvyL1KCGc/AC1CidVEAvSi7GTJs= ceph-917288bc-6fd8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T00:57:52.049 INFO:teuthology.orchestra.run.smithi117.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5MDvNPn53bhDAcR2aou3ThgBUewpLRjmQG78xAKQ9NEJxIbjl1XenwAUTLe68iVOfB7eB6eG9j4n9sRU6/3wexgJNGGZg1O4de5EZvrG0HB5BpVDU5Z8IFytpLeNrE0odk1NZ9Pa+Ea/Oj8zBPoMIJyesidyqgO7svtFSEd8VBgddXkAs5DHHpcht+vn5/i7H5heyuF3N/Sor3qihCU4KTwZhpIPjTNEUlcUR2W999eAWnfhSxD7A4JO2VZJ6tfnmkuaOHdxv9yoTbY3zWA0PByqDfqEY7m8Tgz18e/wKt8qC01HdTPtnUzGkL4DTPJwCnLLGq6SE+Ximk5ZqAVSdaEieVYTX7Bj2xnoBZ/lBkYNJ2EDBET2V9dbDrNUDK9j+Ri2DUJkfpALGNf3+kBk20GPHa0C3RJFFubKuAA26jo+Z4TxzApOgXa8paTgq94P+yY6Bh5nh4ov/ZKiFLK6QMC5S5UXZgIril8TnZvyL1KCGc/AC1CidVEAvSi7GTJs= ceph-917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:57:52.062 DEBUG:teuthology.orchestra.run.smithi183:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5MDvNPn53bhDAcR2aou3ThgBUewpLRjmQG78xAKQ9NEJxIbjl1XenwAUTLe68iVOfB7eB6eG9j4n9sRU6/3wexgJNGGZg1O4de5EZvrG0HB5BpVDU5Z8IFytpLeNrE0odk1NZ9Pa+Ea/Oj8zBPoMIJyesidyqgO7svtFSEd8VBgddXkAs5DHHpcht+vn5/i7H5heyuF3N/Sor3qihCU4KTwZhpIPjTNEUlcUR2W999eAWnfhSxD7A4JO2VZJ6tfnmkuaOHdxv9yoTbY3zWA0PByqDfqEY7m8Tgz18e/wKt8qC01HdTPtnUzGkL4DTPJwCnLLGq6SE+Ximk5ZqAVSdaEieVYTX7Bj2xnoBZ/lBkYNJ2EDBET2V9dbDrNUDK9j+Ri2DUJkfpALGNf3+kBk20GPHa0C3RJFFubKuAA26jo+Z4TxzApOgXa8paTgq94P+yY6Bh5nh4ov/ZKiFLK6QMC5S5UXZgIril8TnZvyL1KCGc/AC1CidVEAvSi7GTJs= ceph-917288bc-6fd8-11ef-bcea-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-11T00:57:52.081 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:51 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2991768379' entity='client.admin' 2024-09-11T00:57:52.103 INFO:teuthology.orchestra.run.smithi183.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC5MDvNPn53bhDAcR2aou3ThgBUewpLRjmQG78xAKQ9NEJxIbjl1XenwAUTLe68iVOfB7eB6eG9j4n9sRU6/3wexgJNGGZg1O4de5EZvrG0HB5BpVDU5Z8IFytpLeNrE0odk1NZ9Pa+Ea/Oj8zBPoMIJyesidyqgO7svtFSEd8VBgddXkAs5DHHpcht+vn5/i7H5heyuF3N/Sor3qihCU4KTwZhpIPjTNEUlcUR2W999eAWnfhSxD7A4JO2VZJ6tfnmkuaOHdxv9yoTbY3zWA0PByqDfqEY7m8Tgz18e/wKt8qC01HdTPtnUzGkL4DTPJwCnLLGq6SE+Ximk5ZqAVSdaEieVYTX7Bj2xnoBZ/lBkYNJ2EDBET2V9dbDrNUDK9j+Ri2DUJkfpALGNf3+kBk20GPHa0C3RJFFubKuAA26jo+Z4TxzApOgXa8paTgq94P+yY6Bh5nh4ov/ZKiFLK6QMC5S5UXZgIril8TnZvyL1KCGc/AC1CidVEAvSi7GTJs= ceph-917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:57:52.116 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-11T00:57:52.505 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:57:52.992 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:52 smithi103 ceph-mon[30562]: mgrmap e13: x(active, since 12s) 2024-09-11T00:57:54.106 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-11T00:57:54.106 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-11T00:57:54.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:54 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1083204974' entity='client.admin' 2024-09-11T00:57:54.656 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:57:56.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:55 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:57:56.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:55 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:57:56.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:55 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi103", "name": "osd_memory_target"} : dispatch 2024-09-11T00:57:56.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:55 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:57:56.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:55 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:57:56.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:55 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:57:56.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:55 smithi103 ceph-mon[30562]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:57:56.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:55 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:57:56.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:55 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:57:56.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:55 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:57:56.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:55 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:57:56.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:55 smithi103 ceph-mon[30562]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-11T00:57:56.579 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi117 2024-09-11T00:57:56.579 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T00:57:56.580 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/etc/ceph/ceph.conf 2024-09-11T00:57:56.599 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T00:57:56.599 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:57:56.658 INFO:tasks.cephadm:Adding host smithi117 to orchestrator... 2024-09-11T00:57:56.658 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch host add smithi117 2024-09-11T00:57:56.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:56 smithi103 ceph-mon[30562]: Updating smithi103:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:57:56.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:56 smithi103 ceph-mon[30562]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:57:57.620 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:57:58.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:58 smithi103 ceph-mon[30562]: Updating smithi103:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:57:58.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:58 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:57:58.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:58 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:57:58.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:58 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:57:59.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:57:59 smithi103 ceph-mon[30562]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi117", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:58:00.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:00 smithi103 ceph-mon[30562]: Deploying cephadm binary to smithi117 2024-09-11T00:58:00.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:00 smithi103 ceph-mon[30562]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:01.508 INFO:teuthology.orchestra.run.smithi103.stdout:Added host 'smithi117' with addr '172.21.15.117' 2024-09-11T00:58:02.407 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T00:58:02.766 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:02.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:02 smithi103 ceph-mon[30562]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:02.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:02.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:02 smithi103 ceph-mon[30562]: Added host smithi117 2024-09-11T00:58:02.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:02.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:02.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:03.470 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:58:03.470 INFO:teuthology.orchestra.run.smithi103.stdout:[{"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}, {"addr": "172.21.15.117", "hostname": "smithi117", "labels": [], "status": ""}] 2024-09-11T00:58:04.106 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:03 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:04.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:03 smithi103 ceph-mon[30562]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:04.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:03 smithi103 ceph-mon[30562]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:58:04.143 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi183 2024-09-11T00:58:04.143 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-11T00:58:04.143 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/etc/ceph/ceph.conf 2024-09-11T00:58:04.164 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-11T00:58:04.164 DEBUG:teuthology.orchestra.run.smithi183:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:58:04.223 INFO:tasks.cephadm:Adding host smithi183 to orchestrator... 2024-09-11T00:58:04.224 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch host add smithi183 2024-09-11T00:58:04.581 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:06.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:06 smithi103 ceph-mon[30562]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi183", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:58:06.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:06 smithi103 ceph-mon[30562]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:06.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:06.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:06.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:06.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:06.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"} : dispatch 2024-09-11T00:58:06.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:06.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:06.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:06.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:06.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:07.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:07 smithi103 ceph-mon[30562]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-11T00:58:07.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:07 smithi103 ceph-mon[30562]: Updating smithi117:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:07.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:07 smithi103 ceph-mon[30562]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:58:07.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:07 smithi103 ceph-mon[30562]: Updating smithi117:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:58:07.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:07 smithi103 ceph-mon[30562]: Deploying cephadm binary to smithi183 2024-09-11T00:58:08.497 INFO:teuthology.orchestra.run.smithi103.stdout:Added host 'smithi183' with addr '172.21.15.183' 2024-09-11T00:58:08.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:08 smithi103 ceph-mon[30562]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:09.252 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch host ls --format=json 2024-09-11T00:58:09.617 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:09.755 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:09 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:09.755 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:09 smithi103 ceph-mon[30562]: Added host smithi183 2024-09-11T00:58:09.756 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:09 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:09.756 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:09 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:09.756 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:09 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:10.375 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:58:10.375 INFO:teuthology.orchestra.run.smithi103.stdout:[{"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}, {"addr": "172.21.15.117", "hostname": "smithi117", "labels": [], "status": ""}, {"addr": "172.21.15.183", "hostname": "smithi183", "labels": [], "status": ""}] 2024-09-11T00:58:10.761 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:10 smithi103 ceph-mon[30562]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:10.761 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:10 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:11.079 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-11T00:58:11.079 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd crush tunables default 2024-09-11T00:58:11.435 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:11.761 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:11 smithi103 ceph-mon[30562]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:58:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:adjusted tunables profile to default 2024-09-11T00:58:12.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:12 smithi103 ceph-mon[30562]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:12.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:12 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1921588355' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-11T00:58:13.253 INFO:tasks.cephadm:Adding mon.a on smithi103 2024-09-11T00:58:13.253 INFO:tasks.cephadm:Adding mon.b on smithi117 2024-09-11T00:58:13.253 INFO:tasks.cephadm:Adding mon.c on smithi183 2024-09-11T00:58:13.253 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch apply mon '3;smithi103:172.21.15.103=a;smithi117:172.21.15.117=b;smithi183:172.21.15.183=c' 2024-09-11T00:58:13.497 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:13.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:13 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1921588355' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T00:58:13.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:13 smithi103 ceph-mon[30562]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:58:13.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:13 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:13.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:13 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:13.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:13 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:13.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:13 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:13.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:13 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi183", "name": "osd_memory_target"} : dispatch 2024-09-11T00:58:13.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:13 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:13.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:13 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:14.116 INFO:teuthology.orchestra.run.smithi183.stdout:Scheduled mon update... 2024-09-11T00:58:14.806 DEBUG:teuthology.orchestra.run.smithi117:mon.b> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.b.service 2024-09-11T00:58:14.809 DEBUG:teuthology.orchestra.run.smithi183:mon.c> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.c.service 2024-09-11T00:58:14.811 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T00:58:14.812 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T00:58:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: Updating smithi183:/etc/ceph/ceph.conf 2024-09-11T00:58:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: Updating smithi183:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: Updating smithi183:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:58:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: Updating smithi183:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:58:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:14.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:14.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:14.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:58:14.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:15.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:15 smithi103 ceph-mon[30562]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi103:172.21.15.103=a;smithi117:172.21.15.117=b;smithi183:172.21.15.183=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:58:15.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:15 smithi103 ceph-mon[30562]: Saving service mon spec with placement smithi103:172.21.15.103=a;smithi117:172.21.15.117=b;smithi183:172.21.15.183=c;count:3 2024-09-11T00:58:15.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:15 smithi103 ceph-mon[30562]: Deploying daemon mon.c on smithi183 2024-09-11T00:58:16.484 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:16 smithi103 ceph-mon[30562]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:17.747 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:58:17.747 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":1,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","modified":"2024-09-11T00:56:42.463809Z","created":"2024-09-11T00:56:42.463809Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-11T00:58:17.748 INFO:teuthology.orchestra.run.smithi183.stderr:dumped monmap epoch 1 2024-09-11T00:58:17.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:17 smithi103 ceph-mon[30562]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:18.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:18 smithi103 ceph-mon[30562]: from='client.? 172.21.15.183:0/1134015176' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:58:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:18 smithi183 systemd[1]: Started Ceph mon.c for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T00:58:19.286 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T00:58:19.287 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T00:58:19.537 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:58:24.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:58:24.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:24.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: mon.a calling monitor election 2024-09-11T00:58:24.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:24.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:24.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:24.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: mon.c calling monitor election 2024-09-11T00:58:24.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:24.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:24.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:24.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:24.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:24.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T00:58:24.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: monmap epoch 2 2024-09-11T00:58:24.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: fsid 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:58:24.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: last_changed 2024-09-11T00:58:18.742898+0000 2024-09-11T00:58:24.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: created 2024-09-11T00:56:42.463809+0000 2024-09-11T00:58:24.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: min_mon_release 19 (squid) 2024-09-11T00:58:24.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: election_strategy: 1 2024-09-11T00:58:24.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-11T00:58:24.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-09-11T00:58:24.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: fsmap 2024-09-11T00:58:24.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:58:24.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: mgrmap e13: x(active, since 44s) 2024-09-11T00:58:24.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: overall HEALTH_OK 2024-09-11T00:58:24.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:24.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:24.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:24.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:58:24.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:24.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:58:24.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:24.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: mon.a calling monitor election 2024-09-11T00:58:24.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:24.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:24.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:24.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: mon.c calling monitor election 2024-09-11T00:58:24.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:24.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:24.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:24.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:24.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:24.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: monmap epoch 2 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: fsid 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: last_changed 2024-09-11T00:58:18.742898+0000 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: created 2024-09-11T00:56:42.463809+0000 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: min_mon_release 19 (squid) 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: election_strategy: 1 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: fsmap 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: mgrmap e13: x(active, since 44s) 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: overall HEALTH_OK 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:58:24.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:24.600 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:58:24.600 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":2,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","modified":"2024-09-11T00:58:18.742898Z","created":"2024-09-11T00:56:42.463809Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:3300","nonce":0},{"type":"v1","addr":"172.21.15.183:6789","nonce":0}]},"addr":"172.21.15.183:6789/0","public_addr":"172.21.15.183:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T00:58:24.600 INFO:teuthology.orchestra.run.smithi183.stderr:dumped monmap epoch 2 2024-09-11T00:58:24.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:24 smithi183 ceph-mon[34992]: Deploying daemon mon.b on smithi117 2024-09-11T00:58:24.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:24 smithi183 ceph-mon[34992]: from='client.? 172.21.15.183:0/421884328' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:58:24.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:25.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:24 smithi103 ceph-mon[30562]: Deploying daemon mon.b on smithi117 2024-09-11T00:58:25.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:24 smithi103 ceph-mon[30562]: from='client.? 172.21.15.183:0/421884328' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:58:25.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:26.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:25 smithi103 ceph-mon[30562]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:26.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:25 smithi183 ceph-mon[34992]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:26.211 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T00:58:26.211 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T00:58:26.463 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:58:27.142 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:58:27.143 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":2,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","modified":"2024-09-11T00:58:18.742898Z","created":"2024-09-11T00:56:42.463809Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:3300","nonce":0},{"type":"v1","addr":"172.21.15.183:6789","nonce":0}]},"addr":"172.21.15.183:6789/0","public_addr":"172.21.15.183:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-11T00:58:27.143 INFO:teuthology.orchestra.run.smithi183.stderr:dumped monmap epoch 2 2024-09-11T00:58:27.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:27 smithi183 ceph-mon[34992]: from='client.? 172.21.15.183:0/3996952635' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:58:27.462 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-11T00:58:27.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:27 smithi103 ceph-mon[30562]: from='client.? 172.21.15.183:0/3996952635' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:58:27.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-11T00:58:27.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-11T00:58:27.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-11T00:58:27.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-11T00:58:27.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-11T00:58:27.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-11T00:58:27.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T00:58:27.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T00:58:27.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-11T00:58:27.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:27.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:58:27.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi183", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:58:27.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:27.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi117", "name": "osd_memory_target"} : dispatch 2024-09-11T00:58:27.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:27.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:27.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-11T00:58:27.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: Updating smithi117:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:27.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: Updating smithi117:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:58:27.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: Updating smithi117:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:58:27.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: Deploying cephadm binary to smithi183 2024-09-11T00:58:27.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:27.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: Added host smithi183 2024-09-11T00:58:27.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:27.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:27.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T00:58:27.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:27.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1921588355' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-11T00:58:27.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1921588355' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-11T00:58:27.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:58:27.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.877 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi183", "name": "osd_memory_target"} : dispatch 2024-09-11T00:58:27.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:27.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:27.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: Updating smithi183:/etc/ceph/ceph.conf 2024-09-11T00:58:27.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: Updating smithi183:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:27.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: Updating smithi183:/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:58:27.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: Updating smithi183:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.client.admin.keyring 2024-09-11T00:58:27.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:27.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:27.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:27.878 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:27.879 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.879 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:58:27.879 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:27.879 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi103:172.21.15.103=a;smithi117:172.21.15.117=b;smithi183:172.21.15.183=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:58:27.879 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: Saving service mon spec with placement smithi103:172.21.15.103=a;smithi117:172.21.15.117=b;smithi183:172.21.15.183=c;count:3 2024-09-11T00:58:27.879 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: Deploying daemon mon.c on smithi183 2024-09-11T00:58:27.879 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:27.879 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:27.879 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='client.? 172.21.15.183:0/1134015176' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:58:27.879 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:58:27.879 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:27.879 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mon.a calling monitor election 2024-09-11T00:58:27.879 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:27.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:27.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:27.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mon.c calling monitor election 2024-09-11T00:58:27.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:27.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:27.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:27.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:27.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:27.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-11T00:58:27.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: monmap epoch 2 2024-09-11T00:58:27.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: fsid 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:58:27.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: last_changed 2024-09-11T00:58:18.742898+0000 2024-09-11T00:58:27.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: created 2024-09-11T00:56:42.463809+0000 2024-09-11T00:58:27.880 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: min_mon_release 19 (squid) 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: election_strategy: 1 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: fsmap 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mgrmap e13: x(active, since 44s) 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: overall HEALTH_OK 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: Deploying daemon mon.b on smithi117 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='client.? 172.21.15.183:0/421884328' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:58:27.881 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:27.882 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:27.882 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: from='client.? 172.21.15.183:0/3996952635' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:58:27.882 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 ceph-mon[35358]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-11T00:58:27.882 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 bash[35339]: 27fec113e201a8efbf810aa6375067ff549be645f7b3574282e78e55033b344d 2024-09-11T00:58:27.882 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:27 smithi117 systemd[1]: Started Ceph mon.b for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T00:58:28.750 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-11T00:58:28.751 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph mon dump -f json 2024-09-11T00:58:29.005 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:58:32.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:32.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:58:32.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: mon.a calling monitor election 2024-09-11T00:58:32.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: mon.c calling monitor election 2024-09-11T00:58:32.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:32.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:32.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: mon.b calling monitor election 2024-09-11T00:58:32.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:32.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T00:58:32.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: monmap epoch 3 2024-09-11T00:58:32.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: fsid 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:58:32.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: last_changed 2024-09-11T00:58:27.466859+0000 2024-09-11T00:58:32.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: created 2024-09-11T00:56:42.463809+0000 2024-09-11T00:58:32.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: min_mon_release 19 (squid) 2024-09-11T00:58:32.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: election_strategy: 1 2024-09-11T00:58:32.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-11T00:58:32.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-09-11T00:58:32.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: 2: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-11T00:58:32.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: fsmap 2024-09-11T00:58:32.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:58:32.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: mgrmap e13: x(active, since 53s) 2024-09-11T00:58:32.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: overall HEALTH_OK 2024-09-11T00:58:32.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:32.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:32.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:32.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:58:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: mon.a calling monitor election 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: mon.c calling monitor election 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: mon.b calling monitor election 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: monmap epoch 3 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: fsid 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: last_changed 2024-09-11T00:58:27.466859+0000 2024-09-11T00:58:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: created 2024-09-11T00:56:42.463809+0000 2024-09-11T00:58:32.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: min_mon_release 19 (squid) 2024-09-11T00:58:32.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: election_strategy: 1 2024-09-11T00:58:32.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-11T00:58:32.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-09-11T00:58:32.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: 2: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-11T00:58:32.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: fsmap 2024-09-11T00:58:32.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:58:32.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: mgrmap e13: x(active, since 53s) 2024-09-11T00:58:32.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: overall HEALTH_OK 2024-09-11T00:58:32.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:32.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:32.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:32.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:32.912 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T00:58:32.912 INFO:teuthology.orchestra.run.smithi183.stdout:{"epoch":3,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","modified":"2024-09-11T00:58:27.466859Z","created":"2024-09-11T00:56:42.463809Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:3300","nonce":0},{"type":"v1","addr":"172.21.15.183:6789","nonce":0}]},"addr":"172.21.15.183:6789/0","public_addr":"172.21.15.183:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:3300","nonce":0},{"type":"v1","addr":"172.21.15.117:6789","nonce":0}]},"addr":"172.21.15.117:6789/0","public_addr":"172.21.15.117:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-11T00:58:32.912 INFO:teuthology.orchestra.run.smithi183.stderr:dumped monmap epoch 3 2024-09-11T00:58:32.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:32.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T00:58:32.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: mon.a calling monitor election 2024-09-11T00:58:32.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: mon.c calling monitor election 2024-09-11T00:58:32.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T00:58:32.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:32.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: mon.b calling monitor election 2024-09-11T00:58:32.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.913 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:32.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:32.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-11T00:58:32.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: monmap epoch 3 2024-09-11T00:58:32.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: fsid 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:58:32.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: last_changed 2024-09-11T00:58:27.466859+0000 2024-09-11T00:58:32.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: created 2024-09-11T00:56:42.463809+0000 2024-09-11T00:58:32.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: min_mon_release 19 (squid) 2024-09-11T00:58:32.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: election_strategy: 1 2024-09-11T00:58:32.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-09-11T00:58:32.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: 1: [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] mon.c 2024-09-11T00:58:32.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: 2: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-09-11T00:58:32.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: fsmap 2024-09-11T00:58:32.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: osdmap e4: 0 total, 0 up, 0 in 2024-09-11T00:58:32.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: mgrmap e13: x(active, since 53s) 2024-09-11T00:58:32.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: overall HEALTH_OK 2024-09-11T00:58:32.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:32.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:32.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:32.915 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:33.481 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-11T00:58:33.481 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config generate-minimal-conf 2024-09-11T00:58:33.788 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:33 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:33.788 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:33 smithi183 ceph-mon[34992]: from='client.? 172.21.15.183:0/1123712847' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:58:33.788 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:33 smithi183 ceph-mon[34992]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:33.788 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:33 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:33.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:33 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:33.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:33 smithi103 ceph-mon[30562]: from='client.? 172.21.15.183:0/1123712847' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:58:33.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:33 smithi103 ceph-mon[30562]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:33.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:33 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:33.848 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:33.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:33 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:33 smithi117 ceph-mon[35358]: from='client.? 172.21.15.183:0/1123712847' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-11T00:58:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:33 smithi117 ceph-mon[35358]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:33 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T00:58:34.582 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 00:58:34 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T00:58:34.467+0000 7f2028800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-11T00:58:34.638 INFO:teuthology.orchestra.run.smithi103.stdout:# minimal ceph.conf for 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:58:34.638 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2024-09-11T00:58:34.638 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T00:58:34.638 INFO:teuthology.orchestra.run.smithi103.stdout: mon_host = [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] 2024-09-11T00:58:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:34 smithi117 ceph-mon[35358]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-11T00:58:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:34 smithi117 ceph-mon[35358]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-11T00:58:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:34 smithi117 ceph-mon[35358]: Updating smithi183:/etc/ceph/ceph.conf 2024-09-11T00:58:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:34 smithi117 ceph-mon[35358]: Updating smithi183:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:34 smithi117 ceph-mon[35358]: Updating smithi117:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:34.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:34.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:34.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:34.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:34 smithi183 ceph-mon[34992]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-11T00:58:34.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:34 smithi183 ceph-mon[34992]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-11T00:58:34.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:34 smithi183 ceph-mon[34992]: Updating smithi183:/etc/ceph/ceph.conf 2024-09-11T00:58:34.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:34 smithi183 ceph-mon[34992]: Updating smithi183:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:34.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:34 smithi183 ceph-mon[34992]: Updating smithi117:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:35.072 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.072 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.072 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.072 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.073 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:35.073 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:35.073 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:34 smithi103 ceph-mon[30562]: Updating smithi103:/etc/ceph/ceph.conf 2024-09-11T00:58:35.073 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:34 smithi103 ceph-mon[30562]: Updating smithi117:/etc/ceph/ceph.conf 2024-09-11T00:58:35.073 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:34 smithi103 ceph-mon[30562]: Updating smithi183:/etc/ceph/ceph.conf 2024-09-11T00:58:35.073 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:34 smithi103 ceph-mon[30562]: Updating smithi183:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:35.073 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:34 smithi103 ceph-mon[30562]: Updating smithi117:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:35.461 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-11T00:58:35.461 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T00:58:35.461 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T00:58:35.519 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T00:58:35.519 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:58:35.616 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T00:58:35.616 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T00:58:35.644 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T00:58:35.644 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:58:35.710 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-11T00:58:35.710 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.conf 2024-09-11T00:58:35.738 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-11T00:58:35.766 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-11T00:58:35.805 INFO:tasks.cephadm:Adding mgr.x on smithi103 2024-09-11T00:58:35.806 INFO:tasks.cephadm:Adding mgr.y on smithi117 2024-09-11T00:58:35.806 INFO:tasks.cephadm:Adding mgr.z on smithi183 2024-09-11T00:58:35.806 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch apply mgr '3;smithi103=x;smithi117=y;smithi183=z' 2024-09-11T00:58:35.868 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1052159948' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:35.868 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.868 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.868 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.868 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: Updating smithi103:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:35.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T00:58:35.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:58:35.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:58:35.869 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:35.870 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: Reconfiguring daemon mon.a on smithi103 2024-09-11T00:58:35.870 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:35 smithi183 ceph-mon[34992]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:35.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1052159948' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: Updating smithi103:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T00:58:35.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:58:35.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:58:35.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:35.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: Reconfiguring daemon mon.a on smithi103 2024-09-11T00:58:35.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:35 smithi117 ceph-mon[35358]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:35.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1052159948' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:35.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: Updating smithi103:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/config/ceph.conf 2024-09-11T00:58:35.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.887 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.888 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:35.888 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: Reconfiguring mon.a (unknown last config time)... 2024-09-11T00:58:35.888 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:58:35.888 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:58:35.888 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:35.888 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: Reconfiguring daemon mon.a on smithi103 2024-09-11T00:58:35.888 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:35 smithi103 ceph-mon[30562]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:36.084 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T00:58:36.725 INFO:teuthology.orchestra.run.smithi183.stdout:Scheduled mgr update... 2024-09-11T00:58:37.281 DEBUG:teuthology.orchestra.run.smithi117:mgr.y> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mgr.y.service 2024-09-11T00:58:37.284 DEBUG:teuthology.orchestra.run.smithi183:mgr.z> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mgr.z.service 2024-09-11T00:58:37.324 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-11T00:58:37.324 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set client client_mount_timeout 600 2024-09-11T00:58:37.328 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-11T00:58:37.329 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set client debug_client 20 2024-09-11T00:58:37.374 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-11T00:58:37.374 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set client debug_ms 1 2024-09-11T00:58:37.420 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-11T00:58:37.420 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set client rados_mon_op_timeout 900 2024-09-11T00:58:37.466 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-11T00:58:37.466 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set client rados_osd_op_timeout 900 2024-09-11T00:58:37.512 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-11T00:58:37.512 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds 20 2024-09-11T00:58:37.559 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-11T00:58:37.559 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mds debug_mds_balancer 20 2024-09-11T00:58:37.606 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-11T00:58:37.606 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mds debug_ms 2 2024-09-11T00:58:37.659 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-11T00:58:37.659 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-11T00:58:37.712 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-11T00:58:37.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_merge_size 5 2024-09-11T00:58:37.763 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-11T00:58:37.763 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_bits 3 2024-09-11T00:58:37.813 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-11T00:58:37.814 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mds mds_bal_split_size 100 2024-09-11T00:58:37.868 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-11T00:58:37.868 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_frag True 2024-09-11T00:58:37.889 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:37 smithi103 ceph-mon[30562]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=x;smithi117=y;smithi183=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:58:37.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:37 smithi103 ceph-mon[30562]: Saving service mgr spec with placement smithi103=x;smithi117=y;smithi183=z;count:3 2024-09-11T00:58:37.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:37 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:37.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:37 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:37.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:37 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:37.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:37 smithi103 ceph-mon[30562]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T00:58:37.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:37 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:58:37.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:37 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:58:37.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:37 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:37.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:37 smithi103 ceph-mon[30562]: Reconfiguring daemon mgr.x on smithi103 2024-09-11T00:58:37.890 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:37 smithi103 ceph-mon[30562]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:37.906 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-11T00:58:37.906 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mds mds_debug_scatterstat True 2024-09-11T00:58:37.957 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-11T00:58:37.958 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mds mds_op_complaint_time 180 2024-09-11T00:58:38.008 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-11T00:58:38.008 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mds mds_verify_scatter True 2024-09-11T00:58:38.061 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-11T00:58:38.061 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mds osd_op_complaint_time 180 2024-09-11T00:58:38.111 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-11T00:58:38.111 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mds rados_mon_op_timeout 900 2024-09-11T00:58:38.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:37 smithi117 ceph-mon[35358]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=x;smithi117=y;smithi183=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:58:38.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:37 smithi117 ceph-mon[35358]: Saving service mgr spec with placement smithi103=x;smithi117=y;smithi183=z;count:3 2024-09-11T00:58:38.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:37 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:38.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:37 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:38.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:37 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:38.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:37 smithi117 ceph-mon[35358]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T00:58:38.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:37 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:58:38.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:37 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:58:38.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:37 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:38.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:37 smithi117 ceph-mon[35358]: Reconfiguring daemon mgr.x on smithi103 2024-09-11T00:58:38.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:37 smithi117 ceph-mon[35358]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:38.165 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-11T00:58:38.166 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mds rados_osd_op_timeout 900 2024-09-11T00:58:38.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:37 smithi183 ceph-mon[34992]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=x;smithi117=y;smithi183=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:58:38.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:37 smithi183 ceph-mon[34992]: Saving service mgr spec with placement smithi103=x;smithi117=y;smithi183=z;count:3 2024-09-11T00:58:38.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:37 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:38.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:37 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:38.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:37 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:38.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:37 smithi183 ceph-mon[34992]: Reconfiguring mgr.x (unknown last config time)... 2024-09-11T00:58:38.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:37 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:58:38.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:37 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:58:38.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:37 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:38.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:37 smithi183 ceph-mon[34992]: Reconfiguring daemon mgr.x on smithi103 2024-09-11T00:58:38.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:37 smithi183 ceph-mon[34992]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:38.220 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-11T00:58:38.220 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mon mon_op_complaint_time 120 2024-09-11T00:58:38.282 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-11T00:58:38.282 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-11T00:58:38.341 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-11T00:58:38.341 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config set osd osd_op_complaint_time 180 2024-09-11T00:58:38.395 DEBUG:tasks.cephadm:set 22 configs 2024-09-11T00:58:38.396 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi103') 2024-09-11T00:58:39.231 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:39.239 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:39.245 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:39.274 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:39.400 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:39.781 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:39.786 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:39.787 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:39.788 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:39.790 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:40.488 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:40.488 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:40.489 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:40 smithi103 ceph-mon[30562]: Reconfiguring mon.b (monmap changed)... 2024-09-11T00:58:40.489 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:58:40.489 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:58:40.489 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:40.489 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:40 smithi103 ceph-mon[30562]: Reconfiguring daemon mon.b on smithi117 2024-09-11T00:58:40.489 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:40 smithi103 ceph-mon[30562]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:40.570 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:40.570 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:40.570 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:40 smithi117 ceph-mon[35358]: Reconfiguring mon.b (monmap changed)... 2024-09-11T00:58:40.570 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:58:40.570 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:58:40.570 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:40.570 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:40 smithi117 ceph-mon[35358]: Reconfiguring daemon mon.b on smithi117 2024-09-11T00:58:40.570 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:40 smithi117 ceph-mon[35358]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:40.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:40.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:40.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:40 smithi183 ceph-mon[34992]: Reconfiguring mon.b (monmap changed)... 2024-09-11T00:58:40.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:58:40.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:58:40.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:40.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:40 smithi183 ceph-mon[34992]: Reconfiguring daemon mon.b on smithi117 2024-09-11T00:58:40.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:40 smithi183 ceph-mon[34992]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:41.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:41 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2641715573' entity='client.admin' 2024-09-11T00:58:41.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:41.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:41.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:41 smithi103 ceph-mon[30562]: Reconfiguring mon.c (monmap changed)... 2024-09-11T00:58:41.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:58:41.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:58:41.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:41.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:41 smithi103 ceph-mon[30562]: Reconfiguring daemon mon.c on smithi183 2024-09-11T00:58:41.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:41 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:58:41.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:41 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:58:41.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:41 smithi103 ceph-mon[30562]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:41.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:41 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2641715573' entity='client.admin' 2024-09-11T00:58:41.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:41.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:41.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:41 smithi183 ceph-mon[34992]: Reconfiguring mon.c (monmap changed)... 2024-09-11T00:58:41.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:58:41.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:58:41.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:41.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:41 smithi183 ceph-mon[34992]: Reconfiguring daemon mon.c on smithi183 2024-09-11T00:58:41.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:41 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:58:41.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:41 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:58:41.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:41 smithi183 ceph-mon[34992]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:41.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.864+0000 7f6a1b400640 1 -- 172.21.15.103:0/3349788125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a14102a30 msgr2=0x7f6a14102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.864+0000 7f6a1b400640 1 --2- 172.21.15.103:0/3349788125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a14102a30 0x7f6a14102e30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009930 tx=0x7f6a0402a420 comp rx=0 tx=0).stop 2024-09-11T00:58:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.865+0000 7f6a1b400640 1 -- 172.21.15.103:0/3349788125 shutdown_connections 2024-09-11T00:58:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.865+0000 7f6a1b400640 1 --2- 172.21.15.103:0/3349788125 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a14104550 0x7f6a1410aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.865+0000 7f6a1b400640 1 --2- 172.21.15.103:0/3349788125 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a14103b90 0x7f6a14104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.865+0000 7f6a1b400640 1 --2- 172.21.15.103:0/3349788125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a14102a30 0x7f6a14102e30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.865+0000 7f6a1b400640 1 -- 172.21.15.103:0/3349788125 >> 172.21.15.103:0/3349788125 conn(0x7f6a140fe320 msgr2=0x7f6a14100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.865+0000 7f6a1b400640 1 -- 172.21.15.103:0/3349788125 shutdown_connections 2024-09-11T00:58:41.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.865+0000 7f6a1b400640 1 -- 172.21.15.103:0/3349788125 wait complete. 2024-09-11T00:58:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.865+0000 7f6a1b400640 1 Processor -- start 2024-09-11T00:58:41.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.866+0000 7f6a1b400640 1 -- start start 2024-09-11T00:58:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.866+0000 7f6a1b400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a14102a30 0x7f6a1419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.866+0000 7f6a1b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a14103b90 0x7f6a1419ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.866+0000 7f6a1b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a14104550 0x7f6a1419b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.866+0000 7f6a1b400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1410da30 con 0x7f6a14103b90 2024-09-11T00:58:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.866+0000 7f6a1b400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1410d8b0 con 0x7f6a14104550 2024-09-11T00:58:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.866+0000 7f6a1b400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1410dbb0 con 0x7f6a14102a30 2024-09-11T00:58:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.866+0000 7f6a18a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a14102a30 0x7f6a1419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.866+0000 7f6a18a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a14102a30 0x7f6a1419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:41244/0 (socket says 172.21.15.103:41244) 2024-09-11T00:58:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.866+0000 7f6a18a00640 1 -- 172.21.15.103:0/2499805603 learned_addr learned my addr 172.21.15.103:0/2499805603 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.866+0000 7f6a0be00640 1 --2- 172.21.15.103:0/2499805603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a14103b90 0x7f6a1419ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.866+0000 7f6a19400640 1 --2- 172.21.15.103:0/2499805603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a14104550 0x7f6a1419b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.867+0000 7f6a18a00640 1 -- 172.21.15.103:0/2499805603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a14104550 msgr2=0x7f6a1419b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:41.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.867+0000 7f6a18a00640 1 --2- 172.21.15.103:0/2499805603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a14104550 0x7f6a1419b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:41.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.867+0000 7f6a18a00640 1 -- 172.21.15.103:0/2499805603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a14103b90 msgr2=0x7f6a1419ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:41.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.867+0000 7f6a18a00640 1 --2- 172.21.15.103:0/2499805603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a14103b90 0x7f6a1419ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:41.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.867+0000 7f6a18a00640 1 -- 172.21.15.103:0/2499805603 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1419bff0 con 0x7f6a14102a30 2024-09-11T00:58:41.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.867+0000 7f6a18a00640 1 --2- 172.21.15.103:0/2499805603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a14102a30 0x7f6a1419a4c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6a04005ab0 tx=0x7f6a04005190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:41.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.867+0000 7f6a12000640 1 -- 172.21.15.103:0/2499805603 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a0403f070 con 0x7f6a14102a30 2024-09-11T00:58:41.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.867+0000 7f6a12000640 1 -- 172.21.15.103:0/2499805603 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(22 keys) ==== 983+0+0 (secure 0 0 0) 0x7f6a040044d0 con 0x7f6a14102a30 2024-09-11T00:58:41.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.867+0000 7f6a1b400640 1 -- 172.21.15.103:0/2499805603 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1419c280 con 0x7f6a14102a30 2024-09-11T00:58:41.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.867+0000 7f6a12000640 1 -- 172.21.15.103:0/2499805603 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04035030 con 0x7f6a14102a30 2024-09-11T00:58:41.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.867+0000 7f6a1b400640 1 -- 172.21.15.103:0/2499805603 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a141a29c0 con 0x7f6a14102a30 2024-09-11T00:58:41.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.868+0000 7f6a12000640 1 -- 172.21.15.103:0/2499805603 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 13) ==== 51481+0+0 (secure 0 0 0) 0x7f6a040037f0 con 0x7f6a14102a30 2024-09-11T00:58:41.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.868+0000 7f6a1b400640 1 -- 172.21.15.103:0/2499805603 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a14102e30 con 0x7f6a14102a30 2024-09-11T00:58:41.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.869+0000 7f6a12000640 1 --2- 172.21.15.103:0/2499805603 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f69f803f510 0x7f69f80419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:41.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.869+0000 7f6a12000640 1 -- 172.21.15.103:0/2499805603 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6a040749a0 con 0x7f6a14102a30 2024-09-11T00:58:41.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.869+0000 7f6a0be00640 1 --2- 172.21.15.103:0/2499805603 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f69f803f510 0x7f69f80419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:41.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.870+0000 7f6a0be00640 1 --2- 172.21.15.103:0/2499805603 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f69f803f510 0x7f69f80419d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00bbe0 tx=0x7f69fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:41.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:41 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2641715573' entity='client.admin' 2024-09-11T00:58:41.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:41.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:41.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:41 smithi117 ceph-mon[35358]: Reconfiguring mon.c (monmap changed)... 2024-09-11T00:58:41.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-11T00:58:41.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-11T00:58:41.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:41.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:41 smithi117 ceph-mon[35358]: Reconfiguring daemon mon.c on smithi183 2024-09-11T00:58:41.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:41 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:58:41.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:41 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:58:41.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:41 smithi117 ceph-mon[35358]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:41.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.874+0000 7f6a12000640 1 -- 172.21.15.103:0/2499805603 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6a04042360 con 0x7f6a14102a30 2024-09-11T00:58:42.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:42.080+0000 7f6a1b400640 1 -- 172.21.15.103:0/2499805603 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f6a141a2cb0 con 0x7f6a14102a30 2024-09-11T00:58:42.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:42.086+0000 7f6a12000640 1 -- 172.21.15.103:0/2499805603 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7f6a04036260 con 0x7f6a14102a30 2024-09-11T00:58:42.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:42.089+0000 7f6a1b400640 1 -- 172.21.15.103:0/2499805603 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f69f803f510 msgr2=0x7f69f80419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:42.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:42.089+0000 7f6a1b400640 1 --2- 172.21.15.103:0/2499805603 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f69f803f510 0x7f69f80419d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f69fc00bbe0 tx=0x7f69fc00b390 comp rx=0 tx=0).stop 2024-09-11T00:58:42.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:42.089+0000 7f6a1b400640 1 -- 172.21.15.103:0/2499805603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a14102a30 msgr2=0x7f6a1419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:42.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:42.089+0000 7f6a1b400640 1 --2- 172.21.15.103:0/2499805603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a14102a30 0x7f6a1419a4c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6a04005ab0 tx=0x7f6a04005190 comp rx=0 tx=0).stop 2024-09-11T00:58:42.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:42.089+0000 7f6a1b400640 1 -- 172.21.15.103:0/2499805603 shutdown_connections 2024-09-11T00:58:42.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:42.089+0000 7f6a1b400640 1 --2- 172.21.15.103:0/2499805603 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f69f803f510 0x7f69f80419d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:42.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:42.089+0000 7f6a1b400640 1 --2- 172.21.15.103:0/2499805603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6a14104550 0x7f6a1419b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:42.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:42.089+0000 7f6a1b400640 1 --2- 172.21.15.103:0/2499805603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a14103b90 0x7f6a1419ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:42.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:42.089+0000 7f6a1b400640 1 --2- 172.21.15.103:0/2499805603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6a14102a30 0x7f6a1419a4c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:42.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:42.089+0000 7f6a1b400640 1 -- 172.21.15.103:0/2499805603 >> 172.21.15.103:0/2499805603 conn(0x7f6a140fe320 msgr2=0x7f6a140fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:42.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:42.089+0000 7f6a1b400640 1 -- 172.21.15.103:0/2499805603 shutdown_connections 2024-09-11T00:58:42.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:42.089+0000 7f6a1b400640 1 -- 172.21.15.103:0/2499805603 wait complete. 2024-09-11T00:58:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:58:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T00:58:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:58:43.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:43.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:42 smithi103 ceph-mon[30562]: Deploying daemon mgr.z on smithi183 2024-09-11T00:58:43.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:42 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:58:43.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:43.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:43.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:43.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:43.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:43.265 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:43.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:58:43.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T00:58:43.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:58:43.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:43.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:42 smithi183 ceph-mon[34992]: Deploying daemon mgr.z on smithi183 2024-09-11T00:58:43.266 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:42 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:58:43.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:43.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:43.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:43.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:43.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:43.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:43.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:58:43.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T00:58:43.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:58:43.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:43.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:42 smithi117 ceph-mon[35358]: Deploying daemon mgr.z on smithi183 2024-09-11T00:58:43.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:42 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:58:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.823+0000 7fb7bd200640 1 -- 172.21.15.103:0/3666618567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7b8104aa0 msgr2=0x7fb7b8104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.823+0000 7fb7bd200640 1 --2- 172.21.15.103:0/3666618567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7b8104aa0 0x7fb7b8104ea0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8009c40 tx=0x7fb7a802a720 comp rx=0 tx=0).stop 2024-09-11T00:58:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.823+0000 7fb7bd200640 1 -- 172.21.15.103:0/3666618567 shutdown_connections 2024-09-11T00:58:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.823+0000 7fb7bd200640 1 --2- 172.21.15.103:0/3666618567 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7b81065c0 0x7fb7b810cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.823+0000 7fb7bd200640 1 --2- 172.21.15.103:0/3666618567 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7b8105c00 0x7fb7b8106080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.823+0000 7fb7bd200640 1 --2- 172.21.15.103:0/3666618567 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7b8104aa0 0x7fb7b8104ea0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.823+0000 7fb7bd200640 1 -- 172.21.15.103:0/3666618567 >> 172.21.15.103:0/3666618567 conn(0x7fb7b8100370 msgr2=0x7fb7b81027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:43.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.823+0000 7fb7bd200640 1 -- 172.21.15.103:0/3666618567 shutdown_connections 2024-09-11T00:58:43.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.823+0000 7fb7bd200640 1 -- 172.21.15.103:0/3666618567 wait complete. 2024-09-11T00:58:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.824+0000 7fb7bd200640 1 Processor -- start 2024-09-11T00:58:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.824+0000 7fb7bd200640 1 -- start start 2024-09-11T00:58:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.824+0000 7fb7bd200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7b8104aa0 0x7fb7b819a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.824+0000 7fb7bd200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7b8105c00 0x7fb7b819a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.824+0000 7fb7bd200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7b81065c0 0x7fb7b819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.824+0000 7fb7bd200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b810fa70 con 0x7fb7b8105c00 2024-09-11T00:58:43.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.824+0000 7fb7bd200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b810f8f0 con 0x7fb7b81065c0 2024-09-11T00:58:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.824+0000 7fb7bd200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb7b810fbf0 con 0x7fb7b8104aa0 2024-09-11T00:58:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.824+0000 7fb7b7400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7b8104aa0 0x7fb7b819a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.824+0000 7fb7b7400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7b8104aa0 0x7fb7b819a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:41258/0 (socket says 172.21.15.103:41258) 2024-09-11T00:58:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.824+0000 7fb7aea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7b8105c00 0x7fb7b819a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.824+0000 7fb7b7400640 1 -- 172.21.15.103:0/323613102 learned_addr learned my addr 172.21.15.103:0/323613102 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.825+0000 7fb7b7e00640 1 --2- 172.21.15.103:0/323613102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7b81065c0 0x7fb7b819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.825+0000 7fb7b7400640 1 -- 172.21.15.103:0/323613102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7b81065c0 msgr2=0x7fb7b819b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.825+0000 7fb7b7400640 1 --2- 172.21.15.103:0/323613102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7b81065c0 0x7fb7b819b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.825+0000 7fb7b7400640 1 -- 172.21.15.103:0/323613102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7b8105c00 msgr2=0x7fb7b819a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.825+0000 7fb7b7400640 1 --2- 172.21.15.103:0/323613102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7b8105c00 0x7fb7b819a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.825+0000 7fb7b7400640 1 -- 172.21.15.103:0/323613102 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7b819bd40 con 0x7fb7b8104aa0 2024-09-11T00:58:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.825+0000 7fb7b7e00640 1 --2- 172.21.15.103:0/323613102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7b81065c0 0x7fb7b819b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:58:43.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.825+0000 7fb7b7400640 1 --2- 172.21.15.103:0/323613102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7b8104aa0 0x7fb7b819a210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8034040 tx=0x7fb7a8031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.826+0000 7fb7b4c00640 1 -- 172.21.15.103:0/323613102 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8041020 con 0x7fb7b8104aa0 2024-09-11T00:58:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.826+0000 7fb7b4c00640 1 -- 172.21.15.103:0/323613102 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(22 keys) ==== 983+0+0 (secure 0 0 0) 0x7fb7a8037040 con 0x7fb7b8104aa0 2024-09-11T00:58:43.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.826+0000 7fb7bd200640 1 -- 172.21.15.103:0/323613102 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7b819bfd0 con 0x7fb7b8104aa0 2024-09-11T00:58:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.826+0000 7fb7b4c00640 1 -- 172.21.15.103:0/323613102 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a8036070 con 0x7fb7b8104aa0 2024-09-11T00:58:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.826+0000 7fb7bd200640 1 -- 172.21.15.103:0/323613102 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7b81a2710 con 0x7fb7b8104aa0 2024-09-11T00:58:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.827+0000 7fb7bd200640 1 -- 172.21.15.103:0/323613102 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7b8104ea0 con 0x7fb7b8104aa0 2024-09-11T00:58:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.827+0000 7fb7b4c00640 1 -- 172.21.15.103:0/323613102 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 13) ==== 51481+0+0 (secure 0 0 0) 0x7fb7a8003970 con 0x7fb7b8104aa0 2024-09-11T00:58:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.827+0000 7fb7b4c00640 1 --2- 172.21.15.103:0/323613102 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb79c03f5c0 0x7fb79c041a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.827+0000 7fb7b4c00640 1 -- 172.21.15.103:0/323613102 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb7a8074ac0 con 0x7fb7b8104aa0 2024-09-11T00:58:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.828+0000 7fb7aea00640 1 --2- 172.21.15.103:0/323613102 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb79c03f5c0 0x7fb79c041a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:43.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.828+0000 7fb7aea00640 1 --2- 172.21.15.103:0/323613102 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb79c03f5c0 0x7fb79c041a80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009530 tx=0x7fb7a0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:43.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:43.832+0000 7fb7b4c00640 1 -- 172.21.15.103:0/323613102 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb7a804b020 con 0x7fb7b8104aa0 2024-09-11T00:58:43.918 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Sep 11 00:58:43 smithi183 podman[36558]: 2024-09-11 00:58:43.729270133 +0000 UTC m=+0.016211112 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T00:58:44.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.026+0000 7fb7bd200640 1 -- 172.21.15.103:0/323613102 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fb7b810b640 con 0x7fb7b8104aa0 2024-09-11T00:58:44.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.031+0000 7fb7b4c00640 1 -- 172.21.15.103:0/323613102 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7fb7a8031a10 con 0x7fb7b8104aa0 2024-09-11T00:58:44.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.034+0000 7fb7bd200640 1 -- 172.21.15.103:0/323613102 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb79c03f5c0 msgr2=0x7fb79c041a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:44.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.034+0000 7fb7bd200640 1 --2- 172.21.15.103:0/323613102 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb79c03f5c0 0x7fb79c041a80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009530 tx=0x7fb7a0009260 comp rx=0 tx=0).stop 2024-09-11T00:58:44.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.034+0000 7fb7bd200640 1 -- 172.21.15.103:0/323613102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7b8104aa0 msgr2=0x7fb7b819a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:44.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.034+0000 7fb7bd200640 1 --2- 172.21.15.103:0/323613102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7b8104aa0 0x7fb7b819a210 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8034040 tx=0x7fb7a8031ee0 comp rx=0 tx=0).stop 2024-09-11T00:58:44.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.034+0000 7fb7bd200640 1 -- 172.21.15.103:0/323613102 shutdown_connections 2024-09-11T00:58:44.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.034+0000 7fb7bd200640 1 --2- 172.21.15.103:0/323613102 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb79c03f5c0 0x7fb79c041a80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:44.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.034+0000 7fb7bd200640 1 --2- 172.21.15.103:0/323613102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb7b81065c0 0x7fb7b819b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:44.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.034+0000 7fb7bd200640 1 --2- 172.21.15.103:0/323613102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7b8105c00 0x7fb7b819a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:44.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.034+0000 7fb7bd200640 1 --2- 172.21.15.103:0/323613102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb7b8104aa0 0x7fb7b819a210 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:44.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.034+0000 7fb7bd200640 1 -- 172.21.15.103:0/323613102 >> 172.21.15.103:0/323613102 conn(0x7fb7b8100370 msgr2=0x7fb7b8101f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:44.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.034+0000 7fb7bd200640 1 -- 172.21.15.103:0/323613102 shutdown_connections 2024-09-11T00:58:44.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.034+0000 7fb7bd200640 1 -- 172.21.15.103:0/323613102 wait complete. 2024-09-11T00:58:44.046 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:43 smithi103 ceph-mon[30562]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:44.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:43 smithi117 ceph-mon[35358]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:44.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:43 smithi183 ceph-mon[34992]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:44.418 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Sep 11 00:58:44 smithi183 podman[36558]: 2024-09-11 00:58:44.085218489 +0000 UTC m=+0.372159465 container init 0fca92bf242e5953ee8ca9dc70a77ac064dcbd6ec0e5e719e25ab7b651d2ad12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T00:58:44.419 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Sep 11 00:58:44 smithi183 podman[36558]: 2024-09-11 00:58:44.08818799 +0000 UTC m=+0.375128963 container start 0fca92bf242e5953ee8ca9dc70a77ac064dcbd6ec0e5e719e25ab7b651d2ad12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-z, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T00:58:44.419 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Sep 11 00:58:44 smithi183 ceph-mgr[36578]: -- 172.21.15.183:0/2500818671 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559907a5f0e0 con 0x559907a3d400 2024-09-11T00:58:44.419 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Sep 11 00:58:44 smithi183 bash[36558]: 0fca92bf242e5953ee8ca9dc70a77ac064dcbd6ec0e5e719e25ab7b651d2ad12 2024-09-11T00:58:44.419 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Sep 11 00:58:44 smithi183 systemd[1]: Started Ceph mgr.z for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T00:58:45.291 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:45 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:58:45.291 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:45.291 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:45.291 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:45.292 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:58:45.292 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T00:58:45.292 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:58:45.292 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:45.292 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:45 smithi117 ceph-mon[35358]: Deploying daemon mgr.y on smithi117 2024-09-11T00:58:45.292 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:45 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:58:45.292 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:45 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:58:45.292 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:45 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:58:45.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:45 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:58:45.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:45.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:45.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:45.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:58:45.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T00:58:45.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:58:45.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:45.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:45 smithi103 ceph-mon[30562]: Deploying daemon mgr.y on smithi117 2024-09-11T00:58:45.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:45 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:58:45.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:45 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:58:45.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:45 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:58:45.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:45 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:58:45.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:45.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:45.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:45.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-11T00:58:45.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-11T00:58:45.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-11T00:58:45.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:45.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:45 smithi183 ceph-mon[34992]: Deploying daemon mgr.y on smithi117 2024-09-11T00:58:45.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:45 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:58:45.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:45 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:58:45.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:45 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:58:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.566+0000 7f153fe00640 1 -- 172.21.15.103:0/3404633497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1538105dc0 msgr2=0x7f1538106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.567+0000 7f153fe00640 1 --2- 172.21.15.103:0/3404633497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1538105dc0 0x7f1538106240 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1524009930 tx=0x7f152402a420 comp rx=0 tx=0).stop 2024-09-11T00:58:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.567+0000 7f153fe00640 1 -- 172.21.15.103:0/3404633497 shutdown_connections 2024-09-11T00:58:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.567+0000 7f153fe00640 1 --2- 172.21.15.103:0/3404633497 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1538106780 0x7f153810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.567+0000 7f153fe00640 1 --2- 172.21.15.103:0/3404633497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1538105dc0 0x7f1538106240 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.567+0000 7f153fe00640 1 --2- 172.21.15.103:0/3404633497 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1538104c60 0x7f1538105060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.567+0000 7f153fe00640 1 -- 172.21.15.103:0/3404633497 >> 172.21.15.103:0/3404633497 conn(0x7f1538100510 msgr2=0x7f1538102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.567+0000 7f153fe00640 1 -- 172.21.15.103:0/3404633497 shutdown_connections 2024-09-11T00:58:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.567+0000 7f153fe00640 1 -- 172.21.15.103:0/3404633497 wait complete. 2024-09-11T00:58:45.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.568+0000 7f153fe00640 1 Processor -- start 2024-09-11T00:58:45.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.568+0000 7f153fe00640 1 -- start start 2024-09-11T00:58:45.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1538104c60 0x7f153819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:45.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153fe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1538105dc0 0x7f153819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:45.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1538106780 0x7f153819b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:45.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f153810fc70 con 0x7f1538106780 2024-09-11T00:58:45.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153fe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f153810faf0 con 0x7f1538104c60 2024-09-11T00:58:45.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153fe00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f153810fdf0 con 0x7f1538105dc0 2024-09-11T00:58:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153d400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1538104c60 0x7f153819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1538106780 0x7f153819b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153ca00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1538105dc0 0x7f153819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153d400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1538104c60 0x7f153819a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:34094/0 (socket says 172.21.15.103:34094) 2024-09-11T00:58:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153d400640 1 -- 172.21.15.103:0/2555230076 learned_addr learned my addr 172.21.15.103:0/2555230076 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153ca00640 1 -- 172.21.15.103:0/2555230076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1538104c60 msgr2=0x7f153819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153ca00640 1 --2- 172.21.15.103:0/2555230076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1538104c60 0x7f153819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153ca00640 1 -- 172.21.15.103:0/2555230076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1538106780 msgr2=0x7f153819b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153ca00640 1 --2- 172.21.15.103:0/2555230076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1538106780 0x7f153819b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.569+0000 7f153ca00640 1 -- 172.21.15.103:0/2555230076 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f153819c010 con 0x7f1538105dc0 2024-09-11T00:58:45.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.570+0000 7f153ca00640 1 --2- 172.21.15.103:0/2555230076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1538105dc0 0x7f153819ab30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f152402a940 tx=0x7f1524004f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:45.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.570+0000 7f1536000640 1 -- 172.21.15.103:0/2555230076 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152403f070 con 0x7f1538105dc0 2024-09-11T00:58:45.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.570+0000 7f1536000640 1 -- 172.21.15.103:0/2555230076 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(22 keys) ==== 983+0+0 (secure 0 0 0) 0x7f1524003a30 con 0x7f1538105dc0 2024-09-11T00:58:45.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.570+0000 7f1536000640 1 -- 172.21.15.103:0/2555230076 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1524035030 con 0x7f1538105dc0 2024-09-11T00:58:45.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.570+0000 7f153fe00640 1 -- 172.21.15.103:0/2555230076 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f153819c2a0 con 0x7f1538105dc0 2024-09-11T00:58:45.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.570+0000 7f153fe00640 1 -- 172.21.15.103:0/2555230076 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15381a2810 con 0x7f1538105dc0 2024-09-11T00:58:45.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.571+0000 7f153fe00640 1 -- 172.21.15.103:0/2555230076 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1538105060 con 0x7f1538105dc0 2024-09-11T00:58:45.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.571+0000 7f1536000640 1 -- 172.21.15.103:0/2555230076 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 13) ==== 51481+0+0 (secure 0 0 0) 0x7f15240035f0 con 0x7f1538105dc0 2024-09-11T00:58:45.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.572+0000 7f1536000640 1 --2- 172.21.15.103:0/2555230076 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f152003f510 0x7f15200419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:45.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.572+0000 7f1536000640 1 -- 172.21.15.103:0/2555230076 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f15240746d0 con 0x7f1538105dc0 2024-09-11T00:58:45.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.572+0000 7f153d400640 1 --2- 172.21.15.103:0/2555230076 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f152003f510 0x7f15200419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:45.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.573+0000 7f153d400640 1 --2- 172.21.15.103:0/2555230076 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f152003f510 0x7f15200419d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f152c009c90 tx=0x7f152c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:45.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.577+0000 7f1536000640 1 -- 172.21.15.103:0/2555230076 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f152403ce90 con 0x7f1538105dc0 2024-09-11T00:58:45.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.044+0000 7f6441a00640 1 -- 172.21.15.103:0/2400630558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f643c103bb0 msgr2=0x7f643c104030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:45.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.044+0000 7f6441a00640 1 --2- 172.21.15.103:0/2400630558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f643c103bb0 0x7f643c104030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6428009960 tx=0x7f642802a460 comp rx=0 tx=0).stop 2024-09-11T00:58:45.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.044+0000 7f6441a00640 1 -- 172.21.15.103:0/2400630558 shutdown_connections 2024-09-11T00:58:45.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.044+0000 7f6441a00640 1 --2- 172.21.15.103:0/2400630558 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f643c104570 0x7f643c10aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.044+0000 7f6441a00640 1 --2- 172.21.15.103:0/2400630558 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f643c103bb0 0x7f643c104030 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.044+0000 7f6441a00640 1 --2- 172.21.15.103:0/2400630558 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f643c102a50 0x7f643c102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.044+0000 7f6441a00640 1 -- 172.21.15.103:0/2400630558 >> 172.21.15.103:0/2400630558 conn(0x7f643c0fe320 msgr2=0x7f643c100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:45.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.044+0000 7f6441a00640 1 -- 172.21.15.103:0/2400630558 shutdown_connections 2024-09-11T00:58:45.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.045+0000 7f6441a00640 1 -- 172.21.15.103:0/2400630558 wait complete. 2024-09-11T00:58:45.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.045+0000 7f6441a00640 1 Processor -- start 2024-09-11T00:58:45.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.046+0000 7f6441a00640 1 -- start start 2024-09-11T00:58:45.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.046+0000 7f6441a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f643c102a50 0x7f643c19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:45.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.046+0000 7f6441a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f643c103bb0 0x7f643c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:45.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.046+0000 7f6441a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f643c104570 0x7f643c19b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:45.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.046+0000 7f6441a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f643c10da70 con 0x7f643c102a50 2024-09-11T00:58:45.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.046+0000 7f6441a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f643c10d8f0 con 0x7f643c103bb0 2024-09-11T00:58:45.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.046+0000 7f6441a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f643c10dbf0 con 0x7f643c104570 2024-09-11T00:58:45.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.046+0000 7f643b400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f643c104570 0x7f643c19b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:45.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.046+0000 7f643b400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f643c104570 0x7f643c19b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:41278/0 (socket says 172.21.15.103:41278) 2024-09-11T00:58:45.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.046+0000 7f643b400640 1 -- 172.21.15.103:0/2936382811 learned_addr learned my addr 172.21.15.103:0/2936382811 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:45.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.046+0000 7f643aa00640 1 --2- 172.21.15.103:0/2936382811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f643c102a50 0x7f643c19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:45.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.047+0000 7f643a000640 1 --2- 172.21.15.103:0/2936382811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f643c103bb0 0x7f643c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:45.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.047+0000 7f643b400640 1 -- 172.21.15.103:0/2936382811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f643c103bb0 msgr2=0x7f643c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:45.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.047+0000 7f643b400640 1 --2- 172.21.15.103:0/2936382811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f643c103bb0 0x7f643c19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.047+0000 7f643b400640 1 -- 172.21.15.103:0/2936382811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f643c102a50 msgr2=0x7f643c19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:45.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.047+0000 7f643b400640 1 --2- 172.21.15.103:0/2936382811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f643c102a50 0x7f643c19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.047+0000 7f643b400640 1 -- 172.21.15.103:0/2936382811 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643c19c010 con 0x7f643c104570 2024-09-11T00:58:45.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.047+0000 7f643b400640 1 --2- 172.21.15.103:0/2936382811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f643c104570 0x7f643c19b770 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f643400eb10 tx=0x7f643400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:45.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.047+0000 7f6433400640 1 -- 172.21.15.103:0/2936382811 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434004b20 con 0x7f643c104570 2024-09-11T00:58:45.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.047+0000 7f6433400640 1 -- 172.21.15.103:0/2936382811 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(22 keys) ==== 983+0+0 (secure 0 0 0) 0x7f6434004cc0 con 0x7f643c104570 2024-09-11T00:58:45.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.048+0000 7f6433400640 1 -- 172.21.15.103:0/2936382811 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434010430 con 0x7f643c104570 2024-09-11T00:58:45.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.048+0000 7f6441a00640 1 -- 172.21.15.103:0/2936382811 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f643c19c300 con 0x7f643c104570 2024-09-11T00:58:45.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.048+0000 7f6441a00640 1 -- 172.21.15.103:0/2936382811 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f643c1a29e0 con 0x7f643c104570 2024-09-11T00:58:45.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.049+0000 7f6433400640 1 -- 172.21.15.103:0/2936382811 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 13) ==== 51481+0+0 (secure 0 0 0) 0x7f64340105d0 con 0x7f643c104570 2024-09-11T00:58:45.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.049+0000 7f6441a00640 1 -- 172.21.15.103:0/2936382811 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f643c102e50 con 0x7f643c104570 2024-09-11T00:58:45.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.049+0000 7f6433400640 1 --2- 172.21.15.103:0/2936382811 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f642003f510 0x7f64200419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:45.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.049+0000 7f6433400640 1 -- 172.21.15.103:0/2936382811 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f64340543b0 con 0x7f643c104570 2024-09-11T00:58:45.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.050+0000 7f643aa00640 1 --2- 172.21.15.103:0/2936382811 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f642003f510 0x7f64200419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:45.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.050+0000 7f643aa00640 1 --2- 172.21.15.103:0/2936382811 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f642003f510 0x7f64200419d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f642c009bd0 tx=0x7f642c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:45.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.054+0000 7f6433400640 1 -- 172.21.15.103:0/2936382811 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f64340108f0 con 0x7f643c104570 2024-09-11T00:58:45.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.280+0000 7f6441a00640 1 -- 172.21.15.103:0/2936382811 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f643c1a2cd0 con 0x7f643c104570 2024-09-11T00:58:45.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.285+0000 7f6433400640 1 -- 172.21.15.103:0/2936382811 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v15)=0 v15) ==== 119+0+0 (secure 0 0 0) 0x7f6434019e00 con 0x7f643c104570 2024-09-11T00:58:45.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.287+0000 7f6441a00640 1 -- 172.21.15.103:0/2936382811 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f642003f510 msgr2=0x7f64200419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:45.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.287+0000 7f6441a00640 1 --2- 172.21.15.103:0/2936382811 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f642003f510 0x7f64200419d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f642c009bd0 tx=0x7f642c005f90 comp rx=0 tx=0).stop 2024-09-11T00:58:45.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.287+0000 7f6441a00640 1 -- 172.21.15.103:0/2936382811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f643c104570 msgr2=0x7f643c19b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:45.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.287+0000 7f6441a00640 1 --2- 172.21.15.103:0/2936382811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f643c104570 0x7f643c19b770 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f643400eb10 tx=0x7f643400c2d0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.287+0000 7f6441a00640 1 -- 172.21.15.103:0/2936382811 shutdown_connections 2024-09-11T00:58:45.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.287+0000 7f6441a00640 1 --2- 172.21.15.103:0/2936382811 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f642003f510 0x7f64200419d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.287+0000 7f6441a00640 1 --2- 172.21.15.103:0/2936382811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f643c104570 0x7f643c19b770 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.287+0000 7f6441a00640 1 --2- 172.21.15.103:0/2936382811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f643c103bb0 0x7f643c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.287+0000 7f6441a00640 1 --2- 172.21.15.103:0/2936382811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f643c102a50 0x7f643c19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.287+0000 7f6441a00640 1 -- 172.21.15.103:0/2936382811 >> 172.21.15.103:0/2936382811 conn(0x7f643c0fe320 msgr2=0x7f643c0fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:45.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.287+0000 7f6441a00640 1 -- 172.21.15.103:0/2936382811 shutdown_connections 2024-09-11T00:58:45.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.287+0000 7f6441a00640 1 -- 172.21.15.103:0/2936382811 wait complete. 2024-09-11T00:58:45.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.766+0000 7f153fe00640 1 -- 172.21.15.103:0/2555230076 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f1538063d50 con 0x7f1538105dc0 2024-09-11T00:58:45.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.771+0000 7f1536000640 1 -- 172.21.15.103:0/2555230076 <== mon.1 v2:172.21.15.183:3300/0 7 ==== config(23 keys) ==== 1014+0+0 (secure 0 0 0) 0x7f152403ae30 con 0x7f1538105dc0 2024-09-11T00:58:45.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.771+0000 7f1536000640 1 -- 172.21.15.103:0/2555230076 <== mon.1 v2:172.21.15.183:3300/0 8 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v18)=0 v18) ==== 123+0+0 (secure 0 0 0) 0x7f1524036260 con 0x7f1538105dc0 2024-09-11T00:58:45.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.773+0000 7f153fe00640 1 -- 172.21.15.103:0/2555230076 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f152003f510 msgr2=0x7f15200419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:45.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.773+0000 7f153fe00640 1 --2- 172.21.15.103:0/2555230076 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f152003f510 0x7f15200419d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f152c009c90 tx=0x7f152c005f90 comp rx=0 tx=0).stop 2024-09-11T00:58:45.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.773+0000 7f153fe00640 1 -- 172.21.15.103:0/2555230076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1538105dc0 msgr2=0x7f153819ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:45.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.773+0000 7f153fe00640 1 --2- 172.21.15.103:0/2555230076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1538105dc0 0x7f153819ab30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f152402a940 tx=0x7f1524004f60 comp rx=0 tx=0).stop 2024-09-11T00:58:45.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.773+0000 7f153fe00640 1 -- 172.21.15.103:0/2555230076 shutdown_connections 2024-09-11T00:58:45.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.773+0000 7f153fe00640 1 --2- 172.21.15.103:0/2555230076 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f152003f510 0x7f15200419d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.773+0000 7f153fe00640 1 --2- 172.21.15.103:0/2555230076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1538106780 0x7f153819b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.773+0000 7f153fe00640 1 --2- 172.21.15.103:0/2555230076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1538105dc0 0x7f153819ab30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.773+0000 7f153fe00640 1 --2- 172.21.15.103:0/2555230076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1538104c60 0x7f153819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:45.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.773+0000 7f153fe00640 1 -- 172.21.15.103:0/2555230076 >> 172.21.15.103:0/2555230076 conn(0x7f1538100510 msgr2=0x7f1538102260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:45.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.774+0000 7f153fe00640 1 -- 172.21.15.103:0/2555230076 shutdown_connections 2024-09-11T00:58:45.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.774+0000 7f153fe00640 1 -- 172.21.15.103:0/2555230076 wait complete. 2024-09-11T00:58:46.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:46 smithi117 ceph-mon[35358]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:46.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:46 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:58:46.292 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:46 smithi103 ceph-mon[30562]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:46.292 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:46 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:58:46.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.151+0000 7fc4b6400640 1 -- 172.21.15.103:0/860224469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4b0076f00 msgr2=0x7fc4b0075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:46.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.151+0000 7fc4b6400640 1 --2- 172.21.15.103:0/860224469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4b0076f00 0x7fc4b0075560 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0009900 tx=0x7fc4a002a410 comp rx=0 tx=0).stop 2024-09-11T00:58:46.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.151+0000 7fc4b6400640 1 -- 172.21.15.103:0/860224469 shutdown_connections 2024-09-11T00:58:46.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.151+0000 7fc4b6400640 1 --2- 172.21.15.103:0/860224469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4b010a9d0 0x7fc4b010ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.151+0000 7fc4b6400640 1 --2- 172.21.15.103:0/860224469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4b0075aa0 0x7fc4b0075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.151+0000 7fc4b6400640 1 --2- 172.21.15.103:0/860224469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4b0076f00 0x7fc4b0075560 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.151+0000 7fc4b6400640 1 -- 172.21.15.103:0/860224469 >> 172.21.15.103:0/860224469 conn(0x7fc4b00fe2f0 msgr2=0x7fc4b0100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:46.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.151+0000 7fc4b6400640 1 -- 172.21.15.103:0/860224469 shutdown_connections 2024-09-11T00:58:46.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.151+0000 7fc4b6400640 1 -- 172.21.15.103:0/860224469 wait complete. 2024-09-11T00:58:46.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.152+0000 7fc4b6400640 1 Processor -- start 2024-09-11T00:58:46.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.153+0000 7fc4b6400640 1 -- start start 2024-09-11T00:58:46.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.153+0000 7fc4b6400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4b0075aa0 0x7fc4b019a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:46.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.153+0000 7fc4b6400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4b0076f00 0x7fc4b019ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:46.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.153+0000 7fc4b6400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4b010a9d0 0x7fc4b019b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:46.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.153+0000 7fc4b6400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b010fbf0 con 0x7fc4b010a9d0 2024-09-11T00:58:46.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.153+0000 7fc4b6400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b010fa70 con 0x7fc4b0075aa0 2024-09-11T00:58:46.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.153+0000 7fc4b6400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b010fd70 con 0x7fc4b0076f00 2024-09-11T00:58:46.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.153+0000 7fc4af400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4b0075aa0 0x7fc4b019a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:46.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.153+0000 7fc4af400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4b0075aa0 0x7fc4b019a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:34054/0 (socket says 172.21.15.103:34054) 2024-09-11T00:58:46.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.153+0000 7fc4af400640 1 -- 172.21.15.103:0/3384021544 learned_addr learned my addr 172.21.15.103:0/3384021544 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:46.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.153+0000 7fc4afe00640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4b010a9d0 0x7fc4b019b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:46.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.153+0000 7fc4a6a00640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4b0076f00 0x7fc4b019ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:46.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.154+0000 7fc4a6a00640 1 -- 172.21.15.103:0/3384021544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4b0075aa0 msgr2=0x7fc4b019a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:46.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.154+0000 7fc4a6a00640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4b0075aa0 0x7fc4b019a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.154+0000 7fc4a6a00640 1 -- 172.21.15.103:0/3384021544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4b010a9d0 msgr2=0x7fc4b019b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:46.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.154+0000 7fc4a6a00640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4b010a9d0 0x7fc4b019b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.154+0000 7fc4a6a00640 1 -- 172.21.15.103:0/3384021544 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b019c010 con 0x7fc4b0076f00 2024-09-11T00:58:46.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.154+0000 7fc4afe00640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4b010a9d0 0x7fc4b019b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:58:46.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.154+0000 7fc4a6a00640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4b0076f00 0x7fc4b019ab30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc49800e9f0 tx=0x7fc49800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:46.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.154+0000 7fc4acc00640 1 -- 172.21.15.103:0/3384021544 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc49800ccc0 con 0x7fc4b0076f00 2024-09-11T00:58:46.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.154+0000 7fc4acc00640 1 -- 172.21.15.103:0/3384021544 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(22 keys) ==== 983+0+0 (secure 0 0 0) 0x7fc498010870 con 0x7fc4b0076f00 2024-09-11T00:58:46.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.154+0000 7fc4b6400640 1 -- 172.21.15.103:0/3384021544 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b019c300 con 0x7fc4b0076f00 2024-09-11T00:58:46.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.154+0000 7fc4acc00640 1 -- 172.21.15.103:0/3384021544 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498018680 con 0x7fc4b0076f00 2024-09-11T00:58:46.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.154+0000 7fc4b6400640 1 -- 172.21.15.103:0/3384021544 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b01a29e0 con 0x7fc4b0076f00 2024-09-11T00:58:46.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.156+0000 7fc4acc00640 1 -- 172.21.15.103:0/3384021544 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 13) ==== 51481+0+0 (secure 0 0 0) 0x7fc498018820 con 0x7fc4b0076f00 2024-09-11T00:58:46.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.156+0000 7fc4b6400640 1 -- 172.21.15.103:0/3384021544 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b0075f20 con 0x7fc4b0076f00 2024-09-11T00:58:46.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.156+0000 7fc4acc00640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc49403f510 0x7fc4940419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:46.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.156+0000 7fc4acc00640 1 -- 172.21.15.103:0/3384021544 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc498054180 con 0x7fc4b0076f00 2024-09-11T00:58:46.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.156+0000 7fc4af400640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc49403f510 0x7fc4940419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:46.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.157+0000 7fc4af400640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc49403f510 0x7fc4940419d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00096c0 tx=0x7fc4a0005df0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:46.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.161+0000 7fc4acc00640 1 -- 172.21.15.103:0/3384021544 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc49801fe00 con 0x7fc4b0076f00 2024-09-11T00:58:46.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.363+0000 7fc4b6400640 1 -- 172.21.15.103:0/3384021544 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7fc4b002e8c0 con 0x7fc4b0076f00 2024-09-11T00:58:46.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.368+0000 7fc4acc00640 1 -- 172.21.15.103:0/3384021544 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v16)=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7fc498025da0 con 0x7fc4b0076f00 2024-09-11T00:58:46.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.370+0000 7fc4b6400640 1 -- 172.21.15.103:0/3384021544 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc49403f510 msgr2=0x7fc4940419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:46.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.370+0000 7fc4b6400640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc49403f510 0x7fc4940419d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00096c0 tx=0x7fc4a0005df0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.370+0000 7fc4b6400640 1 -- 172.21.15.103:0/3384021544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4b0076f00 msgr2=0x7fc4b019ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:46.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.370+0000 7fc4b6400640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4b0076f00 0x7fc4b019ab30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc49800e9f0 tx=0x7fc49800eeb0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.370+0000 7fc4b6400640 1 -- 172.21.15.103:0/3384021544 shutdown_connections 2024-09-11T00:58:46.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.370+0000 7fc4b6400640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc49403f510 0x7fc4940419d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.370+0000 7fc4b6400640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc4b010a9d0 0x7fc4b019b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.370+0000 7fc4b6400640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc4b0076f00 0x7fc4b019ab30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.370+0000 7fc4b6400640 1 --2- 172.21.15.103:0/3384021544 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc4b0075aa0 0x7fc4b019a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.370+0000 7fc4b6400640 1 -- 172.21.15.103:0/3384021544 >> 172.21.15.103:0/3384021544 conn(0x7fc4b00fe2f0 msgr2=0x7fc4b01006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:46.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.370+0000 7fc4b6400640 1 -- 172.21.15.103:0/3384021544 shutdown_connections 2024-09-11T00:58:46.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.370+0000 7fc4b6400640 1 -- 172.21.15.103:0/3384021544 wait complete. 2024-09-11T00:58:46.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:46 smithi183 ceph-mon[34992]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:46.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:46 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:58:46.872 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 11 00:58:46 smithi117 systemd[1]: Started Ceph mgr.y for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T00:58:46.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.393+0000 7fc363c00640 1 -- 172.21.15.103:0/3368310265 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc34003f510 msgr2=0x7fc3400419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:46.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.393+0000 7fc363c00640 1 --2- 172.21.15.103:0/3368310265 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc34003f510 0x7fc3400419d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc344009b60 tx=0x7fc344005f90 comp rx=0 tx=0).stop 2024-09-11T00:58:46.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.393+0000 7fc363c00640 1 -- 172.21.15.103:0/3368310265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc35c102a30 msgr2=0x7fc35c198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:46.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.393+0000 7fc363c00640 1 --2- 172.21.15.103:0/3368310265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc35c102a30 0x7fc35c198180 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00e9f0 tx=0x7fc34c00eeb0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.393+0000 7fc363c00640 1 -- 172.21.15.103:0/3368310265 shutdown_connections 2024-09-11T00:58:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.393+0000 7fc363c00640 1 --2- 172.21.15.103:0/3368310265 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc34003f510 0x7fc3400419d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.393+0000 7fc363c00640 1 --2- 172.21.15.103:0/3368310265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc35c104550 0x7fc35c199410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.393+0000 7fc363c00640 1 --2- 172.21.15.103:0/3368310265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc35c103b90 0x7fc35c1987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.393+0000 7fc363c00640 1 --2- 172.21.15.103:0/3368310265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc35c102a30 0x7fc35c198180 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.393+0000 7fc363c00640 1 -- 172.21.15.103:0/3368310265 >> 172.21.15.103:0/3368310265 conn(0x7fc35c0fe320 msgr2=0x7fc35c0fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.393+0000 7fc363c00640 1 -- 172.21.15.103:0/3368310265 shutdown_connections 2024-09-11T00:58:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:41.393+0000 7fc363c00640 1 -- 172.21.15.103:0/3368310265 wait complete. 2024-09-11T00:58:47.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:47.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:47.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:47.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:47.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:47.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:47 smithi183 ceph-mon[34992]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:47.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.809+0000 7f48b9200640 1 -- 172.21.15.103:0/3237300318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48b4104c60 msgr2=0x7f48b4105060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.809+0000 7f48b9200640 1 --2- 172.21.15.103:0/3237300318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48b4104c60 0x7f48b4105060 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009960 tx=0x7f48a402a460 comp rx=0 tx=0).stop 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.809+0000 7f48b9200640 1 -- 172.21.15.103:0/3237300318 shutdown_connections 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.809+0000 7f48b9200640 1 --2- 172.21.15.103:0/3237300318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48b4106780 0x7f48b410d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.809+0000 7f48b9200640 1 --2- 172.21.15.103:0/3237300318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48b4105dc0 0x7f48b4106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.809+0000 7f48b9200640 1 --2- 172.21.15.103:0/3237300318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48b4104c60 0x7f48b4105060 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.809+0000 7f48b9200640 1 -- 172.21.15.103:0/3237300318 >> 172.21.15.103:0/3237300318 conn(0x7f48b4100510 msgr2=0x7f48b4102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.809+0000 7f48b9200640 1 -- 172.21.15.103:0/3237300318 shutdown_connections 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.809+0000 7f48b9200640 1 -- 172.21.15.103:0/3237300318 wait complete. 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.810+0000 7f48b9200640 1 Processor -- start 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.810+0000 7f48b9200640 1 -- start start 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.810+0000 7f48b9200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48b4104c60 0x7f48b419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48b4105dc0 0x7f48b419ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b9200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48b4106780 0x7f48b419b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b9200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f48b410fc70 con 0x7f48b4105dc0 2024-09-11T00:58:47.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b9200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48b410faf0 con 0x7f48b4106780 2024-09-11T00:58:47.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b9200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f48b410fdf0 con 0x7f48b4104c60 2024-09-11T00:58:47.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b1e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48b4104c60 0x7f48b419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48b4105dc0 0x7f48b419ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b1e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48b4104c60 0x7f48b419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:41320/0 (socket says 172.21.15.103:41320) 2024-09-11T00:58:47.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b1e00640 1 -- 172.21.15.103:0/3794012076 learned_addr learned my addr 172.21.15.103:0/3794012076 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:47.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b2800640 1 --2- 172.21.15.103:0/3794012076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48b4106780 0x7f48b419b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b1e00640 1 -- 172.21.15.103:0/3794012076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48b4106780 msgr2=0x7f48b419b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b1e00640 1 --2- 172.21.15.103:0/3794012076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48b4106780 0x7f48b419b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b1e00640 1 -- 172.21.15.103:0/3794012076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48b4105dc0 msgr2=0x7f48b419ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b1e00640 1 --2- 172.21.15.103:0/3794012076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48b4105dc0 0x7f48b419ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b1e00640 1 -- 172.21.15.103:0/3794012076 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b419bfe0 con 0x7f48b4104c60 2024-09-11T00:58:47.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b1400640 1 --2- 172.21.15.103:0/3794012076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48b4105dc0 0x7f48b419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.811+0000 7f48b1e00640 1 --2- 172.21.15.103:0/3794012076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48b4104c60 0x7f48b419a4b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f48a4005ab0 tx=0x7f48a4005210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.812+0000 7f48aaa00640 1 -- 172.21.15.103:0/3794012076 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a403f070 con 0x7f48b4104c60 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.812+0000 7f48aaa00640 1 -- 172.21.15.103:0/3794012076 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(22 keys) ==== 983+0+0 (secure 0 0 0) 0x7f48a4005610 con 0x7f48b4104c60 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.812+0000 7f48b9200640 1 -- 172.21.15.103:0/3794012076 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b419c270 con 0x7f48b4104c60 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.812+0000 7f48aaa00640 1 -- 172.21.15.103:0/3794012076 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a4035030 con 0x7f48b4104c60 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.812+0000 7f48b9200640 1 -- 172.21.15.103:0/3794012076 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b41a29b0 con 0x7f48b4104c60 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.813+0000 7f48b9200640 1 -- 172.21.15.103:0/3794012076 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b4105060 con 0x7f48b4104c60 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.813+0000 7f48aaa00640 1 -- 172.21.15.103:0/3794012076 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 13) ==== 51481+0+0 (secure 0 0 0) 0x7f48a40037f0 con 0x7f48b4104c60 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.814+0000 7f48aaa00640 1 --2- 172.21.15.103:0/3794012076 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f489803f510 0x7f48980419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.814+0000 7f48aaa00640 1 -- 172.21.15.103:0/3794012076 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f48a40748a0 con 0x7f48b4104c60 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.814+0000 7f48b1400640 1 --2- 172.21.15.103:0/3794012076 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f489803f510 0x7f48980419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.814+0000 7f48b1400640 1 --2- 172.21.15.103:0/3794012076 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f489803f510 0x7f48980419d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f48a0005d00 tx=0x7f48a000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:47.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:44.818+0000 7f48aaa00640 1 -- 172.21.15.103:0/3794012076 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f48a404ad20 con 0x7f48b4104c60 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.008+0000 7f48b9200640 1 -- 172.21.15.103:0/3794012076 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f48b402e790 con 0x7f48b4104c60 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.013+0000 7f48aaa00640 1 -- 172.21.15.103:0/3794012076 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f48a4003cc0 con 0x7f48b4104c60 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.015+0000 7f48b9200640 1 -- 172.21.15.103:0/3794012076 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f489803f510 msgr2=0x7f48980419d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.015+0000 7f48b9200640 1 --2- 172.21.15.103:0/3794012076 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f489803f510 0x7f48980419d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f48a0005d00 tx=0x7f48a000b410 comp rx=0 tx=0).stop 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.015+0000 7f48b9200640 1 -- 172.21.15.103:0/3794012076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48b4104c60 msgr2=0x7f48b419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.015+0000 7f48b9200640 1 --2- 172.21.15.103:0/3794012076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48b4104c60 0x7f48b419a4b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f48a4005ab0 tx=0x7f48a4005210 comp rx=0 tx=0).stop 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.015+0000 7f48b9200640 1 -- 172.21.15.103:0/3794012076 shutdown_connections 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.015+0000 7f48b9200640 1 --2- 172.21.15.103:0/3794012076 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f489803f510 0x7f48980419d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.015+0000 7f48b9200640 1 --2- 172.21.15.103:0/3794012076 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48b4106780 0x7f48b419b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.015+0000 7f48b9200640 1 --2- 172.21.15.103:0/3794012076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48b4105dc0 0x7f48b419ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.015+0000 7f48b9200640 1 --2- 172.21.15.103:0/3794012076 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48b4104c60 0x7f48b419a4b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.015+0000 7f48b9200640 1 -- 172.21.15.103:0/3794012076 >> 172.21.15.103:0/3794012076 conn(0x7f48b4100510 msgr2=0x7f48b41022b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:47.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.015+0000 7f48b9200640 1 -- 172.21.15.103:0/3794012076 shutdown_connections 2024-09-11T00:58:47.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:45.015+0000 7f48b9200640 1 -- 172.21.15.103:0/3794012076 wait complete. 2024-09-11T00:58:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:47 smithi103 ceph-mon[30562]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:48.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:48.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:48.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:48.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:48.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:48.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:47 smithi117 ceph-mon[35358]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:49.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:49.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:49.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:49.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:49.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:49.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:49.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:49.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:49.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:49.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:49.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:49.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:49.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:58:49.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:58:49.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:58:49.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:49.302 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:49.302 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:49.303 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:49.977 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:49 smithi103 ceph-mon[30562]: Standby manager daemon z started 2024-09-11T00:58:49.977 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:49 smithi103 ceph-mon[30562]: from='mgr.? 172.21.15.183:0/1625651346' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-11T00:58:49.977 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:49 smithi103 ceph-mon[30562]: from='mgr.? 172.21.15.183:0/1625651346' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-11T00:58:49.977 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:49 smithi103 ceph-mon[30562]: from='mgr.? 172.21.15.183:0/1625651346' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-11T00:58:49.977 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:49 smithi103 ceph-mon[30562]: from='mgr.? 172.21.15.183:0/1625651346' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-11T00:58:49.977 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:49 smithi103 ceph-mon[30562]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:49.978 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:49 smithi117 ceph-mon[35358]: Standby manager daemon z started 2024-09-11T00:58:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:49 smithi117 ceph-mon[35358]: from='mgr.? 172.21.15.183:0/1625651346' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-11T00:58:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:49 smithi117 ceph-mon[35358]: from='mgr.? 172.21.15.183:0/1625651346' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-11T00:58:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:49 smithi117 ceph-mon[35358]: from='mgr.? 172.21.15.183:0/1625651346' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-11T00:58:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:49 smithi117 ceph-mon[35358]: from='mgr.? 172.21.15.183:0/1625651346' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-11T00:58:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:49 smithi117 ceph-mon[35358]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:50.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:49 smithi183 ceph-mon[34992]: Standby manager daemon z started 2024-09-11T00:58:50.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:49 smithi183 ceph-mon[34992]: from='mgr.? 172.21.15.183:0/1625651346' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-11T00:58:50.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:49 smithi183 ceph-mon[34992]: from='mgr.? 172.21.15.183:0/1625651346' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-11T00:58:50.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:49 smithi183 ceph-mon[34992]: from='mgr.? 172.21.15.183:0/1625651346' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-11T00:58:50.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:49 smithi183 ceph-mon[34992]: from='mgr.? 172.21.15.183:0/1625651346' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-11T00:58:50.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:49 smithi183 ceph-mon[34992]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:50.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:58:50.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.814+0000 7fcca8400640 1 -- 172.21.15.103:0/1825508385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca0104c60 msgr2=0x7fcca0105060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:50.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.814+0000 7fcca8400640 1 --2- 172.21.15.103:0/1825508385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca0104c60 0x7fcca0105060 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009cd0 tx=0x7fcc9402a8f0 comp rx=0 tx=0).stop 2024-09-11T00:58:50.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.814+0000 7fcca8400640 1 -- 172.21.15.103:0/1825508385 shutdown_connections 2024-09-11T00:58:50.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.814+0000 7fcca8400640 1 --2- 172.21.15.103:0/1825508385 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcca0106780 0x7fcca010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:50.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.814+0000 7fcca8400640 1 --2- 172.21.15.103:0/1825508385 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcca0105dc0 0x7fcca0106240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:50.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.814+0000 7fcca8400640 1 --2- 172.21.15.103:0/1825508385 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca0104c60 0x7fcca0105060 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:50.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.814+0000 7fcca8400640 1 -- 172.21.15.103:0/1825508385 >> 172.21.15.103:0/1825508385 conn(0x7fcca0100510 msgr2=0x7fcca0102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:50.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.814+0000 7fcca8400640 1 -- 172.21.15.103:0/1825508385 shutdown_connections 2024-09-11T00:58:50.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.814+0000 7fcca8400640 1 -- 172.21.15.103:0/1825508385 wait complete. 2024-09-11T00:58:50.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.815+0000 7fcca8400640 1 Processor -- start 2024-09-11T00:58:50.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca8400640 1 -- start start 2024-09-11T00:58:50.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca8400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca0104c60 0x7fcca019ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:50.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca8400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcca0105dc0 0x7fcca019b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:50.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca8400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcca0106780 0x7fcca019c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:50.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca8400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcca01105e0 con 0x7fcca0106780 2024-09-11T00:58:50.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca8400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0110460 con 0x7fcca0104c60 2024-09-11T00:58:50.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca8400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcca0110760 con 0x7fcca0105dc0 2024-09-11T00:58:50.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca5a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca0104c60 0x7fcca019ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:50.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca5a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca0104c60 0x7fcca019ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:60984/0 (socket says 172.21.15.103:60984) 2024-09-11T00:58:50.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca5a00640 1 -- 172.21.15.103:0/323934584 learned_addr learned my addr 172.21.15.103:0/323934584 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:50.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca5000640 1 --2- 172.21.15.103:0/323934584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcca0105dc0 0x7fcca019b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:50.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca6400640 1 --2- 172.21.15.103:0/323934584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcca0106780 0x7fcca019c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:50.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca5a00640 1 -- 172.21.15.103:0/323934584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcca0105dc0 msgr2=0x7fcca019b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:50.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca5a00640 1 --2- 172.21.15.103:0/323934584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcca0105dc0 0x7fcca019b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:50.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca5a00640 1 -- 172.21.15.103:0/323934584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcca0106780 msgr2=0x7fcca019c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:50.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca5a00640 1 --2- 172.21.15.103:0/323934584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcca0106780 0x7fcca019c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:50.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.816+0000 7fcca5a00640 1 -- 172.21.15.103:0/323934584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca019c8a0 con 0x7fcca0104c60 2024-09-11T00:58:50.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.817+0000 7fcca5a00640 1 --2- 172.21.15.103:0/323934584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca0104c60 0x7fcca019ad70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcc9402ae10 tx=0x7fcc94004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:50.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.817+0000 7fcc9e000640 1 -- 172.21.15.103:0/323934584 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94003b70 con 0x7fcca0104c60 2024-09-11T00:58:50.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.817+0000 7fcc9e000640 1 -- 172.21.15.103:0/323934584 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(23 keys) ==== 1014+0+0 (secure 0 0 0) 0x7fcc94031d00 con 0x7fcca0104c60 2024-09-11T00:58:50.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.817+0000 7fcc9e000640 1 -- 172.21.15.103:0/323934584 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94004500 con 0x7fcca0104c60 2024-09-11T00:58:50.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.817+0000 7fcca8400640 1 -- 172.21.15.103:0/323934584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca019cb30 con 0x7fcca0104c60 2024-09-11T00:58:50.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.817+0000 7fcca8400640 1 -- 172.21.15.103:0/323934584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca01a3270 con 0x7fcca0104c60 2024-09-11T00:58:50.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.818+0000 7fcca8400640 1 -- 172.21.15.103:0/323934584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca0110da0 con 0x7fcca0104c60 2024-09-11T00:58:50.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.819+0000 7fcc9e000640 1 -- 172.21.15.103:0/323934584 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 14) ==== 102338+0+0 (secure 0 0 0) 0x7fcc940046a0 con 0x7fcca0104c60 2024-09-11T00:58:50.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.820+0000 7fcc9e000640 1 --2- 172.21.15.103:0/323934584 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcc8807a3b0 0x7fcc8807c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:50.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.820+0000 7fcc9e000640 1 -- 172.21.15.103:0/323934584 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcc940bcbc0 con 0x7fcca0104c60 2024-09-11T00:58:50.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.821+0000 7fcca5000640 1 --2- 172.21.15.103:0/323934584 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcc8807a3b0 0x7fcc8807c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:50.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.821+0000 7fcca5000640 1 --2- 172.21.15.103:0/323934584 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcc8807a3b0 0x7fcc8807c870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c0095f0 tx=0x7fcc8c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:50.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:50.824+0000 7fcc9e000640 1 -- 172.21.15.103:0/323934584 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcc94085850 con 0x7fcca0104c60 2024-09-11T00:58:50.884 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:50 smithi103 ceph-mon[30562]: mgrmap e14: x(active, since 70s), standbys: z 2024-09-11T00:58:50.885 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:50 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-11T00:58:51.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.017+0000 7fcca8400640 1 -- 172.21.15.103:0/323934584 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fcca002e860 con 0x7fcca0104c60 2024-09-11T00:58:51.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.024+0000 7fcc9e000640 1 -- 172.21.15.103:0/323934584 <== mon.2 v2:172.21.15.117:3300/0 7 ==== config(24 keys) ==== 1045+0+0 (secure 0 0 0) 0x7fcc940c2080 con 0x7fcca0104c60 2024-09-11T00:58:51.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.024+0000 7fcc9e000640 1 -- 172.21.15.103:0/323934584 <== mon.2 v2:172.21.15.117:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v19)=0 v19) ==== 123+0+0 (secure 0 0 0) 0x7fcc94085150 con 0x7fcca0104c60 2024-09-11T00:58:51.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.027+0000 7fcca8400640 1 -- 172.21.15.103:0/323934584 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcc8807a3b0 msgr2=0x7fcc8807c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.027+0000 7fcca8400640 1 --2- 172.21.15.103:0/323934584 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcc8807a3b0 0x7fcc8807c870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c0095f0 tx=0x7fcc8c005f90 comp rx=0 tx=0).stop 2024-09-11T00:58:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.027+0000 7fcca8400640 1 -- 172.21.15.103:0/323934584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca0104c60 msgr2=0x7fcca019ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.027+0000 7fcca8400640 1 --2- 172.21.15.103:0/323934584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca0104c60 0x7fcca019ad70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcc9402ae10 tx=0x7fcc94004ab0 comp rx=0 tx=0).stop 2024-09-11T00:58:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.027+0000 7fcca8400640 1 -- 172.21.15.103:0/323934584 shutdown_connections 2024-09-11T00:58:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.027+0000 7fcca8400640 1 --2- 172.21.15.103:0/323934584 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcc8807a3b0 0x7fcc8807c870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.027+0000 7fcca8400640 1 --2- 172.21.15.103:0/323934584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcca0106780 0x7fcca019c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.027+0000 7fcca8400640 1 --2- 172.21.15.103:0/323934584 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcca0105dc0 0x7fcca019b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.027+0000 7fcca8400640 1 --2- 172.21.15.103:0/323934584 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcca0104c60 0x7fcca019ad70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.027+0000 7fcca8400640 1 -- 172.21.15.103:0/323934584 >> 172.21.15.103:0/323934584 conn(0x7fcca0100510 msgr2=0x7fcca0109280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.027+0000 7fcca8400640 1 -- 172.21.15.103:0/323934584 shutdown_connections 2024-09-11T00:58:51.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.027+0000 7fcca8400640 1 -- 172.21.15.103:0/323934584 wait complete. 2024-09-11T00:58:51.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:50 smithi117 ceph-mon[35358]: mgrmap e14: x(active, since 70s), standbys: z 2024-09-11T00:58:51.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:50 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-11T00:58:51.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:50 smithi183 ceph-mon[34992]: mgrmap e14: x(active, since 70s), standbys: z 2024-09-11T00:58:51.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:50 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-11T00:58:51.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.149+0000 7f8a52400640 1 -- 172.21.15.103:0/651440187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a4c102890 msgr2=0x7f8a4c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:51.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.149+0000 7f8a52400640 1 --2- 172.21.15.103:0/651440187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a4c102890 0x7f8a4c102c90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009930 tx=0x7f8a3c02a420 comp rx=0 tx=0).stop 2024-09-11T00:58:51.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.149+0000 7f8a52400640 1 -- 172.21.15.103:0/651440187 shutdown_connections 2024-09-11T00:58:51.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.149+0000 7f8a52400640 1 --2- 172.21.15.103:0/651440187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a4c1043b0 0x7f8a4c10ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:51.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.149+0000 7f8a52400640 1 --2- 172.21.15.103:0/651440187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a4c1039f0 0x7f8a4c103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.149+0000 7f8a52400640 1 --2- 172.21.15.103:0/651440187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a4c102890 0x7f8a4c102c90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.149+0000 7f8a52400640 1 -- 172.21.15.103:0/651440187 >> 172.21.15.103:0/651440187 conn(0x7f8a4c0fe180 msgr2=0x7f8a4c1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.149+0000 7f8a52400640 1 -- 172.21.15.103:0/651440187 shutdown_connections 2024-09-11T00:58:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.149+0000 7f8a52400640 1 -- 172.21.15.103:0/651440187 wait complete. 2024-09-11T00:58:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.150+0000 7f8a52400640 1 Processor -- start 2024-09-11T00:58:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a52400640 1 -- start start 2024-09-11T00:58:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a52400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a4c102890 0x7f8a4c105110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a52400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a4c1039f0 0x7f8a4c105760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a52400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a4c1043b0 0x7f8a4c1063a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a52400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c10e330 con 0x7f8a4c102890 2024-09-11T00:58:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a52400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c10e1b0 con 0x7f8a4c1043b0 2024-09-11T00:58:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a52400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c10e4b0 con 0x7f8a4c1039f0 2024-09-11T00:58:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a51000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a4c102890 0x7f8a4c105110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a51000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a4c102890 0x7f8a4c105110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43160/0 (socket says 172.21.15.103:43160) 2024-09-11T00:58:51.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a51000640 1 -- 172.21.15.103:0/2265268546 learned_addr learned my addr 172.21.15.103:0/2265268546 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:51.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a4be00640 1 --2- 172.21.15.103:0/2265268546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a4c1039f0 0x7f8a4c105760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:51.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a51a00640 1 --2- 172.21.15.103:0/2265268546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a4c1043b0 0x7f8a4c1063a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:51.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a51a00640 1 -- 172.21.15.103:0/2265268546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a4c1039f0 msgr2=0x7f8a4c105760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:51.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a51a00640 1 --2- 172.21.15.103:0/2265268546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a4c1039f0 0x7f8a4c105760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:51.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a51a00640 1 -- 172.21.15.103:0/2265268546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a4c102890 msgr2=0x7f8a4c105110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:51.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a51a00640 1 --2- 172.21.15.103:0/2265268546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a4c102890 0x7f8a4c105110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:51.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.151+0000 7f8a51a00640 1 -- 172.21.15.103:0/2265268546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c106c40 con 0x7f8a4c1043b0 2024-09-11T00:58:51.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.152+0000 7f8a51a00640 1 --2- 172.21.15.103:0/2265268546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a4c1043b0 0x7f8a4c1063a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009fd0 tx=0x7f8a4400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:51.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.152+0000 7f8a49600640 1 -- 172.21.15.103:0/2265268546 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4400ce20 con 0x7f8a4c1043b0 2024-09-11T00:58:51.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.152+0000 7f8a49600640 1 -- 172.21.15.103:0/2265268546 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(24 keys) ==== 1045+0+0 (secure 0 0 0) 0x7f8a44005020 con 0x7f8a4c1043b0 2024-09-11T00:58:51.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.152+0000 7f8a52400640 1 -- 172.21.15.103:0/2265268546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c106f30 con 0x7f8a4c1043b0 2024-09-11T00:58:51.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.152+0000 7f8a49600640 1 -- 172.21.15.103:0/2265268546 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a44010690 con 0x7f8a4c1043b0 2024-09-11T00:58:51.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.152+0000 7f8a52400640 1 -- 172.21.15.103:0/2265268546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4c1075e0 con 0x7f8a4c1043b0 2024-09-11T00:58:51.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.153+0000 7f8a52400640 1 -- 172.21.15.103:0/2265268546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a4c102c90 con 0x7f8a4c1043b0 2024-09-11T00:58:51.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.154+0000 7f8a49600640 1 -- 172.21.15.103:0/2265268546 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 14) ==== 102338+0+0 (secure 0 0 0) 0x7f8a44004a40 con 0x7f8a4c1043b0 2024-09-11T00:58:51.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.155+0000 7f8a49600640 1 --2- 172.21.15.103:0/2265268546 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8a3007a450 0x7f8a3007c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:51.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.155+0000 7f8a49600640 1 -- 172.21.15.103:0/2265268546 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8a4409c400 con 0x7f8a4c1043b0 2024-09-11T00:58:51.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.155+0000 7f8a51000640 1 --2- 172.21.15.103:0/2265268546 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8a3007a450 0x7f8a3007c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:51.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.156+0000 7f8a51000640 1 --2- 172.21.15.103:0/2265268546 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8a3007a450 0x7f8a3007c910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0096c0 tx=0x7f8a3c005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:51.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.159+0000 7f8a49600640 1 -- 172.21.15.103:0/2265268546 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8a440051d0 con 0x7f8a4c1043b0 2024-09-11T00:58:51.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.350+0000 7f8a52400640 1 -- 172.21.15.103:0/2265268546 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f8a4c107f50 con 0x7f8a4c1043b0 2024-09-11T00:58:51.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.358+0000 7f8a49600640 1 -- 172.21.15.103:0/2265268546 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v20)=0 v20) ==== 117+0+0 (secure 0 0 0) 0x7f8a44064a40 con 0x7f8a4c1043b0 2024-09-11T00:58:51.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.360+0000 7f8a52400640 1 -- 172.21.15.103:0/2265268546 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8a3007a450 msgr2=0x7f8a3007c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:51.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.360+0000 7f8a52400640 1 --2- 172.21.15.103:0/2265268546 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8a3007a450 0x7f8a3007c910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c0096c0 tx=0x7f8a3c005a40 comp rx=0 tx=0).stop 2024-09-11T00:58:51.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.360+0000 7f8a52400640 1 -- 172.21.15.103:0/2265268546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a4c1043b0 msgr2=0x7f8a4c1063a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:51.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.360+0000 7f8a52400640 1 --2- 172.21.15.103:0/2265268546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a4c1043b0 0x7f8a4c1063a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8a44009fd0 tx=0x7f8a4400ef10 comp rx=0 tx=0).stop 2024-09-11T00:58:51.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.360+0000 7f8a52400640 1 -- 172.21.15.103:0/2265268546 shutdown_connections 2024-09-11T00:58:51.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.360+0000 7f8a52400640 1 --2- 172.21.15.103:0/2265268546 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8a3007a450 0x7f8a3007c910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:51.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.360+0000 7f8a52400640 1 --2- 172.21.15.103:0/2265268546 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a4c1043b0 0x7f8a4c1063a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:51.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.360+0000 7f8a52400640 1 --2- 172.21.15.103:0/2265268546 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a4c1039f0 0x7f8a4c105760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:51.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.360+0000 7f8a52400640 1 --2- 172.21.15.103:0/2265268546 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a4c102890 0x7f8a4c105110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:51.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.360+0000 7f8a52400640 1 -- 172.21.15.103:0/2265268546 >> 172.21.15.103:0/2265268546 conn(0x7f8a4c0fe180 msgr2=0x7f8a4c109110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:51.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.360+0000 7f8a52400640 1 -- 172.21.15.103:0/2265268546 shutdown_connections 2024-09-11T00:58:51.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:51.360+0000 7f8a52400640 1 -- 172.21.15.103:0/2265268546 wait complete. 2024-09-11T00:58:52.267 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:52 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:58:52.268 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:52 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:58:52.268 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:52 smithi103 ceph-mon[30562]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:52.268 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:52 smithi103 ceph-mon[30562]: Standby manager daemon y started 2024-09-11T00:58:52.268 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:52 smithi103 ceph-mon[30562]: from='mgr.? 172.21.15.117:0/3547985361' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-11T00:58:52.268 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:52 smithi103 ceph-mon[30562]: from='mgr.? 172.21.15.117:0/3547985361' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-11T00:58:52.268 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:52 smithi103 ceph-mon[30562]: from='mgr.? 172.21.15.117:0/3547985361' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-11T00:58:52.268 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:52 smithi103 ceph-mon[30562]: from='mgr.? 172.21.15.117:0/3547985361' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-11T00:58:52.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:52 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:58:52.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:52 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:58:52.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:52 smithi117 ceph-mon[35358]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:52.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:52 smithi117 ceph-mon[35358]: Standby manager daemon y started 2024-09-11T00:58:52.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:52 smithi117 ceph-mon[35358]: from='mgr.? 172.21.15.117:0/3547985361' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-11T00:58:52.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:52 smithi117 ceph-mon[35358]: from='mgr.? 172.21.15.117:0/3547985361' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-11T00:58:52.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:52 smithi117 ceph-mon[35358]: from='mgr.? 172.21.15.117:0/3547985361' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-11T00:58:52.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:52 smithi117 ceph-mon[35358]: from='mgr.? 172.21.15.117:0/3547985361' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-11T00:58:52.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:52 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:58:52.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:52 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:58:52.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:52 smithi183 ceph-mon[34992]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:52.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:52 smithi183 ceph-mon[34992]: Standby manager daemon y started 2024-09-11T00:58:52.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:52 smithi183 ceph-mon[34992]: from='mgr.? 172.21.15.117:0/3547985361' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-11T00:58:52.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:52 smithi183 ceph-mon[34992]: from='mgr.? 172.21.15.117:0/3547985361' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-11T00:58:52.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:52 smithi183 ceph-mon[34992]: from='mgr.? 172.21.15.117:0/3547985361' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-11T00:58:52.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:52 smithi183 ceph-mon[34992]: from='mgr.? 172.21.15.117:0/3547985361' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-11T00:58:53.064 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:53.097 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi103') 2024-09-11T00:58:53.316 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:53.317 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:53.318 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:53.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.343+0000 7fda1dc00640 1 -- 172.21.15.103:0/2704881209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda18104c50 msgr2=0x7fda18105050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:53.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.343+0000 7fda1dc00640 1 --2- 172.21.15.103:0/2704881209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda18104c50 0x7fda18105050 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda080098c0 tx=0x7fda0802a390 comp rx=0 tx=0).stop 2024-09-11T00:58:53.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.343+0000 7fda1dc00640 1 -- 172.21.15.103:0/2704881209 shutdown_connections 2024-09-11T00:58:53.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.343+0000 7fda1dc00640 1 --2- 172.21.15.103:0/2704881209 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda18106770 0x7fda1810d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:53.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.343+0000 7fda1dc00640 1 --2- 172.21.15.103:0/2704881209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda18105db0 0x7fda18106230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:53.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.343+0000 7fda1dc00640 1 --2- 172.21.15.103:0/2704881209 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda18104c50 0x7fda18105050 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:53.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.343+0000 7fda1dc00640 1 -- 172.21.15.103:0/2704881209 >> 172.21.15.103:0/2704881209 conn(0x7fda18100520 msgr2=0x7fda18102960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:53.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.343+0000 7fda1dc00640 1 -- 172.21.15.103:0/2704881209 shutdown_connections 2024-09-11T00:58:53.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.344+0000 7fda1dc00640 1 -- 172.21.15.103:0/2704881209 wait complete. 2024-09-11T00:58:53.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.345+0000 7fda1dc00640 1 Processor -- start 2024-09-11T00:58:53.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.345+0000 7fda1dc00640 1 -- start start 2024-09-11T00:58:53.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.345+0000 7fda1dc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda18104c50 0x7fda1819ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:53.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.345+0000 7fda1dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda18105db0 0x7fda1819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:53.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.346+0000 7fda1dc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda18106770 0x7fda1819c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:53.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.346+0000 7fda1dc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fda181106a0 con 0x7fda18105db0 2024-09-11T00:58:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.346+0000 7fda1dc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fda18110520 con 0x7fda18106770 2024-09-11T00:58:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.346+0000 7fda1dc00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fda18110820 con 0x7fda18104c50 2024-09-11T00:58:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.346+0000 7fda16a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda18104c50 0x7fda1819ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.346+0000 7fda16000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda18105db0 0x7fda1819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.346+0000 7fda16a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda18104c50 0x7fda1819ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:40466/0 (socket says 172.21.15.103:40466) 2024-09-11T00:58:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.346+0000 7fda16a00640 1 -- 172.21.15.103:0/293128851 learned_addr learned my addr 172.21.15.103:0/293128851 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.346+0000 7fda17400640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda18106770 0x7fda1819c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.346+0000 7fda16a00640 1 -- 172.21.15.103:0/293128851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda18106770 msgr2=0x7fda1819c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.346+0000 7fda16a00640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda18106770 0x7fda1819c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.346+0000 7fda16a00640 1 -- 172.21.15.103:0/293128851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda18105db0 msgr2=0x7fda1819b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.347+0000 7fda16a00640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda18105db0 0x7fda1819b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.347+0000 7fda16a00640 1 -- 172.21.15.103:0/293128851 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1819c980 con 0x7fda18104c50 2024-09-11T00:58:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.347+0000 7fda17400640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda18106770 0x7fda1819c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:58:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.347+0000 7fda16000640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda18105db0 0x7fda1819b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:58:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.347+0000 7fda16a00640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda18104c50 0x7fda1819ae50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fda08035040 tx=0x7fda08032a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.347+0000 7fda0f400640 1 -- 172.21.15.103:0/293128851 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda08041070 con 0x7fda18104c50 2024-09-11T00:58:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.347+0000 7fda1dc00640 1 -- 172.21.15.103:0/293128851 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda1819cc10 con 0x7fda18104c50 2024-09-11T00:58:53.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.347+0000 7fda0f400640 1 -- 172.21.15.103:0/293128851 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(24 keys) ==== 1045+0+0 (secure 0 0 0) 0x7fda08038040 con 0x7fda18104c50 2024-09-11T00:58:53.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.348+0000 7fda0f400640 1 -- 172.21.15.103:0/293128851 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda08037050 con 0x7fda18104c50 2024-09-11T00:58:53.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.348+0000 7fda1dc00640 1 -- 172.21.15.103:0/293128851 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda181a3180 con 0x7fda18104c50 2024-09-11T00:58:53.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.349+0000 7fda1dc00640 1 -- 172.21.15.103:0/293128851 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda181a33e0 con 0x7fda18104c50 2024-09-11T00:58:53.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.353+0000 7fda0f400640 1 -- 172.21.15.103:0/293128851 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7fda08005110 con 0x7fda18104c50 2024-09-11T00:58:53.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.354+0000 7fda0f400640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd9fc0b5250 0x7fd9fc0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:53.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.355+0000 7fda0f400640 1 -- 172.21.15.103:0/293128851 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fda081035a0 con 0x7fda18104c50 2024-09-11T00:58:53.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.355+0000 7fda16000640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd9fc0b5250 0x7fd9fc0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:53.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.356+0000 7fda16000640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd9fc0b5250 0x7fd9fc0b7710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda04005fd0 tx=0x7fda04009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:53.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.358+0000 7fda0f400640 1 -- 172.21.15.103:0/293128851 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fda080cc130 con 0x7fda18104c50 2024-09-11T00:58:53.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.554+0000 7fda1dc00640 1 -- 172.21.15.103:0/293128851 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7fda181a35b0 con 0x7fda18104c50 2024-09-11T00:58:53.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.562+0000 7fda0f400640 1 -- 172.21.15.103:0/293128851 <== mon.1 v2:172.21.15.183:3300/0 7 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fda080c7180 con 0x7fda18104c50 2024-09-11T00:58:53.564 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:53 smithi103 ceph-mon[30562]: mgrmap e15: x(active, since 72s), standbys: z, y 2024-09-11T00:58:53.564 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-11T00:58:53.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.562+0000 7fda0f400640 1 -- 172.21.15.103:0/293128851 <== mon.1 v2:172.21.15.183:3300/0 8 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v21)=0 v21) ==== 114+0+0 (secure 0 0 0) 0x7fda080cba30 con 0x7fda18104c50 2024-09-11T00:58:53.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.566+0000 7fda1dc00640 1 -- 172.21.15.103:0/293128851 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd9fc0b5250 msgr2=0x7fd9fc0b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:53.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.566+0000 7fda1dc00640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd9fc0b5250 0x7fd9fc0b7710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fda04005fd0 tx=0x7fda04009260 comp rx=0 tx=0).stop 2024-09-11T00:58:53.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.566+0000 7fda1dc00640 1 -- 172.21.15.103:0/293128851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda18104c50 msgr2=0x7fda1819ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:53.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.566+0000 7fda1dc00640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda18104c50 0x7fda1819ae50 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fda08035040 tx=0x7fda08032a70 comp rx=0 tx=0).stop 2024-09-11T00:58:53.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.566+0000 7fda1dc00640 1 -- 172.21.15.103:0/293128851 shutdown_connections 2024-09-11T00:58:53.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.566+0000 7fda1dc00640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd9fc0b5250 0x7fd9fc0b7710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:53.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.566+0000 7fda1dc00640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda18106770 0x7fda1819c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:53.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.566+0000 7fda1dc00640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fda18105db0 0x7fda1819b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:53.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.566+0000 7fda1dc00640 1 --2- 172.21.15.103:0/293128851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fda18104c50 0x7fda1819ae50 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:53.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.566+0000 7fda1dc00640 1 -- 172.21.15.103:0/293128851 >> 172.21.15.103:0/293128851 conn(0x7fda18100520 msgr2=0x7fda18107190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:53.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.566+0000 7fda1dc00640 1 -- 172.21.15.103:0/293128851 shutdown_connections 2024-09-11T00:58:53.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:53.567+0000 7fda1dc00640 1 -- 172.21.15.103:0/293128851 wait complete. 2024-09-11T00:58:53.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:53 smithi117 ceph-mon[35358]: mgrmap e15: x(active, since 72s), standbys: z, y 2024-09-11T00:58:53.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-11T00:58:53.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:53 smithi183 ceph-mon[34992]: mgrmap e15: x(active, since 72s), standbys: z, y 2024-09-11T00:58:53.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-11T00:58:54.542 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:54 smithi103 ceph-mon[30562]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:54.542 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:54 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:58:54.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.655+0000 7fa3bea00640 1 -- 172.21.15.103:0/102981418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3b8102890 msgr2=0x7fa3b8102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:54.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.655+0000 7fa3bea00640 1 --2- 172.21.15.103:0/102981418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3b8102890 0x7fa3b8102c90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009890 tx=0x7fa3ac02a380 comp rx=0 tx=0).stop 2024-09-11T00:58:54.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.655+0000 7fa3bea00640 1 -- 172.21.15.103:0/102981418 shutdown_connections 2024-09-11T00:58:54.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.655+0000 7fa3bea00640 1 --2- 172.21.15.103:0/102981418 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b81043b0 0x7fa3b810ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.655+0000 7fa3bea00640 1 --2- 172.21.15.103:0/102981418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b81039f0 0x7fa3b8103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.655+0000 7fa3bea00640 1 --2- 172.21.15.103:0/102981418 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3b8102890 0x7fa3b8102c90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.655+0000 7fa3bea00640 1 -- 172.21.15.103:0/102981418 >> 172.21.15.103:0/102981418 conn(0x7fa3b80fe180 msgr2=0x7fa3b81005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:54.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.655+0000 7fa3bea00640 1 -- 172.21.15.103:0/102981418 shutdown_connections 2024-09-11T00:58:54.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.655+0000 7fa3bea00640 1 -- 172.21.15.103:0/102981418 wait complete. 2024-09-11T00:58:54.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.656+0000 7fa3bea00640 1 Processor -- start 2024-09-11T00:58:54.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.656+0000 7fa3bea00640 1 -- start start 2024-09-11T00:58:54.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.657+0000 7fa3bea00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b8102890 0x7fa3b819acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:54.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.657+0000 7fa3bea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3b81039f0 0x7fa3b819b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:54.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.657+0000 7fa3bea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b81043b0 0x7fa3b819bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:54.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.657+0000 7fa3bea00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b810e3b0 con 0x7fa3b81043b0 2024-09-11T00:58:54.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.657+0000 7fa3bea00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b810e230 con 0x7fa3b81039f0 2024-09-11T00:58:54.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.657+0000 7fa3bea00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b810e530 con 0x7fa3b8102890 2024-09-11T00:58:54.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.657+0000 7fa3be000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b81043b0 0x7fa3b819bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:54.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.657+0000 7fa3be000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b81043b0 0x7fa3b819bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43210/0 (socket says 172.21.15.103:43210) 2024-09-11T00:58:54.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.657+0000 7fa3be000640 1 -- 172.21.15.103:0/1610537110 learned_addr learned my addr 172.21.15.103:0/1610537110 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:54.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.657+0000 7fa3bd600640 1 --2- 172.21.15.103:0/1610537110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b8102890 0x7fa3b819acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:54.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.657+0000 7fa3bcc00640 1 --2- 172.21.15.103:0/1610537110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3b81039f0 0x7fa3b819b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:54.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.658+0000 7fa3bd600640 1 -- 172.21.15.103:0/1610537110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3b81039f0 msgr2=0x7fa3b819b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:54.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.658+0000 7fa3bd600640 1 --2- 172.21.15.103:0/1610537110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3b81039f0 0x7fa3b819b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.658+0000 7fa3bd600640 1 -- 172.21.15.103:0/1610537110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b81043b0 msgr2=0x7fa3b819bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:54.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.658+0000 7fa3bd600640 1 --2- 172.21.15.103:0/1610537110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b81043b0 0x7fa3b819bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.658+0000 7fa3bd600640 1 -- 172.21.15.103:0/1610537110 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b819c800 con 0x7fa3b8102890 2024-09-11T00:58:54.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.658+0000 7fa3bd600640 1 --2- 172.21.15.103:0/1610537110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b8102890 0x7fa3b819acd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac035040 tx=0x7fa3ac033d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:54.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.658+0000 7fa3b6000640 1 -- 172.21.15.103:0/1610537110 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac037040 con 0x7fa3b8102890 2024-09-11T00:58:54.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.658+0000 7fa3b6000640 1 -- 172.21.15.103:0/1610537110 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fa3ac030830 con 0x7fa3b8102890 2024-09-11T00:58:54.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.658+0000 7fa3b6000640 1 -- 172.21.15.103:0/1610537110 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac003850 con 0x7fa3b8102890 2024-09-11T00:58:54.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.658+0000 7fa3bea00640 1 -- 172.21.15.103:0/1610537110 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b819ca90 con 0x7fa3b8102890 2024-09-11T00:58:54.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.658+0000 7fa3bea00640 1 -- 172.21.15.103:0/1610537110 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b81a31d0 con 0x7fa3b8102890 2024-09-11T00:58:54.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.659+0000 7fa3bea00640 1 -- 172.21.15.103:0/1610537110 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b8102c90 con 0x7fa3b8102890 2024-09-11T00:58:54.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.662+0000 7fa3b6000640 1 -- 172.21.15.103:0/1610537110 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7fa3ac03a070 con 0x7fa3b8102890 2024-09-11T00:58:54.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.663+0000 7fa3b6000640 1 --2- 172.21.15.103:0/1610537110 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3a00b5370 0x7fa3a00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:54.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.663+0000 7fa3b6000640 1 -- 172.21.15.103:0/1610537110 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa3ac103240 con 0x7fa3b8102890 2024-09-11T00:58:54.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.663+0000 7fa3bcc00640 1 --2- 172.21.15.103:0/1610537110 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3a00b5370 0x7fa3a00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:54.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.664+0000 7fa3bcc00640 1 --2- 172.21.15.103:0/1610537110 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3a00b5370 0x7fa3a00b7830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4005fd0 tx=0x7fa3a4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:54.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:54 smithi183 ceph-mon[34992]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:54.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:54 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:58:54.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.667+0000 7fa3b6000640 1 -- 172.21.15.103:0/1610537110 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa3ac049020 con 0x7fa3b8102890 2024-09-11T00:58:54.800 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:54 smithi117 ceph-mon[35358]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:54.800 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:54 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:58:54.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.866+0000 7fa3bea00640 1 -- 172.21.15.103:0/1610537110 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fa3b81a3a70 con 0x7fa3b8102890 2024-09-11T00:58:54.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.874+0000 7fa3b6000640 1 -- 172.21.15.103:0/1610537110 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v23)=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7fa3ac0cbd30 con 0x7fa3b8102890 2024-09-11T00:58:54.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.876+0000 7fa3bea00640 1 -- 172.21.15.103:0/1610537110 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3a00b5370 msgr2=0x7fa3a00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:54.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.876+0000 7fa3bea00640 1 --2- 172.21.15.103:0/1610537110 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3a00b5370 0x7fa3a00b7830 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4005fd0 tx=0x7fa3a4009260 comp rx=0 tx=0).stop 2024-09-11T00:58:54.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.876+0000 7fa3bea00640 1 -- 172.21.15.103:0/1610537110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b8102890 msgr2=0x7fa3b819acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:54.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.876+0000 7fa3bea00640 1 --2- 172.21.15.103:0/1610537110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b8102890 0x7fa3b819acd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac035040 tx=0x7fa3ac033d40 comp rx=0 tx=0).stop 2024-09-11T00:58:54.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.876+0000 7fa3bea00640 1 -- 172.21.15.103:0/1610537110 shutdown_connections 2024-09-11T00:58:54.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.876+0000 7fa3bea00640 1 --2- 172.21.15.103:0/1610537110 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3a00b5370 0x7fa3a00b7830 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.876+0000 7fa3bea00640 1 --2- 172.21.15.103:0/1610537110 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3b81043b0 0x7fa3b819bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.876+0000 7fa3bea00640 1 --2- 172.21.15.103:0/1610537110 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3b81039f0 0x7fa3b819b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.876+0000 7fa3bea00640 1 --2- 172.21.15.103:0/1610537110 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3b8102890 0x7fa3b819acd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.876+0000 7fa3bea00640 1 -- 172.21.15.103:0/1610537110 >> 172.21.15.103:0/1610537110 conn(0x7fa3b80fe180 msgr2=0x7fa3b8075380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:54.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.877+0000 7fa3bea00640 1 -- 172.21.15.103:0/1610537110 shutdown_connections 2024-09-11T00:58:54.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.877+0000 7fa3bea00640 1 -- 172.21.15.103:0/1610537110 wait complete. 2024-09-11T00:58:54.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.462+0000 7f2cc3200640 1 -- 172.21.15.103:0/2422104868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc4104aa0 msgr2=0x7f2cc4104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:54.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.462+0000 7f2cc3200640 1 --2- 172.21.15.103:0/2422104868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc4104aa0 0x7f2cc4104ea0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009930 tx=0x7f2cb402a420 comp rx=0 tx=0).stop 2024-09-11T00:58:54.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.462+0000 7f2cc3200640 1 -- 172.21.15.103:0/2422104868 shutdown_connections 2024-09-11T00:58:54.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.462+0000 7f2cc3200640 1 --2- 172.21.15.103:0/2422104868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cc41065c0 0x7f2cc410cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.462+0000 7f2cc3200640 1 --2- 172.21.15.103:0/2422104868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cc4105c00 0x7f2cc4106080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.462+0000 7f2cc3200640 1 --2- 172.21.15.103:0/2422104868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc4104aa0 0x7f2cc4104ea0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.462+0000 7f2cc3200640 1 -- 172.21.15.103:0/2422104868 >> 172.21.15.103:0/2422104868 conn(0x7f2cc4100370 msgr2=0x7f2cc41027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:54.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.462+0000 7f2cc3200640 1 -- 172.21.15.103:0/2422104868 shutdown_connections 2024-09-11T00:58:54.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.462+0000 7f2cc3200640 1 -- 172.21.15.103:0/2422104868 wait complete. 2024-09-11T00:58:54.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.463+0000 7f2cc3200640 1 Processor -- start 2024-09-11T00:58:54.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.463+0000 7f2cc3200640 1 -- start start 2024-09-11T00:58:54.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc3200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cc4104aa0 0x7f2cc419ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:54.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc3200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cc4105c00 0x7f2cc419b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:54.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc3200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc41065c0 0x7f2cc419bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:54.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc3200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc4110610 con 0x7f2cc41065c0 2024-09-11T00:58:54.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc3200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc4110490 con 0x7f2cc4104aa0 2024-09-11T00:58:54.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc3200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc4110790 con 0x7f2cc4105c00 2024-09-11T00:58:54.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc41065c0 0x7f2cc419bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:54.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc41065c0 0x7f2cc419bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43196/0 (socket says 172.21.15.103:43196) 2024-09-11T00:58:54.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc1e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cc4104aa0 0x7f2cc419ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:54.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc2800640 1 -- 172.21.15.103:0/1806503172 learned_addr learned my addr 172.21.15.103:0/1806503172 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:54.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc1400640 1 --2- 172.21.15.103:0/1806503172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cc4105c00 0x7f2cc419b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:54.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc2800640 1 -- 172.21.15.103:0/1806503172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cc4105c00 msgr2=0x7f2cc419b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:54.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc2800640 1 --2- 172.21.15.103:0/1806503172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cc4105c00 0x7f2cc419b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc2800640 1 -- 172.21.15.103:0/1806503172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cc4104aa0 msgr2=0x7f2cc419ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:54.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc2800640 1 --2- 172.21.15.103:0/1806503172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cc4104aa0 0x7f2cc419ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.464+0000 7f2cc2800640 1 -- 172.21.15.103:0/1806503172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc419c830 con 0x7f2cc41065c0 2024-09-11T00:58:54.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.465+0000 7f2cc2800640 1 --2- 172.21.15.103:0/1806503172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc41065c0 0x7f2cc419bf90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009fd0 tx=0x7f2cbc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:54.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.465+0000 7f2cbaa00640 1 -- 172.21.15.103:0/1806503172 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc017070 con 0x7f2cc41065c0 2024-09-11T00:58:54.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.465+0000 7f2cbaa00640 1 -- 172.21.15.103:0/1806503172 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f2cbc003e00 con 0x7f2cc41065c0 2024-09-11T00:58:54.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.465+0000 7f2cc3200640 1 -- 172.21.15.103:0/1806503172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc419cb20 con 0x7f2cc41065c0 2024-09-11T00:58:54.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.465+0000 7f2cbaa00640 1 -- 172.21.15.103:0/1806503172 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc010460 con 0x7f2cc41065c0 2024-09-11T00:58:54.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.465+0000 7f2cc3200640 1 -- 172.21.15.103:0/1806503172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc41a3200 con 0x7f2cc41065c0 2024-09-11T00:58:54.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.466+0000 7f2cc3200640 1 -- 172.21.15.103:0/1806503172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc410bd50 con 0x7f2cc41065c0 2024-09-11T00:58:54.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.468+0000 7f2cbaa00640 1 -- 172.21.15.103:0/1806503172 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7f2cbc003970 con 0x7f2cc41065c0 2024-09-11T00:58:54.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.469+0000 7f2cbaa00640 1 --2- 172.21.15.103:0/1806503172 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ca80b5370 0x7f2ca80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:54.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.470+0000 7f2cbaa00640 1 -- 172.21.15.103:0/1806503172 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2cbc0e3fa0 con 0x7f2cc41065c0 2024-09-11T00:58:54.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.470+0000 7f2cc1e00640 1 --2- 172.21.15.103:0/1806503172 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ca80b5370 0x7f2ca80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:54.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.470+0000 7f2cc1e00640 1 --2- 172.21.15.103:0/1806503172 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ca80b5370 0x7f2ca80b7830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4005ab0 tx=0x7f2cb4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:54.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.473+0000 7f2cbaa00640 1 -- 172.21.15.103:0/1806503172 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2cbc0ac440 con 0x7f2cc41065c0 2024-09-11T00:58:54.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.672+0000 7f2cc3200640 1 -- 172.21.15.103:0/1806503172 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f2cc4063d50 con 0x7f2cc41065c0 2024-09-11T00:58:54.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.677+0000 7f2cbaa00640 1 -- 172.21.15.103:0/1806503172 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v22)=0 v22) ==== 115+0+0 (secure 0 0 0) 0x7f2cbc0b0e70 con 0x7f2cc41065c0 2024-09-11T00:58:54.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.680+0000 7f2cc3200640 1 -- 172.21.15.103:0/1806503172 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ca80b5370 msgr2=0x7f2ca80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:54.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.680+0000 7f2cc3200640 1 --2- 172.21.15.103:0/1806503172 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ca80b5370 0x7f2ca80b7830 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4005ab0 tx=0x7f2cb4005a20 comp rx=0 tx=0).stop 2024-09-11T00:58:54.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.680+0000 7f2cc3200640 1 -- 172.21.15.103:0/1806503172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc41065c0 msgr2=0x7f2cc419bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:54.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.680+0000 7f2cc3200640 1 --2- 172.21.15.103:0/1806503172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc41065c0 0x7f2cc419bf90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc009fd0 tx=0x7f2cbc00b260 comp rx=0 tx=0).stop 2024-09-11T00:58:54.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.680+0000 7f2cc3200640 1 -- 172.21.15.103:0/1806503172 shutdown_connections 2024-09-11T00:58:54.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.680+0000 7f2cc3200640 1 --2- 172.21.15.103:0/1806503172 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ca80b5370 0x7f2ca80b7830 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.680+0000 7f2cc3200640 1 --2- 172.21.15.103:0/1806503172 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc41065c0 0x7f2cc419bf90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.680+0000 7f2cc3200640 1 --2- 172.21.15.103:0/1806503172 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2cc4105c00 0x7f2cc419b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.680+0000 7f2cc3200640 1 --2- 172.21.15.103:0/1806503172 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2cc4104aa0 0x7f2cc419ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:54.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.680+0000 7f2cc3200640 1 -- 172.21.15.103:0/1806503172 >> 172.21.15.103:0/1806503172 conn(0x7f2cc4100370 msgr2=0x7f2cc4108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:54.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.680+0000 7f2cc3200640 1 -- 172.21.15.103:0/1806503172 shutdown_connections 2024-09-11T00:58:54.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.680+0000 7f2cc3200640 1 -- 172.21.15.103:0/1806503172 wait complete. 2024-09-11T00:58:55.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.454+0000 7fa961800640 1 -- 172.21.15.103:0/4044908539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa95c076f00 msgr2=0x7fa95c075560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:55.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.454+0000 7fa961800640 1 --2- 172.21.15.103:0/4044908539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa95c076f00 0x7fa95c075560 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa94c009900 tx=0x7fa94c02a3f0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.454+0000 7fa961800640 1 -- 172.21.15.103:0/4044908539 shutdown_connections 2024-09-11T00:58:55.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.454+0000 7fa961800640 1 --2- 172.21.15.103:0/4044908539 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa95c10aa00 0x7fa95c10ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.454+0000 7fa961800640 1 --2- 172.21.15.103:0/4044908539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa95c075aa0 0x7fa95c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.454+0000 7fa961800640 1 --2- 172.21.15.103:0/4044908539 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa95c076f00 0x7fa95c075560 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.454+0000 7fa961800640 1 -- 172.21.15.103:0/4044908539 >> 172.21.15.103:0/4044908539 conn(0x7fa95c0fe320 msgr2=0x7fa95c100760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.455+0000 7fa961800640 1 -- 172.21.15.103:0/4044908539 shutdown_connections 2024-09-11T00:58:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.455+0000 7fa961800640 1 -- 172.21.15.103:0/4044908539 wait complete. 2024-09-11T00:58:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.455+0000 7fa961800640 1 Processor -- start 2024-09-11T00:58:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.456+0000 7fa961800640 1 -- start start 2024-09-11T00:58:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.456+0000 7fa961800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa95c075aa0 0x7fa95c19aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.456+0000 7fa961800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa95c076f00 0x7fa95c19b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.456+0000 7fa961800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa95c10aa00 0x7fa95c19c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.456+0000 7fa961800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c1108c0 con 0x7fa95c075aa0 2024-09-11T00:58:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.456+0000 7fa961800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c110740 con 0x7fa95c076f00 2024-09-11T00:58:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.456+0000 7fa961800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa95c110a40 con 0x7fa95c10aa00 2024-09-11T00:58:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.456+0000 7fa95a000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa95c076f00 0x7fa95c19b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.456+0000 7fa95aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa95c075aa0 0x7fa95c19aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.456+0000 7fa95a000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa95c076f00 0x7fa95c19b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:32832/0 (socket says 172.21.15.103:32832) 2024-09-11T00:58:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.456+0000 7fa95a000640 1 -- 172.21.15.103:0/3422487988 learned_addr learned my addr 172.21.15.103:0/3422487988 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.457+0000 7fa95b400640 1 --2- 172.21.15.103:0/3422487988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa95c10aa00 0x7fa95c19c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.457+0000 7fa95a000640 1 -- 172.21.15.103:0/3422487988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa95c10aa00 msgr2=0x7fa95c19c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.457+0000 7fa95a000640 1 --2- 172.21.15.103:0/3422487988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa95c10aa00 0x7fa95c19c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.457+0000 7fa95a000640 1 -- 172.21.15.103:0/3422487988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa95c075aa0 msgr2=0x7fa95c19aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.457+0000 7fa95a000640 1 --2- 172.21.15.103:0/3422487988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa95c075aa0 0x7fa95c19aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.457+0000 7fa95a000640 1 -- 172.21.15.103:0/3422487988 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95c19cb20 con 0x7fa95c076f00 2024-09-11T00:58:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.457+0000 7fa95a000640 1 --2- 172.21.15.103:0/3422487988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa95c076f00 0x7fa95c19b640 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa94800e9f0 tx=0x7fa94800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.457+0000 7fa953400640 1 -- 172.21.15.103:0/3422487988 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94800cd80 con 0x7fa95c076f00 2024-09-11T00:58:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.457+0000 7fa953400640 1 -- 172.21.15.103:0/3422487988 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9480108e0 con 0x7fa95c076f00 2024-09-11T00:58:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.457+0000 7fa953400640 1 -- 172.21.15.103:0/3422487988 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948018980 con 0x7fa95c076f00 2024-09-11T00:58:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.457+0000 7fa961800640 1 -- 172.21.15.103:0/3422487988 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa95c19ce10 con 0x7fa95c076f00 2024-09-11T00:58:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.457+0000 7fa961800640 1 -- 172.21.15.103:0/3422487988 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa95c1a34f0 con 0x7fa95c076f00 2024-09-11T00:58:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.459+0000 7fa961800640 1 -- 172.21.15.103:0/3422487988 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa95c1a36c0 con 0x7fa95c076f00 2024-09-11T00:58:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.461+0000 7fa953400640 1 -- 172.21.15.103:0/3422487988 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7fa948010430 con 0x7fa95c076f00 2024-09-11T00:58:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.463+0000 7fa953400640 1 --2- 172.21.15.103:0/3422487988 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa9400b52d0 0x7fa9400b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.463+0000 7fa953400640 1 -- 172.21.15.103:0/3422487988 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa9480e4270 con 0x7fa95c076f00 2024-09-11T00:58:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.463+0000 7fa95aa00640 1 --2- 172.21.15.103:0/3422487988 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa9400b52d0 0x7fa9400b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.464+0000 7fa95aa00640 1 --2- 172.21.15.103:0/3422487988 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa9400b52d0 0x7fa9400b7790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa94c000c00 tx=0x7fa94c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.466+0000 7fa953400640 1 -- 172.21.15.103:0/3422487988 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa9480acd60 con 0x7fa95c076f00 2024-09-11T00:58:55.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.662+0000 7fa961800640 1 -- 172.21.15.103:0/3422487988 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7fa95c1a3930 con 0x7fa95c076f00 2024-09-11T00:58:55.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.667+0000 7fa953400640 1 -- 172.21.15.103:0/3422487988 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v25)=0 v25) ==== 118+0+0 (secure 0 0 0) 0x7fa9480ac660 con 0x7fa95c076f00 2024-09-11T00:58:55.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.669+0000 7fa961800640 1 -- 172.21.15.103:0/3422487988 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa9400b52d0 msgr2=0x7fa9400b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:55.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.669+0000 7fa961800640 1 --2- 172.21.15.103:0/3422487988 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa9400b52d0 0x7fa9400b7790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa94c000c00 tx=0x7fa94c0314a0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.669+0000 7fa961800640 1 -- 172.21.15.103:0/3422487988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa95c076f00 msgr2=0x7fa95c19b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:55.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.669+0000 7fa961800640 1 --2- 172.21.15.103:0/3422487988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa95c076f00 0x7fa95c19b640 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa94800e9f0 tx=0x7fa94800eeb0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.669+0000 7fa961800640 1 -- 172.21.15.103:0/3422487988 shutdown_connections 2024-09-11T00:58:55.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.669+0000 7fa961800640 1 --2- 172.21.15.103:0/3422487988 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa9400b52d0 0x7fa9400b7790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.669+0000 7fa961800640 1 --2- 172.21.15.103:0/3422487988 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa95c10aa00 0x7fa95c19c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.669+0000 7fa961800640 1 --2- 172.21.15.103:0/3422487988 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa95c076f00 0x7fa95c19b640 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.669+0000 7fa961800640 1 --2- 172.21.15.103:0/3422487988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa95c075aa0 0x7fa95c19aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.669+0000 7fa961800640 1 -- 172.21.15.103:0/3422487988 >> 172.21.15.103:0/3422487988 conn(0x7fa95c0fe320 msgr2=0x7fa95c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:55.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.669+0000 7fa961800640 1 -- 172.21.15.103:0/3422487988 shutdown_connections 2024-09-11T00:58:55.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.669+0000 7fa961800640 1 -- 172.21.15.103:0/3422487988 wait complete. 2024-09-11T00:58:55.815 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:55 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1806503172' entity='client.admin' 2024-09-11T00:58:55.815 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:55 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:58:55.815 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:55 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:58:55.815 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:55 smithi103 ceph-mon[30562]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:55.815 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:55 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:58:55.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.904+0000 7f4477000640 1 -- 172.21.15.103:0/2205576355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447006b6e0 msgr2=0x7f4470103260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.904+0000 7f4477000640 1 --2- 172.21.15.103:0/2205576355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447006b6e0 0x7f4470103260 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4464009900 tx=0x7f446402a410 comp rx=0 tx=0).stop 2024-09-11T00:58:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.904+0000 7f4477000640 1 -- 172.21.15.103:0/2205576355 shutdown_connections 2024-09-11T00:58:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.904+0000 7f4477000640 1 --2- 172.21.15.103:0/2205576355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44701063a0 0x7f4470106850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.904+0000 7f4477000640 1 --2- 172.21.15.103:0/2205576355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44701037f0 0x7f4470105c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.904+0000 7f4477000640 1 --2- 172.21.15.103:0/2205576355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447006b6e0 0x7f4470103260 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.904+0000 7f4477000640 1 -- 172.21.15.103:0/2205576355 >> 172.21.15.103:0/2205576355 conn(0x7f44700fd040 msgr2=0x7f44700ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.904+0000 7f4477000640 1 -- 172.21.15.103:0/2205576355 shutdown_connections 2024-09-11T00:58:55.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.904+0000 7f4477000640 1 -- 172.21.15.103:0/2205576355 wait complete. 2024-09-11T00:58:55.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.905+0000 7f4477000640 1 Processor -- start 2024-09-11T00:58:55.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.905+0000 7f4477000640 1 -- start start 2024-09-11T00:58:55.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.905+0000 7f4477000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447006b6e0 0x7f447019f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:55.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.905+0000 7f4477000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44701037f0 0x7f447019f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:55.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4477000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44701063a0 0x7f44701a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:55.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4477000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4470114a50 con 0x7f44701037f0 2024-09-11T00:58:55.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4477000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f44701148d0 con 0x7f447006b6e0 2024-09-11T00:58:55.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4477000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4470114bd0 con 0x7f44701063a0 2024-09-11T00:58:55.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4475c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447006b6e0 0x7f447019f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:55.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4475c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447006b6e0 0x7f447019f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:32824/0 (socket says 172.21.15.103:32824) 2024-09-11T00:58:55.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4475c00640 1 -- 172.21.15.103:0/2220204833 learned_addr learned my addr 172.21.15.103:0/2220204833 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:55.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4475200640 1 --2- 172.21.15.103:0/2220204833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44701037f0 0x7f447019f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:55.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4475c00640 1 -- 172.21.15.103:0/2220204833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44701063a0 msgr2=0x7f44701a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:55.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4475c00640 1 --2- 172.21.15.103:0/2220204833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44701063a0 0x7f44701a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4475c00640 1 -- 172.21.15.103:0/2220204833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44701037f0 msgr2=0x7f447019f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:55.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4475c00640 1 --2- 172.21.15.103:0/2220204833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44701037f0 0x7f447019f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4475c00640 1 -- 172.21.15.103:0/2220204833 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44701a0bc0 con 0x7f447006b6e0 2024-09-11T00:58:55.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4475200640 1 --2- 172.21.15.103:0/2220204833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44701037f0 0x7f447019f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:58:55.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.906+0000 7f4475c00640 1 --2- 172.21.15.103:0/2220204833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447006b6e0 0x7f447019f100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4464005ab0 tx=0x7f4464003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:55.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.907+0000 7f446e000640 1 -- 172.21.15.103:0/2220204833 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f446403f070 con 0x7f447006b6e0 2024-09-11T00:58:55.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.907+0000 7f446e000640 1 -- 172.21.15.103:0/2220204833 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(25 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4464031b70 con 0x7f447006b6e0 2024-09-11T00:58:55.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.907+0000 7f446e000640 1 -- 172.21.15.103:0/2220204833 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4464035030 con 0x7f447006b6e0 2024-09-11T00:58:55.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.907+0000 7f4477000640 1 -- 172.21.15.103:0/2220204833 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44701a0e50 con 0x7f447006b6e0 2024-09-11T00:58:55.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.907+0000 7f4477000640 1 -- 172.21.15.103:0/2220204833 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44701a73c0 con 0x7f447006b6e0 2024-09-11T00:58:55.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.908+0000 7f4477000640 1 -- 172.21.15.103:0/2220204833 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44700feb30 con 0x7f447006b6e0 2024-09-11T00:58:55.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.910+0000 7f446e000640 1 -- 172.21.15.103:0/2220204833 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7f44640316e0 con 0x7f447006b6e0 2024-09-11T00:58:55.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.912+0000 7f446e000640 1 --2- 172.21.15.103:0/2220204833 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f44580b5370 0x7f44580b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:55.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.912+0000 7f446e000640 1 -- 172.21.15.103:0/2220204833 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f44641049f0 con 0x7f447006b6e0 2024-09-11T00:58:55.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.912+0000 7f4475200640 1 --2- 172.21.15.103:0/2220204833 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f44580b5370 0x7f44580b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:55.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.912+0000 7f4475200640 1 --2- 172.21.15.103:0/2220204833 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f44580b5370 0x7f44580b7830 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f447006bb90 tx=0x7f445c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:55.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:54.913+0000 7f446e000640 1 -- 172.21.15.103:0/2220204833 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f44640cd4e0 con 0x7f447006b6e0 2024-09-11T00:58:55.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.103+0000 7f4477000640 1 -- 172.21.15.103:0/2220204833 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f4470063e60 con 0x7f447006b6e0 2024-09-11T00:58:55.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.111+0000 7f446e000640 1 -- 172.21.15.103:0/2220204833 <== mon.2 v2:172.21.15.117:3300/0 7 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44640cc8f0 con 0x7f447006b6e0 2024-09-11T00:58:55.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.111+0000 7f446e000640 1 -- 172.21.15.103:0/2220204833 <== mon.2 v2:172.21.15.117:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v24)=0 v24) ==== 123+0+0 (secure 0 0 0) 0x7f44640ccde0 con 0x7f447006b6e0 2024-09-11T00:58:55.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.113+0000 7f4477000640 1 -- 172.21.15.103:0/2220204833 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f44580b5370 msgr2=0x7f44580b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:55.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.113+0000 7f4477000640 1 --2- 172.21.15.103:0/2220204833 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f44580b5370 0x7f44580b7830 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f447006bb90 tx=0x7f445c005f90 comp rx=0 tx=0).stop 2024-09-11T00:58:55.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.113+0000 7f4477000640 1 -- 172.21.15.103:0/2220204833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447006b6e0 msgr2=0x7f447019f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:55.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.113+0000 7f4477000640 1 --2- 172.21.15.103:0/2220204833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447006b6e0 0x7f447019f100 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4464005ab0 tx=0x7f4464003b90 comp rx=0 tx=0).stop 2024-09-11T00:58:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.113+0000 7f4477000640 1 -- 172.21.15.103:0/2220204833 shutdown_connections 2024-09-11T00:58:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.113+0000 7f4477000640 1 --2- 172.21.15.103:0/2220204833 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f44580b5370 0x7f44580b7830 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.113+0000 7f4477000640 1 --2- 172.21.15.103:0/2220204833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f44701063a0 0x7f44701a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.113+0000 7f4477000640 1 --2- 172.21.15.103:0/2220204833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f44701037f0 0x7f447019f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.113+0000 7f4477000640 1 --2- 172.21.15.103:0/2220204833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f447006b6e0 0x7f447019f100 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.113+0000 7f4477000640 1 -- 172.21.15.103:0/2220204833 >> 172.21.15.103:0/2220204833 conn(0x7f44700fd040 msgr2=0x7f4470104610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.113+0000 7f4477000640 1 -- 172.21.15.103:0/2220204833 shutdown_connections 2024-09-11T00:58:55.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:55.113+0000 7f4477000640 1 -- 172.21.15.103:0/2220204833 wait complete. 2024-09-11T00:58:56.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:55 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1806503172' entity='client.admin' 2024-09-11T00:58:56.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:55 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:58:56.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:55 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:58:56.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:55 smithi117 ceph-mon[35358]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:56.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:55 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:58:56.124 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:56.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:55 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1806503172' entity='client.admin' 2024-09-11T00:58:56.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:55 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:58:56.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:55 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:58:56.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:55 smithi183 ceph-mon[34992]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:56.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:55 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:58:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.078+0000 7f54c8a00640 1 -- 172.21.15.103:0/2373683581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c4075ac0 msgr2=0x7f54c4075f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.078+0000 7f54c8a00640 1 --2- 172.21.15.103:0/2373683581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c4075ac0 0x7f54c4075f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009900 tx=0x7f54ac02a3f0 comp rx=0 tx=0).stop 2024-09-11T00:58:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.078+0000 7f54c8a00640 1 -- 172.21.15.103:0/2373683581 shutdown_connections 2024-09-11T00:58:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.078+0000 7f54c8a00640 1 --2- 172.21.15.103:0/2373683581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54c410a820 0x7f54c410cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.078+0000 7f54c8a00640 1 --2- 172.21.15.103:0/2373683581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c4075ac0 0x7f54c4075f40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.078+0000 7f54c8a00640 1 --2- 172.21.15.103:0/2373683581 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c4076f20 0x7f54c4075580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.078+0000 7f54c8a00640 1 -- 172.21.15.103:0/2373683581 >> 172.21.15.103:0/2373683581 conn(0x7f54c40fe180 msgr2=0x7f54c41005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.078+0000 7f54c8a00640 1 -- 172.21.15.103:0/2373683581 shutdown_connections 2024-09-11T00:58:57.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.078+0000 7f54c8a00640 1 -- 172.21.15.103:0/2373683581 wait complete. 2024-09-11T00:58:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.079+0000 7f54c8a00640 1 Processor -- start 2024-09-11T00:58:57.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.080+0000 7f54c8a00640 1 -- start start 2024-09-11T00:58:57.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.080+0000 7f54c8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c4075ac0 0x7f54c419add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:57.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.080+0000 7f54c8a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c4076f20 0x7f54c419b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:57.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.080+0000 7f54c8a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54c410a820 0x7f54c419c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:57.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.080+0000 7f54c8a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f54c4110780 con 0x7f54c4075ac0 2024-09-11T00:58:57.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.080+0000 7f54c8a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f54c4110600 con 0x7f54c410a820 2024-09-11T00:58:57.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.080+0000 7f54c8a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f54c4110900 con 0x7f54c4076f20 2024-09-11T00:58:57.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.080+0000 7f54c2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c4075ac0 0x7f54c419add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:57.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.080+0000 7f54c2800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c4075ac0 0x7f54c419add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43264/0 (socket says 172.21.15.103:43264) 2024-09-11T00:58:57.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.080+0000 7f54c2800640 1 -- 172.21.15.103:0/1024206503 learned_addr learned my addr 172.21.15.103:0/1024206503 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:57.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.080+0000 7f54c3200640 1 --2- 172.21.15.103:0/1024206503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54c410a820 0x7f54c419c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:57.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.080+0000 7f54c1e00640 1 --2- 172.21.15.103:0/1024206503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c4076f20 0x7f54c419b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.081+0000 7f54c2800640 1 -- 172.21.15.103:0/1024206503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c4076f20 msgr2=0x7f54c419b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.081+0000 7f54c2800640 1 --2- 172.21.15.103:0/1024206503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c4076f20 0x7f54c419b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.081+0000 7f54c2800640 1 -- 172.21.15.103:0/1024206503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54c410a820 msgr2=0x7f54c419c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.081+0000 7f54c2800640 1 --2- 172.21.15.103:0/1024206503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54c410a820 0x7f54c419c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.081+0000 7f54c2800640 1 -- 172.21.15.103:0/1024206503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c419c900 con 0x7f54c4075ac0 2024-09-11T00:58:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.081+0000 7f54c2800640 1 --2- 172.21.15.103:0/1024206503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c4075ac0 0x7f54c419add0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f54b400eb90 tx=0x7f54b400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.081+0000 7f54bb400640 1 -- 172.21.15.103:0/1024206503 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4004d20 con 0x7f54c4075ac0 2024-09-11T00:58:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.081+0000 7f54bb400640 1 -- 172.21.15.103:0/1024206503 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54b400ee90 con 0x7f54c4075ac0 2024-09-11T00:58:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.081+0000 7f54c8a00640 1 -- 172.21.15.103:0/1024206503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c419cbf0 con 0x7f54c4075ac0 2024-09-11T00:58:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.082+0000 7f54bb400640 1 -- 172.21.15.103:0/1024206503 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b40107f0 con 0x7f54c4075ac0 2024-09-11T00:58:57.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.082+0000 7f54c8a00640 1 -- 172.21.15.103:0/1024206503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c41a32d0 con 0x7f54c4075ac0 2024-09-11T00:58:57.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.083+0000 7f54c8a00640 1 -- 172.21.15.103:0/1024206503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54c41a34a0 con 0x7f54c4075ac0 2024-09-11T00:58:57.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.085+0000 7f54bb400640 1 -- 172.21.15.103:0/1024206503 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7f54b4005020 con 0x7f54c4075ac0 2024-09-11T00:58:57.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.087+0000 7f54bb400640 1 --2- 172.21.15.103:0/1024206503 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f54a80b53f0 0x7f54a80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:57.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.087+0000 7f54bb400640 1 -- 172.21.15.103:0/1024206503 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f54b40e4520 con 0x7f54c4075ac0 2024-09-11T00:58:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.087+0000 7f54c1e00640 1 --2- 172.21.15.103:0/1024206503 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f54a80b53f0 0x7f54a80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:57.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.088+0000 7f54c1e00640 1 --2- 172.21.15.103:0/1024206503 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f54a80b53f0 0x7f54a80b78b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f54ac031500 tx=0x7f54ac005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:57.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.091+0000 7f54bb400640 1 -- 172.21.15.103:0/1024206503 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f54b40ad010 con 0x7f54c4075ac0 2024-09-11T00:58:57.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.282+0000 7f54c8a00640 1 -- 172.21.15.103:0/1024206503 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f54c41a3b90 con 0x7f54c4075ac0 2024-09-11T00:58:57.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.286+0000 7f54bb400640 1 -- 172.21.15.103:0/1024206503 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v26)=0 v26) ==== 120+0+0 (secure 0 0 0) 0x7f54b40ac910 con 0x7f54c4075ac0 2024-09-11T00:58:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.289+0000 7f54c8a00640 1 -- 172.21.15.103:0/1024206503 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f54a80b53f0 msgr2=0x7f54a80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.289+0000 7f54c8a00640 1 --2- 172.21.15.103:0/1024206503 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f54a80b53f0 0x7f54a80b78b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f54ac031500 tx=0x7f54ac005a20 comp rx=0 tx=0).stop 2024-09-11T00:58:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.289+0000 7f54c8a00640 1 -- 172.21.15.103:0/1024206503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c4075ac0 msgr2=0x7f54c419add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.289+0000 7f54c8a00640 1 --2- 172.21.15.103:0/1024206503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c4075ac0 0x7f54c419add0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f54b400eb90 tx=0x7f54b400c6a0 comp rx=0 tx=0).stop 2024-09-11T00:58:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.289+0000 7f54c8a00640 1 -- 172.21.15.103:0/1024206503 shutdown_connections 2024-09-11T00:58:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.289+0000 7f54c8a00640 1 --2- 172.21.15.103:0/1024206503 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f54a80b53f0 0x7f54a80b78b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.289+0000 7f54c8a00640 1 --2- 172.21.15.103:0/1024206503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54c410a820 0x7f54c419c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.289+0000 7f54c8a00640 1 --2- 172.21.15.103:0/1024206503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54c4076f20 0x7f54c419b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.289+0000 7f54c8a00640 1 --2- 172.21.15.103:0/1024206503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54c4075ac0 0x7f54c419add0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:57.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.289+0000 7f54c8a00640 1 -- 172.21.15.103:0/1024206503 >> 172.21.15.103:0/1024206503 conn(0x7f54c40fe180 msgr2=0x7f54c40fe6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:57.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.289+0000 7f54c8a00640 1 -- 172.21.15.103:0/1024206503 shutdown_connections 2024-09-11T00:58:57.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:57.289+0000 7f54c8a00640 1 -- 172.21.15.103:0/1024206503 wait complete. 2024-09-11T00:58:57.403 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:58:58.574 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:58 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1024206503' entity='client.admin' 2024-09-11T00:58:58.574 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:58:58 smithi103 ceph-mon[30562]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:58.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:58 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1024206503' entity='client.admin' 2024-09-11T00:58:58.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:58:58 smithi117 ceph-mon[35358]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:58.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:58 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1024206503' entity='client.admin' 2024-09-11T00:58:58.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:58:58 smithi183 ceph-mon[34992]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:58:59.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.139+0000 7fb70be00640 1 -- 172.21.15.103:0/2672414195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c102890 msgr2=0x7fb70c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:59.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.139+0000 7fb70be00640 1 --2- 172.21.15.103:0/2672414195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c102890 0x7fb70c102c90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009930 tx=0x7fb6fc02a420 comp rx=0 tx=0).stop 2024-09-11T00:58:59.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.139+0000 7fb70be00640 1 -- 172.21.15.103:0/2672414195 shutdown_connections 2024-09-11T00:58:59.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.139+0000 7fb70be00640 1 --2- 172.21.15.103:0/2672414195 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c1043b0 0x7fb70c10ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.139+0000 7fb70be00640 1 --2- 172.21.15.103:0/2672414195 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb70c1039f0 0x7fb70c103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.139+0000 7fb70be00640 1 --2- 172.21.15.103:0/2672414195 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c102890 0x7fb70c102c90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.139+0000 7fb70be00640 1 -- 172.21.15.103:0/2672414195 >> 172.21.15.103:0/2672414195 conn(0x7fb70c0fe180 msgr2=0x7fb70c1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.139+0000 7fb70be00640 1 -- 172.21.15.103:0/2672414195 shutdown_connections 2024-09-11T00:58:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.139+0000 7fb70be00640 1 -- 172.21.15.103:0/2672414195 wait complete. 2024-09-11T00:58:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.140+0000 7fb70be00640 1 Processor -- start 2024-09-11T00:58:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.140+0000 7fb70be00640 1 -- start start 2024-09-11T00:58:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.140+0000 7fb70be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c102890 0x7fb70c076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.140+0000 7fb70be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c1039f0 0x7fb70c075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.140+0000 7fb70be00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb70c1043b0 0x7fb70c075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.140+0000 7fb70be00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c10e510 con 0x7fb70c1039f0 2024-09-11T00:58:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.140+0000 7fb70be00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c10e390 con 0x7fb70c102890 2024-09-11T00:58:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.140+0000 7fb70be00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c10e690 con 0x7fb70c1043b0 2024-09-11T00:58:59.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.140+0000 7fb70a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c1039f0 0x7fb70c075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.141+0000 7fb70a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c1039f0 0x7fb70c075540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43296/0 (socket says 172.21.15.103:43296) 2024-09-11T00:58:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.141+0000 7fb70a000640 1 -- 172.21.15.103:0/1255718280 learned_addr learned my addr 172.21.15.103:0/1255718280 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.141+0000 7fb70aa00640 1 --2- 172.21.15.103:0/1255718280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c102890 0x7fb70c076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.141+0000 7fb70b400640 1 --2- 172.21.15.103:0/1255718280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb70c1043b0 0x7fb70c075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.141+0000 7fb70a000640 1 -- 172.21.15.103:0/1255718280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb70c1043b0 msgr2=0x7fb70c075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.141+0000 7fb70a000640 1 --2- 172.21.15.103:0/1255718280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb70c1043b0 0x7fb70c075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.141+0000 7fb70a000640 1 -- 172.21.15.103:0/1255718280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c102890 msgr2=0x7fb70c076cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.141+0000 7fb70a000640 1 --2- 172.21.15.103:0/1255718280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c102890 0x7fb70c076cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.141+0000 7fb70a000640 1 -- 172.21.15.103:0/1255718280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c076340 con 0x7fb70c1039f0 2024-09-11T00:58:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.141+0000 7fb70a000640 1 --2- 172.21.15.103:0/1255718280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c1039f0 0x7fb70c075540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800e9f0 tx=0x7fb6f800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.141+0000 7fb710a00640 1 -- 172.21.15.103:0/1255718280 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f800cd80 con 0x7fb70c1039f0 2024-09-11T00:58:59.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.141+0000 7fb710a00640 1 -- 172.21.15.103:0/1255718280 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb6f80054d0 con 0x7fb70c1039f0 2024-09-11T00:58:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.141+0000 7fb710a00640 1 -- 172.21.15.103:0/1255718280 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8010690 con 0x7fb70c1039f0 2024-09-11T00:58:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.141+0000 7fb70be00640 1 -- 172.21.15.103:0/1255718280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70c1a2cb0 con 0x7fb70c1039f0 2024-09-11T00:58:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.142+0000 7fb70be00640 1 -- 172.21.15.103:0/1255718280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70c1a31c0 con 0x7fb70c1039f0 2024-09-11T00:58:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.143+0000 7fb70be00640 1 -- 172.21.15.103:0/1255718280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70c109bb0 con 0x7fb70c1039f0 2024-09-11T00:58:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.145+0000 7fb710a00640 1 -- 172.21.15.103:0/1255718280 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7fb6f8004e90 con 0x7fb70c1039f0 2024-09-11T00:58:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.147+0000 7fb710a00640 1 --2- 172.21.15.103:0/1255718280 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb6f00b5370 0x7fb6f00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.147+0000 7fb710a00640 1 -- 172.21.15.103:0/1255718280 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb6f80e43a0 con 0x7fb70c1039f0 2024-09-11T00:58:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.147+0000 7fb70aa00640 1 --2- 172.21.15.103:0/1255718280 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb6f00b5370 0x7fb6f00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.148+0000 7fb70aa00640 1 --2- 172.21.15.103:0/1255718280 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb6f00b5370 0x7fb6f00b7830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009900 tx=0x7fb6fc031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.150+0000 7fb710a00640 1 -- 172.21.15.103:0/1255718280 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb6f80ace90 con 0x7fb70c1039f0 2024-09-11T00:58:59.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.354+0000 7fb70be00640 1 -- 172.21.15.103:0/1255718280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fb70c063dc0 con 0x7fb70c1039f0 2024-09-11T00:58:59.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.358+0000 7fb710a00640 1 -- 172.21.15.103:0/1255718280 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v27)=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7fb6f80ac790 con 0x7fb70c1039f0 2024-09-11T00:58:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.361+0000 7fb70be00640 1 -- 172.21.15.103:0/1255718280 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb6f00b5370 msgr2=0x7fb6f00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.361+0000 7fb70be00640 1 --2- 172.21.15.103:0/1255718280 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb6f00b5370 0x7fb6f00b7830 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009900 tx=0x7fb6fc031430 comp rx=0 tx=0).stop 2024-09-11T00:58:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.361+0000 7fb70be00640 1 -- 172.21.15.103:0/1255718280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c1039f0 msgr2=0x7fb70c075540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.361+0000 7fb70be00640 1 --2- 172.21.15.103:0/1255718280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c1039f0 0x7fb70c075540 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800e9f0 tx=0x7fb6f800edf0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.361+0000 7fb70be00640 1 -- 172.21.15.103:0/1255718280 shutdown_connections 2024-09-11T00:58:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.361+0000 7fb70be00640 1 --2- 172.21.15.103:0/1255718280 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb6f00b5370 0x7fb6f00b7830 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.361+0000 7fb70be00640 1 --2- 172.21.15.103:0/1255718280 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb70c1043b0 0x7fb70c075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.361+0000 7fb70be00640 1 --2- 172.21.15.103:0/1255718280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb70c1039f0 0x7fb70c075540 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.361+0000 7fb70be00640 1 --2- 172.21.15.103:0/1255718280 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb70c102890 0x7fb70c076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.361+0000 7fb70be00640 1 -- 172.21.15.103:0/1255718280 >> 172.21.15.103:0/1255718280 conn(0x7fb70c0fe180 msgr2=0x7fb70c106d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.361+0000 7fb70be00640 1 -- 172.21.15.103:0/1255718280 shutdown_connections 2024-09-11T00:58:59.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.361+0000 7fb70be00640 1 -- 172.21.15.103:0/1255718280 wait complete. 2024-09-11T00:58:59.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.278+0000 7f4e86600640 1 -- 172.21.15.103:0/1617780645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e801039f0 msgr2=0x7f4e80103e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:59.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.278+0000 7f4e86600640 1 --2- 172.21.15.103:0/1617780645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e801039f0 0x7f4e80103e70 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009930 tx=0x7f4e6c02a420 comp rx=0 tx=0).stop 2024-09-11T00:58:59.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.278+0000 7f4e86600640 1 -- 172.21.15.103:0/1617780645 shutdown_connections 2024-09-11T00:58:59.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.278+0000 7f4e86600640 1 --2- 172.21.15.103:0/1617780645 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e801043b0 0x7f4e8010ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.278+0000 7f4e86600640 1 --2- 172.21.15.103:0/1617780645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e801039f0 0x7f4e80103e70 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.278+0000 7f4e86600640 1 --2- 172.21.15.103:0/1617780645 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e80102890 0x7f4e80102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.278+0000 7f4e86600640 1 -- 172.21.15.103:0/1617780645 >> 172.21.15.103:0/1617780645 conn(0x7f4e800fe180 msgr2=0x7f4e801005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:59.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.279+0000 7f4e86600640 1 -- 172.21.15.103:0/1617780645 shutdown_connections 2024-09-11T00:58:59.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.279+0000 7f4e86600640 1 -- 172.21.15.103:0/1617780645 wait complete. 2024-09-11T00:58:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.280+0000 7f4e86600640 1 Processor -- start 2024-09-11T00:58:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.280+0000 7f4e86600640 1 -- start start 2024-09-11T00:58:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e86600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80102890 0x7f4e80198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e86600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e801039f0 0x7f4e80199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e86600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e801043b0 0x7f4e80199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e86600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8010e510 con 0x7f4e80102890 2024-09-11T00:58:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e86600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8010e390 con 0x7f4e801039f0 2024-09-11T00:58:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e86600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4e8010e690 con 0x7f4e801043b0 2024-09-11T00:58:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e85200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80102890 0x7f4e80198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e85200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80102890 0x7f4e80198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43310/0 (socket says 172.21.15.103:43310) 2024-09-11T00:58:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e85200640 1 -- 172.21.15.103:0/417589212 learned_addr learned my addr 172.21.15.103:0/417589212 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:58:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e7fe00640 1 --2- 172.21.15.103:0/417589212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e801039f0 0x7f4e80199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:59.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e85c00640 1 --2- 172.21.15.103:0/417589212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e801043b0 0x7f4e80199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e85200640 1 -- 172.21.15.103:0/417589212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e801043b0 msgr2=0x7f4e80199e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e85200640 1 --2- 172.21.15.103:0/417589212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e801043b0 0x7f4e80199e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e85200640 1 -- 172.21.15.103:0/417589212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e801039f0 msgr2=0x7f4e80199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e85200640 1 --2- 172.21.15.103:0/417589212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e801039f0 0x7f4e80199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.281+0000 7f4e85200640 1 -- 172.21.15.103:0/417589212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e8019a6e0 con 0x7f4e80102890 2024-09-11T00:58:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.282+0000 7f4e85200640 1 --2- 172.21.15.103:0/417589212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80102890 0x7f4e80198bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400e9f0 tx=0x7f4e7400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.282+0000 7f4e7d600640 1 -- 172.21.15.103:0/417589212 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e7400cd80 con 0x7f4e80102890 2024-09-11T00:58:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.282+0000 7f4e7d600640 1 -- 172.21.15.103:0/417589212 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e740108e0 con 0x7f4e80102890 2024-09-11T00:58:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.282+0000 7f4e86600640 1 -- 172.21.15.103:0/417589212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e8019a9d0 con 0x7f4e80102890 2024-09-11T00:58:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.282+0000 7f4e7d600640 1 -- 172.21.15.103:0/417589212 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e74018980 con 0x7f4e80102890 2024-09-11T00:58:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.282+0000 7f4e86600640 1 -- 172.21.15.103:0/417589212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e801a10b0 con 0x7f4e80102890 2024-09-11T00:58:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.284+0000 7f4e86600640 1 -- 172.21.15.103:0/417589212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e80102c90 con 0x7f4e80102890 2024-09-11T00:58:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.287+0000 7f4e7d600640 1 -- 172.21.15.103:0/417589212 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7f4e74010430 con 0x7f4e80102890 2024-09-11T00:58:59.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.289+0000 7f4e7d600640 1 --2- 172.21.15.103:0/417589212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4e680b52f0 0x7f4e680b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:58:59.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.289+0000 7f4e7d600640 1 -- 172.21.15.103:0/417589212 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4e740e42b0 con 0x7f4e80102890 2024-09-11T00:58:59.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.289+0000 7f4e7fe00640 1 --2- 172.21.15.103:0/417589212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4e680b52f0 0x7f4e680b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:58:59.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.290+0000 7f4e7fe00640 1 --2- 172.21.15.103:0/417589212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4e680b52f0 0x7f4e680b77b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009900 tx=0x7f4e6c031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:58:59.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.296+0000 7f4e7d600640 1 -- 172.21.15.103:0/417589212 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4e740ac750 con 0x7f4e80102890 2024-09-11T00:58:59.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.497+0000 7f4e86600640 1 -- 172.21.15.103:0/417589212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f4e80109b40 con 0x7f4e80102890 2024-09-11T00:58:59.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.501+0000 7f4e7d600640 1 -- 172.21.15.103:0/417589212 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v28)=0 v28) ==== 108+0+0 (secure 0 0 0) 0x7f4e740b1180 con 0x7f4e80102890 2024-09-11T00:58:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.503+0000 7f4e86600640 1 -- 172.21.15.103:0/417589212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4e680b52f0 msgr2=0x7f4e680b77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.503+0000 7f4e86600640 1 --2- 172.21.15.103:0/417589212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4e680b52f0 0x7f4e680b77b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009900 tx=0x7f4e6c031430 comp rx=0 tx=0).stop 2024-09-11T00:58:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.503+0000 7f4e86600640 1 -- 172.21.15.103:0/417589212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80102890 msgr2=0x7f4e80198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:58:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.503+0000 7f4e86600640 1 --2- 172.21.15.103:0/417589212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80102890 0x7f4e80198bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4e7400e9f0 tx=0x7f4e7400eeb0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.503+0000 7f4e86600640 1 -- 172.21.15.103:0/417589212 shutdown_connections 2024-09-11T00:58:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.503+0000 7f4e86600640 1 --2- 172.21.15.103:0/417589212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4e680b52f0 0x7f4e680b77b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.503+0000 7f4e86600640 1 --2- 172.21.15.103:0/417589212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4e801043b0 0x7f4e80199e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.503+0000 7f4e86600640 1 --2- 172.21.15.103:0/417589212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4e801039f0 0x7f4e80199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.503+0000 7f4e86600640 1 --2- 172.21.15.103:0/417589212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4e80102890 0x7f4e80198bb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:58:59.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.503+0000 7f4e86600640 1 -- 172.21.15.103:0/417589212 >> 172.21.15.103:0/417589212 conn(0x7f4e800fe180 msgr2=0x7f4e80106d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:58:59.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.503+0000 7f4e86600640 1 -- 172.21.15.103:0/417589212 shutdown_connections 2024-09-11T00:58:59.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:58:59.504+0000 7f4e86600640 1 -- 172.21.15.103:0/417589212 wait complete. 2024-09-11T00:59:00.326 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:59:00.327 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:59:00.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:00 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1255718280' entity='client.admin' 2024-09-11T00:59:00.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:00 smithi103 ceph-mon[30562]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:00.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:00 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/417589212' entity='client.admin' 2024-09-11T00:59:00.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:00 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1255718280' entity='client.admin' 2024-09-11T00:59:00.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:00 smithi117 ceph-mon[35358]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:00.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:00 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/417589212' entity='client.admin' 2024-09-11T00:59:00.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:00 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1255718280' entity='client.admin' 2024-09-11T00:59:00.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:00 smithi183 ceph-mon[34992]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:00.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:00 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/417589212' entity='client.admin' 2024-09-11T00:59:01.861 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:59:01.892 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi103') 2024-09-11T00:59:01.893 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi103') 2024-09-11T00:59:01.893 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi103') 2024-09-11T00:59:01.893 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi103') 2024-09-11T00:59:01.893 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi103') 2024-09-11T00:59:01.893 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi103') 2024-09-11T00:59:01.893 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi103') 2024-09-11T00:59:01.893 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi103') 2024-09-11T00:59:01.893 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi103') 2024-09-11T00:59:02.650 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:02 smithi103 ceph-mon[30562]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:02.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.683+0000 7fc190c00640 1 -- 172.21.15.103:0/4238644588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c10a820 msgr2=0x7fc18c10cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:02.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.683+0000 7fc190c00640 1 --2- 172.21.15.103:0/4238644588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c10a820 0x7fc18c10cc70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fc184009be0 tx=0x7fc18402a6f0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.683+0000 7fc190c00640 1 -- 172.21.15.103:0/4238644588 shutdown_connections 2024-09-11T00:59:02.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.683+0000 7fc190c00640 1 --2- 172.21.15.103:0/4238644588 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c10a820 0x7fc18c10cc70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.683+0000 7fc190c00640 1 --2- 172.21.15.103:0/4238644588 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc18c075ac0 0x7fc18c075f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.683+0000 7fc190c00640 1 --2- 172.21.15.103:0/4238644588 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc18c076f20 0x7fc18c075580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.683+0000 7fc190c00640 1 -- 172.21.15.103:0/4238644588 >> 172.21.15.103:0/4238644588 conn(0x7fc18c0fe180 msgr2=0x7fc18c1005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:59:02.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.683+0000 7fc190c00640 1 -- 172.21.15.103:0/4238644588 shutdown_connections 2024-09-11T00:59:02.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.683+0000 7fc190c00640 1 -- 172.21.15.103:0/4238644588 wait complete. 2024-09-11T00:59:02.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.685+0000 7fc190c00640 1 Processor -- start 2024-09-11T00:59:02.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.685+0000 7fc190c00640 1 -- start start 2024-09-11T00:59:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.685+0000 7fc190c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c075ac0 0x7fc18c19ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.685+0000 7fc190c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc18c076f20 0x7fc18c19b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.685+0000 7fc190c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc18c10a820 0x7fc18c19c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.685+0000 7fc190c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c110780 con 0x7fc18c076f20 2024-09-11T00:59:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.685+0000 7fc190c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c110600 con 0x7fc18c075ac0 2024-09-11T00:59:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.685+0000 7fc190c00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c110900 con 0x7fc18c10a820 2024-09-11T00:59:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.686+0000 7fc18b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c075ac0 0x7fc18c19ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.686+0000 7fc18aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc18c076f20 0x7fc18c19b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.686+0000 7fc18b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c075ac0 0x7fc18c19ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:43170/0 (socket says 172.21.15.103:43170) 2024-09-11T00:59:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.686+0000 7fc18b400640 1 -- 172.21.15.103:0/124042364 learned_addr learned my addr 172.21.15.103:0/124042364 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:59:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.686+0000 7fc18be00640 1 --2- 172.21.15.103:0/124042364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc18c10a820 0x7fc18c19c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.686+0000 7fc18b400640 1 -- 172.21.15.103:0/124042364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc18c10a820 msgr2=0x7fc18c19c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.686+0000 7fc18b400640 1 --2- 172.21.15.103:0/124042364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc18c10a820 0x7fc18c19c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.686+0000 7fc18b400640 1 -- 172.21.15.103:0/124042364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc18c076f20 msgr2=0x7fc18c19b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.686+0000 7fc18b400640 1 --2- 172.21.15.103:0/124042364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc18c076f20 0x7fc18c19b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.686+0000 7fc18b400640 1 -- 172.21.15.103:0/124042364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c19c8c0 con 0x7fc18c075ac0 2024-09-11T00:59:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.686+0000 7fc18b400640 1 --2- 172.21.15.103:0/124042364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c075ac0 0x7fc18c19ad90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00e9c0 tx=0x7fc17c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:59:02.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.687+0000 7fc183e00640 1 -- 172.21.15.103:0/124042364 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c00cde0 con 0x7fc18c075ac0 2024-09-11T00:59:02.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.687+0000 7fc183e00640 1 -- 172.21.15.103:0/124042364 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc17c0035f0 con 0x7fc18c075ac0 2024-09-11T00:59:02.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.687+0000 7fc183e00640 1 -- 172.21.15.103:0/124042364 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c010690 con 0x7fc18c075ac0 2024-09-11T00:59:02.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.687+0000 7fc190c00640 1 -- 172.21.15.103:0/124042364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc18c19cbb0 con 0x7fc18c075ac0 2024-09-11T00:59:02.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.687+0000 7fc190c00640 1 -- 172.21.15.103:0/124042364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc18c1a3290 con 0x7fc18c075ac0 2024-09-11T00:59:02.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.688+0000 7fc190c00640 1 -- 172.21.15.103:0/124042364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc18c109630 con 0x7fc18c075ac0 2024-09-11T00:59:02.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.690+0000 7fc183e00640 1 -- 172.21.15.103:0/124042364 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7fc17c004000 con 0x7fc18c075ac0 2024-09-11T00:59:02.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.691+0000 7fc183e00640 1 --2- 172.21.15.103:0/124042364 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc1700b5370 0x7fc1700b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:02.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.691+0000 7fc183e00640 1 -- 172.21.15.103:0/124042364 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc17c0e4280 con 0x7fc18c075ac0 2024-09-11T00:59:02.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.691+0000 7fc18aa00640 1 --2- 172.21.15.103:0/124042364 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc1700b5370 0x7fc1700b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:02.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.692+0000 7fc18aa00640 1 --2- 172.21.15.103:0/124042364 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc1700b5370 0x7fc1700b7830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc178006fd0 tx=0x7fc178008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:59:02.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.695+0000 7fc183e00640 1 -- 172.21.15.103:0/124042364 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc17c009510 con 0x7fc18c075ac0 2024-09-11T00:59:02.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.560+0000 7fa09a400640 1 -- 172.21.15.103:0/2224565766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa094104c40 msgr2=0x7fa094105040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:02.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.560+0000 7fa09a400640 1 --2- 172.21.15.103:0/2224565766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa094104c40 0x7fa094105040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa084009cd0 tx=0x7fa08402a8f0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.560+0000 7fa09a400640 1 -- 172.21.15.103:0/2224565766 shutdown_connections 2024-09-11T00:59:02.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.560+0000 7fa09a400640 1 --2- 172.21.15.103:0/2224565766 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa094106760 0x7fa09410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.560+0000 7fa09a400640 1 --2- 172.21.15.103:0/2224565766 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa094105da0 0x7fa094106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.560+0000 7fa09a400640 1 --2- 172.21.15.103:0/2224565766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa094104c40 0x7fa094105040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.560+0000 7fa09a400640 1 -- 172.21.15.103:0/2224565766 >> 172.21.15.103:0/2224565766 conn(0x7fa094100510 msgr2=0x7fa094102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:59:02.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.560+0000 7fa09a400640 1 -- 172.21.15.103:0/2224565766 shutdown_connections 2024-09-11T00:59:02.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.560+0000 7fa09a400640 1 -- 172.21.15.103:0/2224565766 wait complete. 2024-09-11T00:59:02.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.561+0000 7fa09a400640 1 Processor -- start 2024-09-11T00:59:02.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.562+0000 7fa09a400640 1 -- start start 2024-09-11T00:59:02.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.562+0000 7fa09a400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa094104c40 0x7fa09419b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:02.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.562+0000 7fa09a400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa094105da0 0x7fa09419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:02.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.562+0000 7fa09a400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa094106760 0x7fa09419c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:02.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.562+0000 7fa09a400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa0941108a0 con 0x7fa094105da0 2024-09-11T00:59:02.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.562+0000 7fa09a400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa094110720 con 0x7fa094106760 2024-09-11T00:59:02.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.562+0000 7fa09a400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa094110a20 con 0x7fa094104c40 2024-09-11T00:59:02.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.562+0000 7fa092a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa094105da0 0x7fa09419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:02.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.562+0000 7fa092a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa094105da0 0x7fa09419b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45720/0 (socket says 172.21.15.103:45720) 2024-09-11T00:59:02.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.562+0000 7fa092a00640 1 -- 172.21.15.103:0/2304751696 learned_addr learned my addr 172.21.15.103:0/2304751696 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:59:02.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.562+0000 7fa093e00640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa094106760 0x7fa09419c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:02.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.562+0000 7fa093400640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa094104c40 0x7fa09419b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:02.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.563+0000 7fa092a00640 1 -- 172.21.15.103:0/2304751696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa094104c40 msgr2=0x7fa09419b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:02.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.563+0000 7fa092a00640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa094104c40 0x7fa09419b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.563+0000 7fa092a00640 1 -- 172.21.15.103:0/2304751696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa094106760 msgr2=0x7fa09419c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:02.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.563+0000 7fa092a00640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa094106760 0x7fa09419c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.563+0000 7fa092a00640 1 -- 172.21.15.103:0/2304751696 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09419cb60 con 0x7fa094105da0 2024-09-11T00:59:02.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.563+0000 7fa093e00640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa094106760 0x7fa09419c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:59:02.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.563+0000 7fa092a00640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa094105da0 0x7fa09419b6f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa08000d950 tx=0x7fa08000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:59:02.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.563+0000 7fa08be00640 1 -- 172.21.15.103:0/2304751696 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa080017070 con 0x7fa094105da0 2024-09-11T00:59:02.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.563+0000 7fa08be00640 1 -- 172.21.15.103:0/2304751696 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa080009c30 con 0x7fa094105da0 2024-09-11T00:59:02.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.563+0000 7fa08be00640 1 -- 172.21.15.103:0/2304751696 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa08000f620 con 0x7fa094105da0 2024-09-11T00:59:02.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.563+0000 7fa09a400640 1 -- 172.21.15.103:0/2304751696 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09419ce50 con 0x7fa094105da0 2024-09-11T00:59:02.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.564+0000 7fa09a400640 1 -- 172.21.15.103:0/2304751696 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0941a3530 con 0x7fa094105da0 2024-09-11T00:59:02.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.565+0000 7fa09a400640 1 -- 172.21.15.103:0/2304751696 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09410c040 con 0x7fa094105da0 2024-09-11T00:59:02.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.568+0000 7fa08be00640 1 -- 172.21.15.103:0/2304751696 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7fa080010460 con 0x7fa094105da0 2024-09-11T00:59:02.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.570+0000 7fa08be00640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0780b52d0 0x7fa0780b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:02.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.570+0000 7fa08be00640 1 -- 172.21.15.103:0/2304751696 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa0800e3a50 con 0x7fa094105da0 2024-09-11T00:59:02.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.570+0000 7fa093400640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0780b52d0 0x7fa0780b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:02.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.571+0000 7fa093400640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0780b52d0 0x7fa0780b7790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa084006010 tx=0x7fa084031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:59:02.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.574+0000 7fa08be00640 1 -- 172.21.15.103:0/2304751696 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa080009de0 con 0x7fa094105da0 2024-09-11T00:59:02.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.775+0000 7fa09a400640 1 -- 172.21.15.103:0/2304751696 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fa094063d50 con 0x7fa094105da0 2024-09-11T00:59:02.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.779+0000 7fa08be00640 1 -- 172.21.15.103:0/2304751696 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v29)=0 v29) ==== 116+0+0 (secure 0 0 0) 0x7fa0800abf70 con 0x7fa094105da0 2024-09-11T00:59:02.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.782+0000 7fa09a400640 1 -- 172.21.15.103:0/2304751696 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0780b52d0 msgr2=0x7fa0780b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:02.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.782+0000 7fa09a400640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0780b52d0 0x7fa0780b7790 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa084006010 tx=0x7fa084031000 comp rx=0 tx=0).stop 2024-09-11T00:59:02.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.782+0000 7fa09a400640 1 -- 172.21.15.103:0/2304751696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa094105da0 msgr2=0x7fa09419b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:02.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.782+0000 7fa09a400640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa094105da0 0x7fa09419b6f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa08000d950 tx=0x7fa08000de10 comp rx=0 tx=0).stop 2024-09-11T00:59:02.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.782+0000 7fa09a400640 1 -- 172.21.15.103:0/2304751696 shutdown_connections 2024-09-11T00:59:02.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.782+0000 7fa09a400640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0780b52d0 0x7fa0780b7790 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.782+0000 7fa09a400640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa094106760 0x7fa09419c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.782+0000 7fa09a400640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa094105da0 0x7fa09419b6f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.782+0000 7fa09a400640 1 --2- 172.21.15.103:0/2304751696 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa094104c40 0x7fa09419b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.782+0000 7fa09a400640 1 -- 172.21.15.103:0/2304751696 >> 172.21.15.103:0/2304751696 conn(0x7fa094100510 msgr2=0x7fa094109210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:59:02.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.782+0000 7fa09a400640 1 -- 172.21.15.103:0/2304751696 shutdown_connections 2024-09-11T00:59:02.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.782+0000 7fa09a400640 1 -- 172.21.15.103:0/2304751696 wait complete. 2024-09-11T00:59:02.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:02 smithi117 ceph-mon[35358]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:02.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.890+0000 7fc190c00640 1 -- 172.21.15.103:0/124042364 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7fc18c063d50 con 0x7fc18c075ac0 2024-09-11T00:59:02.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.895+0000 7fc183e00640 1 -- 172.21.15.103:0/124042364 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v30)=0 v30) ==== 125+0+0 (secure 0 0 0) 0x7fc17c0acd70 con 0x7fc18c075ac0 2024-09-11T00:59:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.898+0000 7fc190c00640 1 -- 172.21.15.103:0/124042364 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc1700b5370 msgr2=0x7fc1700b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.898+0000 7fc190c00640 1 --2- 172.21.15.103:0/124042364 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc1700b5370 0x7fc1700b7830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc178006fd0 tx=0x7fc178008040 comp rx=0 tx=0).stop 2024-09-11T00:59:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.898+0000 7fc190c00640 1 -- 172.21.15.103:0/124042364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c075ac0 msgr2=0x7fc18c19ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.898+0000 7fc190c00640 1 --2- 172.21.15.103:0/124042364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c075ac0 0x7fc18c19ad90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc17c00e9c0 tx=0x7fc17c00ee80 comp rx=0 tx=0).stop 2024-09-11T00:59:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.898+0000 7fc190c00640 1 -- 172.21.15.103:0/124042364 shutdown_connections 2024-09-11T00:59:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.898+0000 7fc190c00640 1 --2- 172.21.15.103:0/124042364 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc1700b5370 0x7fc1700b7830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.898+0000 7fc190c00640 1 --2- 172.21.15.103:0/124042364 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc18c10a820 0x7fc18c19c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.898+0000 7fc190c00640 1 --2- 172.21.15.103:0/124042364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc18c076f20 0x7fc18c19b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.898+0000 7fc190c00640 1 --2- 172.21.15.103:0/124042364 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc18c075ac0 0x7fc18c19ad90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.898+0000 7fc190c00640 1 -- 172.21.15.103:0/124042364 >> 172.21.15.103:0/124042364 conn(0x7fc18c0fe180 msgr2=0x7fc18c106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:59:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.898+0000 7fc190c00640 1 -- 172.21.15.103:0/124042364 shutdown_connections 2024-09-11T00:59:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:02.898+0000 7fc190c00640 1 -- 172.21.15.103:0/124042364 wait complete. 2024-09-11T00:59:02.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:02 smithi183 ceph-mon[34992]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:03.549 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi103') 2024-09-11T00:59:03.549 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi103') 2024-09-11T00:59:03.549 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi103') 2024-09-11T00:59:03.549 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi103') 2024-09-11T00:59:03.550 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi103') 2024-09-11T00:59:03.550 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi103') 2024-09-11T00:59:03.550 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi103') 2024-09-11T00:59:03.550 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi103') 2024-09-11T00:59:04.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:03 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2304751696' entity='client.admin' 2024-09-11T00:59:04.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:03 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' 2024-09-11T00:59:04.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:03 smithi103 ceph-mon[30562]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:04.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:03 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2304751696' entity='client.admin' 2024-09-11T00:59:04.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:03 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' 2024-09-11T00:59:04.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:03 smithi117 ceph-mon[35358]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:04.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:03 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2304751696' entity='client.admin' 2024-09-11T00:59:04.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:03 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' 2024-09-11T00:59:04.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:03 smithi183 ceph-mon[34992]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:04.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.662+0000 7f582ac00640 1 -- 172.21.15.103:0/3379386306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5824105c00 msgr2=0x7f5824106080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:04.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.662+0000 7f582ac00640 1 --2- 172.21.15.103:0/3379386306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5824105c00 0x7f5824106080 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5810009930 tx=0x7f581002a440 comp rx=0 tx=0).stop 2024-09-11T00:59:04.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.662+0000 7f582ac00640 1 -- 172.21.15.103:0/3379386306 shutdown_connections 2024-09-11T00:59:04.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.662+0000 7f582ac00640 1 --2- 172.21.15.103:0/3379386306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58241065c0 0x7f582410cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:04.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.662+0000 7f582ac00640 1 --2- 172.21.15.103:0/3379386306 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5824105c00 0x7f5824106080 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:04.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.662+0000 7f582ac00640 1 --2- 172.21.15.103:0/3379386306 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5824104aa0 0x7f5824104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:04.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.662+0000 7f582ac00640 1 -- 172.21.15.103:0/3379386306 >> 172.21.15.103:0/3379386306 conn(0x7f5824100370 msgr2=0x7f58241027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:59:04.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.662+0000 7f582ac00640 1 -- 172.21.15.103:0/3379386306 shutdown_connections 2024-09-11T00:59:04.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.662+0000 7f582ac00640 1 -- 172.21.15.103:0/3379386306 wait complete. 2024-09-11T00:59:04.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.663+0000 7f582ac00640 1 Processor -- start 2024-09-11T00:59:04.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.663+0000 7f582ac00640 1 -- start start 2024-09-11T00:59:04.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.663+0000 7f582ac00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5824104aa0 0x7f582419ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:04.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.663+0000 7f582ac00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5824105c00 0x7f582419b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:04.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.663+0000 7f582ac00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58241065c0 0x7f582419c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:04.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.663+0000 7f582ac00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f58241107f0 con 0x7f5824104aa0 2024-09-11T00:59:04.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.663+0000 7f582ac00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5824110670 con 0x7f58241065c0 2024-09-11T00:59:04.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.663+0000 7f582ac00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5824110970 con 0x7f5824105c00 2024-09-11T00:59:04.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.664+0000 7f5829800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5824104aa0 0x7f582419ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:04.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.664+0000 7f5829800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5824104aa0 0x7f582419ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45768/0 (socket says 172.21.15.103:45768) 2024-09-11T00:59:04.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.664+0000 7f5829800640 1 -- 172.21.15.103:0/499361508 learned_addr learned my addr 172.21.15.103:0/499361508 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:59:04.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.664+0000 7f582a200640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58241065c0 0x7f582419c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:04.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.664+0000 7f5828e00640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5824105c00 0x7f582419b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:04.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.664+0000 7f5829800640 1 -- 172.21.15.103:0/499361508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5824105c00 msgr2=0x7f582419b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:04.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.664+0000 7f5829800640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5824105c00 0x7f582419b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:04.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.664+0000 7f5829800640 1 -- 172.21.15.103:0/499361508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58241065c0 msgr2=0x7f582419c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:04.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.664+0000 7f5829800640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58241065c0 0x7f582419c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:04.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.664+0000 7f5829800640 1 -- 172.21.15.103:0/499361508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582419c950 con 0x7f5824104aa0 2024-09-11T00:59:04.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.664+0000 7f5828e00640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5824105c00 0x7f582419b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T00:59:04.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.665+0000 7f5829800640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5824104aa0 0x7f582419ae20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f581800b450 tx=0x7f581800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:59:04.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.665+0000 7f5822000640 1 -- 172.21.15.103:0/499361508 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5818015020 con 0x7f5824104aa0 2024-09-11T00:59:04.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.665+0000 7f5822000640 1 -- 172.21.15.103:0/499361508 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5818011d40 con 0x7f5824104aa0 2024-09-11T00:59:04.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.665+0000 7f5822000640 1 -- 172.21.15.103:0/499361508 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581800f340 con 0x7f5824104aa0 2024-09-11T00:59:04.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.665+0000 7f582ac00640 1 -- 172.21.15.103:0/499361508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f582419cc40 con 0x7f5824104aa0 2024-09-11T00:59:04.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.665+0000 7f582ac00640 1 -- 172.21.15.103:0/499361508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58241a3320 con 0x7f5824104aa0 2024-09-11T00:59:04.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.666+0000 7f582ac00640 1 -- 172.21.15.103:0/499361508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f582410bd50 con 0x7f5824104aa0 2024-09-11T00:59:04.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.668+0000 7f5822000640 1 -- 172.21.15.103:0/499361508 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7f5818011890 con 0x7f5824104aa0 2024-09-11T00:59:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.671+0000 7f5822000640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f580c0b52f0 0x7f580c0b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.671+0000 7f5828e00640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f580c0b52f0 0x7f580c0b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:04.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.671+0000 7f5822000640 1 -- 172.21.15.103:0/499361508 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f58180e3c30 con 0x7f5824104aa0 2024-09-11T00:59:04.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.671+0000 7f5828e00640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f580c0b52f0 0x7f580c0b77b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5810005ec0 tx=0x7f5810005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:59:04.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.674+0000 7f5822000640 1 -- 172.21.15.103:0/499361508 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f581801f020 con 0x7f5824104aa0 2024-09-11T00:59:04.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.859+0000 7f582ac00640 1 -- 172.21.15.103:0/499361508 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f5824063d50 con 0x7f5824104aa0 2024-09-11T00:59:04.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.863+0000 7f5822000640 1 -- 172.21.15.103:0/499361508 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v31)=0 v31) ==== 120+0+0 (secure 0 0 0) 0x7f581800d040 con 0x7f5824104aa0 2024-09-11T00:59:04.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.865+0000 7f582ac00640 1 -- 172.21.15.103:0/499361508 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f580c0b52f0 msgr2=0x7f580c0b77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:04.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.865+0000 7f582ac00640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f580c0b52f0 0x7f580c0b77b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5810005ec0 tx=0x7f5810005fd0 comp rx=0 tx=0).stop 2024-09-11T00:59:04.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.865+0000 7f582ac00640 1 -- 172.21.15.103:0/499361508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5824104aa0 msgr2=0x7f582419ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:04.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.865+0000 7f582ac00640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5824104aa0 0x7f582419ae20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f581800b450 tx=0x7f581800b910 comp rx=0 tx=0).stop 2024-09-11T00:59:04.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.866+0000 7f582ac00640 1 -- 172.21.15.103:0/499361508 shutdown_connections 2024-09-11T00:59:04.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.866+0000 7f582ac00640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f580c0b52f0 0x7f580c0b77b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:04.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.866+0000 7f582ac00640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58241065c0 0x7f582419c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:04.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.866+0000 7f582ac00640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5824105c00 0x7f582419b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:04.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.866+0000 7f582ac00640 1 --2- 172.21.15.103:0/499361508 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5824104aa0 0x7f582419ae20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:04.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.866+0000 7f582ac00640 1 -- 172.21.15.103:0/499361508 >> 172.21.15.103:0/499361508 conn(0x7f5824100370 msgr2=0x7f5824108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:59:04.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.866+0000 7f582ac00640 1 -- 172.21.15.103:0/499361508 shutdown_connections 2024-09-11T00:59:04.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:04.866+0000 7f582ac00640 1 -- 172.21.15.103:0/499361508 wait complete. 2024-09-11T00:59:05.563 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi103') 2024-09-11T00:59:05.563 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi103') 2024-09-11T00:59:05.563 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '917288bc-6fd8-11ef-bcea-c7b262605968', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi103') 2024-09-11T00:59:05.564 INFO:tasks.cephadm:Deploying OSDs... 2024-09-11T00:59:05.564 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T00:59:05.564 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T00:59:05.600 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T00:59:05.600 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-09-11T00:59:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T00:59:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:59:05.676 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 637 Links: 1 2024-09-11T00:59:05.676 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:59:05.676 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:59:05.676 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-11 00:57:56.336272890 +0000 2024-09-11T00:59:05.676 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-11 00:53:18.746781608 +0000 2024-09-11T00:59:05.676 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-11 00:53:18.746781608 +0000 2024-09-11T00:59:05.676 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-11 00:53:18.746781608 +0000 2024-09-11T00:59:05.676 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T00:59:05.769 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-11T00:59:05.769 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-11T00:59:05.770 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000269447 s, 1.9 MB/s 2024-09-11T00:59:05.772 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T00:59:05.809 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-09-11T00:59:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T00:59:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:59:05.885 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 659 Links: 1 2024-09-11T00:59:05.885 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:59:05.885 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:59:05.885 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-11 00:57:56.389271886 +0000 2024-09-11T00:59:05.885 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-11 00:53:19.232772222 +0000 2024-09-11T00:59:05.886 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-11 00:53:19.232772222 +0000 2024-09-11T00:59:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-11 00:53:19.232772222 +0000 2024-09-11T00:59:05.886 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T00:59:05.978 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-11T00:59:05.978 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-11T00:59:05.978 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000270482 s, 1.9 MB/s 2024-09-11T00:59:05.981 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T00:59:06.017 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-09-11T00:59:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T00:59:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:59:06.093 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 678 Links: 1 2024-09-11T00:59:06.093 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:59:06.093 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:59:06.093 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-11 00:57:56.444270844 +0000 2024-09-11T00:59:06.093 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-11 00:53:19.709763009 +0000 2024-09-11T00:59:06.093 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-11 00:53:19.709763009 +0000 2024-09-11T00:59:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-11 00:53:19.709763009 +0000 2024-09-11T00:59:06.094 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T00:59:06.125 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:05 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/499361508' entity='client.admin' 2024-09-11T00:59:06.125 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:05 smithi117 ceph-mon[35358]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:06.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:05 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/499361508' entity='client.admin' 2024-09-11T00:59:06.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:05 smithi183 ceph-mon[34992]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:06.179 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:05 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/499361508' entity='client.admin' 2024-09-11T00:59:06.180 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:05 smithi103 ceph-mon[30562]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:06.185 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-11T00:59:06.186 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-11T00:59:06.186 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000267652 s, 1.9 MB/s 2024-09-11T00:59:06.188 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T00:59:06.225 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-09-11T00:59:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T00:59:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:59:06.300 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 6h/6d Inode: 697 Links: 1 2024-09-11T00:59:06.300 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:59:06.300 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:59:06.301 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-11 00:57:56.496269858 +0000 2024-09-11T00:59:06.301 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-11 00:53:20.197753584 +0000 2024-09-11T00:59:06.301 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-11 00:53:20.197753584 +0000 2024-09-11T00:59:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-11 00:53:20.197753584 +0000 2024-09-11T00:59:06.301 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T00:59:06.393 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-11T00:59:06.393 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-11T00:59:06.393 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000290306 s, 1.8 MB/s 2024-09-11T00:59:06.395 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T00:59:06.432 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-09-11T00:59:06.510 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T00:59:06.533 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T00:59:06.533 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-09-11T00:59:06.593 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T00:59:06.593 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:59:06.593 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-11T00:59:06.593 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:59:06.593 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:59:06.593 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-11 00:58:45.962673524 +0000 2024-09-11T00:59:06.593 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-11 00:52:45.117668056 +0000 2024-09-11T00:59:06.593 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-11 00:52:45.117668056 +0000 2024-09-11T00:59:06.594 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-11 00:52:45.117668056 +0000 2024-09-11T00:59:06.594 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T00:59:06.665 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-11T00:59:06.665 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-11T00:59:06.665 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000307355 s, 1.7 MB/s 2024-09-11T00:59:06.667 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T00:59:06.727 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-09-11T00:59:06.783 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T00:59:06.784 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:59:06.784 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-09-11T00:59:06.784 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:59:06.784 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:59:06.784 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-11 00:58:45.962673524 +0000 2024-09-11T00:59:06.784 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-11 00:52:45.451661683 +0000 2024-09-11T00:59:06.784 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-11 00:52:45.451661683 +0000 2024-09-11T00:59:06.784 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-11 00:52:45.451661683 +0000 2024-09-11T00:59:06.785 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T00:59:06.849 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-11T00:59:06.849 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-11T00:59:06.849 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000197508 s, 2.6 MB/s 2024-09-11T00:59:06.851 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T00:59:06.908 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-09-11T00:59:06.965 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T00:59:06.965 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:59:06.965 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-11T00:59:06.965 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:59:06.966 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:59:06.966 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-11 00:58:45.963673505 +0000 2024-09-11T00:59:06.966 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-11 00:52:45.788655252 +0000 2024-09-11T00:59:06.966 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-11 00:52:45.788655252 +0000 2024-09-11T00:59:06.966 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-11 00:52:45.788655252 +0000 2024-09-11T00:59:06.967 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T00:59:07.031 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-11T00:59:07.031 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-11T00:59:07.031 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000174698 s, 2.9 MB/s 2024-09-11T00:59:07.032 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T00:59:07.089 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-09-11T00:59:07.146 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T00:59:07.146 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:59:07.146 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-11T00:59:07.146 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:59:07.146 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:59:07.146 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-09-11 00:58:45.963673505 +0000 2024-09-11T00:59:07.146 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-09-11 00:52:46.115649012 +0000 2024-09-11T00:59:07.146 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-09-11 00:52:46.115649012 +0000 2024-09-11T00:59:07.146 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-09-11 00:52:46.115649012 +0000 2024-09-11T00:59:07.146 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T00:59:07.209 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-09-11T00:59:07.209 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-09-11T00:59:07.209 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000327688 s, 1.6 MB/s 2024-09-11T00:59:07.211 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T00:59:07.267 DEBUG:teuthology.orchestra.run.smithi183:> set -ex 2024-09-11T00:59:07.267 DEBUG:teuthology.orchestra.run.smithi183:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T00:59:07.288 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T00:59:07.288 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_1 2024-09-11T00:59:07.347 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T00:59:07.347 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:59:07.347 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-11T00:59:07.347 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:59:07.347 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:59:07.347 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-09-11 00:58:43.554445548 +0000 2024-09-11T00:59:07.347 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-09-11 00:52:45.907807087 +0000 2024-09-11T00:59:07.347 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-09-11 00:52:45.907807087 +0000 2024-09-11T00:59:07.347 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-09-11 00:52:45.907807087 +0000 2024-09-11T00:59:07.348 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T00:59:07.419 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-09-11T00:59:07.419 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-09-11T00:59:07.419 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000291465 s, 1.8 MB/s 2024-09-11T00:59:07.421 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T00:59:07.479 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_2 2024-09-11T00:59:07.537 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T00:59:07.538 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:59:07.538 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-11T00:59:07.538 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:59:07.538 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:59:07.538 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-09-11 00:58:43.554445548 +0000 2024-09-11T00:59:07.538 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-09-11 00:52:46.237797608 +0000 2024-09-11T00:59:07.538 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-09-11 00:52:46.237797608 +0000 2024-09-11T00:59:07.538 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-09-11 00:52:46.237797608 +0000 2024-09-11T00:59:07.538 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T00:59:07.603 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-09-11T00:59:07.603 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-09-11T00:59:07.603 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000292574 s, 1.7 MB/s 2024-09-11T00:59:07.605 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T00:59:07.662 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_3 2024-09-11T00:59:07.719 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T00:59:07.719 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:59:07.719 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-11T00:59:07.719 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:59:07.719 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:59:07.719 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-09-11 00:58:43.555445520 +0000 2024-09-11T00:59:07.720 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-09-11 00:52:46.560788330 +0000 2024-09-11T00:59:07.720 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-09-11 00:52:46.560788330 +0000 2024-09-11T00:59:07.720 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-09-11 00:52:46.560788330 +0000 2024-09-11T00:59:07.720 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T00:59:07.783 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-09-11T00:59:07.783 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-09-11T00:59:07.783 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.000205465 s, 2.5 MB/s 2024-09-11T00:59:07.784 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T00:59:07.842 DEBUG:teuthology.orchestra.run.smithi183:> stat /dev/vg_nvme/lv_4 2024-09-11T00:59:07.898 INFO:teuthology.orchestra.run.smithi183.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T00:59:07.899 INFO:teuthology.orchestra.run.smithi183.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T00:59:07.899 INFO:teuthology.orchestra.run.smithi183.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-11T00:59:07.899 INFO:teuthology.orchestra.run.smithi183.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T00:59:07.899 INFO:teuthology.orchestra.run.smithi183.stdout:Context: system_u:object_r:device_t:s0 2024-09-11T00:59:07.899 INFO:teuthology.orchestra.run.smithi183.stdout:Access: 2024-09-11 00:58:43.555445520 +0000 2024-09-11T00:59:07.899 INFO:teuthology.orchestra.run.smithi183.stdout:Modify: 2024-09-11 00:52:46.895778707 +0000 2024-09-11T00:59:07.899 INFO:teuthology.orchestra.run.smithi183.stdout:Change: 2024-09-11 00:52:46.895778707 +0000 2024-09-11T00:59:07.899 INFO:teuthology.orchestra.run.smithi183.stdout: Birth: 2024-09-11 00:52:46.895778707 +0000 2024-09-11T00:59:07.899 DEBUG:teuthology.orchestra.run.smithi183:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T00:59:07.965 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records in 2024-09-11T00:59:07.965 INFO:teuthology.orchestra.run.smithi183.stderr:1+0 records out 2024-09-11T00:59:07.965 INFO:teuthology.orchestra.run.smithi183.stderr:512 bytes copied, 0.00022244 s, 2.3 MB/s 2024-09-11T00:59:07.965 DEBUG:teuthology.orchestra.run.smithi183:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T00:59:08.021 INFO:tasks.cephadm:Deploying osd.0 on smithi103 with /dev/vg_nvme/lv_4... 2024-09-11T00:59:08.021 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T00:59:08.386 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:59:08.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:08 smithi103 ceph-mon[30562]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:08.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:08 smithi117 ceph-mon[35358]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:08.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:08 smithi183 ceph-mon[34992]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:10 smithi103 ceph-mon[30562]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:10.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:10 smithi117 ceph-mon[35358]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:10.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:10 smithi183 ceph-mon[34992]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:11.620 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T00:59:11.651 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_4 2024-09-11T00:59:12.012 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T00:59:12.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.502+0000 7ffb3f200640 1 -- 172.21.15.103:0/3926804398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb40105c00 msgr2=0x7ffb40106080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:12.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.502+0000 7ffb3f200640 1 --2- 172.21.15.103:0/3926804398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb40105c00 0x7ffb40106080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0098c0 tx=0x7ffb2c02a390 comp rx=0 tx=0).stop 2024-09-11T00:59:12.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.502+0000 7ffb3f200640 1 -- 172.21.15.103:0/3926804398 shutdown_connections 2024-09-11T00:59:12.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.502+0000 7ffb3f200640 1 --2- 172.21.15.103:0/3926804398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb401065c0 0x7ffb4010cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:12.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.502+0000 7ffb3f200640 1 --2- 172.21.15.103:0/3926804398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb40105c00 0x7ffb40106080 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:12.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.502+0000 7ffb3f200640 1 --2- 172.21.15.103:0/3926804398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb40104aa0 0x7ffb40104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:12.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.502+0000 7ffb3f200640 1 -- 172.21.15.103:0/3926804398 >> 172.21.15.103:0/3926804398 conn(0x7ffb40100370 msgr2=0x7ffb401027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:59:12.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.502+0000 7ffb3f200640 1 -- 172.21.15.103:0/3926804398 shutdown_connections 2024-09-11T00:59:12.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.503+0000 7ffb3f200640 1 -- 172.21.15.103:0/3926804398 wait complete. 2024-09-11T00:59:12.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.503+0000 7ffb3f200640 1 Processor -- start 2024-09-11T00:59:12.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3f200640 1 -- start start 2024-09-11T00:59:12.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3f200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb40104aa0 0x7ffb4019adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:12.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb40105c00 0x7ffb4019b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:12.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3f200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb401065c0 0x7ffb4019c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:12.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffb40110720 con 0x7ffb40105c00 2024-09-11T00:59:12.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3f200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffb401105a0 con 0x7ffb40104aa0 2024-09-11T00:59:12.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3f200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffb401108a0 con 0x7ffb401065c0 2024-09-11T00:59:12.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb40105c00 0x7ffb4019b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3de00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb40104aa0 0x7ffb4019adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3de00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb40104aa0 0x7ffb4019adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:57634/0 (socket says 172.21.15.103:57634) 2024-09-11T00:59:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3de00640 1 -- 172.21.15.103:0/2363418231 learned_addr learned my addr 172.21.15.103:0/2363418231 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T00:59:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3de00640 1 -- 172.21.15.103:0/2363418231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb401065c0 msgr2=0x7ffb4019c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3de00640 1 --2- 172.21.15.103:0/2363418231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb401065c0 0x7ffb4019c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3de00640 1 -- 172.21.15.103:0/2363418231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb40105c00 msgr2=0x7ffb4019b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3de00640 1 --2- 172.21.15.103:0/2363418231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb40105c00 0x7ffb4019b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3de00640 1 -- 172.21.15.103:0/2363418231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb4019c920 con 0x7ffb40104aa0 2024-09-11T00:59:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.504+0000 7ffb3d400640 1 --2- 172.21.15.103:0/2363418231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb40105c00 0x7ffb4019b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T00:59:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.505+0000 7ffb3de00640 1 --2- 172.21.15.103:0/2363418231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb40104aa0 0x7ffb4019adf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000e9f0 tx=0x7ffb3000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:59:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.505+0000 7ffb36a00640 1 -- 172.21.15.103:0/2363418231 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb3000cd80 con 0x7ffb40104aa0 2024-09-11T00:59:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.505+0000 7ffb36a00640 1 -- 172.21.15.103:0/2363418231 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffb300054d0 con 0x7ffb40104aa0 2024-09-11T00:59:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.505+0000 7ffb3f200640 1 -- 172.21.15.103:0/2363418231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb4019cc10 con 0x7ffb40104aa0 2024-09-11T00:59:12.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.505+0000 7ffb36a00640 1 -- 172.21.15.103:0/2363418231 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb30010690 con 0x7ffb40104aa0 2024-09-11T00:59:12.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.505+0000 7ffb3f200640 1 -- 172.21.15.103:0/2363418231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb401a32f0 con 0x7ffb40104aa0 2024-09-11T00:59:12.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.506+0000 7ffb3f200640 1 -- 172.21.15.103:0/2363418231 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb40104ea0 con 0x7ffb40104aa0 2024-09-11T00:59:12.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.508+0000 7ffb36a00640 1 -- 172.21.15.103:0/2363418231 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7ffb30004e90 con 0x7ffb40104aa0 2024-09-11T00:59:12.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.509+0000 7ffb36a00640 1 --2- 172.21.15.103:0/2363418231 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffb240b52f0 0x7ffb240b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:12.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.510+0000 7ffb36a00640 1 -- 172.21.15.103:0/2363418231 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ffb300e4420 con 0x7ffb40104aa0 2024-09-11T00:59:12.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.510+0000 7ffb3d400640 1 --2- 172.21.15.103:0/2363418231 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffb240b52f0 0x7ffb240b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:12.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.510+0000 7ffb3d400640 1 --2- 172.21.15.103:0/2363418231 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffb240b52f0 0x7ffb240b77b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0304b0 tx=0x7ffb2c005040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:59:12.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.513+0000 7ffb36a00640 1 -- 172.21.15.103:0/2363418231 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffb300acf10 con 0x7ffb40104aa0 2024-09-11T00:59:12.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:12.710+0000 7ffb3f200640 1 -- 172.21.15.103:0/2363418231 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7ffb40063590 con 0x7ffb240b52f0 2024-09-11T00:59:12.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:12 smithi103 ceph-mon[30562]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:12.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:12 smithi117 ceph-mon[35358]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:12 smithi183 ceph-mon[34992]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:13.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:13 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:59:13.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:13 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:59:13.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:13 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:13.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:13 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:59:13.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:13 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:59:13.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:13 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:13.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:13 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:59:13.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:13 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:59:13.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:13 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:14.708 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:14 smithi103 ceph-mon[30562]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:59:14.708 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:14 smithi103 ceph-mon[30562]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:14.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:14 smithi117 ceph-mon[35358]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:59:14.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:14 smithi117 ceph-mon[35358]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:14 smithi183 ceph-mon[34992]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:59:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:14 smithi183 ceph-mon[34992]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:16 smithi103 ceph-mon[30562]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:16 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3129209877' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1b3e4222-43fd-4af0-bf97-3ba1000221b7"} : dispatch 2024-09-11T00:59:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:16 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3129209877' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b3e4222-43fd-4af0-bf97-3ba1000221b7"}]': finished 2024-09-11T00:59:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:16 smithi103 ceph-mon[30562]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T00:59:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:16 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:16 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2926909323' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:59:16.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:16 smithi117 ceph-mon[35358]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:16.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:16 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3129209877' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1b3e4222-43fd-4af0-bf97-3ba1000221b7"} : dispatch 2024-09-11T00:59:16.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:16 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3129209877' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b3e4222-43fd-4af0-bf97-3ba1000221b7"}]': finished 2024-09-11T00:59:16.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:16 smithi117 ceph-mon[35358]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T00:59:16.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:16 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:16.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:16 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2926909323' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:59:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:16 smithi183 ceph-mon[34992]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:16 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3129209877' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "1b3e4222-43fd-4af0-bf97-3ba1000221b7"} : dispatch 2024-09-11T00:59:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:16 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3129209877' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1b3e4222-43fd-4af0-bf97-3ba1000221b7"}]': finished 2024-09-11T00:59:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:16 smithi183 ceph-mon[34992]: osdmap e5: 1 total, 0 up, 1 in 2024-09-11T00:59:16.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:16 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:16.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:16 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2926909323' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:59:18.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:18 smithi103 ceph-mon[30562]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:18.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:18 smithi117 ceph-mon[35358]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:18 smithi183 ceph-mon[34992]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:20.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:20 smithi103 ceph-mon[30562]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:20.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:20 smithi117 ceph-mon[35358]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:20.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:20 smithi183 ceph-mon[34992]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:22.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:22 smithi103 ceph-mon[30562]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:22.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:22 smithi117 ceph-mon[35358]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:22.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:22 smithi183 ceph-mon[34992]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:24.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:24 smithi103 ceph-mon[30562]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:24.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:24 smithi117 ceph-mon[35358]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:24.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:24 smithi183 ceph-mon[34992]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:25.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:25 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-11T00:59:25.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:25 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:25.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:25 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-11T00:59:25.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:25 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:25.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:25 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-11T00:59:25.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:25 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:26.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:26 smithi103 ceph-mon[30562]: Deploying daemon osd.0 on smithi103 2024-09-11T00:59:26.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:26 smithi103 ceph-mon[30562]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:26.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:26 smithi117 ceph-mon[35358]: Deploying daemon osd.0 on smithi103 2024-09-11T00:59:26.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:26 smithi117 ceph-mon[35358]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:26.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:26 smithi183 ceph-mon[34992]: Deploying daemon osd.0 on smithi103 2024-09-11T00:59:26.943 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:26 smithi183 ceph-mon[34992]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:28.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:28 smithi103 ceph-mon[30562]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:28.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:28 smithi117 ceph-mon[35358]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:28.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:28 smithi183 ceph-mon[34992]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:30.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:30 smithi103 ceph-mon[30562]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:30.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:30 smithi117 ceph-mon[35358]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:30.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:30 smithi183 ceph-mon[34992]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:32.737 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:32 smithi103 ceph-mon[30562]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:32 smithi117 ceph-mon[35358]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:32.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:32 smithi183 ceph-mon[34992]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:33.807 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:33 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:59:33.807 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:33 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:33.807 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:33 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:33.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:33 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:59:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:33 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:33 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:33.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:33 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:59:33.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:33 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:33.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:33 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:34.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:34 smithi103 ceph-mon[30562]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:34.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:34 smithi117 ceph-mon[35358]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:34 smithi183 ceph-mon[34992]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:36.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:36 smithi103 ceph-mon[30562]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:36.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:36.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:36.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:36.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:59:36.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:36.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:36 smithi117 ceph-mon[35358]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:59:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:36.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:36 smithi183 ceph-mon[34992]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:36.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:36.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:36.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:36.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:59:36.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:38.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:38.031+0000 7ffb36a00640 1 -- 172.21.15.103:0/2363418231 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ffb40063590 con 0x7ffb240b52f0 2024-09-11T00:59:38.033 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 0 on host 'smithi103' 2024-09-11T00:59:38.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:38.033+0000 7ffb3f200640 1 -- 172.21.15.103:0/2363418231 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffb240b52f0 msgr2=0x7ffb240b77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:38.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:38.033+0000 7ffb3f200640 1 --2- 172.21.15.103:0/2363418231 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffb240b52f0 0x7ffb240b77b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0304b0 tx=0x7ffb2c005040 comp rx=0 tx=0).stop 2024-09-11T00:59:38.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:38.033+0000 7ffb3f200640 1 -- 172.21.15.103:0/2363418231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb40104aa0 msgr2=0x7ffb4019adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:38.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:38.033+0000 7ffb3f200640 1 --2- 172.21.15.103:0/2363418231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb40104aa0 0x7ffb4019adf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000e9f0 tx=0x7ffb3000edf0 comp rx=0 tx=0).stop 2024-09-11T00:59:38.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:38.034+0000 7ffb3f200640 1 -- 172.21.15.103:0/2363418231 shutdown_connections 2024-09-11T00:59:38.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:38.034+0000 7ffb3f200640 1 --2- 172.21.15.103:0/2363418231 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffb240b52f0 0x7ffb240b77b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:38.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:38.034+0000 7ffb3f200640 1 --2- 172.21.15.103:0/2363418231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffb401065c0 0x7ffb4019c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:38.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:38.034+0000 7ffb3f200640 1 --2- 172.21.15.103:0/2363418231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffb40105c00 0x7ffb4019b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:38.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:38.034+0000 7ffb3f200640 1 --2- 172.21.15.103:0/2363418231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffb40104aa0 0x7ffb4019adf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:38.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:38.034+0000 7ffb3f200640 1 -- 172.21.15.103:0/2363418231 >> 172.21.15.103:0/2363418231 conn(0x7ffb40100370 msgr2=0x7ffb40108f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:59:38.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:38.034+0000 7ffb3f200640 1 -- 172.21.15.103:0/2363418231 shutdown_connections 2024-09-11T00:59:38.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T00:59:38.034+0000 7ffb3f200640 1 -- 172.21.15.103:0/2363418231 wait complete. 2024-09-11T00:59:38.781 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:38 smithi103 ceph-mon[30562]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:38.781 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:59:38.781 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:38.781 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:38.818 DEBUG:teuthology.orchestra.run.smithi103:osd.0> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.0.service 2024-09-11T00:59:38.823 INFO:tasks.cephadm:Deploying osd.1 on smithi117 with /dev/vg_nvme/lv_4... 2024-09-11T00:59:38.823 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T00:59:38.850 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:38 smithi117 ceph-mon[35358]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:38.850 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:59:38.850 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:38.850 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:38 smithi183 ceph-mon[34992]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:59:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:39.047 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 00:59:38 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0[47006]: 2024-09-11T00:59:38.890+0000 7f97f7e3a640 -1 osd.0 0 log_to_monitors true 2024-09-11T00:59:39.075 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:59:39.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:39 smithi103 ceph-mon[30562]: from='osd.0 [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-11T00:59:39.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:39 smithi103 ceph-mon[30562]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-11T00:59:39.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:39 smithi117 ceph-mon[35358]: from='osd.0 [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-11T00:59:39.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:39 smithi117 ceph-mon[35358]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-11T00:59:39.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:39 smithi183 ceph-mon[34992]: from='osd.0 [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-11T00:59:39.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:39 smithi183 ceph-mon[34992]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-11T00:59:40.800 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:40 smithi103 ceph-mon[30562]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:40.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:40 smithi103 ceph-mon[30562]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T00:59:40.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:40 smithi103 ceph-mon[30562]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T00:59:40.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:40.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:40 smithi103 ceph-mon[30562]: from='osd.0 [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T00:59:40.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:40 smithi103 ceph-mon[30562]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T00:59:40.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:40 smithi117 ceph-mon[35358]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:40 smithi117 ceph-mon[35358]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T00:59:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:40 smithi117 ceph-mon[35358]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T00:59:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:40 smithi117 ceph-mon[35358]: from='osd.0 [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T00:59:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:40 smithi117 ceph-mon[35358]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T00:59:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:40 smithi183 ceph-mon[34992]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:40 smithi183 ceph-mon[34992]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-11T00:59:40.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:40 smithi183 ceph-mon[34992]: osdmap e6: 1 total, 0 up, 1 in 2024-09-11T00:59:40.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:40.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:40 smithi183 ceph-mon[34992]: from='osd.0 [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T00:59:40.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:40 smithi183 ceph-mon[34992]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T00:59:41.348 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T00:59:41.376 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_4 2024-09-11T00:59:41.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:41 smithi117 ceph-mon[35358]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-11T00:59:41.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:41 smithi117 ceph-mon[35358]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T00:59:41.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:41.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:41.650 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:41 smithi117 ceph-mon[35358]: from='osd.0 ' entity='osd.0' 2024-09-11T00:59:41.651 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:41 smithi117 ceph-mon[35358]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:41.676 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T00:59:41.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:41 smithi103 ceph-mon[30562]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-11T00:59:41.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:41 smithi103 ceph-mon[30562]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T00:59:41.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:41.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:41.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:41 smithi103 ceph-mon[30562]: from='osd.0 ' entity='osd.0' 2024-09-11T00:59:41.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:41 smithi103 ceph-mon[30562]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:41.833 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 00:59:41 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0[47006]: 2024-09-11T00:59:41.340+0000 7f97f3000640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T00:59:41.833 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 00:59:41 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0[47006]: 2024-09-11T00:59:41.352+0000 7f97e8600640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T00:59:41.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:41 smithi183 ceph-mon[34992]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-11T00:59:41.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:41 smithi183 ceph-mon[34992]: osdmap e7: 1 total, 0 up, 1 in 2024-09-11T00:59:41.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:41.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:41.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:41 smithi183 ceph-mon[34992]: from='osd.0 ' entity='osd.0' 2024-09-11T00:59:41.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:41 smithi183 ceph-mon[34992]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-11T00:59:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.115+0000 7fe99f969640 1 -- 172.21.15.117:0/3231635494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe998101910 msgr2=0x7fe998101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.115+0000 7fe99f969640 1 --2- 172.21.15.117:0/3231635494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe998101910 0x7fe998101d10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe994009cd0 tx=0x7fe99402a8e0 comp rx=0 tx=0).stop 2024-09-11T00:59:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.115+0000 7fe99f969640 1 -- 172.21.15.117:0/3231635494 shutdown_connections 2024-09-11T00:59:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.115+0000 7fe99f969640 1 --2- 172.21.15.117:0/3231635494 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe998103430 0x7fe998109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.115+0000 7fe99f969640 1 --2- 172.21.15.117:0/3231635494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe998102a70 0x7fe998102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.115+0000 7fe99f969640 1 --2- 172.21.15.117:0/3231635494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe998101910 0x7fe998101d10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.115+0000 7fe99f969640 1 -- 172.21.15.117:0/3231635494 >> 172.21.15.117:0/3231635494 conn(0x7fe9980fd1e0 msgr2=0x7fe9980ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T00:59:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.116+0000 7fe99f969640 1 -- 172.21.15.117:0/3231635494 shutdown_connections 2024-09-11T00:59:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.116+0000 7fe99f969640 1 -- 172.21.15.117:0/3231635494 wait complete. 2024-09-11T00:59:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.116+0000 7fe99f969640 1 Processor -- start 2024-09-11T00:59:42.120 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.116+0000 7fe99f969640 1 -- start start 2024-09-11T00:59:42.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.116+0000 7fe99f969640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe998101910 0x7fe99806b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:42.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.116+0000 7fe99f969640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe998102a70 0x7fe99819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:42.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.116+0000 7fe99f969640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe998103430 0x7fe9981a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:42.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99f969640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe99810d5f0 con 0x7fe998102a70 2024-09-11T00:59:42.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99f969640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe99810d470 con 0x7fe998101910 2024-09-11T00:59:42.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99f969640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe99810d770 con 0x7fe998103430 2024-09-11T00:59:42.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99d705640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe998101910 0x7fe99806b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:42.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99d705640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe998101910 0x7fe99806b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:43622/0 (socket says 172.21.15.117:43622) 2024-09-11T00:59:42.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99d705640 1 -- 172.21.15.117:0/273038448 learned_addr learned my addr 172.21.15.117:0/273038448 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-11T00:59:42.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99df06640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe998103430 0x7fe9981a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:42.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99cf04640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe998102a70 0x7fe99819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:42.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99d705640 1 -- 172.21.15.117:0/273038448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe998103430 msgr2=0x7fe9981a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:42.121 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99d705640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe998103430 0x7fe9981a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99d705640 1 -- 172.21.15.117:0/273038448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe998102a70 msgr2=0x7fe99819dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T00:59:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99d705640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe998102a70 0x7fe99819dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T00:59:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99d705640 1 -- 172.21.15.117:0/273038448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9981a0ad0 con 0x7fe998101910 2024-09-11T00:59:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99df06640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe998103430 0x7fe9981a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T00:59:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99d705640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe998101910 0x7fe99806b450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe9940098d0 tx=0x7fe994003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:59:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe98e7fc640 1 -- 172.21.15.117:0/273038448 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe994004450 con 0x7fe998101910 2024-09-11T00:59:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe98e7fc640 1 -- 172.21.15.117:0/273038448 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe9940045f0 con 0x7fe998101910 2024-09-11T00:59:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99f969640 1 -- 172.21.15.117:0/273038448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9981979a0 con 0x7fe998101910 2024-09-11T00:59:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe98e7fc640 1 -- 172.21.15.117:0/273038448 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe994045670 con 0x7fe998101910 2024-09-11T00:59:42.122 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.117+0000 7fe99f969640 1 -- 172.21.15.117:0/273038448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe998197fb0 con 0x7fe998101910 2024-09-11T00:59:42.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.119+0000 7fe99f969640 1 -- 172.21.15.117:0/273038448 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe998101d10 con 0x7fe998101910 2024-09-11T00:59:42.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.120+0000 7fe98e7fc640 1 -- 172.21.15.117:0/273038448 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7fe99404d070 con 0x7fe998101910 2024-09-11T00:59:42.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.121+0000 7fe98e7fc640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe9840b52d0 0x7fe9840b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T00:59:42.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.121+0000 7fe98e7fc640 1 -- 172.21.15.117:0/273038448 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fe99402e030 con 0x7fe998101910 2024-09-11T00:59:42.123 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.121+0000 7fe99cf04640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe9840b52d0 0x7fe9840b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T00:59:42.124 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.122+0000 7fe99cf04640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe9840b52d0 0x7fe9840b7790 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe988009890 tx=0x7fe988008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T00:59:42.127 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.125+0000 7fe98e7fc640 1 -- 172.21.15.117:0/273038448 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe99404a060 con 0x7fe998101910 2024-09-11T00:59:42.318 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T00:59:42.316+0000 7fe99f969640 1 -- 172.21.15.117:0/273038448 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe998063590 con 0x7fe9840b52d0 2024-09-11T00:59:42.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:42 smithi117 ceph-mon[35358]: purged_snaps scrub starts 2024-09-11T00:59:42.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:42 smithi117 ceph-mon[35358]: purged_snaps scrub ok 2024-09-11T00:59:42.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:42.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:42 smithi117 ceph-mon[35358]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:59:42.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:59:42.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:59:42.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:42.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:42 smithi117 ceph-mon[35358]: osd.0 [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874] boot 2024-09-11T00:59:42.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:42 smithi117 ceph-mon[35358]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T00:59:42.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:42 smithi103 ceph-mon[30562]: purged_snaps scrub starts 2024-09-11T00:59:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:42 smithi103 ceph-mon[30562]: purged_snaps scrub ok 2024-09-11T00:59:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:42 smithi103 ceph-mon[30562]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:59:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:59:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:59:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:42 smithi103 ceph-mon[30562]: osd.0 [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874] boot 2024-09-11T00:59:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:42 smithi103 ceph-mon[30562]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T00:59:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:42.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:42 smithi183 ceph-mon[34992]: purged_snaps scrub starts 2024-09-11T00:59:42.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:42 smithi183 ceph-mon[34992]: purged_snaps scrub ok 2024-09-11T00:59:42.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:42.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:42 smithi183 ceph-mon[34992]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T00:59:42.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T00:59:42.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T00:59:42.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:42.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:42 smithi183 ceph-mon[34992]: osd.0 [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874] boot 2024-09-11T00:59:42.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:42 smithi183 ceph-mon[34992]: osdmap e8: 1 total, 1 up, 1 in 2024-09-11T00:59:42.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-11T00:59:43.743 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:43 smithi117 ceph-mon[35358]: Detected new or changed devices on smithi103 2024-09-11T00:59:43.743 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:43.743 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:43.743 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:59:43.743 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:43 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi103 to 17089M 2024-09-11T00:59:43.743 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:43.743 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:43.743 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:59:43.744 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:43.744 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:43 smithi117 ceph-mon[35358]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:44.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:43 smithi103 ceph-mon[30562]: Detected new or changed devices on smithi103 2024-09-11T00:59:44.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:44.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:44.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:59:44.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:43 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi103 to 17089M 2024-09-11T00:59:44.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:44.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:44.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:59:44.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:44.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:43 smithi103 ceph-mon[30562]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:44.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:43 smithi183 ceph-mon[34992]: Detected new or changed devices on smithi103 2024-09-11T00:59:44.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:44.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:44.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T00:59:44.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:43 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi103 to 17089M 2024-09-11T00:59:44.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:44.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:44.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T00:59:44.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:44.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:43 smithi183 ceph-mon[34992]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:44.992 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:44 smithi117 ceph-mon[35358]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T00:59:44.992 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:44 smithi117 ceph-mon[35358]: from='client.? 172.21.15.117:0/1388214737' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a2b40da-7361-4c4f-a9dc-a769b427a0fc"} : dispatch 2024-09-11T00:59:44.992 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:44 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a2b40da-7361-4c4f-a9dc-a769b427a0fc"} : dispatch 2024-09-11T00:59:44.992 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:44 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a2b40da-7361-4c4f-a9dc-a769b427a0fc"}]': finished 2024-09-11T00:59:44.992 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:44 smithi117 ceph-mon[35358]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T00:59:44.992 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:59:45.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:44 smithi103 ceph-mon[30562]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T00:59:45.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:44 smithi103 ceph-mon[30562]: from='client.? 172.21.15.117:0/1388214737' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a2b40da-7361-4c4f-a9dc-a769b427a0fc"} : dispatch 2024-09-11T00:59:45.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:44 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a2b40da-7361-4c4f-a9dc-a769b427a0fc"} : dispatch 2024-09-11T00:59:45.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:44 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a2b40da-7361-4c4f-a9dc-a769b427a0fc"}]': finished 2024-09-11T00:59:45.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:44 smithi103 ceph-mon[30562]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T00:59:45.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:59:45.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:44 smithi183 ceph-mon[34992]: osdmap e9: 1 total, 1 up, 1 in 2024-09-11T00:59:45.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:44 smithi183 ceph-mon[34992]: from='client.? 172.21.15.117:0/1388214737' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a2b40da-7361-4c4f-a9dc-a769b427a0fc"} : dispatch 2024-09-11T00:59:45.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:44 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "9a2b40da-7361-4c4f-a9dc-a769b427a0fc"} : dispatch 2024-09-11T00:59:45.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:44 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9a2b40da-7361-4c4f-a9dc-a769b427a0fc"}]': finished 2024-09-11T00:59:45.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:44 smithi183 ceph-mon[34992]: osdmap e10: 2 total, 1 up, 2 in 2024-09-11T00:59:45.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T00:59:46.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:45 smithi103 ceph-mon[30562]: from='client.? 172.21.15.117:0/3501332869' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:59:46.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:45 smithi103 ceph-mon[30562]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:46.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:45 smithi117 ceph-mon[35358]: from='client.? 172.21.15.117:0/3501332869' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:59:46.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:45 smithi117 ceph-mon[35358]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:46.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:45 smithi183 ceph-mon[34992]: from='client.? 172.21.15.117:0/3501332869' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T00:59:46.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:45 smithi183 ceph-mon[34992]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:48.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:48 smithi103 ceph-mon[30562]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:48.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:48 smithi117 ceph-mon[35358]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:48.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:48 smithi183 ceph-mon[34992]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:50.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:50 smithi103 ceph-mon[30562]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:50.763 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:50 smithi117 ceph-mon[35358]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:50.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:50 smithi183 ceph-mon[34992]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:52.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:52 smithi103 ceph-mon[30562]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:52.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:52 smithi117 ceph-mon[35358]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:52.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:52 smithi183 ceph-mon[34992]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:53.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-11T00:59:53.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:53.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:53 smithi103 ceph-mon[30562]: Deploying daemon osd.1 on smithi117 2024-09-11T00:59:53.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-11T00:59:53.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:53.853 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:53 smithi117 ceph-mon[35358]: Deploying daemon osd.1 on smithi117 2024-09-11T00:59:53.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-11T00:59:53.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T00:59:53.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:53 smithi183 ceph-mon[34992]: Deploying daemon osd.1 on smithi117 2024-09-11T00:59:54.819 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:54 smithi183 ceph-mon[34992]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:54.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:54 smithi103 ceph-mon[30562]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:54.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:54 smithi117 ceph-mon[35358]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:56.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:56 smithi103 ceph-mon[30562]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:56.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:56 smithi117 ceph-mon[35358]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:56 smithi183 ceph-mon[34992]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:58.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:58 smithi103 ceph-mon[30562]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:58.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:58 smithi117 ceph-mon[35358]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:58 smithi183 ceph-mon[34992]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T00:59:59.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:59 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:59:59.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:59 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:59.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 00:59:59 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:59.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:59 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:59:59.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:59 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:59.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 00:59:59 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:59.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:59 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T00:59:59.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:59 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T00:59:59.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 00:59:59 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:00.737 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:00 smithi117 ceph-mon[35358]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:00.737 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:00 smithi117 ceph-mon[35358]: overall HEALTH_OK 2024-09-11T01:00:00.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:00 smithi103 ceph-mon[30562]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:00.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:00 smithi103 ceph-mon[30562]: overall HEALTH_OK 2024-09-11T01:00:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:00 smithi183 ceph-mon[34992]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:00 smithi183 ceph-mon[34992]: overall HEALTH_OK 2024-09-11T01:00:02.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:02.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:02.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:02.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:02.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:02.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:02 smithi117 ceph-mon[35358]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:02.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:02.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:02.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:02.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:02.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:02.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:02 smithi183 ceph-mon[34992]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:02.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:02.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:02.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:02.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:02.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:02.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:02 smithi103 ceph-mon[30562]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:02.713 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:00:02.711+0000 7fe98e7fc640 1 -- 172.21.15.117:0/273038448 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe998063590 con 0x7fe9840b52d0 2024-09-11T01:00:02.714 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 1 on host 'smithi117' 2024-09-11T01:00:02.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:00:02.714+0000 7fe99f969640 1 -- 172.21.15.117:0/273038448 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe9840b52d0 msgr2=0x7fe9840b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:02.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:00:02.714+0000 7fe99f969640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe9840b52d0 0x7fe9840b7790 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe988009890 tx=0x7fe988008040 comp rx=0 tx=0).stop 2024-09-11T01:00:02.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:00:02.714+0000 7fe99f969640 1 -- 172.21.15.117:0/273038448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe998101910 msgr2=0x7fe99806b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:02.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:00:02.714+0000 7fe99f969640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe998101910 0x7fe99806b450 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe9940098d0 tx=0x7fe994003c20 comp rx=0 tx=0).stop 2024-09-11T01:00:02.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:00:02.714+0000 7fe99f969640 1 -- 172.21.15.117:0/273038448 shutdown_connections 2024-09-11T01:00:02.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:00:02.714+0000 7fe99f969640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe9840b52d0 0x7fe9840b7790 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:02.716 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:00:02.714+0000 7fe99f969640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe998103430 0x7fe9981a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:02.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:00:02.714+0000 7fe99f969640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe998102a70 0x7fe99819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:02.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:00:02.714+0000 7fe99f969640 1 --2- 172.21.15.117:0/273038448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe998101910 0x7fe99806b450 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:02.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:00:02.714+0000 7fe99f969640 1 -- 172.21.15.117:0/273038448 >> 172.21.15.117:0/273038448 conn(0x7fe9980fd1e0 msgr2=0x7fe998105e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:02.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:00:02.714+0000 7fe99f969640 1 -- 172.21.15.117:0/273038448 shutdown_connections 2024-09-11T01:00:02.717 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:00:02.714+0000 7fe99f969640 1 -- 172.21.15.117:0/273038448 wait complete. 2024-09-11T01:00:03.273 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:03 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:03.273 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:03 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:03.273 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:03 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:03.301 DEBUG:teuthology.orchestra.run.smithi117:osd.1> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.1.service 2024-09-11T01:00:03.303 INFO:tasks.cephadm:Deploying osd.2 on smithi183 with /dev/vg_nvme/lv_4... 2024-09-11T01:00:03.303 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-11T01:00:03.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:03 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:03.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:03 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:03.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:03 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:03.559 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T01:00:03.581 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:03 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:03.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:03 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:03.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:03 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:04.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:04 smithi183 ceph-mon[34992]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:04.445 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:04 smithi117 ceph-mon[35358]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:04.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:04 smithi103 ceph-mon[30562]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:05.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:05 smithi117 ceph-mon[35358]: from='osd.1 [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-11T01:00:05.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:05 smithi117 ceph-mon[35358]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-11T01:00:05.376 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:00:05 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1[39850]: 2024-09-11T01:00:05.063+0000 7f84da20d640 -1 osd.1 0 log_to_monitors true 2024-09-11T01:00:05.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:05 smithi183 ceph-mon[34992]: from='osd.1 [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-11T01:00:05.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:05 smithi183 ceph-mon[34992]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-11T01:00:05.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:05 smithi103 ceph-mon[30562]: from='osd.1 [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-11T01:00:05.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:05 smithi103 ceph-mon[30562]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-11T01:00:05.714 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T01:00:05.742 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_4 2024-09-11T01:00:05.993 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T01:00:06.369 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:06 smithi183 ceph-mon[34992]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T01:00:06.369 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:06 smithi183 ceph-mon[34992]: from='osd.1 [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:00:06.369 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:06 smithi183 ceph-mon[34992]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T01:00:06.369 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:06 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:06.369 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:06 smithi183 ceph-mon[34992]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:00:06.369 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:06 smithi183 ceph-mon[34992]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:06.369 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:06 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:06.369 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:06 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:06.369 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:06 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:00:06.370 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:06 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:06.370 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:06 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:06.370 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:06 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:06.370 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:06 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:06.370 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:06 smithi183 ceph-mon[34992]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-11T01:00:06.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-mon[35358]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T01:00:06.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-mon[35358]: from='osd.1 [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:00:06.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-mon[35358]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T01:00:06.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:06.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-mon[35358]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:00:06.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-mon[35358]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:06.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:06.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:06.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:00:06.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:06.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:06.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:06.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:06.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-mon[35358]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-11T01:00:06.498 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.447+0000 7f2887e20640 1 -- 172.21.15.183:0/1594252425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2880101910 msgr2=0x7f2880101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:06.498 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.447+0000 7f2887e20640 1 --2- 172.21.15.183:0/1594252425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2880101910 0x7f2880101d10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f287c009960 tx=0x7f287c02a460 comp rx=0 tx=0).stop 2024-09-11T01:00:06.498 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.447+0000 7f2887e20640 1 -- 172.21.15.183:0/1594252425 shutdown_connections 2024-09-11T01:00:06.498 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.447+0000 7f2887e20640 1 --2- 172.21.15.183:0/1594252425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2880103430 0x7f2880109db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:06.498 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.447+0000 7f2887e20640 1 --2- 172.21.15.183:0/1594252425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2880102a70 0x7f2880102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:06.498 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.447+0000 7f2887e20640 1 --2- 172.21.15.183:0/1594252425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2880101910 0x7f2880101d10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:06.498 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.447+0000 7f2887e20640 1 -- 172.21.15.183:0/1594252425 >> 172.21.15.183:0/1594252425 conn(0x7f28800fd1e0 msgr2=0x7f28800ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:06.498 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.447+0000 7f2887e20640 1 -- 172.21.15.183:0/1594252425 shutdown_connections 2024-09-11T01:00:06.498 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.447+0000 7f2887e20640 1 -- 172.21.15.183:0/1594252425 wait complete. 2024-09-11T01:00:06.499 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.448+0000 7f2887e20640 1 Processor -- start 2024-09-11T01:00:06.499 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.448+0000 7f2887e20640 1 -- start start 2024-09-11T01:00:06.499 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.448+0000 7f2887e20640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2880101910 0x7f2880197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:06.499 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.448+0000 7f2887e20640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2880102a70 0x7f2880198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:06.499 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.448+0000 7f2887e20640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2880103430 0x7f2880198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:06.499 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.448+0000 7f2887e20640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f288010d590 con 0x7f2880103430 2024-09-11T01:00:06.499 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.448+0000 7f2887e20640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f288010d410 con 0x7f2880101910 2024-09-11T01:00:06.499 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.448+0000 7f2887e20640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f288010d710 con 0x7f2880102a70 2024-09-11T01:00:06.499 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.448+0000 7f28853bb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2880102a70 0x7f2880198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:06.499 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.448+0000 7f28853bb640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2880102a70 0x7f2880198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:34796/0 (socket says 172.21.15.183:34796) 2024-09-11T01:00:06.499 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.448+0000 7f28853bb640 1 -- 172.21.15.183:0/4263876211 learned_addr learned my addr 172.21.15.183:0/4263876211 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-09-11T01:00:06.499 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.449+0000 7f2885bbc640 1 --2- 172.21.15.183:0/4263876211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2880101910 0x7f2880197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:06.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.449+0000 7f28853bb640 1 -- 172.21.15.183:0/4263876211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2880101910 msgr2=0x7f2880197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:06.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.449+0000 7f28853bb640 1 --2- 172.21.15.183:0/4263876211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2880101910 0x7f2880197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:06.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.449+0000 7f28853bb640 1 -- 172.21.15.183:0/4263876211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2880103430 msgr2=0x7f2880198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:06.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.449+0000 7f28853bb640 1 --2- 172.21.15.183:0/4263876211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2880103430 0x7f2880198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:06.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.449+0000 7f28853bb640 1 -- 172.21.15.183:0/4263876211 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2880199850 con 0x7f2880102a70 2024-09-11T01:00:06.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.449+0000 7f28853bb640 1 --2- 172.21.15.183:0/4263876211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2880102a70 0x7f2880198370 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f287000c920 tx=0x7f287000cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:06.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.449+0000 7f2876ffd640 1 -- 172.21.15.183:0/4263876211 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2870007c70 con 0x7f2880102a70 2024-09-11T01:00:06.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.449+0000 7f2876ffd640 1 -- 172.21.15.183:0/4263876211 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2870007e10 con 0x7f2880102a70 2024-09-11T01:00:06.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.449+0000 7f2887e20640 1 -- 172.21.15.183:0/4263876211 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2880199b40 con 0x7f2880102a70 2024-09-11T01:00:06.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.449+0000 7f2876ffd640 1 -- 172.21.15.183:0/4263876211 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2870018820 con 0x7f2880102a70 2024-09-11T01:00:06.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.449+0000 7f2887e20640 1 -- 172.21.15.183:0/4263876211 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28801a0220 con 0x7f2880102a70 2024-09-11T01:00:06.500 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.450+0000 7f2887e20640 1 -- 172.21.15.183:0/4263876211 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2880108c30 con 0x7f2880102a70 2024-09-11T01:00:06.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.451+0000 7f2876ffd640 1 -- 172.21.15.183:0/4263876211 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7f287000f450 con 0x7f2880102a70 2024-09-11T01:00:06.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.452+0000 7f2876ffd640 1 --2- 172.21.15.183:0/4263876211 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f286c0b5250 0x7f286c0b7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:06.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.452+0000 7f2876ffd640 1 -- 172.21.15.183:0/4263876211 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f28700e43a0 con 0x7f2880102a70 2024-09-11T01:00:06.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.452+0000 7f2885bbc640 1 --2- 172.21.15.183:0/4263876211 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f286c0b5250 0x7f286c0b7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:06.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.453+0000 7f2885bbc640 1 --2- 172.21.15.183:0/4263876211 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f286c0b5250 0x7f286c0b7710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f287c0057c0 tx=0x7f287c005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:06.501 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.456+0000 7f2876ffd640 1 -- 172.21.15.183:0/4263876211 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2870014030 con 0x7f2880102a70 2024-09-11T01:00:06.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:06 smithi103 ceph-mon[30562]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-11T01:00:06.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:06 smithi103 ceph-mon[30562]: from='osd.1 [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:00:06.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:06 smithi103 ceph-mon[30562]: osdmap e11: 2 total, 1 up, 2 in 2024-09-11T01:00:06.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:06.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:06 smithi103 ceph-mon[30562]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:00:06.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:06 smithi103 ceph-mon[30562]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:06.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:06.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:06.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:00:06.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:06.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:06.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:06.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:06.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:06 smithi103 ceph-mon[30562]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-11T01:00:06.646 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:06.644+0000 7f2887e20640 1 -- 172.21.15.183:0/4263876211 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2880063590 con 0x7f286c0b5250 2024-09-11T01:00:06.873 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1[39850]: 2024-09-11T01:00:06.846+0000 7f84d6190640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T01:00:06.873 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:00:06 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1[39850]: 2024-09-11T01:00:06.850+0000 7f84cdfaf640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:00:07.367 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:07 smithi183 ceph-mon[34992]: Detected new or changed devices on smithi117 2024-09-11T01:00:07.367 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:07 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi117 to 17088M 2024-09-11T01:00:07.367 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:07 smithi183 ceph-mon[34992]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T01:00:07.367 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:07 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:07.367 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:07 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:07.368 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:07 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:00:07.368 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:07 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:00:07.368 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:07 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:07.368 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:07 smithi183 ceph-mon[34992]: from='osd.1 ' entity='osd.1' 2024-09-11T01:00:07.368 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:07 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:07.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:07 smithi103 ceph-mon[30562]: Detected new or changed devices on smithi117 2024-09-11T01:00:07.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:07 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi117 to 17088M 2024-09-11T01:00:07.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:07 smithi103 ceph-mon[30562]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T01:00:07.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:07 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:07.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:07 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:07.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:07 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:00:07.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:07 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:00:07.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:07 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:07.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:07 smithi103 ceph-mon[30562]: from='osd.1 ' entity='osd.1' 2024-09-11T01:00:07.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:07 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:07.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:07 smithi117 ceph-mon[35358]: Detected new or changed devices on smithi117 2024-09-11T01:00:07.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:07 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi117 to 17088M 2024-09-11T01:00:07.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:07 smithi117 ceph-mon[35358]: osdmap e12: 2 total, 1 up, 2 in 2024-09-11T01:00:07.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:07 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:07.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:07 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:07.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:07 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:00:07.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:07 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:00:07.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:07 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:07.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:07 smithi117 ceph-mon[35358]: from='osd.1 ' entity='osd.1' 2024-09-11T01:00:07.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:07 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:08.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:08 smithi183 ceph-mon[34992]: purged_snaps scrub starts 2024-09-11T01:00:08.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:08 smithi183 ceph-mon[34992]: purged_snaps scrub ok 2024-09-11T01:00:08.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:08 smithi183 ceph-mon[34992]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:00:08.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:08 smithi183 ceph-mon[34992]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:08.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:08 smithi183 ceph-mon[34992]: osd.1 [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556] boot 2024-09-11T01:00:08.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:08 smithi183 ceph-mon[34992]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T01:00:08.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:08 smithi103 ceph-mon[30562]: purged_snaps scrub starts 2024-09-11T01:00:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:08 smithi103 ceph-mon[30562]: purged_snaps scrub ok 2024-09-11T01:00:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:08 smithi103 ceph-mon[30562]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:00:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:08 smithi103 ceph-mon[30562]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:08 smithi103 ceph-mon[30562]: osd.1 [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556] boot 2024-09-11T01:00:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:08 smithi103 ceph-mon[30562]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T01:00:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:08.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:08 smithi117 ceph-mon[35358]: purged_snaps scrub starts 2024-09-11T01:00:08.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:08 smithi117 ceph-mon[35358]: purged_snaps scrub ok 2024-09-11T01:00:08.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:08 smithi117 ceph-mon[35358]: from='client.24283 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:00:08.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:08 smithi117 ceph-mon[35358]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-11T01:00:08.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:08 smithi117 ceph-mon[35358]: osd.1 [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556] boot 2024-09-11T01:00:08.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:08 smithi117 ceph-mon[35358]: osdmap e13: 2 total, 2 up, 2 in 2024-09-11T01:00:08.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-11T01:00:10.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:09 smithi117 ceph-mon[35358]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T01:00:10.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:09 smithi117 ceph-mon[35358]: from='client.? 172.21.15.183:0/2529690894' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5db919c1-90a7-4ba7-acf3-89eeb77ae131"} : dispatch 2024-09-11T01:00:10.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:09 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5db919c1-90a7-4ba7-acf3-89eeb77ae131"} : dispatch 2024-09-11T01:00:10.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:09 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5db919c1-90a7-4ba7-acf3-89eeb77ae131"}]': finished 2024-09-11T01:00:10.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:09 smithi117 ceph-mon[35358]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T01:00:10.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:09 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:10.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:09 smithi117 ceph-mon[35358]: from='client.? 172.21.15.183:0/1363385118' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:00:10.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:09 smithi117 ceph-mon[35358]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:10.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:09 smithi183 ceph-mon[34992]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T01:00:10.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:09 smithi183 ceph-mon[34992]: from='client.? 172.21.15.183:0/2529690894' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5db919c1-90a7-4ba7-acf3-89eeb77ae131"} : dispatch 2024-09-11T01:00:10.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:09 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5db919c1-90a7-4ba7-acf3-89eeb77ae131"} : dispatch 2024-09-11T01:00:10.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:09 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5db919c1-90a7-4ba7-acf3-89eeb77ae131"}]': finished 2024-09-11T01:00:10.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:09 smithi183 ceph-mon[34992]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T01:00:10.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:09 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:10.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:09 smithi183 ceph-mon[34992]: from='client.? 172.21.15.183:0/1363385118' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:00:10.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:09 smithi183 ceph-mon[34992]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:10.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:09 smithi103 ceph-mon[30562]: osdmap e14: 2 total, 2 up, 2 in 2024-09-11T01:00:10.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:09 smithi103 ceph-mon[30562]: from='client.? 172.21.15.183:0/2529690894' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5db919c1-90a7-4ba7-acf3-89eeb77ae131"} : dispatch 2024-09-11T01:00:10.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:09 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "5db919c1-90a7-4ba7-acf3-89eeb77ae131"} : dispatch 2024-09-11T01:00:10.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:09 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5db919c1-90a7-4ba7-acf3-89eeb77ae131"}]': finished 2024-09-11T01:00:10.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:09 smithi103 ceph-mon[30562]: osdmap e15: 3 total, 2 up, 3 in 2024-09-11T01:00:10.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:09 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:10.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:09 smithi103 ceph-mon[30562]: from='client.? 172.21.15.183:0/1363385118' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:00:10.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:09 smithi103 ceph-mon[30562]: pgmap v80: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:12.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:12 smithi103 ceph-mon[30562]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:12.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:12 smithi117 ceph-mon[35358]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:12 smithi183 ceph-mon[34992]: pgmap v81: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:14.594 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:14 smithi183 ceph-mon[34992]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:14 smithi103 ceph-mon[30562]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:14.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:14 smithi117 ceph-mon[35358]: pgmap v82: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:16.581 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:16 smithi183 ceph-mon[34992]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:16 smithi103 ceph-mon[30562]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:16.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:16 smithi117 ceph-mon[35358]: pgmap v83: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:17.792 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:17 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-11T01:00:17.792 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:17 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:17.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:17 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-11T01:00:17.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:17 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:17.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:17 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-11T01:00:17.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:17 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:18.762 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:18 smithi183 ceph-mon[34992]: Deploying daemon osd.2 on smithi183 2024-09-11T01:00:18.763 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:18 smithi183 ceph-mon[34992]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:18.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:18 smithi103 ceph-mon[30562]: Deploying daemon osd.2 on smithi183 2024-09-11T01:00:18.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:18 smithi103 ceph-mon[30562]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:18.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:18 smithi117 ceph-mon[35358]: Deploying daemon osd.2 on smithi183 2024-09-11T01:00:18.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:18 smithi117 ceph-mon[35358]: pgmap v84: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:20.803 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:20 smithi183 ceph-mon[34992]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:20.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:20 smithi103 ceph-mon[30562]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:20.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:20 smithi117 ceph-mon[35358]: pgmap v85: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:22.617 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:22 smithi183 ceph-mon[34992]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:22.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:22 smithi103 ceph-mon[30562]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:22.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:22 smithi117 ceph-mon[35358]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:23.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:23.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:23.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:23.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:23 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:23.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:23 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:23.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:23 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:23.905 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:23.905 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:23.905 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:24.776 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:24 smithi183 ceph-mon[34992]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:24.796 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:24 smithi117 ceph-mon[35358]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:24.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:24 smithi103 ceph-mon[30562]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:26.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:26 smithi103 ceph-mon[30562]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:26.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:26.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:26.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:26.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:26.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:26.854 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:26 smithi183 ceph-mon[34992]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:26.855 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:26.855 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:26.855 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:26.855 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:26.855 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:26.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:26 smithi117 ceph-mon[35358]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:26.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:26.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:26.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:26.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:26.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:27.487 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:27.484+0000 7f2876ffd640 1 -- 172.21.15.183:0/4263876211 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2880063590 con 0x7f286c0b5250 2024-09-11T01:00:27.487 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 2 on host 'smithi183' 2024-09-11T01:00:27.489 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:27.486+0000 7f2887e20640 1 -- 172.21.15.183:0/4263876211 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f286c0b5250 msgr2=0x7f286c0b7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:27.489 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:27.486+0000 7f2887e20640 1 --2- 172.21.15.183:0/4263876211 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f286c0b5250 0x7f286c0b7710 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f287c0057c0 tx=0x7f287c005d50 comp rx=0 tx=0).stop 2024-09-11T01:00:27.489 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:27.486+0000 7f2887e20640 1 -- 172.21.15.183:0/4263876211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2880102a70 msgr2=0x7f2880198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:27.489 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:27.486+0000 7f2887e20640 1 --2- 172.21.15.183:0/4263876211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2880102a70 0x7f2880198370 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f287000c920 tx=0x7f287000cde0 comp rx=0 tx=0).stop 2024-09-11T01:00:27.489 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:27.486+0000 7f2887e20640 1 -- 172.21.15.183:0/4263876211 shutdown_connections 2024-09-11T01:00:27.489 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:27.486+0000 7f2887e20640 1 --2- 172.21.15.183:0/4263876211 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f286c0b5250 0x7f286c0b7710 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:27.489 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:27.486+0000 7f2887e20640 1 --2- 172.21.15.183:0/4263876211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2880103430 0x7f2880198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:27.490 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:27.486+0000 7f2887e20640 1 --2- 172.21.15.183:0/4263876211 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2880102a70 0x7f2880198370 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:27.490 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:27.486+0000 7f2887e20640 1 --2- 172.21.15.183:0/4263876211 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2880101910 0x7f2880197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:27.490 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:27.486+0000 7f2887e20640 1 -- 172.21.15.183:0/4263876211 >> 172.21.15.183:0/4263876211 conn(0x7f28800fd1e0 msgr2=0x7f2880105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:27.490 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:27.487+0000 7f2887e20640 1 -- 172.21.15.183:0/4263876211 shutdown_connections 2024-09-11T01:00:27.490 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:00:27.487+0000 7f2887e20640 1 -- 172.21.15.183:0/4263876211 wait complete. 2024-09-11T01:00:27.789 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:27 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:27.789 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:27 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:27.789 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:27 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:27.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:27 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:27.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:27 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:27.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:27 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:27.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:27.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:27.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:28.075 DEBUG:teuthology.orchestra.run.smithi183:osd.2> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.2.service 2024-09-11T01:00:28.078 INFO:tasks.cephadm:Deploying osd.3 on smithi103 with /dev/vg_nvme/lv_3... 2024-09-11T01:00:28.079 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T01:00:28.454 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:00:28.626 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:28 smithi183 ceph-mon[34992]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:28.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:28 smithi103 ceph-mon[30562]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:28.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:28 smithi117 ceph-mon[35358]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:29.918 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:00:29 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2[39961]: 2024-09-11T01:00:29.744+0000 7f25ce522640 -1 osd.2 0 log_to_monitors true 2024-09-11T01:00:30.635 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:30 smithi183 ceph-mon[34992]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:30.635 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:30 smithi183 ceph-mon[34992]: from='osd.2 [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-11T01:00:30.635 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:30 smithi183 ceph-mon[34992]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-11T01:00:30.796 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:30 smithi103 ceph-mon[30562]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:30.796 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:30 smithi103 ceph-mon[30562]: from='osd.2 [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-11T01:00:30.796 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:30 smithi103 ceph-mon[30562]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-11T01:00:30.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:30 smithi117 ceph-mon[35358]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:30.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:30 smithi117 ceph-mon[35358]: from='osd.2 [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-11T01:00:30.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:30 smithi117 ceph-mon[35358]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-11T01:00:31.560 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:00:31.603 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_3 2024-09-11T01:00:31.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:31 smithi103 ceph-mon[30562]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T01:00:31.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:31 smithi103 ceph-mon[30562]: from='osd.2 [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:00:31.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:31 smithi103 ceph-mon[30562]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T01:00:31.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:31 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:31.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:31 smithi103 ceph-mon[30562]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:00:31.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:31 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:31.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:31 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:31.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:31 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:00:31.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:31 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:31.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:31 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:31.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:31 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:31.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:31 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:31.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:31 smithi117 ceph-mon[35358]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T01:00:31.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:31 smithi117 ceph-mon[35358]: from='osd.2 [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:00:31.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:31 smithi117 ceph-mon[35358]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T01:00:31.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:31 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:31.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:31 smithi117 ceph-mon[35358]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:00:31.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:31 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:31.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:31 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:31.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:31 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:00:31.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:31 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:31.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:31 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:31.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:31 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:31.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:31 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:31.918 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:00:31 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2[39961]: 2024-09-11T01:00:31.558+0000 7f25ca4a5640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T01:00:31.918 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:00:31 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2[39961]: 2024-09-11T01:00:31.563+0000 7f25c62cc640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:00:31.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:31 smithi183 ceph-mon[34992]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-11T01:00:31.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:31 smithi183 ceph-mon[34992]: from='osd.2 [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:00:31.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:31 smithi183 ceph-mon[34992]: osdmap e16: 3 total, 2 up, 3 in 2024-09-11T01:00:31.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:31 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:31.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:31 smithi183 ceph-mon[34992]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:00:31.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:31 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:31.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:31 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:31.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:31 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:00:31.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:31 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:31.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:31 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:31.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:31 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:31.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:31 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:31.967 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:00:32.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.548+0000 7f7f5b000640 1 -- 172.21.15.103:0/1855688329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f54075ac0 msgr2=0x7f7f54075f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:32.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.548+0000 7f7f5b000640 1 --2- 172.21.15.103:0/1855688329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f54075ac0 0x7f7f54075f40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c009900 tx=0x7f7f3c02a410 comp rx=0 tx=0).stop 2024-09-11T01:00:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.548+0000 7f7f5b000640 1 -- 172.21.15.103:0/1855688329 shutdown_connections 2024-09-11T01:00:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.548+0000 7f7f5b000640 1 --2- 172.21.15.103:0/1855688329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f5410a9b0 0x7f7f5410ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.548+0000 7f7f5b000640 1 --2- 172.21.15.103:0/1855688329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f54075ac0 0x7f7f54075f40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.548+0000 7f7f5b000640 1 --2- 172.21.15.103:0/1855688329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f54076f20 0x7f7f54075580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.548+0000 7f7f5b000640 1 -- 172.21.15.103:0/1855688329 >> 172.21.15.103:0/1855688329 conn(0x7f7f540fe2f0 msgr2=0x7f7f54100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.549+0000 7f7f5b000640 1 -- 172.21.15.103:0/1855688329 shutdown_connections 2024-09-11T01:00:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.549+0000 7f7f5b000640 1 -- 172.21.15.103:0/1855688329 wait complete. 2024-09-11T01:00:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.549+0000 7f7f5b000640 1 Processor -- start 2024-09-11T01:00:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.550+0000 7f7f5b000640 1 -- start start 2024-09-11T01:00:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.550+0000 7f7f5b000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54075ac0 0x7f7f5419b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.550+0000 7f7f5b000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f54076f20 0x7f7f5419b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.550+0000 7f7f5b000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f5410a9b0 0x7f7f5419c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.550+0000 7f7f5b000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7f541108f0 con 0x7f7f5410a9b0 2024-09-11T01:00:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.550+0000 7f7f5b000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7f54110770 con 0x7f7f54075ac0 2024-09-11T01:00:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.550+0000 7f7f5b000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7f54110a70 con 0x7f7f54076f20 2024-09-11T01:00:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.550+0000 7f7f53e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54075ac0 0x7f7f5419b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.550+0000 7f7f59000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f5410a9b0 0x7f7f5419c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.550+0000 7f7f53e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54075ac0 0x7f7f5419b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:51512/0 (socket says 172.21.15.103:51512) 2024-09-11T01:00:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.550+0000 7f7f53e00640 1 -- 172.21.15.103:0/3164961651 learned_addr learned my addr 172.21.15.103:0/3164961651 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:00:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.551+0000 7f7f4b400640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f54076f20 0x7f7f5419b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:32.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.551+0000 7f7f59000640 1 -- 172.21.15.103:0/3164961651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f54076f20 msgr2=0x7f7f5419b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:32.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.551+0000 7f7f59000640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f54076f20 0x7f7f5419b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:32.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.551+0000 7f7f59000640 1 -- 172.21.15.103:0/3164961651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54075ac0 msgr2=0x7f7f5419b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:32.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.551+0000 7f7f59000640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54075ac0 0x7f7f5419b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:32.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.551+0000 7f7f59000640 1 -- 172.21.15.103:0/3164961651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5419cb50 con 0x7f7f5410a9b0 2024-09-11T01:00:32.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.551+0000 7f7f4b400640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f54076f20 0x7f7f5419b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:00:32.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.551+0000 7f7f53e00640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54075ac0 0x7f7f5419b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:00:32.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.551+0000 7f7f59000640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f5410a9b0 0x7f7f5419c2b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c005fd0 tx=0x7f7f4c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:32.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.552+0000 7f7f51600640 1 -- 172.21.15.103:0/3164961651 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c00cdf0 con 0x7f7f5410a9b0 2024-09-11T01:00:32.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.552+0000 7f7f51600640 1 -- 172.21.15.103:0/3164961651 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f4c005020 con 0x7f7f5410a9b0 2024-09-11T01:00:32.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.552+0000 7f7f5b000640 1 -- 172.21.15.103:0/3164961651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5419ce40 con 0x7f7f5410a9b0 2024-09-11T01:00:32.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.552+0000 7f7f51600640 1 -- 172.21.15.103:0/3164961651 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f4c010690 con 0x7f7f5410a9b0 2024-09-11T01:00:32.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.552+0000 7f7f5b000640 1 -- 172.21.15.103:0/3164961651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f541a3520 con 0x7f7f5410a9b0 2024-09-11T01:00:32.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.553+0000 7f7f5b000640 1 -- 172.21.15.103:0/3164961651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f541a36f0 con 0x7f7f5410a9b0 2024-09-11T01:00:32.557 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.555+0000 7f7f51600640 1 -- 172.21.15.103:0/3164961651 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 153195+0+0 (secure 0 0 0) 0x7f7f4c005460 con 0x7f7f5410a9b0 2024-09-11T01:00:32.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.557+0000 7f7f51600640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7f380b52d0 0x7f7f380b7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:00:32.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.557+0000 7f7f53e00640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7f380b52d0 0x7f7f380b7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:00:32.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.557+0000 7f7f51600640 1 -- 172.21.15.103:0/3164961651 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2571+0+0 (secure 0 0 0) 0x7f7f4c0e4b40 con 0x7f7f5410a9b0 2024-09-11T01:00:32.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.558+0000 7f7f53e00640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7f380b52d0 0x7f7f380b7790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7f44005fd0 tx=0x7f7f4400b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:00:32.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.562+0000 7f7f51600640 1 -- 172.21.15.103:0/3164961651 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7f4c0ad0b0 con 0x7f7f5410a9b0 2024-09-11T01:00:32.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:32.758+0000 7f7f5b000640 1 -- 172.21.15.103:0/3164961651 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7f540ff020 con 0x7f7f380b52d0 2024-09-11T01:00:32.760 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:32 smithi103 ceph-mon[30562]: Detected new or changed devices on smithi183 2024-09-11T01:00:32.760 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:32 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi183 to 17088M 2024-09-11T01:00:32.761 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:32 smithi103 ceph-mon[30562]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:32.761 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:32 smithi103 ceph-mon[30562]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-09-11T01:00:32.761 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:32 smithi103 ceph-mon[30562]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T01:00:32.761 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:32.761 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:32 smithi117 ceph-mon[35358]: Detected new or changed devices on smithi183 2024-09-11T01:00:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:32 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi183 to 17088M 2024-09-11T01:00:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:32 smithi117 ceph-mon[35358]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:32 smithi117 ceph-mon[35358]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-09-11T01:00:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:32 smithi117 ceph-mon[35358]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T01:00:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:32.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:32.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:32 smithi183 ceph-mon[34992]: Detected new or changed devices on smithi183 2024-09-11T01:00:32.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:32 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi183 to 17088M 2024-09-11T01:00:32.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:32 smithi183 ceph-mon[34992]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:32.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:32 smithi183 ceph-mon[34992]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-09-11T01:00:32.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:32 smithi183 ceph-mon[34992]: osdmap e17: 3 total, 2 up, 3 in 2024-09-11T01:00:32.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:32.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:33.614 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:33 smithi103 ceph-mon[30562]: purged_snaps scrub starts 2024-09-11T01:00:33.614 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:33 smithi103 ceph-mon[30562]: purged_snaps scrub ok 2024-09-11T01:00:33.615 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:33 smithi103 ceph-mon[30562]: osd.2 [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770] boot 2024-09-11T01:00:33.615 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:33 smithi103 ceph-mon[30562]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T01:00:33.615 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:33 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:33.615 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:33 smithi103 ceph-mon[30562]: from='client.14403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:00:33.615 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:33 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:00:33.615 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:33 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:00:33.615 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:33 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:33.615 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:33 smithi103 ceph-mon[30562]: pgmap v95: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:33.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:33 smithi117 ceph-mon[35358]: purged_snaps scrub starts 2024-09-11T01:00:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:33 smithi117 ceph-mon[35358]: purged_snaps scrub ok 2024-09-11T01:00:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:33 smithi117 ceph-mon[35358]: osd.2 [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770] boot 2024-09-11T01:00:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:33 smithi117 ceph-mon[35358]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T01:00:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:33 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:33 smithi117 ceph-mon[35358]: from='client.14403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:00:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:33 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:00:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:33 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:00:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:33 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:33 smithi117 ceph-mon[35358]: pgmap v95: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:33.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:33 smithi183 ceph-mon[34992]: purged_snaps scrub starts 2024-09-11T01:00:33.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:33 smithi183 ceph-mon[34992]: purged_snaps scrub ok 2024-09-11T01:00:33.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:33 smithi183 ceph-mon[34992]: osd.2 [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770] boot 2024-09-11T01:00:33.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:33 smithi183 ceph-mon[34992]: osdmap e18: 3 total, 3 up, 3 in 2024-09-11T01:00:33.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:33 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-11T01:00:33.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:33 smithi183 ceph-mon[34992]: from='client.14403 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:00:33.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:33 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:00:33.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:33 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:00:33.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:33 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:33.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:33 smithi183 ceph-mon[34992]: pgmap v95: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-11T01:00:34.665 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:34 smithi103 ceph-mon[30562]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T01:00:34.665 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-11T01:00:34.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:34 smithi117 ceph-mon[35358]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T01:00:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-11T01:00:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:34 smithi183 ceph-mon[34992]: osdmap e19: 3 total, 3 up, 3 in 2024-09-11T01:00:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-11T01:00:35.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T01:00:35.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:35 smithi103 ceph-mon[30562]: osdmap e20: 3 total, 3 up, 3 in 2024-09-11T01:00:35.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-11T01:00:35.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:35 smithi103 ceph-mon[30562]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:35.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T01:00:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:35 smithi117 ceph-mon[35358]: osdmap e20: 3 total, 3 up, 3 in 2024-09-11T01:00:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-11T01:00:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:35 smithi117 ceph-mon[35358]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:35.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-11T01:00:35.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:35 smithi183 ceph-mon[34992]: osdmap e20: 3 total, 3 up, 3 in 2024-09-11T01:00:35.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-11T01:00:35.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:35 smithi183 ceph-mon[34992]: pgmap v98: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:36.099 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 sudo[51877]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T01:00:36.099 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 sudo[51877]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T01:00:36.099 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 sudo[51877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T01:00:36.100 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:00:35 smithi103 sudo[51869]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T01:00:36.100 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:00:35 smithi103 sudo[51869]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T01:00:36.100 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:00:35 smithi103 sudo[51869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T01:00:36.100 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:00:35 smithi103 sudo[51869]: pam_unix(sudo:session): session closed for user root 2024-09-11T01:00:36.100 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:00:35 smithi103 sudo[51874]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T01:00:36.101 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:00:35 smithi103 sudo[51874]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T01:00:36.101 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:00:35 smithi103 sudo[51874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T01:00:36.101 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:00:35 smithi103 sudo[51874]: pam_unix(sudo:session): session closed for user root 2024-09-11T01:00:36.191 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:00:35 smithi117 sudo[43829]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T01:00:36.191 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:00:35 smithi117 sudo[43829]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T01:00:36.191 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:00:35 smithi117 sudo[43829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T01:00:36.191 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:00:35 smithi117 sudo[43829]: pam_unix(sudo:session): session closed for user root 2024-09-11T01:00:36.191 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:00:35 smithi117 sudo[43832]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T01:00:36.192 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:00:35 smithi117 sudo[43832]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T01:00:36.192 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:00:35 smithi117 sudo[43832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T01:00:36.192 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:00:35 smithi117 sudo[43832]: pam_unix(sudo:session): session closed for user root 2024-09-11T01:00:36.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44012]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T01:00:36.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44012]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T01:00:36.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T01:00:36.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44012]: pam_unix(sudo:session): session closed for user root 2024-09-11T01:00:36.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44015]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T01:00:36.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44015]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T01:00:36.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T01:00:36.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44015]: pam_unix(sudo:session): session closed for user root 2024-09-11T01:00:36.419 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44006]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T01:00:36.420 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44006]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T01:00:36.420 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T01:00:36.420 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44006]: pam_unix(sudo:session): session closed for user root 2024-09-11T01:00:36.420 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44009]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T01:00:36.420 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44009]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T01:00:36.420 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T01:00:36.420 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:00:36 smithi183 sudo[44009]: pam_unix(sudo:session): session closed for user root 2024-09-11T01:00:36.485 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 sudo[51877]: pam_unix(sudo:session): session closed for user root 2024-09-11T01:00:36.485 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 sudo[51883]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T01:00:36.485 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 sudo[51883]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T01:00:36.486 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 sudo[51883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T01:00:36.486 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 sudo[51883]: pam_unix(sudo:session): session closed for user root 2024-09-11T01:00:36.585 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 sudo[43835]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-11T01:00:36.586 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 sudo[43835]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T01:00:36.586 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 sudo[43835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T01:00:36.586 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 sudo[43835]: pam_unix(sudo:session): session closed for user root 2024-09-11T01:00:36.586 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 sudo[43838]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-11T01:00:36.586 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 sudo[43838]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-11T01:00:36.586 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 sudo[43838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-11T01:00:36.587 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 sudo[43838]: pam_unix(sudo:session): session closed for user root 2024-09-11T01:00:36.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T01:00:36.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T01:00:36.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: osdmap e21: 3 total, 3 up, 3 in 2024-09-11T01:00:36.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3617808058' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bdc465f2-06a5-4667-9651-4e168700d674"} : dispatch 2024-09-11T01:00:36.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bdc465f2-06a5-4667-9651-4e168700d674"} : dispatch 2024-09-11T01:00:36.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdc465f2-06a5-4667-9651-4e168700d674"}]': finished 2024-09-11T01:00:36.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T01:00:36.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:00:36.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:36.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:36.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:36.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T01:00:36.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T01:00:36.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T01:00:36.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T01:00:36.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T01:00:36.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T01:00:36.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T01:00:36.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T01:00:36.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T01:00:36.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T01:00:36.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T01:00:36.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T01:00:36.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T01:00:36.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T01:00:36.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T01:00:36.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:36 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2101350234' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:00:36.841 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T01:00:36.841 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T01:00:36.841 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: osdmap e21: 3 total, 3 up, 3 in 2024-09-11T01:00:36.841 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3617808058' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bdc465f2-06a5-4667-9651-4e168700d674"} : dispatch 2024-09-11T01:00:36.841 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bdc465f2-06a5-4667-9651-4e168700d674"} : dispatch 2024-09-11T01:00:36.841 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdc465f2-06a5-4667-9651-4e168700d674"}]': finished 2024-09-11T01:00:36.841 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T01:00:36.841 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:00:36.842 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:36.842 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:36.842 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:36.842 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T01:00:36.842 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T01:00:36.842 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T01:00:36.842 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T01:00:36.842 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T01:00:36.842 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T01:00:36.842 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T01:00:36.842 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T01:00:36.842 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T01:00:36.842 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T01:00:36.842 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T01:00:36.843 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T01:00:36.843 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T01:00:36.843 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T01:00:36.843 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T01:00:36.843 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:36 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2101350234' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:00:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T01:00:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-11T01:00:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: osdmap e21: 3 total, 3 up, 3 in 2024-09-11T01:00:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3617808058' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bdc465f2-06a5-4667-9651-4e168700d674"} : dispatch 2024-09-11T01:00:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "bdc465f2-06a5-4667-9651-4e168700d674"} : dispatch 2024-09-11T01:00:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bdc465f2-06a5-4667-9651-4e168700d674"}]': finished 2024-09-11T01:00:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: osdmap e22: 4 total, 3 up, 4 in 2024-09-11T01:00:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:00:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:36.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:36.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:36.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T01:00:36.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T01:00:36.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T01:00:36.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T01:00:36.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T01:00:36.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T01:00:36.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T01:00:36.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T01:00:36.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T01:00:36.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T01:00:36.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-11T01:00:36.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-11T01:00:36.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-11T01:00:36.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-11T01:00:36.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-11T01:00:36.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:36 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2101350234' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:00:37.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:37.786+0000 7f7f51600640 1 -- 172.21.15.103:0/3164961651 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f7f4c0a8c20 con 0x7f7f5410a9b0 2024-09-11T01:00:38.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:37 smithi103 ceph-mon[30562]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T01:00:38.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:37 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:00:38.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:37 smithi103 ceph-mon[30562]: pgmap v102: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:38.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:37 smithi117 ceph-mon[35358]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T01:00:38.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:37 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:00:38.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:37 smithi117 ceph-mon[35358]: pgmap v102: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:38.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:37 smithi183 ceph-mon[34992]: osdmap e23: 4 total, 3 up, 4 in 2024-09-11T01:00:38.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:37 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:00:38.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:37 smithi183 ceph-mon[34992]: pgmap v102: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:39.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:38 smithi103 ceph-mon[30562]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T01:00:39.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:38 smithi103 ceph-mon[30562]: Cluster is now healthy 2024-09-11T01:00:39.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:38 smithi103 ceph-mon[30562]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T01:00:39.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:38 smithi117 ceph-mon[35358]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T01:00:39.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:38 smithi117 ceph-mon[35358]: Cluster is now healthy 2024-09-11T01:00:39.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:38 smithi117 ceph-mon[35358]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T01:00:39.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:38 smithi183 ceph-mon[34992]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T01:00:39.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:38 smithi183 ceph-mon[34992]: Cluster is now healthy 2024-09-11T01:00:39.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:38 smithi183 ceph-mon[34992]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-11T01:00:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:39 smithi103 ceph-mon[30562]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:40.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:39 smithi117 ceph-mon[35358]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:40.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:39 smithi183 ceph-mon[34992]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:42 smithi103 ceph-mon[30562]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:42.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:42 smithi117 ceph-mon[35358]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:42.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:42 smithi183 ceph-mon[34992]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:44.723 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:44 smithi103 ceph-mon[30562]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:44.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:44 smithi117 ceph-mon[35358]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:44.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:44 smithi183 ceph-mon[34992]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:45.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-11T01:00:45.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:45.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-11T01:00:45.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:45.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-11T01:00:45.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:46.580 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:46 smithi103 ceph-mon[30562]: Deploying daemon osd.3 on smithi103 2024-09-11T01:00:46.580 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:46 smithi103 ceph-mon[30562]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:46.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:46 smithi117 ceph-mon[35358]: Deploying daemon osd.3 on smithi103 2024-09-11T01:00:46.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:46 smithi117 ceph-mon[35358]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:46.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:46 smithi183 ceph-mon[34992]: Deploying daemon osd.3 on smithi103 2024-09-11T01:00:46.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:46 smithi183 ceph-mon[34992]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:48.696 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:48 smithi103 ceph-mon[30562]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:48.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:48 smithi117 ceph-mon[35358]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:48.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:48 smithi183 ceph-mon[34992]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:50.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:50 smithi103 ceph-mon[30562]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:50.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:50 smithi117 ceph-mon[35358]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:50.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:50 smithi183 ceph-mon[34992]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:52.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:52 smithi103 ceph-mon[30562]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:52.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:52 smithi117 ceph-mon[35358]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:52.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:52 smithi183 ceph-mon[34992]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:53.668 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:53.668 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:53.668 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:53.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:53.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:53.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:53.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:53.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:53.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:54.819 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:54 smithi183 ceph-mon[34992]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:54.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:54 smithi103 ceph-mon[30562]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:54.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:54 smithi117 ceph-mon[35358]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:56.780 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:56 smithi103 ceph-mon[30562]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:56.781 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:56 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:56.781 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:56 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:56.781 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:56 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:56.781 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:56 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:56.781 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:56 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:56.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:56 smithi117 ceph-mon[35358]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:56.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:56 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:56.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:56 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:56.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:56 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:56.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:56 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:56.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:56 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:56 smithi183 ceph-mon[34992]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:56 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:56 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:56 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:00:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:56 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:00:56.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:56 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:57.658 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 3 on host 'smithi103' 2024-09-11T01:00:57.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:57.655+0000 7f7f51600640 1 -- 172.21.15.103:0/3164961651 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7f540ff020 con 0x7f7f380b52d0 2024-09-11T01:00:57.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:57.658+0000 7f7f5b000640 1 -- 172.21.15.103:0/3164961651 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7f380b52d0 msgr2=0x7f7f380b7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:57.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:57.658+0000 7f7f5b000640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7f380b52d0 0x7f7f380b7790 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7f44005fd0 tx=0x7f7f4400b4a0 comp rx=0 tx=0).stop 2024-09-11T01:00:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:57.658+0000 7f7f5b000640 1 -- 172.21.15.103:0/3164961651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f5410a9b0 msgr2=0x7f7f5419c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:00:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:57.658+0000 7f7f5b000640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f5410a9b0 0x7f7f5419c2b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c005fd0 tx=0x7f7f4c00ef10 comp rx=0 tx=0).stop 2024-09-11T01:00:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:57.658+0000 7f7f5b000640 1 -- 172.21.15.103:0/3164961651 shutdown_connections 2024-09-11T01:00:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:57.658+0000 7f7f5b000640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7f380b52d0 0x7f7f380b7790 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:57.658+0000 7f7f5b000640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f5410a9b0 0x7f7f5419c2b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:57.658+0000 7f7f5b000640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7f54076f20 0x7f7f5419b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:57.658+0000 7f7f5b000640 1 --2- 172.21.15.103:0/3164961651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f54075ac0 0x7f7f5419b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:00:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:57.658+0000 7f7f5b000640 1 -- 172.21.15.103:0/3164961651 >> 172.21.15.103:0/3164961651 conn(0x7f7f540fe2f0 msgr2=0x7f7f540fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:00:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:57.658+0000 7f7f5b000640 1 -- 172.21.15.103:0/3164961651 shutdown_connections 2024-09-11T01:00:57.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:00:57.659+0000 7f7f5b000640 1 -- 172.21.15.103:0/3164961651 wait complete. 2024-09-11T01:00:58.405 DEBUG:teuthology.orchestra.run.smithi103:osd.3> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.3.service 2024-09-11T01:00:58.410 INFO:tasks.cephadm:Deploying osd.4 on smithi117 with /dev/vg_nvme/lv_3... 2024-09-11T01:00:58.410 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T01:00:58.633 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:58 smithi103 ceph-mon[30562]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:58.634 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:58 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:58.634 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:58 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:58.634 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:58 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:58.634 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:00:58 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3[53918]: 2024-09-11T01:00:58.524+0000 7f511003a640 -1 osd.3 0 log_to_monitors true 2024-09-11T01:00:58.666 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T01:00:58.786 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:58 smithi117 ceph-mon[35358]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:58.786 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:58 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:58.786 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:58 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:58.786 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:58 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:58 smithi183 ceph-mon[34992]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:00:58.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:58 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:00:58.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:58 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:58.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:58 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:00:59.806 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:00:59 smithi117 ceph-mon[35358]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-11T01:00:59.818 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:00:59 smithi103 ceph-mon[30562]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-11T01:00:59.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:00:59 smithi183 ceph-mon[34992]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-11T01:01:00.581 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:00 smithi103 ceph-mon[30562]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:01:00.581 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:00 smithi103 ceph-mon[30562]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T01:01:00.581 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:00 smithi103 ceph-mon[30562]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T01:01:00.581 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:00 smithi103 ceph-mon[30562]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T01:01:00.581 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:00 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:01:00.806 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:00 smithi117 ceph-mon[35358]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:01:00.807 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:00 smithi117 ceph-mon[35358]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T01:01:00.807 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:00 smithi117 ceph-mon[35358]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T01:01:00.807 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:00 smithi117 ceph-mon[35358]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T01:01:00.807 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:00 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:01:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:00 smithi183 ceph-mon[34992]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:01:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:00 smithi183 ceph-mon[34992]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-11T01:01:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:00 smithi183 ceph-mon[34992]: osdmap e24: 4 total, 3 up, 4 in 2024-09-11T01:01:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:00 smithi183 ceph-mon[34992]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T01:01:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:00 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:01:01.003 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T01:01:01.028 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_3 2024-09-11T01:01:01.281 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T01:01:01.574 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:01:01 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3[53918]: 2024-09-11T01:01:01.317+0000 7f510b200640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T01:01:01.575 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:01:01 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3[53918]: 2024-09-11T01:01:01.343+0000 7f5100800640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:01:01.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:01 smithi103 ceph-mon[30562]: purged_snaps scrub starts 2024-09-11T01:01:01.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:01 smithi103 ceph-mon[30562]: purged_snaps scrub ok 2024-09-11T01:01:01.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:01 smithi103 ceph-mon[30562]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-11T01:01:01.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:01 smithi103 ceph-mon[30562]: osdmap e25: 4 total, 3 up, 4 in 2024-09-11T01:01:01.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:01 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:01:01.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:01 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:01:01.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:01 smithi103 ceph-mon[30562]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' 2024-09-11T01:01:01.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:01 smithi103 ceph-mon[30562]: osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162] boot 2024-09-11T01:01:01.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:01 smithi103 ceph-mon[30562]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T01:01:01.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:01 smithi117 ceph-mon[35358]: purged_snaps scrub starts 2024-09-11T01:01:01.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:01 smithi117 ceph-mon[35358]: purged_snaps scrub ok 2024-09-11T01:01:01.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:01 smithi117 ceph-mon[35358]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-11T01:01:01.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:01 smithi117 ceph-mon[35358]: osdmap e25: 4 total, 3 up, 4 in 2024-09-11T01:01:01.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:01 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:01:01.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:01 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:01:01.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:01 smithi117 ceph-mon[35358]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' 2024-09-11T01:01:01.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:01 smithi117 ceph-mon[35358]: osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162] boot 2024-09-11T01:01:01.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:01 smithi117 ceph-mon[35358]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T01:01:01.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.736+0000 7f3cb50dc640 1 -- 172.21.15.117:0/3647580729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb01028f0 msgr2=0x7f3cb0102d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:01.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.736+0000 7f3cb50dc640 1 --2- 172.21.15.117:0/3647580729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb01028f0 0x7f3cb0102d70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3c98009900 tx=0x7f3c9802a410 comp rx=0 tx=0).stop 2024-09-11T01:01:01.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.736+0000 7f3cb50dc640 1 -- 172.21.15.117:0/3647580729 shutdown_connections 2024-09-11T01:01:01.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.736+0000 7f3cb50dc640 1 --2- 172.21.15.117:0/3647580729 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb0103460 0x7f3cb0109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:01.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.736+0000 7f3cb50dc640 1 --2- 172.21.15.117:0/3647580729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb01028f0 0x7f3cb0102d70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:01.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.736+0000 7f3cb50dc640 1 --2- 172.21.15.117:0/3647580729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb0101fb0 0x7f3cb01023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:01.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.736+0000 7f3cb50dc640 1 -- 172.21.15.117:0/3647580729 >> 172.21.15.117:0/3647580729 conn(0x7f3cb00fc9b0 msgr2=0x7f3cb00fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:01:01.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.736+0000 7f3cb50dc640 1 -- 172.21.15.117:0/3647580729 shutdown_connections 2024-09-11T01:01:01.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.736+0000 7f3cb50dc640 1 -- 172.21.15.117:0/3647580729 wait complete. 2024-09-11T01:01:01.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.737+0000 7f3cb50dc640 1 Processor -- start 2024-09-11T01:01:01.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.737+0000 7f3cb50dc640 1 -- start start 2024-09-11T01:01:01.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.737+0000 7f3cb50dc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb0101fb0 0x7f3cb0198e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:01.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.737+0000 7f3cb50dc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb01028f0 0x7f3cb0199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:01.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.737+0000 7f3cb50dc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb0103460 0x7f3cb019a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:01.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.737+0000 7f3cb50dc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb010d630 con 0x7f3cb0103460 2024-09-11T01:01:01.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.737+0000 7f3cb50dc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb010d4b0 con 0x7f3cb01028f0 2024-09-11T01:01:01.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.737+0000 7f3cb50dc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb010d7b0 con 0x7f3cb0101fb0 2024-09-11T01:01:01.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3ca7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb01028f0 0x7f3cb0199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:01.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3ca7fff640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb01028f0 0x7f3cb0199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:46846/0 (socket says 172.21.15.117:46846) 2024-09-11T01:01:01.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3ca7fff640 1 -- 172.21.15.117:0/506135533 learned_addr learned my addr 172.21.15.117:0/506135533 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-11T01:01:01.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3caed9d640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb0101fb0 0x7f3cb0198e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:01.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3caf59e640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb0103460 0x7f3cb019a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:01.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3ca7fff640 1 -- 172.21.15.117:0/506135533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb0101fb0 msgr2=0x7f3cb0198e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:01.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3ca7fff640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb0101fb0 0x7f3cb0198e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:01.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3ca7fff640 1 -- 172.21.15.117:0/506135533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb0103460 msgr2=0x7f3cb019a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:01.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3ca7fff640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb0103460 0x7f3cb019a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:01.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3ca7fff640 1 -- 172.21.15.117:0/506135533 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb019a970 con 0x7f3cb01028f0 2024-09-11T01:01:01.747 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3caed9d640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb0101fb0 0x7f3cb0198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:01:01.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3caf59e640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb0103460 0x7f3cb019a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:01:01.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3ca7fff640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb01028f0 0x7f3cb0199490 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3c98031490 tx=0x7f3c98032b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:01:01.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3cacd99640 1 -- 172.21.15.117:0/506135533 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9803f030 con 0x7f3cb01028f0 2024-09-11T01:01:01.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3cacd99640 1 -- 172.21.15.117:0/506135533 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c98003aa0 con 0x7f3cb01028f0 2024-09-11T01:01:01.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3cacd99640 1 -- 172.21.15.117:0/506135533 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c98035070 con 0x7f3cb01028f0 2024-09-11T01:01:01.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3cb50dc640 1 -- 172.21.15.117:0/506135533 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb019ac00 con 0x7f3cb01028f0 2024-09-11T01:01:01.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.738+0000 7f3cb50dc640 1 -- 172.21.15.117:0/506135533 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb01a1170 con 0x7f3cb01028f0 2024-09-11T01:01:01.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.740+0000 7f3cb50dc640 1 -- 172.21.15.117:0/506135533 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb01a13a0 con 0x7f3cb01028f0 2024-09-11T01:01:01.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.741+0000 7f3cacd99640 1 -- 172.21.15.117:0/506135533 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f3c9803bbb0 con 0x7f3cb01028f0 2024-09-11T01:01:01.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.742+0000 7f3cacd99640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3c9c0b52e0 0x7f3c9c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:01.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.742+0000 7f3cacd99640 1 -- 172.21.15.117:0/506135533 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3702+0+0 (secure 0 0 0) 0x7f3c98105360 con 0x7f3cb01028f0 2024-09-11T01:01:01.748 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.742+0000 7f3caed9d640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3c9c0b52e0 0x7f3c9c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:01.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.743+0000 7f3caed9d640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3c9c0b52e0 0x7f3c9c0b77a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009930 tx=0x7f3ca0008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:01:01.749 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.746+0000 7f3cacd99640 1 -- 172.21.15.117:0/506135533 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3c980cd420 con 0x7f3cb01028f0 2024-09-11T01:01:01.816 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:01 smithi183 ceph-mon[34992]: purged_snaps scrub starts 2024-09-11T01:01:01.816 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:01 smithi183 ceph-mon[34992]: purged_snaps scrub ok 2024-09-11T01:01:01.816 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:01 smithi183 ceph-mon[34992]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-11T01:01:01.816 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:01 smithi183 ceph-mon[34992]: osdmap e25: 4 total, 3 up, 4 in 2024-09-11T01:01:01.816 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:01 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:01:01.817 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:01 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:01:01.817 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:01 smithi183 ceph-mon[34992]: from='osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162]' entity='osd.3' 2024-09-11T01:01:01.817 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:01 smithi183 ceph-mon[34992]: osd.3 [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162] boot 2024-09-11T01:01:01.817 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:01 smithi183 ceph-mon[34992]: osdmap e26: 4 total, 4 up, 4 in 2024-09-11T01:01:01.945 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:01.943+0000 7f3cb50dc640 1 -- 172.21.15.117:0/506135533 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3cb00feab0 con 0x7f3c9c0b52e0 2024-09-11T01:01:02.615 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:02 smithi117 ceph-mon[35358]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:01:02.615 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:01:02.615 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:01:02.615 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:01:02.615 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:02.615 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:02 smithi117 ceph-mon[35358]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T01:01:02.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:02 smithi103 ceph-mon[30562]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:01:02.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:01:02.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:01:02.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:01:02.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:02.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:02 smithi103 ceph-mon[30562]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T01:01:02.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:02 smithi183 ceph-mon[34992]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-11T01:01:02.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-11T01:01:02.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:01:02.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:01:02.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:02.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:02 smithi183 ceph-mon[34992]: osdmap e27: 4 total, 4 up, 4 in 2024-09-11T01:01:03.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:03 smithi117 ceph-mon[35358]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:01:03.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:03 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:03.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:03 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:03.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:03 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:03.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:03 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:03.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:03 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:03.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:03 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:03.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:03 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:03.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:03 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:03.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:03 smithi117 ceph-mon[35358]: osdmap e28: 4 total, 4 up, 4 in 2024-09-11T01:01:03.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:03 smithi103 ceph-mon[30562]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:01:03.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:03 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:03.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:03 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:03.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:03 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:03.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:03 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:03.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:03 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:03.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:03 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:03.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:03 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:03.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:03 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:03.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:03 smithi103 ceph-mon[30562]: osdmap e28: 4 total, 4 up, 4 in 2024-09-11T01:01:03.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:03 smithi183 ceph-mon[34992]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:01:03.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:03 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:03.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:03 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:03.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:03 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:03.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:03 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:03.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:03 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:03.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:03 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:03.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:03 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:03.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:03 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:03.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:03 smithi183 ceph-mon[34992]: osdmap e28: 4 total, 4 up, 4 in 2024-09-11T01:01:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:04 smithi103 ceph-mon[30562]: Detected new or changed devices on smithi103 2024-09-11T01:01:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:04 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi103 to 8544M 2024-09-11T01:01:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:04 smithi103 ceph-mon[30562]: pgmap v120: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:04 smithi103 ceph-mon[30562]: from='client.? 172.21.15.117:0/3501228698' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "be86a5d2-5e86-4bf4-8464-9dff7a801e4e"} : dispatch 2024-09-11T01:01:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:04 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "be86a5d2-5e86-4bf4-8464-9dff7a801e4e"} : dispatch 2024-09-11T01:01:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:04 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be86a5d2-5e86-4bf4-8464-9dff7a801e4e"}]': finished 2024-09-11T01:01:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:04 smithi103 ceph-mon[30562]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T01:01:04.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:04 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:04.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:04 smithi117 ceph-mon[35358]: Detected new or changed devices on smithi103 2024-09-11T01:01:04.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:04 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi103 to 8544M 2024-09-11T01:01:04.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:04 smithi117 ceph-mon[35358]: pgmap v120: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:04.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:04 smithi117 ceph-mon[35358]: from='client.? 172.21.15.117:0/3501228698' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "be86a5d2-5e86-4bf4-8464-9dff7a801e4e"} : dispatch 2024-09-11T01:01:04.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:04 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "be86a5d2-5e86-4bf4-8464-9dff7a801e4e"} : dispatch 2024-09-11T01:01:04.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:04 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be86a5d2-5e86-4bf4-8464-9dff7a801e4e"}]': finished 2024-09-11T01:01:04.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:04 smithi117 ceph-mon[35358]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T01:01:04.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:04 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:04 smithi183 ceph-mon[34992]: Detected new or changed devices on smithi103 2024-09-11T01:01:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:04 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi103 to 8544M 2024-09-11T01:01:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:04 smithi183 ceph-mon[34992]: pgmap v120: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:04.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:04 smithi183 ceph-mon[34992]: from='client.? 172.21.15.117:0/3501228698' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "be86a5d2-5e86-4bf4-8464-9dff7a801e4e"} : dispatch 2024-09-11T01:01:04.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:04 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "be86a5d2-5e86-4bf4-8464-9dff7a801e4e"} : dispatch 2024-09-11T01:01:04.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:04 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be86a5d2-5e86-4bf4-8464-9dff7a801e4e"}]': finished 2024-09-11T01:01:04.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:04 smithi183 ceph-mon[34992]: osdmap e29: 5 total, 4 up, 5 in 2024-09-11T01:01:04.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:04 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:05.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:05 smithi103 ceph-mon[30562]: from='client.? 172.21.15.117:0/1296119529' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:01:05.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:05 smithi117 ceph-mon[35358]: from='client.? 172.21.15.117:0/1296119529' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:01:05.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:05 smithi183 ceph-mon[34992]: from='client.? 172.21.15.117:0/1296119529' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:01:06.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:06 smithi103 ceph-mon[30562]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:06.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:06 smithi117 ceph-mon[35358]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:06.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:06 smithi183 ceph-mon[34992]: pgmap v122: 1 pgs: 1 peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:08.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:08 smithi103 ceph-mon[30562]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:08.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:08 smithi117 ceph-mon[35358]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:08.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:08 smithi183 ceph-mon[34992]: pgmap v123: 1 pgs: 1 peering; 577 KiB data, 121 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:09.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:09 smithi103 ceph-mon[30562]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-11T01:01:09.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:09 smithi117 ceph-mon[35358]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-11T01:01:09.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:09 smithi183 ceph-mon[34992]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-11T01:01:12.684 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:12 smithi117 ceph-mon[35358]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-11T01:01:12.684 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-11T01:01:12.684 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:12.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:12 smithi103 ceph-mon[30562]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-11T01:01:12.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-11T01:01:12.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:12 smithi183 ceph-mon[34992]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-11T01:01:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-11T01:01:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:13.789 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:13 smithi117 ceph-mon[35358]: Deploying daemon osd.4 on smithi117 2024-09-11T01:01:13.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:13 smithi103 ceph-mon[30562]: Deploying daemon osd.4 on smithi117 2024-09-11T01:01:13.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:13 smithi183 ceph-mon[34992]: Deploying daemon osd.4 on smithi117 2024-09-11T01:01:14.824 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:14 smithi117 ceph-mon[35358]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:01:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:14 smithi103 ceph-mon[30562]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:01:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:14 smithi183 ceph-mon[34992]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:01:16.775 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:16 smithi117 ceph-mon[35358]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-11T01:01:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:16 smithi103 ceph-mon[30562]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-11T01:01:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:16 smithi183 ceph-mon[34992]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-11T01:01:18.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:18 smithi103 ceph-mon[30562]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T01:01:18.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:01:18.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:18.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:18.833 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:18 smithi117 ceph-mon[35358]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T01:01:18.833 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:01:18.833 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:18.833 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:18 smithi183 ceph-mon[34992]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T01:01:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:01:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:20.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:20 smithi103 ceph-mon[30562]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T01:01:20.843 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:20 smithi117 ceph-mon[35358]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T01:01:20.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:20 smithi183 ceph-mon[34992]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T01:01:22.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:21 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:22.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:21 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:22.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:21 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:22.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:21 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:22.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:21 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:22.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:21 smithi103 ceph-mon[30562]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:22.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:21 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:22.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:21 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:22.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:21 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:22.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:21 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:22.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:21 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:22.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:21 smithi117 ceph-mon[35358]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:22.414 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:22.412+0000 7f3cacd99640 1 -- 172.21.15.117:0/506135533 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3cb00feab0 con 0x7f3c9c0b52e0 2024-09-11T01:01:22.415 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 4 on host 'smithi117' 2024-09-11T01:01:22.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:22.415+0000 7f3cb50dc640 1 -- 172.21.15.117:0/506135533 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3c9c0b52e0 msgr2=0x7f3c9c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:22.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:22.415+0000 7f3cb50dc640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3c9c0b52e0 0x7f3c9c0b77a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0009930 tx=0x7f3ca0008040 comp rx=0 tx=0).stop 2024-09-11T01:01:22.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:22.415+0000 7f3cb50dc640 1 -- 172.21.15.117:0/506135533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb01028f0 msgr2=0x7f3cb0199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:22.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:22.415+0000 7f3cb50dc640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb01028f0 0x7f3cb0199490 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3c98031490 tx=0x7f3c98032b90 comp rx=0 tx=0).stop 2024-09-11T01:01:22.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:22.415+0000 7f3cb50dc640 1 -- 172.21.15.117:0/506135533 shutdown_connections 2024-09-11T01:01:22.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:22.415+0000 7f3cb50dc640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3c9c0b52e0 0x7f3c9c0b77a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:22.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:22.415+0000 7f3cb50dc640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb0103460 0x7f3cb019a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:22.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:22.415+0000 7f3cb50dc640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb01028f0 0x7f3cb0199490 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:22.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:22.415+0000 7f3cb50dc640 1 --2- 172.21.15.117:0/506135533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb0101fb0 0x7f3cb0198e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:22.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:22.415+0000 7f3cb50dc640 1 -- 172.21.15.117:0/506135533 >> 172.21.15.117:0/506135533 conn(0x7f3cb00fc9b0 msgr2=0x7f3cb00fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:01:22.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:22.415+0000 7f3cb50dc640 1 -- 172.21.15.117:0/506135533 shutdown_connections 2024-09-11T01:01:22.417 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:01:22.415+0000 7f3cb50dc640 1 -- 172.21.15.117:0/506135533 wait complete. 2024-09-11T01:01:22.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:21 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:22.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:21 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:22.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:21 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:22.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:21 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:22.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:21 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:22.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:21 smithi183 ceph-mon[34992]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:23.060 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:23 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:01:23.061 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:23 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:23.061 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:23 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:23.085 DEBUG:teuthology.orchestra.run.smithi117:osd.4> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.4.service 2024-09-11T01:01:23.088 INFO:tasks.cephadm:Deploying osd.5 on smithi183 with /dev/vg_nvme/lv_3... 2024-09-11T01:01:23.088 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-11T01:01:23.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:01:23.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:23.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:23.345 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T01:01:23.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:01:23.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:23.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:24.279 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:24 smithi117 ceph-mon[35358]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:24.280 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:01:24 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4[46606]: 2024-09-11T01:01:24.201+0000 7f61033db640 -1 osd.4 0 log_to_monitors true 2024-09-11T01:01:24.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:24 smithi103 ceph-mon[30562]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:24.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:24 smithi183 ceph-mon[34992]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:25.281 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:25 smithi183 ceph-mon[34992]: from='osd.4 [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T01:01:25.281 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:25 smithi183 ceph-mon[34992]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T01:01:25.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:25 smithi103 ceph-mon[30562]: from='osd.4 [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T01:01:25.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:25 smithi103 ceph-mon[30562]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T01:01:25.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:25 smithi117 ceph-mon[35358]: from='osd.4 [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T01:01:25.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:25 smithi117 ceph-mon[35358]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-11T01:01:25.966 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T01:01:25.996 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_3 2024-09-11T01:01:26.253 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T01:01:26.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:26 smithi103 ceph-mon[30562]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T01:01:26.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:26 smithi103 ceph-mon[30562]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T01:01:26.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:26.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:26 smithi103 ceph-mon[30562]: from='osd.4 [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:01:26.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:26 smithi103 ceph-mon[30562]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:01:26.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:26 smithi103 ceph-mon[30562]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:26.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:26.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:26.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:26.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:26.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:26.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:26.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:26.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:26.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-mon[35358]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T01:01:26.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-mon[35358]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T01:01:26.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:26.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-mon[35358]: from='osd.4 [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:01:26.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-mon[35358]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:01:26.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-mon[35358]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:26.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:26.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:26.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:26.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:26.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:26.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:26.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:26.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:26.374 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:26 smithi183 ceph-mon[34992]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-11T01:01:26.374 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:26 smithi183 ceph-mon[34992]: osdmap e30: 5 total, 4 up, 5 in 2024-09-11T01:01:26.374 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:26.374 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:26 smithi183 ceph-mon[34992]: from='osd.4 [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:01:26.374 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:26 smithi183 ceph-mon[34992]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:01:26.374 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:26 smithi183 ceph-mon[34992]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:26.375 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:26.375 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:26.375 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:26.375 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:26.375 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:26.375 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:26.375 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:26.375 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:26.733 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.729+0000 7fb63462f640 1 -- 172.21.15.183:0/3729499808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb62c103b90 msgr2=0x7fb62c104010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:26.733 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.729+0000 7fb63462f640 1 --2- 172.21.15.183:0/3729499808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb62c103b90 0x7fb62c104010 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb620009d00 tx=0x7fb62002a910 comp rx=0 tx=0).stop 2024-09-11T01:01:26.734 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.729+0000 7fb63462f640 1 -- 172.21.15.183:0/3729499808 shutdown_connections 2024-09-11T01:01:26.734 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.729+0000 7fb63462f640 1 --2- 172.21.15.183:0/3729499808 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c104550 0x7fb62c10aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:26.734 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.729+0000 7fb63462f640 1 --2- 172.21.15.183:0/3729499808 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb62c103b90 0x7fb62c104010 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:26.734 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.729+0000 7fb63462f640 1 --2- 172.21.15.183:0/3729499808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c102a30 0x7fb62c102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:26.734 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.729+0000 7fb63462f640 1 -- 172.21.15.183:0/3729499808 >> 172.21.15.183:0/3729499808 conn(0x7fb62c0fe320 msgr2=0x7fb62c100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:01:26.734 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.729+0000 7fb63462f640 1 -- 172.21.15.183:0/3729499808 shutdown_connections 2024-09-11T01:01:26.734 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.729+0000 7fb63462f640 1 -- 172.21.15.183:0/3729499808 wait complete. 2024-09-11T01:01:26.734 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb63462f640 1 Processor -- start 2024-09-11T01:01:26.734 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb63462f640 1 -- start start 2024-09-11T01:01:26.734 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb63462f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c102a30 0x7fb62c198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:26.734 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb63462f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb62c103b90 0x7fb62c199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:26.734 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb63462f640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c104550 0x7fb62c19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:26.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb63462f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c10e6b0 con 0x7fb62c102a30 2024-09-11T01:01:26.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb63462f640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c10e530 con 0x7fb62c104550 2024-09-11T01:01:26.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb63462f640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb62c10e830 con 0x7fb62c103b90 2024-09-11T01:01:26.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb631bca640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb62c103b90 0x7fb62c199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:26.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb631bca640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb62c103b90 0x7fb62c199450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:42712/0 (socket says 172.21.15.183:42712) 2024-09-11T01:01:26.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb631bca640 1 -- 172.21.15.183:0/3685242426 learned_addr learned my addr 172.21.15.183:0/3685242426 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-09-11T01:01:26.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb632bcc640 1 --2- 172.21.15.183:0/3685242426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c104550 0x7fb62c19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:26.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb6323cb640 1 --2- 172.21.15.183:0/3685242426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c102a30 0x7fb62c198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:26.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb631bca640 1 -- 172.21.15.183:0/3685242426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c104550 msgr2=0x7fb62c19a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:26.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb631bca640 1 --2- 172.21.15.183:0/3685242426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c104550 0x7fb62c19a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:26.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb631bca640 1 -- 172.21.15.183:0/3685242426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c102a30 msgr2=0x7fb62c198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:26.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb631bca640 1 --2- 172.21.15.183:0/3685242426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c102a30 0x7fb62c198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:26.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.730+0000 7fb631bca640 1 -- 172.21.15.183:0/3685242426 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62c19a930 con 0x7fb62c103b90 2024-09-11T01:01:26.735 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.731+0000 7fb631bca640 1 --2- 172.21.15.183:0/3685242426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb62c103b90 0x7fb62c199450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb620009430 tx=0x7fb620003c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:01:26.736 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.731+0000 7fb62b7fe640 1 -- 172.21.15.183:0/3685242426 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6200307d0 con 0x7fb62c103b90 2024-09-11T01:01:26.736 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.731+0000 7fb62b7fe640 1 -- 172.21.15.183:0/3685242426 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb620003e40 con 0x7fb62c103b90 2024-09-11T01:01:26.736 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.731+0000 7fb63462f640 1 -- 172.21.15.183:0/3685242426 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb62c19abc0 con 0x7fb62c103b90 2024-09-11T01:01:26.736 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.731+0000 7fb62b7fe640 1 -- 172.21.15.183:0/3685242426 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62002fce0 con 0x7fb62c103b90 2024-09-11T01:01:26.736 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.731+0000 7fb63462f640 1 -- 172.21.15.183:0/3685242426 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb62c1a1300 con 0x7fb62c103b90 2024-09-11T01:01:26.737 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.732+0000 7fb63462f640 1 -- 172.21.15.183:0/3685242426 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb62c109db0 con 0x7fb62c103b90 2024-09-11T01:01:26.737 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.733+0000 7fb62b7fe640 1 -- 172.21.15.183:0/3685242426 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fb620030970 con 0x7fb62c103b90 2024-09-11T01:01:26.737 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.734+0000 7fb62b7fe640 1 --2- 172.21.15.183:0/3685242426 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb6140b52e0 0x7fb6140b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:26.737 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.734+0000 7fb62b7fe640 1 -- 172.21.15.183:0/3685242426 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7fb620106260 con 0x7fb62c103b90 2024-09-11T01:01:26.737 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.734+0000 7fb6323cb640 1 --2- 172.21.15.183:0/3685242426 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb6140b52e0 0x7fb6140b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:26.737 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.735+0000 7fb6323cb640 1 --2- 172.21.15.183:0/3685242426 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb6140b52e0 0x7fb6140b77a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00bbe0 tx=0x7fb61c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:01:26.739 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.737+0000 7fb62b7fe640 1 -- 172.21.15.183:0/3685242426 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb6200ce290 con 0x7fb62c103b90 2024-09-11T01:01:26.872 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4[46606]: 2024-09-11T01:01:26.720+0000 7f60ff35e640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T01:01:26.873 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:01:26 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4[46606]: 2024-09-11T01:01:26.725+0000 7f60f717d640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:01:26.921 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:26.919+0000 7fb63462f640 1 -- 172.21.15.183:0/3685242426 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb62c063590 con 0x7fb6140b52e0 2024-09-11T01:01:27.329 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:27 smithi183 ceph-mon[34992]: Detected new or changed devices on smithi117 2024-09-11T01:01:27.329 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:27 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi117 to 8544M 2024-09-11T01:01:27.329 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:27 smithi183 ceph-mon[34992]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-11T01:01:27.330 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:27 smithi183 ceph-mon[34992]: osdmap e31: 5 total, 4 up, 5 in 2024-09-11T01:01:27.330 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:27 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:27.330 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:27 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:27.330 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:27 smithi183 ceph-mon[34992]: from='osd.4 ' entity='osd.4' 2024-09-11T01:01:27.330 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:27 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:01:27.330 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:27 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:01:27.330 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:27 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:27.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:27 smithi103 ceph-mon[30562]: Detected new or changed devices on smithi117 2024-09-11T01:01:27.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:27 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi117 to 8544M 2024-09-11T01:01:27.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:27 smithi103 ceph-mon[30562]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-11T01:01:27.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:27 smithi103 ceph-mon[30562]: osdmap e31: 5 total, 4 up, 5 in 2024-09-11T01:01:27.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:27 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:27.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:27 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:27.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:27 smithi103 ceph-mon[30562]: from='osd.4 ' entity='osd.4' 2024-09-11T01:01:27.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:27 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:01:27.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:27 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:01:27.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:27 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:27.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:27 smithi117 ceph-mon[35358]: Detected new or changed devices on smithi117 2024-09-11T01:01:27.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:27 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi117 to 8544M 2024-09-11T01:01:27.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:27 smithi117 ceph-mon[35358]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-11T01:01:27.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:27 smithi117 ceph-mon[35358]: osdmap e31: 5 total, 4 up, 5 in 2024-09-11T01:01:27.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:27.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:27.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:27 smithi117 ceph-mon[35358]: from='osd.4 ' entity='osd.4' 2024-09-11T01:01:27.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:01:27.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:01:27.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:28.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:28 smithi103 ceph-mon[30562]: purged_snaps scrub starts 2024-09-11T01:01:28.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:28 smithi103 ceph-mon[30562]: purged_snaps scrub ok 2024-09-11T01:01:28.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:28 smithi103 ceph-mon[30562]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:01:28.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:28 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:28.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:28 smithi103 ceph-mon[30562]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:28.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:28 smithi103 ceph-mon[30562]: osd.4 [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504] boot 2024-09-11T01:01:28.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:28 smithi103 ceph-mon[30562]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T01:01:28.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:28 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:28.347 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:28 smithi183 ceph-mon[34992]: purged_snaps scrub starts 2024-09-11T01:01:28.347 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:28 smithi183 ceph-mon[34992]: purged_snaps scrub ok 2024-09-11T01:01:28.347 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:28 smithi183 ceph-mon[34992]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:01:28.347 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:28 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:28.347 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:28 smithi183 ceph-mon[34992]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:28.347 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:28 smithi183 ceph-mon[34992]: osd.4 [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504] boot 2024-09-11T01:01:28.347 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:28 smithi183 ceph-mon[34992]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T01:01:28.348 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:28 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:28.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:28 smithi117 ceph-mon[35358]: purged_snaps scrub starts 2024-09-11T01:01:28.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:28 smithi117 ceph-mon[35358]: purged_snaps scrub ok 2024-09-11T01:01:28.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:28 smithi117 ceph-mon[35358]: from='client.24361 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:01:28.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:28 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:28.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:28 smithi117 ceph-mon[35358]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-11T01:01:28.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:28 smithi117 ceph-mon[35358]: osd.4 [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504] boot 2024-09-11T01:01:28.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:28 smithi117 ceph-mon[35358]: osdmap e32: 5 total, 5 up, 5 in 2024-09-11T01:01:28.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:28 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-11T01:01:30.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:30 smithi103 ceph-mon[30562]: osdmap e33: 5 total, 5 up, 5 in 2024-09-11T01:01:30.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:30 smithi103 ceph-mon[30562]: from='client.? 172.21.15.183:0/4172257871' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "090b20ec-d9ff-4e10-ad9f-52ab41dbf148"} : dispatch 2024-09-11T01:01:30.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:30 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "090b20ec-d9ff-4e10-ad9f-52ab41dbf148"} : dispatch 2024-09-11T01:01:30.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:30 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "090b20ec-d9ff-4e10-ad9f-52ab41dbf148"}]': finished 2024-09-11T01:01:30.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:30 smithi103 ceph-mon[30562]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T01:01:30.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:30 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:30.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:30 smithi103 ceph-mon[30562]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:30.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:30 smithi103 ceph-mon[30562]: from='client.? 172.21.15.183:0/1263527017' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:01:30.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:30 smithi117 ceph-mon[35358]: osdmap e33: 5 total, 5 up, 5 in 2024-09-11T01:01:30.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:30 smithi117 ceph-mon[35358]: from='client.? 172.21.15.183:0/4172257871' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "090b20ec-d9ff-4e10-ad9f-52ab41dbf148"} : dispatch 2024-09-11T01:01:30.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:30 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "090b20ec-d9ff-4e10-ad9f-52ab41dbf148"} : dispatch 2024-09-11T01:01:30.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:30 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "090b20ec-d9ff-4e10-ad9f-52ab41dbf148"}]': finished 2024-09-11T01:01:30.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:30 smithi117 ceph-mon[35358]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T01:01:30.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:30 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:30.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:30 smithi117 ceph-mon[35358]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:30.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:30 smithi117 ceph-mon[35358]: from='client.? 172.21.15.183:0/1263527017' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:01:30.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:30 smithi183 ceph-mon[34992]: osdmap e33: 5 total, 5 up, 5 in 2024-09-11T01:01:30.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:30 smithi183 ceph-mon[34992]: from='client.? 172.21.15.183:0/4172257871' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "090b20ec-d9ff-4e10-ad9f-52ab41dbf148"} : dispatch 2024-09-11T01:01:30.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:30 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "090b20ec-d9ff-4e10-ad9f-52ab41dbf148"} : dispatch 2024-09-11T01:01:30.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:30 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "090b20ec-d9ff-4e10-ad9f-52ab41dbf148"}]': finished 2024-09-11T01:01:30.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:30 smithi183 ceph-mon[34992]: osdmap e34: 6 total, 5 up, 6 in 2024-09-11T01:01:30.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:30 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:30.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:30 smithi183 ceph-mon[34992]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:30.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:30 smithi183 ceph-mon[34992]: from='client.? 172.21.15.183:0/1263527017' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:01:32.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:32 smithi103 ceph-mon[30562]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:32.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:32 smithi117 ceph-mon[35358]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:32.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:32 smithi183 ceph-mon[34992]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:34.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:34 smithi103 ceph-mon[30562]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:34.862 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:34 smithi183 ceph-mon[34992]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:34.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:34 smithi117 ceph-mon[35358]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:36.587 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:36 smithi183 ceph-mon[34992]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:36.810 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:36 smithi103 ceph-mon[30562]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:36.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:36 smithi117 ceph-mon[35358]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:38.774 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:38 smithi183 ceph-mon[34992]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:38.774 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-11T01:01:38.774 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:38.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:38 smithi103 ceph-mon[30562]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:38.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-11T01:01:38.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:38.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:38 smithi117 ceph-mon[35358]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-11T01:01:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:39.660 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:39 smithi183 ceph-mon[34992]: Deploying daemon osd.5 on smithi183 2024-09-11T01:01:39.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:39 smithi103 ceph-mon[30562]: Deploying daemon osd.5 on smithi183 2024-09-11T01:01:39.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:39 smithi117 ceph-mon[35358]: Deploying daemon osd.5 on smithi183 2024-09-11T01:01:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:40 smithi103 ceph-mon[30562]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:40.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:40 smithi117 ceph-mon[35358]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:40 smithi183 ceph-mon[34992]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:42.626 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:42 smithi183 ceph-mon[34992]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:42 smithi103 ceph-mon[30562]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:42.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:42 smithi117 ceph-mon[35358]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:44.645 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:44 smithi183 ceph-mon[34992]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:44.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:01:44.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:44.646 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:44.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:44 smithi103 ceph-mon[30562]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:44.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:01:44.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:44.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:44.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:44 smithi117 ceph-mon[35358]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:44.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:01:44.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:44.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:46.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:46 smithi103 ceph-mon[30562]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:46.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:46 smithi117 ceph-mon[35358]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:46.877 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:46 smithi183 ceph-mon[34992]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:47.208 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:47.206+0000 7fb62b7fe640 1 -- 172.21.15.183:0/3685242426 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb62c063590 con 0x7fb6140b52e0 2024-09-11T01:01:47.208 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 5 on host 'smithi183' 2024-09-11T01:01:47.210 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:47.208+0000 7fb63462f640 1 -- 172.21.15.183:0/3685242426 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb6140b52e0 msgr2=0x7fb6140b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:47.211 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:47.208+0000 7fb63462f640 1 --2- 172.21.15.183:0/3685242426 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb6140b52e0 0x7fb6140b77a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb61c00bbe0 tx=0x7fb61c00b390 comp rx=0 tx=0).stop 2024-09-11T01:01:47.211 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:47.208+0000 7fb63462f640 1 -- 172.21.15.183:0/3685242426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb62c103b90 msgr2=0x7fb62c199450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:47.211 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:47.208+0000 7fb63462f640 1 --2- 172.21.15.183:0/3685242426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb62c103b90 0x7fb62c199450 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb620009430 tx=0x7fb620003c20 comp rx=0 tx=0).stop 2024-09-11T01:01:47.211 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:47.208+0000 7fb63462f640 1 -- 172.21.15.183:0/3685242426 shutdown_connections 2024-09-11T01:01:47.211 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:47.208+0000 7fb63462f640 1 --2- 172.21.15.183:0/3685242426 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb6140b52e0 0x7fb6140b77a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:47.211 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:47.208+0000 7fb63462f640 1 --2- 172.21.15.183:0/3685242426 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb62c104550 0x7fb62c19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:47.211 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:47.208+0000 7fb63462f640 1 --2- 172.21.15.183:0/3685242426 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb62c103b90 0x7fb62c199450 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:47.211 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:47.208+0000 7fb63462f640 1 --2- 172.21.15.183:0/3685242426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb62c102a30 0x7fb62c198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:47.211 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:47.209+0000 7fb63462f640 1 -- 172.21.15.183:0/3685242426 >> 172.21.15.183:0/3685242426 conn(0x7fb62c0fe320 msgr2=0x7fb62c106f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:01:47.211 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:47.209+0000 7fb63462f640 1 -- 172.21.15.183:0/3685242426 shutdown_connections 2024-09-11T01:01:47.211 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:01:47.209+0000 7fb63462f640 1 -- 172.21.15.183:0/3685242426 wait complete. 2024-09-11T01:01:47.923 DEBUG:teuthology.orchestra.run.smithi183:osd.5> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.5.service 2024-09-11T01:01:47.925 INFO:tasks.cephadm:Deploying osd.6 on smithi103 with /dev/vg_nvme/lv_2... 2024-09-11T01:01:47.925 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T01:01:48.300 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:01:48.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:48.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:48.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:48.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:48.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:48 smithi103 ceph-mon[30562]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:48.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:48.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:48.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:48.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:48.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:48 smithi117 ceph-mon[35358]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:48.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:48.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:48.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:48.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:48.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:48 smithi183 ceph-mon[34992]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:49.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:49 smithi183 ceph-mon[34992]: from='osd.5 [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T01:01:49.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:49 smithi183 ceph-mon[34992]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T01:01:49.669 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:01:49 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5[46826]: 2024-09-11T01:01:49.484+0000 7f1c10dcf640 -1 osd.5 0 log_to_monitors true 2024-09-11T01:01:49.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:49 smithi103 ceph-mon[30562]: from='osd.5 [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T01:01:49.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:49 smithi103 ceph-mon[30562]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T01:01:49.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:49 smithi117 ceph-mon[35358]: from='osd.5 [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T01:01:49.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:49 smithi117 ceph-mon[35358]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-11T01:01:50.778 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:01:50 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5[46826]: 2024-09-11T01:01:50.559+0000 7f1c0cd52640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T01:01:50.778 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:01:50 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5[46826]: 2024-09-11T01:01:50.565+0000 7f1c08b79640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:01:50.778 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:50 smithi183 ceph-mon[34992]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:50.778 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:50 smithi183 ceph-mon[34992]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T01:01:50.778 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:50 smithi183 ceph-mon[34992]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T01:01:50.778 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:50 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:50.779 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:50 smithi183 ceph-mon[34992]: from='osd.5 [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:01:50.779 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:50 smithi183 ceph-mon[34992]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:01:50.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:50 smithi103 ceph-mon[30562]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:50.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:50 smithi103 ceph-mon[30562]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T01:01:50.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:50 smithi103 ceph-mon[30562]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T01:01:50.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:50 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:50.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:50 smithi103 ceph-mon[30562]: from='osd.5 [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:01:50.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:50 smithi103 ceph-mon[30562]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:01:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:50 smithi117 ceph-mon[35358]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:50 smithi117 ceph-mon[35358]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-11T01:01:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:50 smithi117 ceph-mon[35358]: osdmap e35: 6 total, 5 up, 6 in 2024-09-11T01:01:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:50 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:50 smithi117 ceph-mon[35358]: from='osd.5 [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:01:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:50 smithi117 ceph-mon[35358]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:01:51.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-09-11T01:01:51.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T01:01:51.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:51.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:51.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:51.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:51.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:51.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:51.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:51.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:51.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:51.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:51.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:01:51.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:51.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:51.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:51 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:51.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-09-11T01:01:51.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T01:01:51.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:51.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:51.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:51.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:51.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:51.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:51.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:51.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:51.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:51.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:51.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:01:51.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:51.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:51.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:51 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:51.881 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:01:51.914 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_2 2024-09-11T01:01:51.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-09-11T01:01:51.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: osdmap e36: 6 total, 5 up, 6 in 2024-09-11T01:01:51.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:51.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:51.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:51.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:51.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:51.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T01:01:51.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:51.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:51.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:51.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:51.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:01:51.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:51.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:01:51.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:51 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:01:52.282 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:01:52.753 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:52 smithi103 ceph-mon[30562]: purged_snaps scrub starts 2024-09-11T01:01:52.753 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:52 smithi103 ceph-mon[30562]: purged_snaps scrub ok 2024-09-11T01:01:52.754 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:52 smithi103 ceph-mon[30562]: Detected new or changed devices on smithi183 2024-09-11T01:01:52.754 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:52 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi183 to 8544M 2024-09-11T01:01:52.754 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:52 smithi103 ceph-mon[30562]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:52.754 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:52 smithi103 ceph-mon[30562]: osd.5 [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547] boot 2024-09-11T01:01:52.754 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:52 smithi103 ceph-mon[30562]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T01:01:52.754 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:52 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:52.754 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:52 smithi103 ceph-mon[30562]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T01:01:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.864+0000 7ff32e600640 1 -- 172.21.15.103:0/3370622067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3281065c0 msgr2=0x7ff32810cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.864+0000 7ff32e600640 1 --2- 172.21.15.103:0/3370622067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3281065c0 0x7ff32810cf40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff320009930 tx=0x7ff32002a420 comp rx=0 tx=0).stop 2024-09-11T01:01:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.864+0000 7ff32e600640 1 -- 172.21.15.103:0/3370622067 shutdown_connections 2024-09-11T01:01:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.864+0000 7ff32e600640 1 --2- 172.21.15.103:0/3370622067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3281065c0 0x7ff32810cf40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.864+0000 7ff32e600640 1 --2- 172.21.15.103:0/3370622067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff328105c00 0x7ff328106080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.864+0000 7ff32e600640 1 --2- 172.21.15.103:0/3370622067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff328104aa0 0x7ff328104ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.864+0000 7ff32e600640 1 -- 172.21.15.103:0/3370622067 >> 172.21.15.103:0/3370622067 conn(0x7ff328100370 msgr2=0x7ff3281027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:01:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.864+0000 7ff32e600640 1 -- 172.21.15.103:0/3370622067 shutdown_connections 2024-09-11T01:01:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.864+0000 7ff32e600640 1 -- 172.21.15.103:0/3370622067 wait complete. 2024-09-11T01:01:52.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.865+0000 7ff32e600640 1 Processor -- start 2024-09-11T01:01:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.866+0000 7ff32e600640 1 -- start start 2024-09-11T01:01:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.866+0000 7ff32e600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff328104aa0 0x7ff32819ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.866+0000 7ff32e600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff328105c00 0x7ff32819b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.866+0000 7ff32e600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3281065c0 0x7ff32819bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.866+0000 7ff32e600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff328110770 con 0x7ff328104aa0 2024-09-11T01:01:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.866+0000 7ff32e600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff3281105f0 con 0x7ff328105c00 2024-09-11T01:01:52.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.866+0000 7ff32e600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff3281108f0 con 0x7ff3281065c0 2024-09-11T01:01:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.866+0000 7ff32d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff328104aa0 0x7ff32819ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:52.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.866+0000 7ff32d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff328104aa0 0x7ff32819ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44204/0 (socket says 172.21.15.103:44204) 2024-09-11T01:01:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.866+0000 7ff31fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff328105c00 0x7ff32819b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.866+0000 7ff32d200640 1 -- 172.21.15.103:0/572765861 learned_addr learned my addr 172.21.15.103:0/572765861 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:01:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.867+0000 7ff32dc00640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3281065c0 0x7ff32819bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.867+0000 7ff31fe00640 1 -- 172.21.15.103:0/572765861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3281065c0 msgr2=0x7ff32819bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.867+0000 7ff31fe00640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3281065c0 0x7ff32819bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.867+0000 7ff31fe00640 1 -- 172.21.15.103:0/572765861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff328104aa0 msgr2=0x7ff32819ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:01:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.867+0000 7ff31fe00640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff328104aa0 0x7ff32819ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:01:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.867+0000 7ff31fe00640 1 -- 172.21.15.103:0/572765861 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32819c830 con 0x7ff328105c00 2024-09-11T01:01:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.867+0000 7ff32dc00640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3281065c0 0x7ff32819bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:01:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.867+0000 7ff32d200640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff328104aa0 0x7ff32819ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:01:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.867+0000 7ff31fe00640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff328105c00 0x7ff32819b3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff31000e9f0 tx=0x7ff31000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:01:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.867+0000 7ff326000640 1 -- 172.21.15.103:0/572765861 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31000ccc0 con 0x7ff328105c00 2024-09-11T01:01:52.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.867+0000 7ff326000640 1 -- 172.21.15.103:0/572765861 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3100108e0 con 0x7ff328105c00 2024-09-11T01:01:52.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.867+0000 7ff32e600640 1 -- 172.21.15.103:0/572765861 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32819cb20 con 0x7ff328105c00 2024-09-11T01:01:52.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.867+0000 7ff326000640 1 -- 172.21.15.103:0/572765861 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff310018880 con 0x7ff328105c00 2024-09-11T01:01:52.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.868+0000 7ff32e600640 1 -- 172.21.15.103:0/572765861 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3281a3200 con 0x7ff328105c00 2024-09-11T01:01:52.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.868+0000 7ff32e600640 1 -- 172.21.15.103:0/572765861 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff32810bd30 con 0x7ff328105c00 2024-09-11T01:01:52.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:52 smithi117 ceph-mon[35358]: purged_snaps scrub starts 2024-09-11T01:01:52.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:52 smithi117 ceph-mon[35358]: purged_snaps scrub ok 2024-09-11T01:01:52.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:52 smithi117 ceph-mon[35358]: Detected new or changed devices on smithi183 2024-09-11T01:01:52.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:52 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi183 to 8544M 2024-09-11T01:01:52.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:52 smithi117 ceph-mon[35358]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:52.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:52 smithi117 ceph-mon[35358]: osd.5 [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547] boot 2024-09-11T01:01:52.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:52 smithi117 ceph-mon[35358]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T01:01:52.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:52 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:52.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:52 smithi117 ceph-mon[35358]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T01:01:52.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.871+0000 7ff326000640 1 -- 172.21.15.103:0/572765861 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7ff310010430 con 0x7ff328105c00 2024-09-11T01:01:52.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.872+0000 7ff326000640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff30c0b5410 0x7ff30c0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:01:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.872+0000 7ff326000640 1 -- 172.21.15.103:0/572765861 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4533+0+0 (secure 0 0 0) 0x7ff3100e5130 con 0x7ff328105c00 2024-09-11T01:01:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.872+0000 7ff32d200640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff30c0b5410 0x7ff30c0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:01:52.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.873+0000 7ff32d200640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff30c0b5410 0x7ff30c0b78d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff3180049d0 tx=0x7ff318009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:01:52.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:52.874+0000 7ff326000640 1 -- 172.21.15.103:0/572765861 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff3100ace10 con 0x7ff328105c00 2024-09-11T01:01:52.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:52 smithi183 ceph-mon[34992]: purged_snaps scrub starts 2024-09-11T01:01:52.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:52 smithi183 ceph-mon[34992]: purged_snaps scrub ok 2024-09-11T01:01:52.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:52 smithi183 ceph-mon[34992]: Detected new or changed devices on smithi183 2024-09-11T01:01:52.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:52 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi183 to 8544M 2024-09-11T01:01:52.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:52 smithi183 ceph-mon[34992]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-11T01:01:52.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:52 smithi183 ceph-mon[34992]: osd.5 [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547] boot 2024-09-11T01:01:52.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:52 smithi183 ceph-mon[34992]: osdmap e37: 6 total, 6 up, 6 in 2024-09-11T01:01:52.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:52 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-11T01:01:52.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:52 smithi183 ceph-mon[34992]: osdmap e38: 6 total, 6 up, 6 in 2024-09-11T01:01:53.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:01:53.067+0000 7ff32e600640 1 -- 172.21.15.103:0/572765861 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff328063590 con 0x7ff30c0b5410 2024-09-11T01:01:53.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:01:53.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:01:53.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:53.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:53 smithi103 ceph-mon[30562]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T01:01:53.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:01:53.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:01:53.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:53.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:53 smithi117 ceph-mon[35358]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T01:01:53.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:01:53.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:01:53.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:01:53.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:53 smithi183 ceph-mon[34992]: osdmap e39: 6 total, 6 up, 6 in 2024-09-11T01:01:54.820 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:54 smithi183 ceph-mon[34992]: from='client.24404 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:01:54.820 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:54 smithi183 ceph-mon[34992]: pgmap v156: 1 pgs: 1 activating+degraded; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T01:01:54.820 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:54 smithi183 ceph-mon[34992]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-11T01:01:54.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:54 smithi103 ceph-mon[30562]: from='client.24404 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:01:54.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:54 smithi103 ceph-mon[30562]: pgmap v156: 1 pgs: 1 activating+degraded; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T01:01:54.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:54 smithi103 ceph-mon[30562]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-11T01:01:54.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:54 smithi117 ceph-mon[35358]: from='client.24404 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:01:54.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:54 smithi117 ceph-mon[35358]: pgmap v156: 1 pgs: 1 activating+degraded; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T01:01:54.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:54 smithi117 ceph-mon[35358]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-11T01:01:56.625 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:56 smithi103 ceph-mon[30562]: pgmap v157: 1 pgs: 1 activating+degraded; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T01:01:56.626 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:56 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1856428655' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "19abe982-3522-40f9-a628-ddaef462cdb9"} : dispatch 2024-09-11T01:01:56.626 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:56 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1856428655' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19abe982-3522-40f9-a628-ddaef462cdb9"}]': finished 2024-09-11T01:01:56.626 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:56 smithi103 ceph-mon[30562]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T01:01:56.626 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:56 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:01:56.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:56 smithi117 ceph-mon[35358]: pgmap v157: 1 pgs: 1 activating+degraded; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T01:01:56.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:56 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1856428655' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "19abe982-3522-40f9-a628-ddaef462cdb9"} : dispatch 2024-09-11T01:01:56.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:56 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1856428655' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19abe982-3522-40f9-a628-ddaef462cdb9"}]': finished 2024-09-11T01:01:56.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:56 smithi117 ceph-mon[35358]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T01:01:56.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:56 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:01:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:56 smithi183 ceph-mon[34992]: pgmap v157: 1 pgs: 1 activating+degraded; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T01:01:56.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:56 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1856428655' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "19abe982-3522-40f9-a628-ddaef462cdb9"} : dispatch 2024-09-11T01:01:56.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:56 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1856428655' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19abe982-3522-40f9-a628-ddaef462cdb9"}]': finished 2024-09-11T01:01:56.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:56 smithi183 ceph-mon[34992]: osdmap e40: 7 total, 6 up, 7 in 2024-09-11T01:01:56.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:56 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:01:57.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:57 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/393984260' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:01:57.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:57 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/393984260' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:01:57.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:57 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/393984260' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:01:58.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:58 smithi103 ceph-mon[30562]: pgmap v159: 1 pgs: 1 activating+degraded; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T01:01:58.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:58 smithi117 ceph-mon[35358]: pgmap v159: 1 pgs: 1 activating+degraded; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T01:01:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:58 smithi183 ceph-mon[34992]: pgmap v159: 1 pgs: 1 activating+degraded; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 2/6 objects degraded (33.333%) 2024-09-11T01:01:59.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:01:59 smithi117 ceph-mon[35358]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-11T01:01:59.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:01:59 smithi183 ceph-mon[34992]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-11T01:02:00.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:01:59 smithi103 ceph-mon[30562]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-11T01:02:00.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:00 smithi117 ceph-mon[35358]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-11T01:02:00.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:00 smithi117 ceph-mon[35358]: Cluster is now healthy 2024-09-11T01:02:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:00 smithi183 ceph-mon[34992]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-11T01:02:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:00 smithi183 ceph-mon[34992]: Cluster is now healthy 2024-09-11T01:02:01.034 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:00 smithi103 ceph-mon[30562]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-11T01:02:01.034 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:00 smithi103 ceph-mon[30562]: Cluster is now healthy 2024-09-11T01:02:01.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:01 smithi103 ceph-mon[30562]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-11T01:02:01.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:01 smithi117 ceph-mon[35358]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-11T01:02:01.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:01 smithi183 ceph-mon[34992]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-11T01:02:04.695 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:04 smithi103 ceph-mon[30562]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:02:04.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:04 smithi117 ceph-mon[35358]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:02:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:04 smithi183 ceph-mon[34992]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:02:06.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:06 smithi103 ceph-mon[30562]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:02:06.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-11T01:02:06.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:06.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:06 smithi103 ceph-mon[30562]: Deploying daemon osd.6 on smithi103 2024-09-11T01:02:06.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:06 smithi117 ceph-mon[35358]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:02:06.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:06 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-11T01:02:06.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:06 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:06.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:06 smithi117 ceph-mon[35358]: Deploying daemon osd.6 on smithi103 2024-09-11T01:02:06.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:06 smithi183 ceph-mon[34992]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:02:06.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:06 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-11T01:02:06.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:06 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:06.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:06 smithi183 ceph-mon[34992]: Deploying daemon osd.6 on smithi103 2024-09-11T01:02:08.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:08 smithi103 ceph-mon[30562]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-11T01:02:08.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:08 smithi117 ceph-mon[35358]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-11T01:02:08.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:08 smithi183 ceph-mon[34992]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-11T01:02:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:10 smithi103 ceph-mon[30562]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T01:02:10.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:10 smithi117 ceph-mon[35358]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T01:02:10.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:10 smithi183 ceph-mon[34992]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T01:02:12.795 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:12 smithi103 ceph-mon[30562]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:12.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:12 smithi117 ceph-mon[35358]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:12 smithi183 ceph-mon[34992]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:14 smithi103 ceph-mon[30562]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:02:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:14.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:14 smithi117 ceph-mon[35358]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:14.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:14 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:02:14.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:14 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:14.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:14 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:14 smithi183 ceph-mon[34992]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:14 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:02:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:14 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:14 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:16.684 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:16 smithi103 ceph-mon[30562]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:16.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:16 smithi117 ceph-mon[35358]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:16 smithi183 ceph-mon[34992]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:18.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:18.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:18.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:18.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:02:18.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:18.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:18 smithi103 ceph-mon[30562]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:18.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:18.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:18.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:18.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:02:18.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:18.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:18 smithi117 ceph-mon[35358]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:18.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:18.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:18.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:18.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:02:18.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:18.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:18 smithi183 ceph-mon[34992]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:18.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:02:18.419+0000 7ff326000640 1 -- 172.21.15.103:0/572765861 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff328063590 con 0x7ff30c0b5410 2024-09-11T01:02:18.421 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 6 on host 'smithi103' 2024-09-11T01:02:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:02:18.422+0000 7ff32e600640 1 -- 172.21.15.103:0/572765861 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff30c0b5410 msgr2=0x7ff30c0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:02:18.422+0000 7ff32e600640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff30c0b5410 0x7ff30c0b78d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff3180049d0 tx=0x7ff318009500 comp rx=0 tx=0).stop 2024-09-11T01:02:18.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:02:18.422+0000 7ff32e600640 1 -- 172.21.15.103:0/572765861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff328105c00 msgr2=0x7ff32819b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:02:18.422+0000 7ff32e600640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff328105c00 0x7ff32819b3c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff31000e9f0 tx=0x7ff31000eeb0 comp rx=0 tx=0).stop 2024-09-11T01:02:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:02:18.422+0000 7ff32e600640 1 -- 172.21.15.103:0/572765861 shutdown_connections 2024-09-11T01:02:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:02:18.422+0000 7ff32e600640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff30c0b5410 0x7ff30c0b78d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:02:18.422+0000 7ff32e600640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff3281065c0 0x7ff32819bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:02:18.422+0000 7ff32e600640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff328105c00 0x7ff32819b3c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:02:18.422+0000 7ff32e600640 1 --2- 172.21.15.103:0/572765861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff328104aa0 0x7ff32819ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:18.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:02:18.422+0000 7ff32e600640 1 -- 172.21.15.103:0/572765861 >> 172.21.15.103:0/572765861 conn(0x7ff328100370 msgr2=0x7ff328108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:18.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:02:18.422+0000 7ff32e600640 1 -- 172.21.15.103:0/572765861 shutdown_connections 2024-09-11T01:02:18.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:02:18.422+0000 7ff32e600640 1 -- 172.21.15.103:0/572765861 wait complete. 2024-09-11T01:02:19.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:19 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:02:19.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:19 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:19.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:19 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:19.246 DEBUG:teuthology.orchestra.run.smithi103:osd.6> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.6.service 2024-09-11T01:02:19.250 INFO:tasks.cephadm:Deploying osd.7 on smithi117 with /dev/vg_nvme/lv_2... 2024-09-11T01:02:19.250 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T01:02:19.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:19 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:02:19.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:19 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:19.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:19 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:19.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:19 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:02:19.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:19 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:19.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:19 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:19.506 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T01:02:19.965 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:02:19 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6[60567]: 2024-09-11T01:02:19.846+0000 7ff081161640 -1 osd.6 0 log_to_monitors true 2024-09-11T01:02:20.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:20 smithi103 ceph-mon[30562]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:20.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:20 smithi103 ceph-mon[30562]: from='osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-11T01:02:20.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:20 smithi117 ceph-mon[35358]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:20.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:20 smithi117 ceph-mon[35358]: from='osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-11T01:02:20.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:20 smithi183 ceph-mon[34992]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:20.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:20 smithi183 ceph-mon[34992]: from='osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-11T01:02:21.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:21 smithi103 ceph-mon[30562]: from='osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T01:02:21.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:21 smithi103 ceph-mon[30562]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T01:02:21.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:21 smithi103 ceph-mon[30562]: from='osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T01:02:21.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:21 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:21.122 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:02:21 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6[60567]: 2024-09-11T01:02:21.074+0000 7ff07c000640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T01:02:21.122 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:02:21 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6[60567]: 2024-09-11T01:02:21.089+0000 7ff077000640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:02:21.224 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:21 smithi117 ceph-mon[35358]: from='osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T01:02:21.225 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:21 smithi117 ceph-mon[35358]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T01:02:21.225 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:21 smithi117 ceph-mon[35358]: from='osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T01:02:21.225 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:21 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:21.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:21 smithi183 ceph-mon[34992]: from='osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-11T01:02:21.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:21 smithi183 ceph-mon[34992]: osdmap e41: 7 total, 6 up, 7 in 2024-09-11T01:02:21.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:21 smithi183 ceph-mon[34992]: from='osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T01:02:21.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:21 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:21.950 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T01:02:21.976 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_2 2024-09-11T01:02:22.233 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T01:02:22.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:22 smithi103 ceph-mon[30562]: from='osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-11T01:02:22.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:22 smithi103 ceph-mon[30562]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T01:02:22.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:22 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:22.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:22 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:22.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:22 smithi103 ceph-mon[30562]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:22.361 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:22 smithi117 ceph-mon[35358]: from='osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-11T01:02:22.362 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:22 smithi117 ceph-mon[35358]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T01:02:22.362 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:22 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:22.362 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:22 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:22.362 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:22 smithi117 ceph-mon[35358]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:22.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:22 smithi183 ceph-mon[34992]: from='osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-11T01:02:22.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:22 smithi183 ceph-mon[34992]: osdmap e42: 7 total, 6 up, 7 in 2024-09-11T01:02:22.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:22 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:22.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:22 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:22.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:22 smithi183 ceph-mon[34992]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-09-11T01:02:22.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.724+0000 7f9003bfc640 1 -- 172.21.15.117:0/4272450405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc101940 msgr2=0x7f8ffc101d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:22.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.724+0000 7f9003bfc640 1 --2- 172.21.15.117:0/4272450405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc101940 0x7f8ffc101d40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8009cd0 tx=0x7f8ff802a8e0 comp rx=0 tx=0).stop 2024-09-11T01:02:22.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.724+0000 7f9003bfc640 1 -- 172.21.15.117:0/4272450405 shutdown_connections 2024-09-11T01:02:22.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.724+0000 7f9003bfc640 1 --2- 172.21.15.117:0/4272450405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ffc103460 0x7f8ffc109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:22.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.724+0000 7f9003bfc640 1 --2- 172.21.15.117:0/4272450405 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ffc102aa0 0x7f8ffc102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:22.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.724+0000 7f9003bfc640 1 --2- 172.21.15.117:0/4272450405 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc101940 0x7f8ffc101d40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:22.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.724+0000 7f9003bfc640 1 -- 172.21.15.117:0/4272450405 >> 172.21.15.117:0/4272450405 conn(0x7f8ffc0fd210 msgr2=0x7f8ffc0ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:22.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.724+0000 7f9003bfc640 1 -- 172.21.15.117:0/4272450405 shutdown_connections 2024-09-11T01:02:22.742 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.724+0000 7f9003bfc640 1 -- 172.21.15.117:0/4272450405 wait complete. 2024-09-11T01:02:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9003bfc640 1 Processor -- start 2024-09-11T01:02:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9003bfc640 1 -- start start 2024-09-11T01:02:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9003bfc640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc101940 0x7f8ffc198fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9003bfc640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ffc102aa0 0x7f8ffc1995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9003bfc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ffc103460 0x7f8ffc19a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9003bfc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc10e750 con 0x7f8ffc103460 2024-09-11T01:02:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9003bfc640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc10e5d0 con 0x7f8ffc101940 2024-09-11T01:02:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9003bfc640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8ffc10e8d0 con 0x7f8ffc102aa0 2024-09-11T01:02:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9001998640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc101940 0x7f8ffc198fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9001998640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc101940 0x7f8ffc198fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:58500/0 (socket says 172.21.15.117:58500) 2024-09-11T01:02:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9001998640 1 -- 172.21.15.117:0/3742291010 learned_addr learned my addr 172.21.15.117:0/3742291010 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-11T01:02:22.743 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9001197640 1 --2- 172.21.15.117:0/3742291010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ffc102aa0 0x7f8ffc1995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:22.744 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9001998640 1 -- 172.21.15.117:0/3742291010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ffc102aa0 msgr2=0x7f8ffc1995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9001998640 1 --2- 172.21.15.117:0/3742291010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ffc102aa0 0x7f8ffc1995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9001998640 1 -- 172.21.15.117:0/3742291010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ffc103460 msgr2=0x7f8ffc19a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9001998640 1 --2- 172.21.15.117:0/3742291010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ffc103460 0x7f8ffc19a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9001998640 1 -- 172.21.15.117:0/3742291010 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ffc19aad0 con 0x7f8ffc101940 2024-09-11T01:02:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.725+0000 7f9001197640 1 --2- 172.21.15.117:0/3742291010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ffc102aa0 0x7f8ffc1995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:02:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.726+0000 7f9001998640 1 --2- 172.21.15.117:0/3742291010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc101940 0x7f8ffc198fa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8003c20 tx=0x7f8ff8003c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.726+0000 7f8ff2ffd640 1 -- 172.21.15.117:0/3742291010 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8004450 con 0x7f8ffc101940 2024-09-11T01:02:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.726+0000 7f8ff2ffd640 1 -- 172.21.15.117:0/3742291010 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ff80045f0 con 0x7f8ffc101940 2024-09-11T01:02:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.726+0000 7f9003bfc640 1 -- 172.21.15.117:0/3742291010 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ffc19ad60 con 0x7f8ffc101940 2024-09-11T01:02:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.726+0000 7f8ff2ffd640 1 -- 172.21.15.117:0/3742291010 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ff803b660 con 0x7f8ffc101940 2024-09-11T01:02:22.745 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.726+0000 7f9003bfc640 1 -- 172.21.15.117:0/3742291010 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ffc1a14a0 con 0x7f8ffc101940 2024-09-11T01:02:22.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.727+0000 7f9003bfc640 1 -- 172.21.15.117:0/3742291010 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ffc108cc0 con 0x7f8ffc101940 2024-09-11T01:02:22.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.728+0000 7f8ff2ffd640 1 -- 172.21.15.117:0/3742291010 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f8ff8030070 con 0x7f8ffc101940 2024-09-11T01:02:22.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.728+0000 7f8ff2ffd640 1 --2- 172.21.15.117:0/3742291010 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8fe80b5360 0x7f8fe80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:22.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.729+0000 7f8ff2ffd640 1 -- 172.21.15.117:0/3742291010 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4965+0+0 (secure 0 0 0) 0x7f8ff802e030 con 0x7f8ffc101940 2024-09-11T01:02:22.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.729+0000 7f9001197640 1 --2- 172.21.15.117:0/3742291010 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8fe80b5360 0x7f8fe80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:22.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.729+0000 7f9001197640 1 --2- 172.21.15.117:0/3742291010 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8fe80b5360 0x7f8fe80b7820 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009b40 tx=0x7f8fec005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:22.746 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.733+0000 7f8ff2ffd640 1 -- 172.21.15.117:0/3742291010 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8ff80cd8b0 con 0x7f8ffc101940 2024-09-11T01:02:22.919 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:22.917+0000 7f9003bfc640 1 -- 172.21.15.117:0/3742291010 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f8ffc063590 con 0x7f8fe80b5360 2024-09-11T01:02:23.327 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:23 smithi117 ceph-mon[35358]: purged_snaps scrub starts 2024-09-11T01:02:23.327 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:23 smithi117 ceph-mon[35358]: purged_snaps scrub ok 2024-09-11T01:02:23.327 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:23 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:23.327 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:23 smithi117 ceph-mon[35358]: osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972] boot 2024-09-11T01:02:23.327 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:23 smithi117 ceph-mon[35358]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T01:02:23.327 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:23 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:23.327 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:23 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:02:23.327 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:23 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:02:23.327 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:23 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:23.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:23 smithi103 ceph-mon[30562]: purged_snaps scrub starts 2024-09-11T01:02:23.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:23 smithi103 ceph-mon[30562]: purged_snaps scrub ok 2024-09-11T01:02:23.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:23.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:23 smithi103 ceph-mon[30562]: osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972] boot 2024-09-11T01:02:23.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:23 smithi103 ceph-mon[30562]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T01:02:23.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:23.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:02:23.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:02:23.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:23 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:23.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:23 smithi183 ceph-mon[34992]: purged_snaps scrub starts 2024-09-11T01:02:23.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:23 smithi183 ceph-mon[34992]: purged_snaps scrub ok 2024-09-11T01:02:23.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:23.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:23 smithi183 ceph-mon[34992]: osd.6 [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972] boot 2024-09-11T01:02:23.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:23 smithi183 ceph-mon[34992]: osdmap e43: 7 total, 7 up, 7 in 2024-09-11T01:02:23.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-11T01:02:23.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:02:23.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:02:23.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:23 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:24.199 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:24 smithi117 ceph-mon[35358]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:02:24.199 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:24 smithi117 ceph-mon[35358]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T01:02:24.199 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:24 smithi117 ceph-mon[35358]: Detected new or changed devices on smithi103 2024-09-11T01:02:24.199 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:24.199 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:24.199 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:24.199 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:24.199 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:24.199 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:24 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi103 to 5696M 2024-09-11T01:02:24.199 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:24.199 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:24.200 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:02:24.200 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:24.200 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:24 smithi117 ceph-mon[35358]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:24.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:24 smithi103 ceph-mon[30562]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:02:24.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:24 smithi103 ceph-mon[30562]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T01:02:24.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:24 smithi103 ceph-mon[30562]: Detected new or changed devices on smithi103 2024-09-11T01:02:24.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:24.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:24.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:24.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:24.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:24.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:24 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi103 to 5696M 2024-09-11T01:02:24.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:24.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:24.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:02:24.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:24.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:24 smithi103 ceph-mon[30562]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:24.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:24 smithi183 ceph-mon[34992]: from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:02:24.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:24 smithi183 ceph-mon[34992]: osdmap e44: 7 total, 7 up, 7 in 2024-09-11T01:02:24.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:24 smithi183 ceph-mon[34992]: Detected new or changed devices on smithi103 2024-09-11T01:02:24.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:24.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:24.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:24.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:24.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:24.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:24 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi103 to 5696M 2024-09-11T01:02:24.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:24.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:24.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:02:24.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:24.420 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:24 smithi183 ceph-mon[34992]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:25.507 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:25 smithi117 ceph-mon[35358]: from='client.? 172.21.15.117:0/1708717408' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e875ff09-805a-40ff-9d6a-dd2607ce3432"} : dispatch 2024-09-11T01:02:25.508 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:25 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e875ff09-805a-40ff-9d6a-dd2607ce3432"} : dispatch 2024-09-11T01:02:25.508 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:25 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e875ff09-805a-40ff-9d6a-dd2607ce3432"}]': finished 2024-09-11T01:02:25.508 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:25 smithi117 ceph-mon[35358]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T01:02:25.508 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:25 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:25.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:25 smithi103 ceph-mon[30562]: from='client.? 172.21.15.117:0/1708717408' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e875ff09-805a-40ff-9d6a-dd2607ce3432"} : dispatch 2024-09-11T01:02:25.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:25 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e875ff09-805a-40ff-9d6a-dd2607ce3432"} : dispatch 2024-09-11T01:02:25.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:25 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e875ff09-805a-40ff-9d6a-dd2607ce3432"}]': finished 2024-09-11T01:02:25.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:25 smithi103 ceph-mon[30562]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T01:02:25.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:25 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:25.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:25 smithi183 ceph-mon[34992]: from='client.? 172.21.15.117:0/1708717408' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e875ff09-805a-40ff-9d6a-dd2607ce3432"} : dispatch 2024-09-11T01:02:25.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:25 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e875ff09-805a-40ff-9d6a-dd2607ce3432"} : dispatch 2024-09-11T01:02:25.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:25 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e875ff09-805a-40ff-9d6a-dd2607ce3432"}]': finished 2024-09-11T01:02:25.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:25 smithi183 ceph-mon[34992]: osdmap e45: 8 total, 7 up, 8 in 2024-09-11T01:02:25.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:25 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:26.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:26 smithi103 ceph-mon[30562]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:26.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:26 smithi103 ceph-mon[30562]: from='client.? 172.21.15.117:0/1103886134' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:02:26.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:26 smithi117 ceph-mon[35358]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:26.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:26 smithi117 ceph-mon[35358]: from='client.? 172.21.15.117:0/1103886134' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:02:26.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:26 smithi183 ceph-mon[34992]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:26.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:26 smithi183 ceph-mon[34992]: from='client.? 172.21.15.117:0/1103886134' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:02:28.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:28 smithi103 ceph-mon[30562]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:28.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:28 smithi117 ceph-mon[35358]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:28.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:28 smithi183 ceph-mon[34992]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 205 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:30.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:30 smithi117 ceph-mon[35358]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:30.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:30 smithi103 ceph-mon[30562]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:30 smithi183 ceph-mon[34992]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:32.741 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:32 smithi117 ceph-mon[35358]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:32.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:32 smithi103 ceph-mon[30562]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:32.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:32 smithi183 ceph-mon[34992]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:34.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:34 smithi103 ceph-mon[30562]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:34.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-11T01:02:34.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:34.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:34 smithi117 ceph-mon[35358]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:34.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-11T01:02:34.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:34 smithi183 ceph-mon[34992]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-11T01:02:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:35.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:35 smithi103 ceph-mon[30562]: Deploying daemon osd.7 on smithi117 2024-09-11T01:02:35.722 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:35 smithi117 ceph-mon[35358]: Deploying daemon osd.7 on smithi117 2024-09-11T01:02:35.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:35 smithi183 ceph-mon[34992]: Deploying daemon osd.7 on smithi117 2024-09-11T01:02:36.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:36 smithi117 ceph-mon[35358]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:36.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:36 smithi103 ceph-mon[30562]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:36.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:36 smithi183 ceph-mon[34992]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:38.751 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:38 smithi117 ceph-mon[35358]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:38.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:38 smithi103 ceph-mon[30562]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:38 smithi183 ceph-mon[34992]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:40.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:40 smithi117 ceph-mon[35358]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:40.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:02:40.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:40.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:40 smithi103 ceph-mon[30562]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:02:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:40.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:40 smithi183 ceph-mon[34992]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:40.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:02:40.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:40.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:42 smithi103 ceph-mon[30562]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:02:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:42.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:42 smithi117 ceph-mon[35358]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:42.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:42.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:42.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:42.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:02:42.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:42.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:42 smithi183 ceph-mon[34992]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:42.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:42.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:42.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:42.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:02:42.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:43.360 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:43.358+0000 7f8ff2ffd640 1 -- 172.21.15.117:0/3742291010 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8ffc063590 con 0x7f8fe80b5360 2024-09-11T01:02:43.361 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 7 on host 'smithi117' 2024-09-11T01:02:43.362 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:43.360+0000 7f9003bfc640 1 -- 172.21.15.117:0/3742291010 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8fe80b5360 msgr2=0x7f8fe80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:43.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:43.360+0000 7f9003bfc640 1 --2- 172.21.15.117:0/3742291010 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8fe80b5360 0x7f8fe80b7820 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009b40 tx=0x7f8fec005e50 comp rx=0 tx=0).stop 2024-09-11T01:02:43.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:43.360+0000 7f9003bfc640 1 -- 172.21.15.117:0/3742291010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc101940 msgr2=0x7f8ffc198fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:43.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:43.360+0000 7f9003bfc640 1 --2- 172.21.15.117:0/3742291010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc101940 0x7f8ffc198fa0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8003c20 tx=0x7f8ff8003c50 comp rx=0 tx=0).stop 2024-09-11T01:02:43.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:43.361+0000 7f9003bfc640 1 -- 172.21.15.117:0/3742291010 shutdown_connections 2024-09-11T01:02:43.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:43.361+0000 7f9003bfc640 1 --2- 172.21.15.117:0/3742291010 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8fe80b5360 0x7f8fe80b7820 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:43.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:43.361+0000 7f9003bfc640 1 --2- 172.21.15.117:0/3742291010 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ffc103460 0x7f8ffc19a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:43.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:43.361+0000 7f9003bfc640 1 --2- 172.21.15.117:0/3742291010 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ffc102aa0 0x7f8ffc1995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:43.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:43.361+0000 7f9003bfc640 1 --2- 172.21.15.117:0/3742291010 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ffc101940 0x7f8ffc198fa0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:43.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:43.361+0000 7f9003bfc640 1 -- 172.21.15.117:0/3742291010 >> 172.21.15.117:0/3742291010 conn(0x7f8ffc0fd210 msgr2=0x7f8ffc105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:43.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:43.361+0000 7f9003bfc640 1 -- 172.21.15.117:0/3742291010 shutdown_connections 2024-09-11T01:02:43.363 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:02:43.361+0000 7f9003bfc640 1 -- 172.21.15.117:0/3742291010 wait complete. 2024-09-11T01:02:43.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:02:43.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:43.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:43.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:02:43.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:43.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:43.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:02:43.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:43.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:43.953 DEBUG:teuthology.orchestra.run.smithi117:osd.7> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.7.service 2024-09-11T01:02:43.955 INFO:tasks.cephadm:Deploying osd.8 on smithi183 with /dev/vg_nvme/lv_2... 2024-09-11T01:02:43.955 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-11T01:02:44.212 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T01:02:44.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:44 smithi183 ceph-mon[34992]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:44.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:44 smithi103 ceph-mon[30562]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:44.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:44 smithi117 ceph-mon[35358]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:45.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:45 smithi117 ceph-mon[35358]: from='osd.7 [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-11T01:02:45.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:45 smithi117 ceph-mon[35358]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-11T01:02:45.623 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:02:45 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7[53093]: 2024-09-11T01:02:45.410+0000 7f64d7f3c640 -1 osd.7 0 log_to_monitors true 2024-09-11T01:02:45.627 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:45 smithi183 ceph-mon[34992]: from='osd.7 [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-11T01:02:45.627 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:45 smithi183 ceph-mon[34992]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-11T01:02:45.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:45 smithi103 ceph-mon[30562]: from='osd.7 [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-11T01:02:45.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:45 smithi103 ceph-mon[30562]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-11T01:02:46.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:46 smithi117 ceph-mon[35358]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:46.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:46 smithi117 ceph-mon[35358]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T01:02:46.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:46 smithi117 ceph-mon[35358]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T01:02:46.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:46 smithi117 ceph-mon[35358]: from='osd.7 [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:02:46.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:46 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:46.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:46 smithi117 ceph-mon[35358]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:02:46.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:46 smithi183 ceph-mon[34992]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:46.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:46 smithi183 ceph-mon[34992]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T01:02:46.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:46 smithi183 ceph-mon[34992]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T01:02:46.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:46 smithi183 ceph-mon[34992]: from='osd.7 [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:02:46.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:46 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:46.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:46 smithi183 ceph-mon[34992]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:02:46.799 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T01:02:46.827 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_2 2024-09-11T01:02:46.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:46 smithi103 ceph-mon[30562]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:46.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:46 smithi103 ceph-mon[30562]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-11T01:02:46.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:46 smithi103 ceph-mon[30562]: osdmap e46: 8 total, 7 up, 8 in 2024-09-11T01:02:46.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:46 smithi103 ceph-mon[30562]: from='osd.7 [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:02:46.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:46 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:46.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:46 smithi103 ceph-mon[30562]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:02:47.078 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T01:02:47.573 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7[53093]: 2024-09-11T01:02:47.268+0000 7f64d3ebf640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T01:02:47.574 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7[53093]: 2024-09-11T01:02:47.275+0000 7f64cbcde640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:02:47.574 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.548+0000 7f7da6af7640 1 -- 172.21.15.183:0/3204039687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7da0104550 msgr2=0x7f7da010aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:47.574 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.548+0000 7f7da6af7640 1 --2- 172.21.15.183:0/3204039687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7da0104550 0x7f7da010aed0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7d98009d00 tx=0x7f7d9802a910 comp rx=0 tx=0).stop 2024-09-11T01:02:47.574 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.548+0000 7f7da6af7640 1 -- 172.21.15.183:0/3204039687 shutdown_connections 2024-09-11T01:02:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.548+0000 7f7da6af7640 1 --2- 172.21.15.183:0/3204039687 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7da0104550 0x7f7da010aed0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.548+0000 7f7da6af7640 1 --2- 172.21.15.183:0/3204039687 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da0103b90 0x7f7da0104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.548+0000 7f7da6af7640 1 --2- 172.21.15.183:0/3204039687 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7da0102a30 0x7f7da0102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.548+0000 7f7da6af7640 1 -- 172.21.15.183:0/3204039687 >> 172.21.15.183:0/3204039687 conn(0x7f7da00fe320 msgr2=0x7f7da0100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:02:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.548+0000 7f7da6af7640 1 -- 172.21.15.183:0/3204039687 shutdown_connections 2024-09-11T01:02:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.548+0000 7f7da6af7640 1 -- 172.21.15.183:0/3204039687 wait complete. 2024-09-11T01:02:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.549+0000 7f7da6af7640 1 Processor -- start 2024-09-11T01:02:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.549+0000 7f7da6af7640 1 -- start start 2024-09-11T01:02:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.549+0000 7f7da6af7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da0102a30 0x7f7da0076cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.549+0000 7f7da6af7640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7da0103b90 0x7f7da0075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:47.575 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.549+0000 7f7da6af7640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7da0104550 0x7f7da0075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:47.576 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.549+0000 7f7da6af7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7da010e730 con 0x7f7da0102a30 2024-09-11T01:02:47.576 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.549+0000 7f7da6af7640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7da010e5b0 con 0x7f7da0103b90 2024-09-11T01:02:47.576 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.549+0000 7f7da6af7640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7da010e8b0 con 0x7f7da0104550 2024-09-11T01:02:47.576 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.549+0000 7f7da5094640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7da0104550 0x7f7da0075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:47.576 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.549+0000 7f7da5094640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7da0104550 0x7f7da0075a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:55090/0 (socket says 172.21.15.183:55090) 2024-09-11T01:02:47.576 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.549+0000 7f7da5094640 1 -- 172.21.15.183:0/7816096 learned_addr learned my addr 172.21.15.183:0/7816096 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-09-11T01:02:47.576 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.549+0000 7f7d9ffff640 1 --2- 172.21.15.183:0/7816096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7da0103b90 0x7f7da0075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:47.576 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.550+0000 7f7da5094640 1 -- 172.21.15.183:0/7816096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7da0103b90 msgr2=0x7f7da0075540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:47.576 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.550+0000 7f7da5094640 1 --2- 172.21.15.183:0/7816096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7da0103b90 0x7f7da0075540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:47.576 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.550+0000 7f7da5094640 1 -- 172.21.15.183:0/7816096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da0102a30 msgr2=0x7f7da0076cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:02:47.576 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.550+0000 7f7da5094640 1 --2- 172.21.15.183:0/7816096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da0102a30 0x7f7da0076cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:02:47.576 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.550+0000 7f7da5094640 1 -- 172.21.15.183:0/7816096 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da0076340 con 0x7f7da0104550 2024-09-11T01:02:47.577 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.550+0000 7f7da5094640 1 --2- 172.21.15.183:0/7816096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7da0104550 0x7f7da0075a80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7d98003ba0 tx=0x7f7d98003bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:47.577 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.550+0000 7f7d9dffb640 1 -- 172.21.15.183:0/7816096 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d980317d0 con 0x7f7da0104550 2024-09-11T01:02:47.577 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.550+0000 7f7da6af7640 1 -- 172.21.15.183:0/7816096 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da01a2f50 con 0x7f7da0104550 2024-09-11T01:02:47.577 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.550+0000 7f7d9dffb640 1 -- 172.21.15.183:0/7816096 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d98030a80 con 0x7f7da0104550 2024-09-11T01:02:47.577 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.550+0000 7f7d9dffb640 1 -- 172.21.15.183:0/7816096 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d9802fc20 con 0x7f7da0104550 2024-09-11T01:02:47.577 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.550+0000 7f7da6af7640 1 -- 172.21.15.183:0/7816096 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da01a34d0 con 0x7f7da0104550 2024-09-11T01:02:47.577 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.551+0000 7f7da6af7640 1 -- 172.21.15.183:0/7816096 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da0102e30 con 0x7f7da0104550 2024-09-11T01:02:47.577 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.552+0000 7f7d9dffb640 1 -- 172.21.15.183:0/7816096 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f7d980305d0 con 0x7f7da0104550 2024-09-11T01:02:47.577 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.553+0000 7f7d9dffb640 1 --2- 172.21.15.183:0/7816096 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7d900b5480 0x7f7d900b7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:02:47.577 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.553+0000 7f7d9dffb640 1 -- 172.21.15.183:0/7816096 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5150+0+0 (secure 0 0 0) 0x7f7d98106400 con 0x7f7da0104550 2024-09-11T01:02:47.577 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.553+0000 7f7da4893640 1 --2- 172.21.15.183:0/7816096 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7d900b5480 0x7f7d900b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:02:47.577 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.554+0000 7f7da4893640 1 --2- 172.21.15.183:0/7816096 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7d900b5480 0x7f7d900b7940 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400a8f0 tx=0x7f7d94005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:02:47.577 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.557+0000 7f7d9dffb640 1 -- 172.21.15.183:0/7816096 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7d980cdf20 con 0x7f7da0104550 2024-09-11T01:02:47.744 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:02:47.742+0000 7f7da6af7640 1 -- 172.21.15.183:0/7816096 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7da0063590 con 0x7f7d900b5480 2024-09-11T01:02:47.744 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-11T01:02:47.744 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T01:02:47.745 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:47.745 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:47.745 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:47.745 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:47.745 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:47.745 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:47.745 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:47.745 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:47.745 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:47.745 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:02:47.745 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:47.745 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T01:02:47.745 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:47.745 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:47 smithi183 ceph-mon[34992]: from='osd.7 ' entity='osd.7' 2024-09-11T01:02:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-11T01:02:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T01:02:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:47.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:47.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:47.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:02:47.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:47.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T01:02:47.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:47.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:47 smithi103 ceph-mon[30562]: from='osd.7 ' entity='osd.7' 2024-09-11T01:02:47.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-11T01:02:47.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: osdmap e47: 8 total, 7 up, 8 in 2024-09-11T01:02:47.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:47.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:47.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:47.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:47.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:47.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:47.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T01:02:47.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:47.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:47.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:02:47.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:02:47.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: osdmap e48: 8 total, 7 up, 8 in 2024-09-11T01:02:47.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:47.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:47 smithi117 ceph-mon[35358]: from='osd.7 ' entity='osd.7' 2024-09-11T01:02:48.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:48 smithi183 ceph-mon[34992]: purged_snaps scrub starts 2024-09-11T01:02:48.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:48 smithi183 ceph-mon[34992]: purged_snaps scrub ok 2024-09-11T01:02:48.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:48 smithi183 ceph-mon[34992]: Detected new or changed devices on smithi117 2024-09-11T01:02:48.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:48 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi117 to 5696M 2024-09-11T01:02:48.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:48 smithi183 ceph-mon[34992]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:48.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:48.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:02:48.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:02:48.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:48.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:48 smithi183 ceph-mon[34992]: osd.7 [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713] boot 2024-09-11T01:02:48.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:48 smithi183 ceph-mon[34992]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T01:02:48.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:48 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:48.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:48 smithi103 ceph-mon[30562]: purged_snaps scrub starts 2024-09-11T01:02:48.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:48 smithi103 ceph-mon[30562]: purged_snaps scrub ok 2024-09-11T01:02:48.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:48 smithi103 ceph-mon[30562]: Detected new or changed devices on smithi117 2024-09-11T01:02:48.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:48 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi117 to 5696M 2024-09-11T01:02:48.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:48 smithi103 ceph-mon[30562]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:48.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:48.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:02:48.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:02:48.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:48.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:48 smithi103 ceph-mon[30562]: osd.7 [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713] boot 2024-09-11T01:02:48.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:48 smithi103 ceph-mon[30562]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T01:02:48.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:48 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:48.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:48 smithi117 ceph-mon[35358]: purged_snaps scrub starts 2024-09-11T01:02:48.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:48 smithi117 ceph-mon[35358]: purged_snaps scrub ok 2024-09-11T01:02:48.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:48 smithi117 ceph-mon[35358]: Detected new or changed devices on smithi117 2024-09-11T01:02:48.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:48 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi117 to 5696M 2024-09-11T01:02:48.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:48 smithi117 ceph-mon[35358]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 206 MiB used, 626 GiB / 626 GiB avail 2024-09-11T01:02:48.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:48.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:02:48.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:02:48.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:48.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:48 smithi117 ceph-mon[35358]: osd.7 [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713] boot 2024-09-11T01:02:48.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:48 smithi117 ceph-mon[35358]: osdmap e49: 8 total, 8 up, 8 in 2024-09-11T01:02:48.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:48 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-11T01:02:49.735 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:49 smithi183 ceph-mon[34992]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:02:49.735 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:49 smithi183 ceph-mon[34992]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T01:02:49.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:49 smithi103 ceph-mon[30562]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:02:49.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:49 smithi103 ceph-mon[30562]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T01:02:49.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:49 smithi117 ceph-mon[35358]: from='client.24421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:02:49.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:49 smithi117 ceph-mon[35358]: osdmap e50: 8 total, 8 up, 8 in 2024-09-11T01:02:50.809 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:50 smithi183 ceph-mon[34992]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:02:50.809 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:50 smithi183 ceph-mon[34992]: osdmap e51: 8 total, 8 up, 8 in 2024-09-11T01:02:50.809 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:50 smithi183 ceph-mon[34992]: from='client.? 172.21.15.183:0/2407479415' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a"} : dispatch 2024-09-11T01:02:50.809 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:50 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a"} : dispatch 2024-09-11T01:02:50.809 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:50 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a"}]': finished 2024-09-11T01:02:50.809 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:50 smithi183 ceph-mon[34992]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T01:02:50.810 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:50 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:02:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:50 smithi117 ceph-mon[35358]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:02:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:50 smithi117 ceph-mon[35358]: osdmap e51: 8 total, 8 up, 8 in 2024-09-11T01:02:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:50 smithi117 ceph-mon[35358]: from='client.? 172.21.15.183:0/2407479415' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a"} : dispatch 2024-09-11T01:02:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:50 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a"} : dispatch 2024-09-11T01:02:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:50 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a"}]': finished 2024-09-11T01:02:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:50 smithi117 ceph-mon[35358]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T01:02:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:50 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:02:51.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:50 smithi103 ceph-mon[30562]: pgmap v195: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:02:51.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:50 smithi103 ceph-mon[30562]: osdmap e51: 8 total, 8 up, 8 in 2024-09-11T01:02:51.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:50 smithi103 ceph-mon[30562]: from='client.? 172.21.15.183:0/2407479415' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a"} : dispatch 2024-09-11T01:02:51.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:50 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a"} : dispatch 2024-09-11T01:02:51.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:50 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a"}]': finished 2024-09-11T01:02:51.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:50 smithi103 ceph-mon[30562]: osdmap e52: 9 total, 8 up, 9 in 2024-09-11T01:02:51.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:50 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:02:51.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:51 smithi117 ceph-mon[35358]: from='client.? 172.21.15.183:0/369868371' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:02:51.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:51 smithi183 ceph-mon[34992]: from='client.? 172.21.15.183:0/369868371' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:02:52.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:51 smithi103 ceph-mon[30562]: from='client.? 172.21.15.183:0/369868371' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:02:52.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:52 smithi117 ceph-mon[35358]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:02:52.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:52 smithi117 ceph-mon[35358]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-11T01:02:52.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:52 smithi183 ceph-mon[34992]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:02:52.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:52 smithi183 ceph-mon[34992]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-11T01:02:53.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:52 smithi103 ceph-mon[30562]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:02:53.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:52 smithi103 ceph-mon[30562]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-09-11T01:02:53.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:53 smithi117 ceph-mon[35358]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:02:53.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:53 smithi183 ceph-mon[34992]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:02:54.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:53 smithi103 ceph-mon[30562]: pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:02:55.825 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:55 smithi183 ceph-mon[34992]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-11T01:02:55.825 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:55 smithi183 ceph-mon[34992]: Cluster is now healthy 2024-09-11T01:02:55.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:55 smithi103 ceph-mon[30562]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-11T01:02:55.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:55 smithi103 ceph-mon[30562]: Cluster is now healthy 2024-09-11T01:02:55.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:55 smithi117 ceph-mon[35358]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-09-11T01:02:55.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:55 smithi117 ceph-mon[35358]: Cluster is now healthy 2024-09-11T01:02:56.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:56 smithi103 ceph-mon[30562]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 183 KiB/s, 0 objects/s recovering 2024-09-11T01:02:56.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:56 smithi117 ceph-mon[35358]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 183 KiB/s, 0 objects/s recovering 2024-09-11T01:02:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:56 smithi183 ceph-mon[34992]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 183 KiB/s, 0 objects/s recovering 2024-09-11T01:02:58.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:58 smithi117 ceph-mon[35358]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T01:02:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:58 smithi183 ceph-mon[34992]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T01:02:59.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:58 smithi103 ceph-mon[30562]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-11T01:02:59.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:59 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-11T01:02:59.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:02:59 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:02:59.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:59 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-11T01:02:59.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:02:59 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:00.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:59 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-11T01:03:00.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:02:59 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:00.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:00 smithi183 ceph-mon[34992]: Deploying daemon osd.8 on smithi183 2024-09-11T01:03:00.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:00 smithi183 ceph-mon[34992]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-09-11T01:03:00.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:00 smithi117 ceph-mon[35358]: Deploying daemon osd.8 on smithi183 2024-09-11T01:03:00.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:00 smithi117 ceph-mon[35358]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-09-11T01:03:01.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:00 smithi103 ceph-mon[30562]: Deploying daemon osd.8 on smithi183 2024-09-11T01:03:01.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:00 smithi103 ceph-mon[30562]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-09-11T01:03:01.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:01 smithi183 ceph-mon[34992]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-11T01:03:01.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:01 smithi117 ceph-mon[35358]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-11T01:03:02.081 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:01 smithi103 ceph-mon[30562]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-09-11T01:03:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:04 smithi103 ceph-mon[30562]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T01:03:04.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:04 smithi117 ceph-mon[35358]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T01:03:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:04 smithi183 ceph-mon[34992]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T01:03:05.634 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:03:05.634 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:05.634 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:05.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:03:05.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:05.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:05.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:03:05.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:05.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:06.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:06 smithi103 ceph-mon[30562]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T01:03:06.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:06 smithi117 ceph-mon[35358]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T01:03:06.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:06 smithi183 ceph-mon[34992]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-11T01:03:08.503 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:03:08.500+0000 7f7d9dffb640 1 -- 172.21.15.183:0/7816096 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7da0063590 con 0x7f7d900b5480 2024-09-11T01:03:08.503 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 8 on host 'smithi183' 2024-09-11T01:03:08.505 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:03:08.503+0000 7f7da6af7640 1 -- 172.21.15.183:0/7816096 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7d900b5480 msgr2=0x7f7d900b7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:08.505 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:03:08.503+0000 7f7da6af7640 1 --2- 172.21.15.183:0/7816096 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7d900b5480 0x7f7d900b7940 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400a8f0 tx=0x7f7d94005bf0 comp rx=0 tx=0).stop 2024-09-11T01:03:08.505 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:03:08.503+0000 7f7da6af7640 1 -- 172.21.15.183:0/7816096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7da0104550 msgr2=0x7f7da0075a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:08.505 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:03:08.503+0000 7f7da6af7640 1 --2- 172.21.15.183:0/7816096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7da0104550 0x7f7da0075a80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7d98003ba0 tx=0x7f7d98003bd0 comp rx=0 tx=0).stop 2024-09-11T01:03:08.506 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:03:08.503+0000 7f7da6af7640 1 -- 172.21.15.183:0/7816096 shutdown_connections 2024-09-11T01:03:08.506 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:03:08.503+0000 7f7da6af7640 1 --2- 172.21.15.183:0/7816096 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7d900b5480 0x7f7d900b7940 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:08.506 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:03:08.503+0000 7f7da6af7640 1 --2- 172.21.15.183:0/7816096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7da0104550 0x7f7da0075a80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:08.506 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:03:08.503+0000 7f7da6af7640 1 --2- 172.21.15.183:0/7816096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7da0103b90 0x7f7da0075540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:08.506 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:03:08.503+0000 7f7da6af7640 1 --2- 172.21.15.183:0/7816096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da0102a30 0x7f7da0076cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:08.506 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:03:08.503+0000 7f7da6af7640 1 -- 172.21.15.183:0/7816096 >> 172.21.15.183:0/7816096 conn(0x7f7da00fe320 msgr2=0x7f7da0106f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:03:08.506 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:03:08.503+0000 7f7da6af7640 1 -- 172.21.15.183:0/7816096 shutdown_connections 2024-09-11T01:03:08.506 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:03:08.503+0000 7f7da6af7640 1 -- 172.21.15.183:0/7816096 wait complete. 2024-09-11T01:03:08.805 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:08 smithi183 ceph-mon[34992]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:03:08.805 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:08.805 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:08.806 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:08.806 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:03:08.806 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:08.806 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:03:08.806 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:08.806 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:08.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:08 smithi103 ceph-mon[30562]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:03:08.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:08.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:08.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:08.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:03:08.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:08.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:03:08.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:08.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:08 smithi117 ceph-mon[35358]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:03:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:03:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:03:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:09.142 DEBUG:teuthology.orchestra.run.smithi183:osd.8> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.8.service 2024-09-11T01:03:09.144 INFO:tasks.cephadm:Deploying osd.9 on smithi103 with /dev/vg_nvme/lv_1... 2024-09-11T01:03:09.144 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T01:03:09.529 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:03:10.808 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:10 smithi183 ceph-mon[34992]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:03:10.808 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:10 smithi183 ceph-mon[34992]: from='osd.8 [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-11T01:03:10.808 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:10 smithi183 ceph-mon[34992]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-11T01:03:10.809 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:03:10 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8[53465]: 2024-09-11T01:03:10.479+0000 7f9b62552640 -1 osd.8 0 log_to_monitors true 2024-09-11T01:03:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:10 smithi103 ceph-mon[30562]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:03:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:10 smithi103 ceph-mon[30562]: from='osd.8 [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-11T01:03:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:10 smithi103 ceph-mon[30562]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-11T01:03:10.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:10 smithi117 ceph-mon[35358]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:03:10.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:10 smithi117 ceph-mon[35358]: from='osd.8 [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-11T01:03:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:10 smithi117 ceph-mon[35358]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-11T01:03:11.812 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:03:11 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8[53465]: 2024-09-11T01:03:11.539+0000 7f9b5e4d5640 -1 osd.8 0 waiting for initial osdmap 2024-09-11T01:03:11.812 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:03:11 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8[53465]: 2024-09-11T01:03:11.550+0000 7f9b5a2fc640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:03:11.812 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:11 smithi183 ceph-mon[34992]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T01:03:11.812 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:11 smithi183 ceph-mon[34992]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T01:03:11.812 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:11 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:03:11.813 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:11 smithi183 ceph-mon[34992]: from='osd.8 [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:03:11.813 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:11 smithi183 ceph-mon[34992]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:03:11.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:11 smithi103 ceph-mon[30562]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T01:03:11.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:11 smithi103 ceph-mon[30562]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T01:03:11.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:11 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:03:11.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:11 smithi103 ceph-mon[30562]: from='osd.8 [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:03:11.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:11 smithi103 ceph-mon[30562]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:03:11.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:11 smithi117 ceph-mon[35358]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-11T01:03:11.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:11 smithi117 ceph-mon[35358]: osdmap e53: 9 total, 8 up, 9 in 2024-09-11T01:03:11.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:11 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:03:11.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:11 smithi117 ceph-mon[35358]: from='osd.8 [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:03:11.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:11 smithi117 ceph-mon[35358]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:03:12.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:03:12.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-09-11T01:03:12.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T01:03:12.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:03:12.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:03:12.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: osd.8 [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593] boot 2024-09-11T01:03:12.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: osdmap e55: 9 total, 9 up, 9 in 2024-09-11T01:03:12.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:03:12.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:12.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:12.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:12.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:12.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:12.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:12.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:12.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:03:12.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:03:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-09-11T01:03:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T01:03:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:03:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:03:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: osd.8 [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593] boot 2024-09-11T01:03:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: osdmap e55: 9 total, 9 up, 9 in 2024-09-11T01:03:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:03:12.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:12.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:12.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:12.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:12.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:12.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:12.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:12.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:03:12.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-09-11T01:03:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-09-11T01:03:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: osdmap e54: 9 total, 8 up, 9 in 2024-09-11T01:03:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:03:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:03:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: osd.8 [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593] boot 2024-09-11T01:03:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: osdmap e55: 9 total, 9 up, 9 in 2024-09-11T01:03:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-11T01:03:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:12.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:12.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:03:12.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:13.165 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:03:13.569 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_1 2024-09-11T01:03:13.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:13 smithi103 ceph-mon[30562]: purged_snaps scrub starts 2024-09-11T01:03:13.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:13 smithi103 ceph-mon[30562]: purged_snaps scrub ok 2024-09-11T01:03:13.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:13 smithi103 ceph-mon[30562]: Detected new or changed devices on smithi183 2024-09-11T01:03:13.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:13 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi183 to 5696M 2024-09-11T01:03:13.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:13 smithi103 ceph-mon[30562]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T01:03:13.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:13 smithi117 ceph-mon[35358]: purged_snaps scrub starts 2024-09-11T01:03:13.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:13 smithi117 ceph-mon[35358]: purged_snaps scrub ok 2024-09-11T01:03:13.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:13 smithi117 ceph-mon[35358]: Detected new or changed devices on smithi183 2024-09-11T01:03:13.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:13 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi183 to 5696M 2024-09-11T01:03:13.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:13 smithi117 ceph-mon[35358]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T01:03:13.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:13 smithi183 ceph-mon[34992]: purged_snaps scrub starts 2024-09-11T01:03:13.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:13 smithi183 ceph-mon[34992]: purged_snaps scrub ok 2024-09-11T01:03:13.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:13 smithi183 ceph-mon[34992]: Detected new or changed devices on smithi183 2024-09-11T01:03:13.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:13 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi183 to 5696M 2024-09-11T01:03:13.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:13 smithi183 ceph-mon[34992]: osdmap e56: 9 total, 9 up, 9 in 2024-09-11T01:03:13.939 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:03:14.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.567+0000 7fcd1d000640 1 -- 172.21.15.103:0/2724311761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd18104c40 msgr2=0x7fcd18105040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:14.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.567+0000 7fcd1d000640 1 --2- 172.21.15.103:0/2724311761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd18104c40 0x7fcd18105040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcd08009930 tx=0x7fcd0802a420 comp rx=0 tx=0).stop 2024-09-11T01:03:14.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.567+0000 7fcd1d000640 1 -- 172.21.15.103:0/2724311761 shutdown_connections 2024-09-11T01:03:14.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.567+0000 7fcd1d000640 1 --2- 172.21.15.103:0/2724311761 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd18106760 0x7fcd1810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:14.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.567+0000 7fcd1d000640 1 --2- 172.21.15.103:0/2724311761 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd18105da0 0x7fcd18106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:14.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.567+0000 7fcd1d000640 1 --2- 172.21.15.103:0/2724311761 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd18104c40 0x7fcd18105040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:14.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.567+0000 7fcd1d000640 1 -- 172.21.15.103:0/2724311761 >> 172.21.15.103:0/2724311761 conn(0x7fcd18100510 msgr2=0x7fcd18102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:03:14.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.567+0000 7fcd1d000640 1 -- 172.21.15.103:0/2724311761 shutdown_connections 2024-09-11T01:03:14.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.567+0000 7fcd1d000640 1 -- 172.21.15.103:0/2724311761 wait complete. 2024-09-11T01:03:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.568+0000 7fcd1d000640 1 Processor -- start 2024-09-11T01:03:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.568+0000 7fcd1d000640 1 -- start start 2024-09-11T01:03:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.568+0000 7fcd1d000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd18104c40 0x7fcd1819b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.568+0000 7fcd1d000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd18105da0 0x7fcd1819b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.568+0000 7fcd1d000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd18106760 0x7fcd1819c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.568+0000 7fcd1d000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcd181108a0 con 0x7fcd18104c40 2024-09-11T01:03:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.568+0000 7fcd1d000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcd18110720 con 0x7fcd18105da0 2024-09-11T01:03:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.568+0000 7fcd1d000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcd18110a20 con 0x7fcd18106760 2024-09-11T01:03:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.568+0000 7fcd15e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd18104c40 0x7fcd1819b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.569+0000 7fcd15e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd18104c40 0x7fcd1819b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44942/0 (socket says 172.21.15.103:44942) 2024-09-11T01:03:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.569+0000 7fcd15e00640 1 -- 172.21.15.103:0/2998942501 learned_addr learned my addr 172.21.15.103:0/2998942501 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:03:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.569+0000 7fcd15400640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd18105da0 0x7fcd1819b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.569+0000 7fcd16800640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd18106760 0x7fcd1819c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.569+0000 7fcd15e00640 1 -- 172.21.15.103:0/2998942501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd18106760 msgr2=0x7fcd1819c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.569+0000 7fcd15e00640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd18106760 0x7fcd1819c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.569+0000 7fcd15e00640 1 -- 172.21.15.103:0/2998942501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd18105da0 msgr2=0x7fcd1819b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.569+0000 7fcd15e00640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd18105da0 0x7fcd1819b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.569+0000 7fcd15e00640 1 -- 172.21.15.103:0/2998942501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1819cb50 con 0x7fcd18104c40 2024-09-11T01:03:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.569+0000 7fcd15400640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd18105da0 0x7fcd1819b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:03:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.569+0000 7fcd15e00640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd18104c40 0x7fcd1819b020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcd08005ab0 tx=0x7fcd080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:03:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.570+0000 7fcd0ea00640 1 -- 172.21.15.103:0/2998942501 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0803f030 con 0x7fcd18104c40 2024-09-11T01:03:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.570+0000 7fcd0ea00640 1 -- 172.21.15.103:0/2998942501 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd08003cb0 con 0x7fcd18104c40 2024-09-11T01:03:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.570+0000 7fcd0ea00640 1 -- 172.21.15.103:0/2998942501 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd08035070 con 0x7fcd18104c40 2024-09-11T01:03:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.570+0000 7fcd1d000640 1 -- 172.21.15.103:0/2998942501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1819cde0 con 0x7fcd18104c40 2024-09-11T01:03:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.570+0000 7fcd1d000640 1 -- 172.21.15.103:0/2998942501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd181a3350 con 0x7fcd18104c40 2024-09-11T01:03:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.571+0000 7fcd1d000640 1 -- 172.21.15.103:0/2998942501 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd1810bfc0 con 0x7fcd18104c40 2024-09-11T01:03:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.573+0000 7fcd0ea00640 1 -- 172.21.15.103:0/2998942501 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fcd0803bc20 con 0x7fcd18104c40 2024-09-11T01:03:14.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.575+0000 7fcd0ea00640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fccfc0b5360 0x7fccfc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:14.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.575+0000 7fcd15400640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fccfc0b5360 0x7fccfc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:14.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.575+0000 7fcd0ea00640 1 -- 172.21.15.103:0/2998942501 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5829+0+0 (secure 0 0 0) 0x7fcd08105e60 con 0x7fcd18104c40 2024-09-11T01:03:14.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.576+0000 7fcd15400640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fccfc0b5360 0x7fccfc0b7820 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400bfd0 tx=0x7fcd0400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:03:14.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.579+0000 7fcd0ea00640 1 -- 172.21.15.103:0/2998942501 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcd080ccfe0 con 0x7fcd18104c40 2024-09-11T01:03:14.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:14.775+0000 7fcd1d000640 1 -- 172.21.15.103:0/2998942501 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fcd18063590 con 0x7fccfc0b5360 2024-09-11T01:03:14.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:14 smithi103 ceph-mon[30562]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:14.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:14 smithi103 ceph-mon[30562]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T01:03:14.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:14 smithi117 ceph-mon[35358]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:14.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:14 smithi117 ceph-mon[35358]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T01:03:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:14 smithi183 ceph-mon[34992]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:14 smithi183 ceph-mon[34992]: osdmap e57: 9 total, 9 up, 9 in 2024-09-11T01:03:15.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:15 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:03:15.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:15 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:03:15.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:15 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:15.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:15 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:03:15.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:15 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:03:15.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:15 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:15.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:15 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:03:15.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:15 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:03:15.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:15 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:16.818 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:16 smithi103 ceph-mon[30562]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:03:16.818 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:16 smithi103 ceph-mon[30562]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:16.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:16 smithi117 ceph-mon[35358]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:03:16.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:16 smithi117 ceph-mon[35358]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:16 smithi183 ceph-mon[34992]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:03:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:16 smithi183 ceph-mon[34992]: pgmap v215: 1 pgs: 1 peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:18.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:18 smithi103 ceph-mon[30562]: pgmap v216: 1 pgs: 1 peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:18.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:18 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/975446149' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c36d17d2-0bc8-4322-a998-9c8eff970e58"} : dispatch 2024-09-11T01:03:18.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:18 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c36d17d2-0bc8-4322-a998-9c8eff970e58"} : dispatch 2024-09-11T01:03:18.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:18 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c36d17d2-0bc8-4322-a998-9c8eff970e58"}]': finished 2024-09-11T01:03:18.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:18 smithi103 ceph-mon[30562]: osdmap e58: 10 total, 9 up, 10 in 2024-09-11T01:03:18.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:18.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:18 smithi117 ceph-mon[35358]: pgmap v216: 1 pgs: 1 peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:18.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:18 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/975446149' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c36d17d2-0bc8-4322-a998-9c8eff970e58"} : dispatch 2024-09-11T01:03:18.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:18 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c36d17d2-0bc8-4322-a998-9c8eff970e58"} : dispatch 2024-09-11T01:03:18.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:18 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c36d17d2-0bc8-4322-a998-9c8eff970e58"}]': finished 2024-09-11T01:03:18.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:18 smithi117 ceph-mon[35358]: osdmap e58: 10 total, 9 up, 10 in 2024-09-11T01:03:18.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:18 smithi183 ceph-mon[34992]: pgmap v216: 1 pgs: 1 peering; 577 KiB data, 264 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:18 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/975446149' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c36d17d2-0bc8-4322-a998-9c8eff970e58"} : dispatch 2024-09-11T01:03:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:18 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c36d17d2-0bc8-4322-a998-9c8eff970e58"} : dispatch 2024-09-11T01:03:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:18 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c36d17d2-0bc8-4322-a998-9c8eff970e58"}]': finished 2024-09-11T01:03:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:18 smithi183 ceph-mon[34992]: osdmap e58: 10 total, 9 up, 10 in 2024-09-11T01:03:18.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:19.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:19 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/656508184' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:03:19.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:19 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/656508184' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:03:19.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:19 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/656508184' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:03:20.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:20 smithi103 ceph-mon[30562]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-11T01:03:20.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:20 smithi117 ceph-mon[35358]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-11T01:03:20.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:20 smithi183 ceph-mon[34992]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-11T01:03:22.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:22 smithi103 ceph-mon[30562]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T01:03:22.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:22 smithi117 ceph-mon[35358]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T01:03:22.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:22 smithi183 ceph-mon[34992]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T01:03:24.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:24 smithi103 ceph-mon[30562]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-11T01:03:24.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:24 smithi117 ceph-mon[35358]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-11T01:03:24.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:24 smithi183 ceph-mon[34992]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-11T01:03:26.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:26 smithi103 ceph-mon[30562]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:03:26.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:26 smithi117 ceph-mon[35358]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:03:26.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:26 smithi183 ceph-mon[34992]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:03:27.688 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:27 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-11T01:03:27.689 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:27 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:27.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-11T01:03:27.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:27 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:27.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:27 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-11T01:03:27.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:27 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:28.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:28 smithi103 ceph-mon[30562]: Deploying daemon osd.9 on smithi103 2024-09-11T01:03:28.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:28 smithi103 ceph-mon[30562]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:03:28.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:28 smithi117 ceph-mon[35358]: Deploying daemon osd.9 on smithi103 2024-09-11T01:03:28.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:28 smithi117 ceph-mon[35358]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:03:28.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:28 smithi183 ceph-mon[34992]: Deploying daemon osd.9 on smithi103 2024-09-11T01:03:28.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:28 smithi183 ceph-mon[34992]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:03:30.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:30 smithi103 ceph-mon[30562]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-11T01:03:30.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:30 smithi117 ceph-mon[35358]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-11T01:03:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:30 smithi183 ceph-mon[34992]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-11T01:03:32.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:32 smithi103 ceph-mon[30562]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:32 smithi117 ceph-mon[35358]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:32.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:32 smithi183 ceph-mon[34992]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:34.690 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:34 smithi103 ceph-mon[30562]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:34.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:34 smithi117 ceph-mon[35358]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:34 smithi183 ceph-mon[34992]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:35.853 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:03:35.853 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:35.853 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:35.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:03:35.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:35.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:03:35.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:35.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:36.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:36 smithi117 ceph-mon[35358]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:36.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:36 smithi103 ceph-mon[30562]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:36.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:36 smithi183 ceph-mon[34992]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:38.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:38 smithi103 ceph-mon[30562]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:38.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:38 smithi117 ceph-mon[35358]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:38 smithi183 ceph-mon[34992]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:39.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:39.872+0000 7fcd0ea00640 1 -- 172.21.15.103:0/2998942501 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fcd18063590 con 0x7fccfc0b5360 2024-09-11T01:03:39.875 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 9 on host 'smithi103' 2024-09-11T01:03:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:39.874+0000 7fcd1d000640 1 -- 172.21.15.103:0/2998942501 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fccfc0b5360 msgr2=0x7fccfc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:39.874+0000 7fcd1d000640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fccfc0b5360 0x7fccfc0b7820 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400bfd0 tx=0x7fcd0400b390 comp rx=0 tx=0).stop 2024-09-11T01:03:39.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:39.874+0000 7fcd1d000640 1 -- 172.21.15.103:0/2998942501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd18104c40 msgr2=0x7fcd1819b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:39.874+0000 7fcd1d000640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd18104c40 0x7fcd1819b020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcd08005ab0 tx=0x7fcd080042f0 comp rx=0 tx=0).stop 2024-09-11T01:03:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:39.875+0000 7fcd1d000640 1 -- 172.21.15.103:0/2998942501 shutdown_connections 2024-09-11T01:03:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:39.875+0000 7fcd1d000640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fccfc0b5360 0x7fccfc0b7820 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:39.875+0000 7fcd1d000640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcd18106760 0x7fcd1819c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:39.875+0000 7fcd1d000640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcd18105da0 0x7fcd1819b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:39.875+0000 7fcd1d000640 1 --2- 172.21.15.103:0/2998942501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcd18104c40 0x7fcd1819b020 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:39.875+0000 7fcd1d000640 1 -- 172.21.15.103:0/2998942501 >> 172.21.15.103:0/2998942501 conn(0x7fcd18100510 msgr2=0x7fcd18109190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:03:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:39.875+0000 7fcd1d000640 1 -- 172.21.15.103:0/2998942501 shutdown_connections 2024-09-11T01:03:39.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:03:39.875+0000 7fcd1d000640 1 -- 172.21.15.103:0/2998942501 wait complete. 2024-09-11T01:03:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:03:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:39 smithi103 ceph-mon[30562]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:40.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:40.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:40.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:40.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:03:40.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:40.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:39 smithi117 ceph-mon[35358]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:40.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:40.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:40.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:40.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:03:40.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:40.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:39 smithi183 ceph-mon[34992]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:40.842 DEBUG:teuthology.orchestra.run.smithi103:osd.9> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.9.service 2024-09-11T01:03:40.847 INFO:tasks.cephadm:Deploying osd.10 on smithi117 with /dev/vg_nvme/lv_1... 2024-09-11T01:03:40.847 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T01:03:41.012 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:03:41.012 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:41.012 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:41.102 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T01:03:41.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:03:41.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:41.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:41.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:03:41.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:41.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:42.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:41 smithi103 ceph-mon[30562]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-11T01:03:42.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:41 smithi103 ceph-mon[30562]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:42.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:41 smithi117 ceph-mon[35358]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-11T01:03:42.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:41 smithi117 ceph-mon[35358]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:42.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:41 smithi183 ceph-mon[34992]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-11T01:03:42.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:41 smithi183 ceph-mon[34992]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:42 smithi103 ceph-mon[30562]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T01:03:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:42 smithi103 ceph-mon[30562]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T01:03:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:42 smithi103 ceph-mon[30562]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T01:03:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:42 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:43.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:42 smithi117 ceph-mon[35358]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T01:03:43.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:42 smithi117 ceph-mon[35358]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T01:03:43.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:42 smithi117 ceph-mon[35358]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T01:03:43.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:42 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:43.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:42 smithi183 ceph-mon[34992]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-11T01:03:43.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:42 smithi183 ceph-mon[34992]: osdmap e59: 10 total, 9 up, 10 in 2024-09-11T01:03:43.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:42 smithi183 ceph-mon[34992]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]} : dispatch 2024-09-11T01:03:43.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:42 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:43.489 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-09-11T01:03:43.515 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi117:vg_nvme/lv_1 2024-09-11T01:03:43.766 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T01:03:43.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:43 smithi103 ceph-mon[30562]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-11T01:03:43.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:43 smithi103 ceph-mon[30562]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T01:03:43.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:43.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:43.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:43 smithi103 ceph-mon[30562]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:43.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:43 smithi103 ceph-mon[30562]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' 2024-09-11T01:03:43.832 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:03:43 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:03:43.572+0000 7f238f000640 -1 osd.9 0 waiting for initial osdmap 2024-09-11T01:03:43.833 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:03:43 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:03:43.599+0000 7f2385000640 -1 osd.9 60 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:03:44.047 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:43 smithi117 ceph-mon[35358]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-11T01:03:44.524 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:43 smithi117 ceph-mon[35358]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T01:03:44.524 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:44.524 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:44.524 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:43 smithi117 ceph-mon[35358]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:44.524 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:43 smithi117 ceph-mon[35358]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' 2024-09-11T01:03:44.525 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:43 smithi183 ceph-mon[34992]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-09-11T01:03:44.525 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:43 smithi183 ceph-mon[34992]: osdmap e60: 10 total, 9 up, 10 in 2024-09-11T01:03:44.525 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:44.526 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:44.526 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:43 smithi183 ceph-mon[34992]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 265 MiB used, 804 GiB / 805 GiB avail 2024-09-11T01:03:44.526 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:43 smithi183 ceph-mon[34992]: from='osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877]' entity='osd.9' 2024-09-11T01:03:44.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.223+0000 7f6b9d081640 1 -- 172.21.15.117:0/2266403409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b98108720 msgr2=0x7f6b9810abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:44.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.223+0000 7f6b9d081640 1 --2- 172.21.15.117:0/2266403409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b98108720 0x7f6b9810abe0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009ca0 tx=0x7f6b9002a8c0 comp rx=0 tx=0).stop 2024-09-11T01:03:44.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.224+0000 7f6b9d081640 1 -- 172.21.15.117:0/2266403409 shutdown_connections 2024-09-11T01:03:44.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.224+0000 7f6b9d081640 1 --2- 172.21.15.117:0/2266403409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b98108720 0x7f6b9810abe0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:44.526 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.224+0000 7f6b9d081640 1 --2- 172.21.15.117:0/2266403409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b98105bd0 0x7f6b98107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:44.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.224+0000 7f6b9d081640 1 --2- 172.21.15.117:0/2266403409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b9806b640 0x7f6b98105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:44.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.224+0000 7f6b9d081640 1 -- 172.21.15.117:0/2266403409 >> 172.21.15.117:0/2266403409 conn(0x7f6b980fd1e0 msgr2=0x7f6b980ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:03:44.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.224+0000 7f6b9d081640 1 -- 172.21.15.117:0/2266403409 shutdown_connections 2024-09-11T01:03:44.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.224+0000 7f6b9d081640 1 -- 172.21.15.117:0/2266403409 wait complete. 2024-09-11T01:03:44.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.224+0000 7f6b9d081640 1 Processor -- start 2024-09-11T01:03:44.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9d081640 1 -- start start 2024-09-11T01:03:44.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9d081640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b9806b640 0x7f6b98198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:44.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9d081640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b98105bd0 0x7f6b98199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:44.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9d081640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b98108720 0x7f6b98199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:44.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9d081640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9810e670 con 0x7f6b9806b640 2024-09-11T01:03:44.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9d081640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9810e4f0 con 0x7f6b98108720 2024-09-11T01:03:44.527 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9d081640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9810e7f0 con 0x7f6b98105bd0 2024-09-11T01:03:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b98108720 0x7f6b98199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9759e640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b98108720 0x7f6b98199f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:35878/0 (socket says 172.21.15.117:35878) 2024-09-11T01:03:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9759e640 1 -- 172.21.15.117:0/1749234314 learned_addr learned my addr 172.21.15.117:0/1749234314 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-09-11T01:03:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9659c640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b98105bd0 0x7f6b98199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b96d9d640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b9806b640 0x7f6b98198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9759e640 1 -- 172.21.15.117:0/1749234314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b98105bd0 msgr2=0x7f6b98199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9759e640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b98105bd0 0x7f6b98199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9759e640 1 -- 172.21.15.117:0/1749234314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b9806b640 msgr2=0x7f6b98198ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:03:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9759e640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b9806b640 0x7f6b98198ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:03:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9759e640 1 -- 172.21.15.117:0/1749234314 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9819a810 con 0x7f6b98108720 2024-09-11T01:03:44.528 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9659c640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b98105bd0 0x7f6b98199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:03:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.225+0000 7f6b9759e640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b98108720 0x7f6b98199f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b90031a20 tx=0x7f6b90003c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:03:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.226+0000 7f6b7ffff640 1 -- 172.21.15.117:0/1749234314 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b90004240 con 0x7f6b98108720 2024-09-11T01:03:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.226+0000 7f6b9d081640 1 -- 172.21.15.117:0/1749234314 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9819aaa0 con 0x7f6b98108720 2024-09-11T01:03:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.226+0000 7f6b7ffff640 1 -- 172.21.15.117:0/1749234314 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b90003e10 con 0x7f6b98108720 2024-09-11T01:03:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.226+0000 7f6b7ffff640 1 -- 172.21.15.117:0/1749234314 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b900305c0 con 0x7f6b98108720 2024-09-11T01:03:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.226+0000 7f6b9d081640 1 -- 172.21.15.117:0/1749234314 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b981a11e0 con 0x7f6b98108720 2024-09-11T01:03:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.227+0000 7f6b9d081640 1 -- 172.21.15.117:0/1749234314 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b98105fd0 con 0x7f6b98108720 2024-09-11T01:03:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.228+0000 7f6b7ffff640 1 -- 172.21.15.117:0/1749234314 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f6b9002f660 con 0x7f6b98108720 2024-09-11T01:03:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.229+0000 7f6b7ffff640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6b800b52e0 0x7f6b800b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:03:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.229+0000 7f6b7ffff640 1 -- 172.21.15.117:0/1749234314 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5981+0+0 (secure 0 0 0) 0x7f6b90106a10 con 0x7f6b98108720 2024-09-11T01:03:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.229+0000 7f6b96d9d640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6b800b52e0 0x7f6b800b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:03:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.230+0000 7f6b96d9d640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6b800b52e0 0x7f6b800b77a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6b88005fd0 tx=0x7f6b88005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:03:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.234+0000 7f6b7ffff640 1 -- 172.21.15.117:0/1749234314 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6b900ce1f0 con 0x7f6b98108720 2024-09-11T01:03:44.529 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:03:44.420+0000 7f6b9d081640 1 -- 172.21.15.117:0/1749234314 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f6b98063590 con 0x7f6b800b52e0 2024-09-11T01:03:45.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:44 smithi103 ceph-mon[30562]: purged_snaps scrub starts 2024-09-11T01:03:45.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:44 smithi103 ceph-mon[30562]: purged_snaps scrub ok 2024-09-11T01:03:45.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:45.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:44 smithi103 ceph-mon[30562]: from='client.24494 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:03:45.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:03:45.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:03:45.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:45.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:44 smithi103 ceph-mon[30562]: osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877] boot 2024-09-11T01:03:45.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:44 smithi103 ceph-mon[30562]: osdmap e61: 10 total, 10 up, 10 in 2024-09-11T01:03:45.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:45.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:44 smithi117 ceph-mon[35358]: purged_snaps scrub starts 2024-09-11T01:03:45.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:44 smithi117 ceph-mon[35358]: purged_snaps scrub ok 2024-09-11T01:03:45.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:45.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:44 smithi117 ceph-mon[35358]: from='client.24494 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:03:45.124 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:03:45.124 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:03:45.124 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:45.124 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:44 smithi117 ceph-mon[35358]: osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877] boot 2024-09-11T01:03:45.124 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:44 smithi117 ceph-mon[35358]: osdmap e61: 10 total, 10 up, 10 in 2024-09-11T01:03:45.124 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:45.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:44 smithi183 ceph-mon[34992]: purged_snaps scrub starts 2024-09-11T01:03:45.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:44 smithi183 ceph-mon[34992]: purged_snaps scrub ok 2024-09-11T01:03:45.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:45.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:44 smithi183 ceph-mon[34992]: from='client.24494 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi117:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:03:45.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:03:45.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:03:45.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:45.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:44 smithi183 ceph-mon[34992]: osd.9 [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877] boot 2024-09-11T01:03:45.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:44 smithi183 ceph-mon[34992]: osdmap e61: 10 total, 10 up, 10 in 2024-09-11T01:03:45.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-11T01:03:46.091 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:45 smithi117 ceph-mon[35358]: Detected new or changed devices on smithi103 2024-09-11T01:03:46.092 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:46.092 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:46.092 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:46.092 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:46.092 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:46.092 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:46.092 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:45 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi103 to 4272M 2024-09-11T01:03:46.092 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:46.092 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:46.092 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:03:46.092 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:45 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:46.092 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:45 smithi117 ceph-mon[35358]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:46.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:45 smithi183 ceph-mon[34992]: Detected new or changed devices on smithi103 2024-09-11T01:03:46.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:46.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:46.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:46.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:46.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:46.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:46.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:45 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi103 to 4272M 2024-09-11T01:03:46.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:46.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:46.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:03:46.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:45 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:46.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:45 smithi183 ceph-mon[34992]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:46.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:45 smithi103 ceph-mon[30562]: Detected new or changed devices on smithi103 2024-09-11T01:03:46.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:46.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:46.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:46.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:46.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:46.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T01:03:46.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:45 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi103 to 4272M 2024-09-11T01:03:46.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:46.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:46.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:03:46.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:45 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:03:46.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:45 smithi103 ceph-mon[30562]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:47.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:46 smithi117 ceph-mon[35358]: osdmap e62: 10 total, 10 up, 10 in 2024-09-11T01:03:47.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:46 smithi183 ceph-mon[34992]: osdmap e62: 10 total, 10 up, 10 in 2024-09-11T01:03:47.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:46 smithi103 ceph-mon[30562]: osdmap e62: 10 total, 10 up, 10 in 2024-09-11T01:03:48.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:47 smithi117 ceph-mon[35358]: from='client.? 172.21.15.117:0/2669576374' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e71bc5f7-a829-43cf-a10b-b2444da1d773"} : dispatch 2024-09-11T01:03:48.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:47 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e71bc5f7-a829-43cf-a10b-b2444da1d773"} : dispatch 2024-09-11T01:03:48.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:47 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e71bc5f7-a829-43cf-a10b-b2444da1d773"}]': finished 2024-09-11T01:03:48.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:47 smithi117 ceph-mon[35358]: osdmap e63: 11 total, 10 up, 11 in 2024-09-11T01:03:48.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:03:48.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:47 smithi117 ceph-mon[35358]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:48.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:47 smithi117 ceph-mon[35358]: from='client.? 172.21.15.117:0/3034598461' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:03:48.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:47 smithi183 ceph-mon[34992]: from='client.? 172.21.15.117:0/2669576374' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e71bc5f7-a829-43cf-a10b-b2444da1d773"} : dispatch 2024-09-11T01:03:48.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:47 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e71bc5f7-a829-43cf-a10b-b2444da1d773"} : dispatch 2024-09-11T01:03:48.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:47 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e71bc5f7-a829-43cf-a10b-b2444da1d773"}]': finished 2024-09-11T01:03:48.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:47 smithi183 ceph-mon[34992]: osdmap e63: 11 total, 10 up, 11 in 2024-09-11T01:03:48.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:03:48.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:47 smithi183 ceph-mon[34992]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:48.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:47 smithi183 ceph-mon[34992]: from='client.? 172.21.15.117:0/3034598461' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:03:48.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:47 smithi103 ceph-mon[30562]: from='client.? 172.21.15.117:0/2669576374' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e71bc5f7-a829-43cf-a10b-b2444da1d773"} : dispatch 2024-09-11T01:03:48.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:47 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e71bc5f7-a829-43cf-a10b-b2444da1d773"} : dispatch 2024-09-11T01:03:48.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:47 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e71bc5f7-a829-43cf-a10b-b2444da1d773"}]': finished 2024-09-11T01:03:48.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:47 smithi103 ceph-mon[30562]: osdmap e63: 11 total, 10 up, 11 in 2024-09-11T01:03:48.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:03:48.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:47 smithi103 ceph-mon[30562]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:48.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:47 smithi103 ceph-mon[30562]: from='client.? 172.21.15.117:0/3034598461' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:03:50.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:50 smithi103 ceph-mon[30562]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:50.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:50 smithi117 ceph-mon[35358]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:50.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:50 smithi183 ceph-mon[34992]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:52.642 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:52 smithi117 ceph-mon[35358]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:52.812 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:52 smithi103 ceph-mon[30562]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:52.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:52 smithi183 ceph-mon[34992]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:54.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:54 smithi117 ceph-mon[35358]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:54.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:54 smithi103 ceph-mon[30562]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:54.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:54 smithi183 ceph-mon[34992]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:55.825 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:55 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-11T01:03:55.825 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:55 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:55.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:55 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-11T01:03:55.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:55 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:55.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:55 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-11T01:03:55.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:55 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:03:56.828 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:56 smithi117 ceph-mon[35358]: Deploying daemon osd.10 on smithi117 2024-09-11T01:03:56.828 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:56 smithi117 ceph-mon[35358]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:56.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:56 smithi103 ceph-mon[30562]: Deploying daemon osd.10 on smithi117 2024-09-11T01:03:56.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:56 smithi103 ceph-mon[30562]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:56 smithi183 ceph-mon[34992]: Deploying daemon osd.10 on smithi117 2024-09-11T01:03:56.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:56 smithi183 ceph-mon[34992]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:58.817 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:03:58 smithi117 ceph-mon[35358]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:58.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:03:58 smithi103 ceph-mon[30562]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:03:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:03:58 smithi183 ceph-mon[34992]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:00.815 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:00 smithi117 ceph-mon[35358]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:00.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:00 smithi103 ceph-mon[30562]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:00 smithi183 ceph-mon[34992]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:01.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:01 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:01.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:01 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:01.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:01 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:01.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:01 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:01.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:01 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:01.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:01 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:01.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:01 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:01.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:01 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:01.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:01 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:02.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:02 smithi103 ceph-mon[30562]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:02.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:02 smithi117 ceph-mon[35358]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:02.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:02 smithi183 ceph-mon[34992]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:04.748 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:04 smithi117 ceph-mon[35358]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:04.749 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:04 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:04.749 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:04 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:04.749 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:04 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:04.749 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:04 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:04.749 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:04 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:04.793 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:04:04.790+0000 7f6b7ffff640 1 -- 172.21.15.117:0/1749234314 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f6b98063590 con 0x7f6b800b52e0 2024-09-11T01:04:04.793 INFO:teuthology.orchestra.run.smithi117.stdout:Created osd(s) 10 on host 'smithi117' 2024-09-11T01:04:04.794 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:04:04.793+0000 7f6b9d081640 1 -- 172.21.15.117:0/1749234314 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6b800b52e0 msgr2=0x7f6b800b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:04.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:04:04.793+0000 7f6b9d081640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6b800b52e0 0x7f6b800b77a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6b88005fd0 tx=0x7f6b88005e20 comp rx=0 tx=0).stop 2024-09-11T01:04:04.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:04:04.793+0000 7f6b9d081640 1 -- 172.21.15.117:0/1749234314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b98108720 msgr2=0x7f6b98199f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:04.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:04:04.793+0000 7f6b9d081640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b98108720 0x7f6b98199f70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b90031a20 tx=0x7f6b90003c20 comp rx=0 tx=0).stop 2024-09-11T01:04:04.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:04:04.793+0000 7f6b9d081640 1 -- 172.21.15.117:0/1749234314 shutdown_connections 2024-09-11T01:04:04.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:04:04.793+0000 7f6b9d081640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6b800b52e0 0x7f6b800b77a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:04.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:04:04.793+0000 7f6b9d081640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b98108720 0x7f6b98199f70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:04.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:04:04.793+0000 7f6b9d081640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6b98105bd0 0x7f6b98199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:04.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:04:04.793+0000 7f6b9d081640 1 --2- 172.21.15.117:0/1749234314 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b9806b640 0x7f6b98198ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:04.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:04:04.793+0000 7f6b9d081640 1 -- 172.21.15.117:0/1749234314 >> 172.21.15.117:0/1749234314 conn(0x7f6b980fd1e0 msgr2=0x7f6b98103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:04.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:04:04.793+0000 7f6b9d081640 1 -- 172.21.15.117:0/1749234314 shutdown_connections 2024-09-11T01:04:04.795 INFO:teuthology.orchestra.run.smithi117.stderr:2024-09-11T01:04:04.793+0000 7f6b9d081640 1 -- 172.21.15.117:0/1749234314 wait complete. 2024-09-11T01:04:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:04 smithi103 ceph-mon[30562]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:04 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:04 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:04 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:04 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:04 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:04 smithi183 ceph-mon[34992]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:04 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:04 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:04 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:04 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:04.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:04 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:05.448 DEBUG:teuthology.orchestra.run.smithi117:osd.10> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.10.service 2024-09-11T01:04:05.450 INFO:tasks.cephadm:Deploying osd.11 on smithi183 with /dev/vg_nvme/lv_1... 2024-09-11T01:04:05.451 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-11T01:04:05.702 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T01:04:05.742 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:05.743 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:05.743 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:05.793 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:05.793 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:05.793 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:05.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:05.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:05.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:06.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:06 smithi103 ceph-mon[30562]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:06.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:06 smithi117 ceph-mon[35358]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:06.916 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:06 smithi183 ceph-mon[34992]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:07.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:07 smithi117 ceph-mon[35358]: from='osd.10 [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-11T01:04:07.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:07 smithi117 ceph-mon[35358]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-11T01:04:07.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:04:07 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:04:07.365+0000 7efe4aa58640 -1 osd.10 0 log_to_monitors true 2024-09-11T01:04:07.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:07 smithi103 ceph-mon[30562]: from='osd.10 [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-11T01:04:07.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:07 smithi103 ceph-mon[30562]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-11T01:04:07.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:07 smithi183 ceph-mon[34992]: from='osd.10 [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-11T01:04:07.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:07 smithi183 ceph-mon[34992]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-11T01:04:08.327 INFO:teuthology.orchestra.run.smithi183.stdout: 2024-09-11T01:04:08.354 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch daemon add osd smithi183:vg_nvme/lv_1 2024-09-11T01:04:08.609 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T01:04:08.874 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:04:08.587+0000 7efe469db640 -1 osd.10 0 waiting for initial osdmap 2024-09-11T01:04:08.874 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:04:08.598+0000 7efe42802640 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:04:08.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:08.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T01:04:08.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T01:04:08.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:04:08.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: from='osd.10 [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:04:08.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:04:08.875 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:08.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:08.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:08.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:08.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:08.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:08.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:08.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:08.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:08.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:08.879 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:08.879 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T01:04:08.879 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T01:04:08.879 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:04:08.879 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: from='osd.10 [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:04:08.879 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:04:08.879 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:08.880 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:08.880 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:08.880 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:08.880 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:08.880 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:08.880 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:08.880 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:08.880 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:08.881 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:09.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:09.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-11T01:04:09.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: osdmap e64: 11 total, 10 up, 11 in 2024-09-11T01:04:09.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:04:09.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: from='osd.10 [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:04:09.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]} : dispatch 2024-09-11T01:04:09.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:09.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:09.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:09.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:09.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:09.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:09.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:09.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:09.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:09.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:09.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.086+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2316325149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b006b6e0 msgr2=0x7fc8b01055f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:09.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.086+0000 7fc8b6c92640 1 --2- 172.21.15.183:0/2316325149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b006b6e0 0x7fc8b01055f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009900 tx=0x7fc8a402a410 comp rx=0 tx=0).stop 2024-09-11T01:04:09.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.086+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2316325149 shutdown_connections 2024-09-11T01:04:09.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.086+0000 7fc8b6c92640 1 --2- 172.21.15.183:0/2316325149 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b0108730 0x7fc8b010abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:09.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.086+0000 7fc8b6c92640 1 --2- 172.21.15.183:0/2316325149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b0105b80 0x7fc8b0107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:09.091 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.086+0000 7fc8b6c92640 1 --2- 172.21.15.183:0/2316325149 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b006b6e0 0x7fc8b01055f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:09.092 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.086+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2316325149 >> 172.21.15.183:0/2316325149 conn(0x7fc8b00fd1e0 msgr2=0x7fc8b00ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:09.092 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.086+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2316325149 shutdown_connections 2024-09-11T01:04:09.092 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.086+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2316325149 wait complete. 2024-09-11T01:04:09.092 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b6c92640 1 Processor -- start 2024-09-11T01:04:09.092 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b6c92640 1 -- start start 2024-09-11T01:04:09.092 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b6c92640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b006b6e0 0x7fc8b0198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:09.092 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b6c92640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b0105b80 0x7fc8b01994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:09.092 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b6c92640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b0108730 0x7fc8b019a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:09.092 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b6c92640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b010e700 con 0x7fc8b0105b80 2024-09-11T01:04:09.092 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b6c92640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b010e580 con 0x7fc8b006b6e0 2024-09-11T01:04:09.093 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b6c92640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b010e880 con 0x7fc8b0108730 2024-09-11T01:04:09.093 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b522f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b0108730 0x7fc8b019a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:09.093 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b522f640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b0108730 0x7fc8b019a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:57822/0 (socket says 172.21.15.183:57822) 2024-09-11T01:04:09.093 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b522f640 1 -- 172.21.15.183:0/2591894233 learned_addr learned my addr 172.21.15.183:0/2591894233 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-09-11T01:04:09.093 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b4a2e640 1 --2- 172.21.15.183:0/2591894233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b006b6e0 0x7fc8b0198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:09.093 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8affff640 1 --2- 172.21.15.183:0/2591894233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b0105b80 0x7fc8b01994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:09.093 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b522f640 1 -- 172.21.15.183:0/2591894233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b006b6e0 msgr2=0x7fc8b0198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:09.093 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b522f640 1 --2- 172.21.15.183:0/2591894233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b006b6e0 0x7fc8b0198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:09.094 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b522f640 1 -- 172.21.15.183:0/2591894233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b0105b80 msgr2=0x7fc8b01994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:09.094 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.087+0000 7fc8b522f640 1 --2- 172.21.15.183:0/2591894233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b0105b80 0x7fc8b01994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:09.094 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.088+0000 7fc8b522f640 1 -- 172.21.15.183:0/2591894233 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b019a9b0 con 0x7fc8b0108730 2024-09-11T01:04:09.094 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.088+0000 7fc8b522f640 1 --2- 172.21.15.183:0/2591894233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b0108730 0x7fc8b019a110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800eaa0 tx=0x7fc8a800ef60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:09.094 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.088+0000 7fc8adffb640 1 -- 172.21.15.183:0/2591894233 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a800cdb0 con 0x7fc8b0108730 2024-09-11T01:04:09.094 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.088+0000 7fc8adffb640 1 -- 172.21.15.183:0/2591894233 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8a8005020 con 0x7fc8b0108730 2024-09-11T01:04:09.094 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.088+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2591894233 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b019aca0 con 0x7fc8b0108730 2024-09-11T01:04:09.094 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.088+0000 7fc8adffb640 1 -- 172.21.15.183:0/2591894233 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a80116d0 con 0x7fc8b0108730 2024-09-11T01:04:09.094 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.088+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2591894233 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b0101620 con 0x7fc8b0108730 2024-09-11T01:04:09.095 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.089+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2591894233 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b00fecd0 con 0x7fc8b0108730 2024-09-11T01:04:09.095 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.090+0000 7fc8adffb640 1 -- 172.21.15.183:0/2591894233 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fc8a800f040 con 0x7fc8b0108730 2024-09-11T01:04:09.095 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.091+0000 7fc8adffb640 1 --2- 172.21.15.183:0/2591894233 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc8a00b5360 0x7fc8a00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:09.095 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.092+0000 7fc8adffb640 1 -- 172.21.15.183:0/2591894233 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6414+0+0 (secure 0 0 0) 0x7fc8a80e5320 con 0x7fc8b0108730 2024-09-11T01:04:09.095 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.092+0000 7fc8b4a2e640 1 --2- 172.21.15.183:0/2591894233 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc8a00b5360 0x7fc8a00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:09.095 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.092+0000 7fc8b4a2e640 1 --2- 172.21.15.183:0/2591894233 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc8a00b5360 0x7fc8a00b7820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4000c00 tx=0x7fc8a40314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:09.097 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.095+0000 7fc8adffb640 1 -- 172.21.15.183:0/2591894233 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc8a8016030 con 0x7fc8b0108730 2024-09-11T01:04:09.286 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:09.284+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2591894233 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc8b002e930 con 0x7fc8a00b5360 2024-09-11T01:04:09.856 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:09 smithi183 ceph-mon[34992]: Detected new or changed devices on smithi117 2024-09-11T01:04:09.856 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:09 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi117 to 4272M 2024-09-11T01:04:09.856 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:09 smithi183 ceph-mon[34992]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-11T01:04:09.856 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:09 smithi183 ceph-mon[34992]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T01:04:09.857 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:09 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:04:09.857 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:09 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:04:09.857 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:09 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:04:09.857 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:09 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:04:09.857 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:09 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:09.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:09 smithi117 ceph-mon[35358]: Detected new or changed devices on smithi117 2024-09-11T01:04:09.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:09 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi117 to 4272M 2024-09-11T01:04:09.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:09 smithi117 ceph-mon[35358]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-11T01:04:09.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:09 smithi117 ceph-mon[35358]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T01:04:09.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:09 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:04:09.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:09 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:04:09.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:09 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:04:09.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:09 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:04:09.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:09 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:10.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:09 smithi103 ceph-mon[30562]: Detected new or changed devices on smithi117 2024-09-11T01:04:10.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:09 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi117 to 4272M 2024-09-11T01:04:10.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:09 smithi103 ceph-mon[30562]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi117", "root=default"]}]': finished 2024-09-11T01:04:10.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:09 smithi103 ceph-mon[30562]: osdmap e65: 11 total, 10 up, 11 in 2024-09-11T01:04:10.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:09 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:04:10.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:09 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:04:10.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:09 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-11T01:04:10.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:09 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-11T01:04:10.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:09 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:10 smithi117 ceph-mon[35358]: purged_snaps scrub starts 2024-09-11T01:04:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:10 smithi117 ceph-mon[35358]: purged_snaps scrub ok 2024-09-11T01:04:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:10 smithi117 ceph-mon[35358]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:04:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:10 smithi117 ceph-mon[35358]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:10 smithi117 ceph-mon[35358]: osd.10 [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873] boot 2024-09-11T01:04:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:10 smithi117 ceph-mon[35358]: osdmap e66: 11 total, 11 up, 11 in 2024-09-11T01:04:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:10 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:04:10.921 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:10 smithi183 ceph-mon[34992]: purged_snaps scrub starts 2024-09-11T01:04:10.922 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:10 smithi183 ceph-mon[34992]: purged_snaps scrub ok 2024-09-11T01:04:10.922 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:10 smithi183 ceph-mon[34992]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:04:10.922 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:10 smithi183 ceph-mon[34992]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:10.922 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:10 smithi183 ceph-mon[34992]: osd.10 [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873] boot 2024-09-11T01:04:10.922 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:10 smithi183 ceph-mon[34992]: osdmap e66: 11 total, 11 up, 11 in 2024-09-11T01:04:10.922 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:10 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:04:11.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:10 smithi103 ceph-mon[30562]: purged_snaps scrub starts 2024-09-11T01:04:11.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:10 smithi103 ceph-mon[30562]: purged_snaps scrub ok 2024-09-11T01:04:11.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:10 smithi103 ceph-mon[30562]: from='client.24487 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi183:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:04:11.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:10 smithi103 ceph-mon[30562]: pgmap v250: 1 pgs: 1 peering; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-11T01:04:11.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:10 smithi103 ceph-mon[30562]: osd.10 [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873] boot 2024-09-11T01:04:11.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:10 smithi103 ceph-mon[30562]: osdmap e66: 11 total, 11 up, 11 in 2024-09-11T01:04:11.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:10 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-11T01:04:11.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:11 smithi117 ceph-mon[35358]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T01:04:11.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:11 smithi117 ceph-mon[35358]: pgmap v253: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:11.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:11 smithi183 ceph-mon[34992]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T01:04:11.914 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:11 smithi183 ceph-mon[34992]: pgmap v253: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:12.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:11 smithi103 ceph-mon[30562]: osdmap e67: 11 total, 11 up, 11 in 2024-09-11T01:04:12.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:11 smithi103 ceph-mon[30562]: pgmap v253: 1 pgs: 1 peering; 577 KiB data, 327 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:12 smithi117 ceph-mon[35358]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T01:04:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:12 smithi117 ceph-mon[35358]: from='client.? 172.21.15.183:0/1407605072' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f36697f-4d18-4efa-bf14-d68a13464958"} : dispatch 2024-09-11T01:04:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:12 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f36697f-4d18-4efa-bf14-d68a13464958"} : dispatch 2024-09-11T01:04:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:12 smithi117 ceph-mon[35358]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f36697f-4d18-4efa-bf14-d68a13464958"}]': finished 2024-09-11T01:04:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:12 smithi117 ceph-mon[35358]: osdmap e69: 12 total, 11 up, 12 in 2024-09-11T01:04:12.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:12 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:12.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:12 smithi117 ceph-mon[35358]: from='client.? 172.21.15.183:0/1189718358' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:04:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:12 smithi183 ceph-mon[34992]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T01:04:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:12 smithi183 ceph-mon[34992]: from='client.? 172.21.15.183:0/1407605072' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f36697f-4d18-4efa-bf14-d68a13464958"} : dispatch 2024-09-11T01:04:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:12 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f36697f-4d18-4efa-bf14-d68a13464958"} : dispatch 2024-09-11T01:04:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:12 smithi183 ceph-mon[34992]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f36697f-4d18-4efa-bf14-d68a13464958"}]': finished 2024-09-11T01:04:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:12 smithi183 ceph-mon[34992]: osdmap e69: 12 total, 11 up, 12 in 2024-09-11T01:04:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:12 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:12.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:12 smithi183 ceph-mon[34992]: from='client.? 172.21.15.183:0/1189718358' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:04:13.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:12 smithi103 ceph-mon[30562]: osdmap e68: 11 total, 11 up, 11 in 2024-09-11T01:04:13.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:12 smithi103 ceph-mon[30562]: from='client.? 172.21.15.183:0/1407605072' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f36697f-4d18-4efa-bf14-d68a13464958"} : dispatch 2024-09-11T01:04:13.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:12 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8f36697f-4d18-4efa-bf14-d68a13464958"} : dispatch 2024-09-11T01:04:13.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:12 smithi103 ceph-mon[30562]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f36697f-4d18-4efa-bf14-d68a13464958"}]': finished 2024-09-11T01:04:13.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:12 smithi103 ceph-mon[30562]: osdmap e69: 12 total, 11 up, 12 in 2024-09-11T01:04:13.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:12 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:13.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:12 smithi103 ceph-mon[30562]: from='client.? 172.21.15.183:0/1189718358' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-11T01:04:13.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:13 smithi117 ceph-mon[35358]: pgmap v256: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:13.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:13 smithi183 ceph-mon[34992]: pgmap v256: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:14.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:13 smithi103 ceph-mon[30562]: pgmap v256: 1 pgs: 1 peering; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:16 smithi103 ceph-mon[30562]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-11T01:04:16.836 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:16 smithi183 ceph-mon[34992]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-11T01:04:16.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:16 smithi117 ceph-mon[35358]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-11T01:04:18.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:18 smithi103 ceph-mon[30562]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-11T01:04:18.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:18 smithi117 ceph-mon[35358]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-11T01:04:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:18 smithi183 ceph-mon[34992]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 329 MiB used, 983 GiB / 983 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-09-11T01:04:20.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:20 smithi103 ceph-mon[30562]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T01:04:20.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:20 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-11T01:04:20.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:20 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:20.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:20 smithi117 ceph-mon[35358]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T01:04:20.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:20 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-11T01:04:20.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:20 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:20.912 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:20 smithi183 ceph-mon[34992]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-11T01:04:20.912 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:20 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-11T01:04:20.912 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:20 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:21.570 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:21 smithi103 ceph-mon[30562]: Deploying daemon osd.11 on smithi183 2024-09-11T01:04:21.657 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:21 smithi183 ceph-mon[34992]: Deploying daemon osd.11 on smithi183 2024-09-11T01:04:21.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:21 smithi117 ceph-mon[35358]: Deploying daemon osd.11 on smithi183 2024-09-11T01:04:22.815 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:22 smithi183 ceph-mon[34992]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:04:22.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:22 smithi103 ceph-mon[30562]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:04:22.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:22 smithi117 ceph-mon[35358]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-11T01:04:24.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:24 smithi103 ceph-mon[30562]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-11T01:04:24.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:24 smithi117 ceph-mon[35358]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-11T01:04:24.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:24 smithi183 ceph-mon[34992]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-11T01:04:26.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:26 smithi183 ceph-mon[34992]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T01:04:26.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:26.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:26.649 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:26.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:26 smithi103 ceph-mon[30562]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T01:04:26.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:26.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:26.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:26.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:26 smithi117 ceph-mon[35358]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-11T01:04:26.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:26.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:26.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:28.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:28 smithi183 ceph-mon[34992]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:28.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:28 smithi103 ceph-mon[30562]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:28.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:28 smithi117 ceph-mon[35358]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:29.173 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:29.172+0000 7fc8adffb640 1 -- 172.21.15.183:0/2591894233 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fc8b002e930 con 0x7fc8a00b5360 2024-09-11T01:04:29.174 INFO:teuthology.orchestra.run.smithi183.stdout:Created osd(s) 11 on host 'smithi183' 2024-09-11T01:04:29.176 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:29.174+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2591894233 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc8a00b5360 msgr2=0x7fc8a00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:29.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:29.174+0000 7fc8b6c92640 1 --2- 172.21.15.183:0/2591894233 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc8a00b5360 0x7fc8a00b7820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4000c00 tx=0x7fc8a40314a0 comp rx=0 tx=0).stop 2024-09-11T01:04:29.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:29.174+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2591894233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b0108730 msgr2=0x7fc8b019a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:29.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:29.174+0000 7fc8b6c92640 1 --2- 172.21.15.183:0/2591894233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b0108730 0x7fc8b019a110 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800eaa0 tx=0x7fc8a800ef60 comp rx=0 tx=0).stop 2024-09-11T01:04:29.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:29.174+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2591894233 shutdown_connections 2024-09-11T01:04:29.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:29.174+0000 7fc8b6c92640 1 --2- 172.21.15.183:0/2591894233 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc8a00b5360 0x7fc8a00b7820 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:29.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:29.174+0000 7fc8b6c92640 1 --2- 172.21.15.183:0/2591894233 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc8b0108730 0x7fc8b019a110 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:29.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:29.174+0000 7fc8b6c92640 1 --2- 172.21.15.183:0/2591894233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc8b0105b80 0x7fc8b01994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:29.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:29.174+0000 7fc8b6c92640 1 --2- 172.21.15.183:0/2591894233 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8b006b6e0 0x7fc8b0198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:29.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:29.174+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2591894233 >> 172.21.15.183:0/2591894233 conn(0x7fc8b00fd1e0 msgr2=0x7fc8b0103e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:29.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:29.174+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2591894233 shutdown_connections 2024-09-11T01:04:29.177 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:29.174+0000 7fc8b6c92640 1 -- 172.21.15.183:0/2591894233 wait complete. 2024-09-11T01:04:29.864 DEBUG:teuthology.orchestra.run.smithi183:osd.11> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.11.service 2024-09-11T01:04:29.867 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-11T01:04:29.867 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T01:04:30.251 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:04:30.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:30 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:30.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:30 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:30.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:30 smithi103 ceph-mon[30562]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:30.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:30 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:30.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:30 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:30.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:30 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:30.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:30 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:30.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:30 smithi183 ceph-mon[34992]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:30.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:30 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:30.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:30 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:30.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:30 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:30.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:30 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:30.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:30 smithi117 ceph-mon[35358]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:30.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:30 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:30.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:30 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:30.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.846+0000 7fa3fa600640 1 -- 172.21.15.103:0/1189395603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3f4104c40 msgr2=0x7fa3f4105040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:30.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.846+0000 7fa3fa600640 1 --2- 172.21.15.103:0/1189395603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3f4104c40 0x7fa3f4105040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4009cd0 tx=0x7fa3e402a8e0 comp rx=0 tx=0).stop 2024-09-11T01:04:30.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.847+0000 7fa3fa600640 1 -- 172.21.15.103:0/1189395603 shutdown_connections 2024-09-11T01:04:30.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.847+0000 7fa3fa600640 1 --2- 172.21.15.103:0/1189395603 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f4106760 0x7fa3f410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:30.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.847+0000 7fa3fa600640 1 --2- 172.21.15.103:0/1189395603 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3f4105da0 0x7fa3f4106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:30.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.847+0000 7fa3fa600640 1 --2- 172.21.15.103:0/1189395603 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3f4104c40 0x7fa3f4105040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:30.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.847+0000 7fa3fa600640 1 -- 172.21.15.103:0/1189395603 >> 172.21.15.103:0/1189395603 conn(0x7fa3f4100510 msgr2=0x7fa3f4102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:30.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.847+0000 7fa3fa600640 1 -- 172.21.15.103:0/1189395603 shutdown_connections 2024-09-11T01:04:30.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.847+0000 7fa3fa600640 1 -- 172.21.15.103:0/1189395603 wait complete. 2024-09-11T01:04:30.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.848+0000 7fa3fa600640 1 Processor -- start 2024-09-11T01:04:30.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.848+0000 7fa3fa600640 1 -- start start 2024-09-11T01:04:30.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.848+0000 7fa3fa600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3f4104c40 0x7fa3f419b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:30.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.848+0000 7fa3fa600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3f4105da0 0x7fa3f419b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:30.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.848+0000 7fa3fa600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f4106760 0x7fa3f419c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:30.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.848+0000 7fa3fa600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f4110910 con 0x7fa3f4105da0 2024-09-11T01:04:30.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.848+0000 7fa3fa600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f4110790 con 0x7fa3f4106760 2024-09-11T01:04:30.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.848+0000 7fa3fa600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f4110a90 con 0x7fa3f4104c40 2024-09-11T01:04:30.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.849+0000 7fa3f3400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3f4104c40 0x7fa3f419b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:30.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.849+0000 7fa3f2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3f4105da0 0x7fa3f419b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:30.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.849+0000 7fa3f3400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3f4104c40 0x7fa3f419b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:51358/0 (socket says 172.21.15.103:51358) 2024-09-11T01:04:30.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.849+0000 7fa3f3400640 1 -- 172.21.15.103:0/3340099143 learned_addr learned my addr 172.21.15.103:0/3340099143 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:04:30.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.849+0000 7fa3f3e00640 1 --2- 172.21.15.103:0/3340099143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f4106760 0x7fa3f419c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:30.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.849+0000 7fa3f3400640 1 -- 172.21.15.103:0/3340099143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f4106760 msgr2=0x7fa3f419c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:30.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.849+0000 7fa3f3400640 1 --2- 172.21.15.103:0/3340099143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f4106760 0x7fa3f419c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:30.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.849+0000 7fa3f3400640 1 -- 172.21.15.103:0/3340099143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3f4105da0 msgr2=0x7fa3f419b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:30.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.849+0000 7fa3f3400640 1 --2- 172.21.15.103:0/3340099143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3f4105da0 0x7fa3f419b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:30.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.849+0000 7fa3f3400640 1 -- 172.21.15.103:0/3340099143 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f419cb80 con 0x7fa3f4104c40 2024-09-11T01:04:30.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.849+0000 7fa3f3e00640 1 --2- 172.21.15.103:0/3340099143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f4106760 0x7fa3f419c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:04:30.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.849+0000 7fa3f3400640 1 --2- 172.21.15.103:0/3340099143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3f4104c40 0x7fa3f419b0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4000f80 tx=0x7fa3e4003b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:30.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.850+0000 7fa3ebe00640 1 -- 172.21.15.103:0/3340099143 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e4004240 con 0x7fa3f4104c40 2024-09-11T01:04:30.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.850+0000 7fa3ebe00640 1 -- 172.21.15.103:0/3340099143 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3e40305a0 con 0x7fa3f4104c40 2024-09-11T01:04:30.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.850+0000 7fa3fa600640 1 -- 172.21.15.103:0/3340099143 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f419ce10 con 0x7fa3f4104c40 2024-09-11T01:04:30.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.850+0000 7fa3ebe00640 1 -- 172.21.15.103:0/3340099143 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e403a660 con 0x7fa3f4104c40 2024-09-11T01:04:30.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.850+0000 7fa3fa600640 1 -- 172.21.15.103:0/3340099143 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f41a3550 con 0x7fa3f4104c40 2024-09-11T01:04:30.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.851+0000 7fa3fa600640 1 -- 172.21.15.103:0/3340099143 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f4105040 con 0x7fa3f4104c40 2024-09-11T01:04:30.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.853+0000 7fa3ebe00640 1 -- 172.21.15.103:0/3340099143 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fa3e404d020 con 0x7fa3f4104c40 2024-09-11T01:04:30.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.854+0000 7fa3ebe00640 1 --2- 172.21.15.103:0/3340099143 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3d80b52e0 0x7fa3d80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:30.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.854+0000 7fa3ebe00640 1 -- 172.21.15.103:0/3340099143 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6809+0+0 (secure 0 0 0) 0x7fa3e402e030 con 0x7fa3f4104c40 2024-09-11T01:04:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.855+0000 7fa3f2a00640 1 --2- 172.21.15.103:0/3340099143 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3d80b52e0 0x7fa3d80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.855+0000 7fa3f2a00640 1 --2- 172.21.15.103:0/3340099143 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3d80b52e0 0x7fa3d80b77a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009bd0 tx=0x7fa3e0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:30.858+0000 7fa3ebe00640 1 -- 172.21.15.103:0/3340099143 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa3e40cd7b0 con 0x7fa3f4104c40 2024-09-11T01:04:31.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:31.042+0000 7fa3fa600640 1 -- 172.21.15.103:0/3340099143 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fa3f4063d50 con 0x7fa3f4104c40 2024-09-11T01:04:31.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:31.043+0000 7fa3ebe00640 1 -- 172.21.15.103:0/3340099143 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7fa3e40cd0b0 con 0x7fa3f4104c40 2024-09-11T01:04:31.047 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:04:31.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:31.045+0000 7fa3fa600640 1 -- 172.21.15.103:0/3340099143 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3d80b52e0 msgr2=0x7fa3d80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:31.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:31.045+0000 7fa3fa600640 1 --2- 172.21.15.103:0/3340099143 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3d80b52e0 0x7fa3d80b77a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0009bd0 tx=0x7fa3e0005f90 comp rx=0 tx=0).stop 2024-09-11T01:04:31.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:31.045+0000 7fa3fa600640 1 -- 172.21.15.103:0/3340099143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3f4104c40 msgr2=0x7fa3f419b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:31.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:31.045+0000 7fa3fa600640 1 --2- 172.21.15.103:0/3340099143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3f4104c40 0x7fa3f419b0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa3e4000f80 tx=0x7fa3e4003b80 comp rx=0 tx=0).stop 2024-09-11T01:04:31.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:31.046+0000 7fa3fa600640 1 -- 172.21.15.103:0/3340099143 shutdown_connections 2024-09-11T01:04:31.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:31.046+0000 7fa3fa600640 1 --2- 172.21.15.103:0/3340099143 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3d80b52e0 0x7fa3d80b77a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:31.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:31.046+0000 7fa3fa600640 1 --2- 172.21.15.103:0/3340099143 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3f4106760 0x7fa3f419c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:31.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:31.046+0000 7fa3fa600640 1 --2- 172.21.15.103:0/3340099143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3f4105da0 0x7fa3f419b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:31.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:31.046+0000 7fa3fa600640 1 --2- 172.21.15.103:0/3340099143 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3f4104c40 0x7fa3f419b0c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:31.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:31.046+0000 7fa3fa600640 1 -- 172.21.15.103:0/3340099143 >> 172.21.15.103:0/3340099143 conn(0x7fa3f4100510 msgr2=0x7fa3f4109190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:31.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:31.046+0000 7fa3fa600640 1 -- 172.21.15.103:0/3340099143 shutdown_connections 2024-09-11T01:04:31.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:31.046+0000 7fa3fa600640 1 -- 172.21.15.103:0/3340099143 wait complete. 2024-09-11T01:04:31.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:31 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3340099143' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T01:04:31.480 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:31 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3340099143' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T01:04:31.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:31 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3340099143' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T01:04:31.975 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":69,"num_osds":12,"num_up_osds":11,"osd_up_since":1726016649,"num_in_osds":12,"osd_in_since":1726016651,"num_remapped_pgs":0} 2024-09-11T01:04:32.081 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:04:31 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:04:31.940+0000 7fd8b04f1640 -1 osd.11 0 log_to_monitors true 2024-09-11T01:04:32.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:32 smithi183 ceph-mon[34992]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:32.420 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:32 smithi183 ceph-mon[34992]: from='osd.11 [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-11T01:04:32.420 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:32 smithi183 ceph-mon[34992]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-11T01:04:32.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:32 smithi103 ceph-mon[30562]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:32.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:32 smithi103 ceph-mon[30562]: from='osd.11 [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-11T01:04:32.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:32 smithi103 ceph-mon[30562]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-11T01:04:32.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:32 smithi117 ceph-mon[35358]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:32.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:32 smithi117 ceph-mon[35358]: from='osd.11 [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-11T01:04:32.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:32 smithi117 ceph-mon[35358]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-11T01:04:32.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T01:04:33.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:33 smithi103 ceph-mon[30562]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T01:04:33.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:33 smithi103 ceph-mon[30562]: from='osd.11 [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:04:33.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:33 smithi103 ceph-mon[30562]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T01:04:33.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:33 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:33.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:33 smithi103 ceph-mon[30562]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:04:33.356 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:04:33.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:33 smithi117 ceph-mon[35358]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T01:04:33.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:33 smithi117 ceph-mon[35358]: from='osd.11 [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:04:33.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:33 smithi117 ceph-mon[35358]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T01:04:33.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:33 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:33.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:33 smithi117 ceph-mon[35358]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:04:33.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:33 smithi183 ceph-mon[34992]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-11T01:04:33.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:33 smithi183 ceph-mon[34992]: from='osd.11 [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:04:33.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:33 smithi183 ceph-mon[34992]: osdmap e70: 12 total, 11 up, 12 in 2024-09-11T01:04:33.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:33 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:33.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:33 smithi183 ceph-mon[34992]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]} : dispatch 2024-09-11T01:04:34.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.942+0000 7fe596400640 1 -- 172.21.15.103:0/1831909243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe590103b80 msgr2=0x7fe590104000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:34.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.942+0000 7fe596400640 1 --2- 172.21.15.103:0/1831909243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe590103b80 0x7fe590104000 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009930 tx=0x7fe57c02a420 comp rx=0 tx=0).stop 2024-09-11T01:04:34.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.942+0000 7fe596400640 1 -- 172.21.15.103:0/1831909243 shutdown_connections 2024-09-11T01:04:34.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.942+0000 7fe596400640 1 --2- 172.21.15.103:0/1831909243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe590104540 0x7fe59010aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:34.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.942+0000 7fe596400640 1 --2- 172.21.15.103:0/1831909243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe590103b80 0x7fe590104000 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:34.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.942+0000 7fe596400640 1 --2- 172.21.15.103:0/1831909243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe590102a20 0x7fe590102e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:34.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.942+0000 7fe596400640 1 -- 172.21.15.103:0/1831909243 >> 172.21.15.103:0/1831909243 conn(0x7fe5900fe2f0 msgr2=0x7fe590100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.942+0000 7fe596400640 1 -- 172.21.15.103:0/1831909243 shutdown_connections 2024-09-11T01:04:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.942+0000 7fe596400640 1 -- 172.21.15.103:0/1831909243 wait complete. 2024-09-11T01:04:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.944+0000 7fe596400640 1 Processor -- start 2024-09-11T01:04:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.944+0000 7fe596400640 1 -- start start 2024-09-11T01:04:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.944+0000 7fe596400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe590102a20 0x7fe59019b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.944+0000 7fe596400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe590103b80 0x7fe59019b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.944+0000 7fe596400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe590104540 0x7fe59019c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.944+0000 7fe596400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe59010e680 con 0x7fe590103b80 2024-09-11T01:04:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.944+0000 7fe596400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe59010e500 con 0x7fe590102a20 2024-09-11T01:04:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.944+0000 7fe596400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe59010e800 con 0x7fe590104540 2024-09-11T01:04:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.944+0000 7fe58ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe590103b80 0x7fe59019b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe58ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe590103b80 0x7fe59019b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33454/0 (socket says 172.21.15.103:33454) 2024-09-11T01:04:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe58ea00640 1 -- 172.21.15.103:0/452259857 learned_addr learned my addr 172.21.15.103:0/452259857 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:04:34.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe58f400640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe590102a20 0x7fe59019b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe58fe00640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe590104540 0x7fe59019c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe58ea00640 1 -- 172.21.15.103:0/452259857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe590104540 msgr2=0x7fe59019c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe58ea00640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe590104540 0x7fe59019c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe58ea00640 1 -- 172.21.15.103:0/452259857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe590102a20 msgr2=0x7fe59019b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe58ea00640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe590102a20 0x7fe59019b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe58ea00640 1 -- 172.21.15.103:0/452259857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59019cb60 con 0x7fe590103b80 2024-09-11T01:04:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe58fe00640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe590104540 0x7fe59019c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:04:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe58ea00640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe590103b80 0x7fe59019b680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe57c005ab0 tx=0x7fe57c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe587e00640 1 -- 172.21.15.103:0/452259857 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c03f030 con 0x7fe590103b80 2024-09-11T01:04:34.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe587e00640 1 -- 172.21.15.103:0/452259857 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe57c032e40 con 0x7fe590103b80 2024-09-11T01:04:34.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe587e00640 1 -- 172.21.15.103:0/452259857 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe57c035070 con 0x7fe590103b80 2024-09-11T01:04:34.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.945+0000 7fe596400640 1 -- 172.21.15.103:0/452259857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe59019cdf0 con 0x7fe590103b80 2024-09-11T01:04:34.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.946+0000 7fe596400640 1 -- 172.21.15.103:0/452259857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5901a3360 con 0x7fe590103b80 2024-09-11T01:04:34.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.947+0000 7fe596400640 1 -- 172.21.15.103:0/452259857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5901a35c0 con 0x7fe590103b80 2024-09-11T01:04:34.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.949+0000 7fe587e00640 1 -- 172.21.15.103:0/452259857 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fe57c03ba60 con 0x7fe590103b80 2024-09-11T01:04:34.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.950+0000 7fe587e00640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe5740b52e0 0x7fe5740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:34.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.950+0000 7fe587e00640 1 -- 172.21.15.103:0/452259857 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6847+0+0 (secure 0 0 0) 0x7fe57c1062c0 con 0x7fe590103b80 2024-09-11T01:04:34.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.951+0000 7fe58f400640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe5740b52e0 0x7fe5740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:34.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.951+0000 7fe58f400640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe5740b52e0 0x7fe5740b77a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe580009bd0 tx=0x7fe580005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:34.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:33.953+0000 7fe587e00640 1 -- 172.21.15.103:0/452259857 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe57c0cd6a0 con 0x7fe590103b80 2024-09-11T01:04:34.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:34.140+0000 7fe596400640 1 -- 172.21.15.103:0/452259857 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe5901a3790 con 0x7fe590103b80 2024-09-11T01:04:34.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:34.140+0000 7fe587e00640 1 -- 172.21.15.103:0/452259857 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fe57c0ccfa0 con 0x7fe590103b80 2024-09-11T01:04:34.143 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:04:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:34.143+0000 7fe596400640 1 -- 172.21.15.103:0/452259857 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe5740b52e0 msgr2=0x7fe5740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:34.143+0000 7fe596400640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe5740b52e0 0x7fe5740b77a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe580009bd0 tx=0x7fe580005f90 comp rx=0 tx=0).stop 2024-09-11T01:04:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:34.143+0000 7fe596400640 1 -- 172.21.15.103:0/452259857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe590103b80 msgr2=0x7fe59019b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:34.143+0000 7fe596400640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe590103b80 0x7fe59019b680 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe57c005ab0 tx=0x7fe57c0042f0 comp rx=0 tx=0).stop 2024-09-11T01:04:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:34.143+0000 7fe596400640 1 -- 172.21.15.103:0/452259857 shutdown_connections 2024-09-11T01:04:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:34.143+0000 7fe596400640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe5740b52e0 0x7fe5740b77a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:34.143+0000 7fe596400640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe590104540 0x7fe59019c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:34.143+0000 7fe596400640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe590103b80 0x7fe59019b680 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:34.143+0000 7fe596400640 1 --2- 172.21.15.103:0/452259857 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe590102a20 0x7fe59019b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:34.143+0000 7fe596400640 1 -- 172.21.15.103:0/452259857 >> 172.21.15.103:0/452259857 conn(0x7fe5900fe2f0 msgr2=0x7fe590109310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:34.143+0000 7fe596400640 1 -- 172.21.15.103:0/452259857 shutdown_connections 2024-09-11T01:04:34.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:34.143+0000 7fe596400640 1 -- 172.21.15.103:0/452259857 wait complete. 2024-09-11T01:04:34.168 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:04:33 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:04:33.892+0000 7fd8ac474640 -1 osd.11 0 waiting for initial osdmap 2024-09-11T01:04:34.168 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:04:33 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:04:33.905+0000 7fd8a4293640 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T01:04:34.538 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-09-11T01:04:34.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T01:04:34.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:34.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:34.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: Detected new or changed devices on smithi183 2024-09-11T01:04:34.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:34.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:34.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:34.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:34.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi183 to 4272M 2024-09-11T01:04:34.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.540 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:34.540 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:34.540 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.540 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:34.540 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:34.540 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:34.540 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:34.540 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.540 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='osd.11 ' entity='osd.11' 2024-09-11T01:04:34.540 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:34 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/452259857' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T01:04:34.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-09-11T01:04:34.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T01:04:34.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:34.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:34.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: Detected new or changed devices on smithi183 2024-09-11T01:04:34.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:34.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:34.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:34.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:34.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi183 to 4272M 2024-09-11T01:04:34.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:34.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:34.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:34.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:34.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:34.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:34.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='osd.11 ' entity='osd.11' 2024-09-11T01:04:34.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:34 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/452259857' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T01:04:34.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi183", "root=default"]}]': finished 2024-09-11T01:04:34.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: osdmap e71: 12 total, 11 up, 12 in 2024-09-11T01:04:34.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:34.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:34.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: Detected new or changed devices on smithi183 2024-09-11T01:04:34.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:34.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:34.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:34.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T01:04:34.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi183 to 4272M 2024-09-11T01:04:34.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:34.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:34.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 983 GiB / 983 GiB avail 2024-09-11T01:04:34.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:34.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:34.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:34.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:34.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='osd.11 ' entity='osd.11' 2024-09-11T01:04:34.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:34 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/452259857' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T01:04:35.027 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726016649,"num_in_osds":12,"osd_in_since":1726016651,"num_remapped_pgs":0} 2024-09-11T01:04:35.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:35 smithi103 ceph-mon[30562]: purged_snaps scrub starts 2024-09-11T01:04:35.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:35 smithi103 ceph-mon[30562]: purged_snaps scrub ok 2024-09-11T01:04:35.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:35.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:35 smithi103 ceph-mon[30562]: osd.11 [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289] boot 2024-09-11T01:04:35.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:35 smithi103 ceph-mon[30562]: osdmap e72: 12 total, 12 up, 12 in 2024-09-11T01:04:35.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:35 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:35.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:35 smithi117 ceph-mon[35358]: purged_snaps scrub starts 2024-09-11T01:04:35.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:35 smithi117 ceph-mon[35358]: purged_snaps scrub ok 2024-09-11T01:04:35.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:35.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:35 smithi117 ceph-mon[35358]: osd.11 [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289] boot 2024-09-11T01:04:35.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:35 smithi117 ceph-mon[35358]: osdmap e72: 12 total, 12 up, 12 in 2024-09-11T01:04:35.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:35 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:35.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:35 smithi183 ceph-mon[34992]: purged_snaps scrub starts 2024-09-11T01:04:35.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:35 smithi183 ceph-mon[34992]: purged_snaps scrub ok 2024-09-11T01:04:35.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:35.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:35 smithi183 ceph-mon[34992]: osd.11 [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289] boot 2024-09-11T01:04:35.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:35 smithi183 ceph-mon[34992]: osdmap e72: 12 total, 12 up, 12 in 2024-09-11T01:04:35.670 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:35 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-11T01:04:36.028 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd stat -f json 2024-09-11T01:04:36.331 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:36 smithi103 ceph-mon[30562]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:36.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:36 smithi103 ceph-mon[30562]: osdmap e73: 12 total, 12 up, 12 in 2024-09-11T01:04:36.401 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:04:36.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:36 smithi117 ceph-mon[35358]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:36.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:36 smithi117 ceph-mon[35358]: osdmap e73: 12 total, 12 up, 12 in 2024-09-11T01:04:36.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:36 smithi183 ceph-mon[34992]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:36.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:36 smithi183 ceph-mon[34992]: osdmap e73: 12 total, 12 up, 12 in 2024-09-11T01:04:37.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.992+0000 7faf2fe00640 1 -- 172.21.15.103:0/2292145689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf28106760 msgr2=0x7faf2810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:37.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.992+0000 7faf2fe00640 1 --2- 172.21.15.103:0/2292145689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf28106760 0x7faf2810d0e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7faf20009cd0 tx=0x7faf2002a8e0 comp rx=0 tx=0).stop 2024-09-11T01:04:37.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.992+0000 7faf2fe00640 1 -- 172.21.15.103:0/2292145689 shutdown_connections 2024-09-11T01:04:37.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.992+0000 7faf2fe00640 1 --2- 172.21.15.103:0/2292145689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf28106760 0x7faf2810d0e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:37.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.992+0000 7faf2fe00640 1 --2- 172.21.15.103:0/2292145689 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf28105da0 0x7faf28106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:37.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.992+0000 7faf2fe00640 1 --2- 172.21.15.103:0/2292145689 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf28104c40 0x7faf28105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:37.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.992+0000 7faf2fe00640 1 -- 172.21.15.103:0/2292145689 >> 172.21.15.103:0/2292145689 conn(0x7faf28100550 msgr2=0x7faf28102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:37.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.992+0000 7faf2fe00640 1 -- 172.21.15.103:0/2292145689 shutdown_connections 2024-09-11T01:04:37.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.992+0000 7faf2fe00640 1 -- 172.21.15.103:0/2292145689 wait complete. 2024-09-11T01:04:37.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.993+0000 7faf2fe00640 1 Processor -- start 2024-09-11T01:04:37.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.994+0000 7faf2fe00640 1 -- start start 2024-09-11T01:04:37.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.994+0000 7faf2fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf28104c40 0x7faf2819afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:37.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.994+0000 7faf2fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf28105da0 0x7faf2819b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:37.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.994+0000 7faf2fe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf28106760 0x7faf2819c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:37.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.994+0000 7faf2fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faf28110910 con 0x7faf28104c40 2024-09-11T01:04:37.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.994+0000 7faf2fe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faf28110790 con 0x7faf28105da0 2024-09-11T01:04:37.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.994+0000 7faf2fe00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faf28110a90 con 0x7faf28106760 2024-09-11T01:04:37.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.994+0000 7faf2d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf28104c40 0x7faf2819afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:37.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.994+0000 7faf2d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf28104c40 0x7faf2819afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33486/0 (socket says 172.21.15.103:33486) 2024-09-11T01:04:37.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.994+0000 7faf2d400640 1 -- 172.21.15.103:0/1600675329 learned_addr learned my addr 172.21.15.103:0/1600675329 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:04:37.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.994+0000 7faf2ca00640 1 --2- 172.21.15.103:0/1600675329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf28105da0 0x7faf2819b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:37.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.995+0000 7faf2de00640 1 --2- 172.21.15.103:0/1600675329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf28106760 0x7faf2819c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:37.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.995+0000 7faf2d400640 1 -- 172.21.15.103:0/1600675329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf28106760 msgr2=0x7faf2819c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:37.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.995+0000 7faf2d400640 1 --2- 172.21.15.103:0/1600675329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf28106760 0x7faf2819c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:37.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.995+0000 7faf2d400640 1 -- 172.21.15.103:0/1600675329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf28105da0 msgr2=0x7faf2819b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:37.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.995+0000 7faf2d400640 1 --2- 172.21.15.103:0/1600675329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf28105da0 0x7faf2819b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:37.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.995+0000 7faf2d400640 1 -- 172.21.15.103:0/1600675329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2819cae0 con 0x7faf28104c40 2024-09-11T01:04:37.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.995+0000 7faf2d400640 1 --2- 172.21.15.103:0/1600675329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf28104c40 0x7faf2819afb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00e9f0 tx=0x7faf1c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:37.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.995+0000 7faf26000640 1 -- 172.21.15.103:0/1600675329 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c00cd80 con 0x7faf28104c40 2024-09-11T01:04:37.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.995+0000 7faf26000640 1 -- 172.21.15.103:0/1600675329 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf1c0054d0 con 0x7faf28104c40 2024-09-11T01:04:37.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.995+0000 7faf2fe00640 1 -- 172.21.15.103:0/1600675329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2819cdd0 con 0x7faf28104c40 2024-09-11T01:04:37.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.995+0000 7faf26000640 1 -- 172.21.15.103:0/1600675329 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf1c010690 con 0x7faf28104c40 2024-09-11T01:04:37.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.995+0000 7faf2fe00640 1 -- 172.21.15.103:0/1600675329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf281a34b0 con 0x7faf28104c40 2024-09-11T01:04:37.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.997+0000 7faf2fe00640 1 -- 172.21.15.103:0/1600675329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf2810bed0 con 0x7faf28104c40 2024-09-11T01:04:37.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:36.999+0000 7faf26000640 1 -- 172.21.15.103:0/1600675329 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7faf1c004e90 con 0x7faf28104c40 2024-09-11T01:04:37.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.000+0000 7faf26000640 1 --2- 172.21.15.103:0/1600675329 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faf100b5360 0x7faf100b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:37.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.000+0000 7faf26000640 1 -- 172.21.15.103:0/1600675329 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7faf1c0e5bb0 con 0x7faf28104c40 2024-09-11T01:04:37.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.000+0000 7faf2ca00640 1 --2- 172.21.15.103:0/1600675329 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faf100b5360 0x7faf100b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:37.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.001+0000 7faf2ca00640 1 --2- 172.21.15.103:0/1600675329 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faf100b5360 0x7faf100b7820 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faf14009bd0 tx=0x7faf14005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:37.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.004+0000 7faf26000640 1 -- 172.21.15.103:0/1600675329 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7faf1c0ace70 con 0x7faf28104c40 2024-09-11T01:04:37.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.188+0000 7faf2fe00640 1 -- 172.21.15.103:0/1600675329 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7faf28063d80 con 0x7faf28104c40 2024-09-11T01:04:37.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.188+0000 7faf26000640 1 -- 172.21.15.103:0/1600675329 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7faf1c0ac770 con 0x7faf28104c40 2024-09-11T01:04:37.192 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:04:37.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.191+0000 7faf2fe00640 1 -- 172.21.15.103:0/1600675329 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faf100b5360 msgr2=0x7faf100b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:37.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.191+0000 7faf2fe00640 1 --2- 172.21.15.103:0/1600675329 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faf100b5360 0x7faf100b7820 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7faf14009bd0 tx=0x7faf14005f90 comp rx=0 tx=0).stop 2024-09-11T01:04:37.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.191+0000 7faf2fe00640 1 -- 172.21.15.103:0/1600675329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf28104c40 msgr2=0x7faf2819afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:37.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.191+0000 7faf2fe00640 1 --2- 172.21.15.103:0/1600675329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf28104c40 0x7faf2819afb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00e9f0 tx=0x7faf1c00edf0 comp rx=0 tx=0).stop 2024-09-11T01:04:37.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.191+0000 7faf2fe00640 1 -- 172.21.15.103:0/1600675329 shutdown_connections 2024-09-11T01:04:37.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.191+0000 7faf2fe00640 1 --2- 172.21.15.103:0/1600675329 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faf100b5360 0x7faf100b7820 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:37.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.191+0000 7faf2fe00640 1 --2- 172.21.15.103:0/1600675329 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf28106760 0x7faf2819c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:37.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.191+0000 7faf2fe00640 1 --2- 172.21.15.103:0/1600675329 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf28105da0 0x7faf2819b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:37.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.191+0000 7faf2fe00640 1 --2- 172.21.15.103:0/1600675329 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf28104c40 0x7faf2819afb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:37.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.191+0000 7faf2fe00640 1 -- 172.21.15.103:0/1600675329 >> 172.21.15.103:0/1600675329 conn(0x7faf28100550 msgr2=0x7faf281090a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:37.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.191+0000 7faf2fe00640 1 -- 172.21.15.103:0/1600675329 shutdown_connections 2024-09-11T01:04:37.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:37.191+0000 7faf2fe00640 1 -- 172.21.15.103:0/1600675329 wait complete. 2024-09-11T01:04:37.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:37 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1600675329' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T01:04:37.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:37 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1600675329' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T01:04:37.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:37 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1600675329' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-11T01:04:38.209 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1726016674,"num_in_osds":12,"osd_in_since":1726016651,"num_remapped_pgs":0} 2024-09-11T01:04:38.210 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T01:04:38.578 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:04:38.581 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:38 smithi103 ceph-mon[30562]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:38.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:38 smithi117 ceph-mon[35358]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:38.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:38 smithi183 ceph-mon[34992]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:39.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.170+0000 7f38bfe00640 1 -- 172.21.15.103:0/3438722806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c0108620 msgr2=0x7f38c0108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:39.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.170+0000 7f38bfe00640 1 --2- 172.21.15.103:0/3438722806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c0108620 0x7f38c0108a60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f38a8009900 tx=0x7f38a802a3f0 comp rx=0 tx=0).stop 2024-09-11T01:04:39.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.170+0000 7f38bfe00640 1 -- 172.21.15.103:0/3438722806 shutdown_connections 2024-09-11T01:04:39.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.170+0000 7f38bfe00640 1 --2- 172.21.15.103:0/3438722806 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0108fa0 0x7f38c010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:39.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.170+0000 7f38bfe00640 1 --2- 172.21.15.103:0/3438722806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c0108620 0x7f38c0108a60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:39.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.170+0000 7f38bfe00640 1 --2- 172.21.15.103:0/3438722806 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38c0102c10 0x7f38c0102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:39.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.170+0000 7f38bfe00640 1 -- 172.21.15.103:0/3438722806 >> 172.21.15.103:0/3438722806 conn(0x7f38c00fe660 msgr2=0x7f38c0100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:39.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.170+0000 7f38bfe00640 1 -- 172.21.15.103:0/3438722806 shutdown_connections 2024-09-11T01:04:39.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.170+0000 7f38bfe00640 1 -- 172.21.15.103:0/3438722806 wait complete. 2024-09-11T01:04:39.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.171+0000 7f38bfe00640 1 Processor -- start 2024-09-11T01:04:39.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.172+0000 7f38bfe00640 1 -- start start 2024-09-11T01:04:39.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.172+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c0102c10 0x7f38c019b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:39.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.172+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0108620 0x7f38c019b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:39.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.172+0000 7f38bfe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38c0108fa0 0x7f38c01a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:39.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.172+0000 7f38bfe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f38c0112c60 con 0x7f38c0102c10 2024-09-11T01:04:39.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.172+0000 7f38bfe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f38c0112ae0 con 0x7f38c0108620 2024-09-11T01:04:39.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.172+0000 7f38bfe00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f38c0112de0 con 0x7f38c0108fa0 2024-09-11T01:04:39.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.172+0000 7f38bea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c0102c10 0x7f38c019b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:39.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.172+0000 7f38bea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c0102c10 0x7f38c019b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33512/0 (socket says 172.21.15.103:33512) 2024-09-11T01:04:39.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.172+0000 7f38bea00640 1 -- 172.21.15.103:0/929772180 learned_addr learned my addr 172.21.15.103:0/929772180 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:04:39.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.172+0000 7f38b6000640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0108620 0x7f38c019b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:39.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.172+0000 7f38bf400640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38c0108fa0 0x7f38c01a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:39.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.173+0000 7f38bea00640 1 -- 172.21.15.103:0/929772180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38c0108fa0 msgr2=0x7f38c01a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:39.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.173+0000 7f38bea00640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38c0108fa0 0x7f38c01a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:39.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.173+0000 7f38bea00640 1 -- 172.21.15.103:0/929772180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0108620 msgr2=0x7f38c019b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:39.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.173+0000 7f38bea00640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0108620 0x7f38c019b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:39.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.173+0000 7f38bea00640 1 -- 172.21.15.103:0/929772180 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38c01a12d0 con 0x7f38c0102c10 2024-09-11T01:04:39.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.173+0000 7f38b6000640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0108620 0x7f38c019b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:04:39.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.173+0000 7f38bea00640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c0102c10 0x7f38c019b220 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f38b000eb90 tx=0x7f38b000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:39.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.173+0000 7f38b7e00640 1 -- 172.21.15.103:0/929772180 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0004d20 con 0x7f38c0102c10 2024-09-11T01:04:39.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.173+0000 7f38bfe00640 1 -- 172.21.15.103:0/929772180 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38c01a15c0 con 0x7f38c0102c10 2024-09-11T01:04:39.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.173+0000 7f38b7e00640 1 -- 172.21.15.103:0/929772180 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f38b000ee90 con 0x7f38c0102c10 2024-09-11T01:04:39.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.173+0000 7f38b7e00640 1 -- 172.21.15.103:0/929772180 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38b0010670 con 0x7f38c0102c10 2024-09-11T01:04:39.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.173+0000 7f38bfe00640 1 -- 172.21.15.103:0/929772180 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38c01a7c80 con 0x7f38c0102c10 2024-09-11T01:04:39.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.175+0000 7f38bfe00640 1 -- 172.21.15.103:0/929772180 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38c0102ff0 con 0x7f38c0102c10 2024-09-11T01:04:39.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.178+0000 7f38b7e00640 1 -- 172.21.15.103:0/929772180 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f38b0010930 con 0x7f38c0102c10 2024-09-11T01:04:39.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.180+0000 7f38b7e00640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f38a40b5390 0x7f38a40b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:39.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.180+0000 7f38b7e00640 1 -- 172.21.15.103:0/929772180 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f38b00e6090 con 0x7f38c0102c10 2024-09-11T01:04:39.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.180+0000 7f38b6000640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f38a40b5390 0x7f38a40b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:39.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.181+0000 7f38b6000640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f38a40b5390 0x7f38a40b7850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f38a8031440 tx=0x7f38a8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:39.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.181+0000 7f38b7e00640 1 -- 172.21.15.103:0/929772180 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f38b0056220 con 0x7f38c0102c10 2024-09-11T01:04:39.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.372+0000 7f38bfe00640 1 -- 172.21.15.103:0/929772180 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38c019c350 con 0x7f38c0102c10 2024-09-11T01:04:39.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.373+0000 7f38b7e00640 1 -- 172.21.15.103:0/929772180 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18571 (secure 0 0 0) 0x7f38b00ad350 con 0x7f38c0102c10 2024-09-11T01:04:39.376 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:04:39.376 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":73,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","created":"2024-09-11T00:56:46.242882+0000","modified":"2024-09-11T01:04:35.897365+0000","last_up_change":"2024-09-11T01:04:34.895368+0000","last_in_change":"2024-09-11T01:04:11.663436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:00:33.745338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"1b3e4222-43fd-4af0-bf97-3ba1000221b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6803","nonce":1867193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6805","nonce":1867193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6809","nonce":1867193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6807","nonce":1867193874}]},"public_addr":"172.21.15.103:6803/1867193874","cluster_addr":"172.21.15.103:6805/1867193874","heartbeat_back_addr":"172.21.15.103:6809/1867193874","heartbeat_front_addr":"172.21.15.103:6807/1867193874","state":["exists","up"]},{"osd":1,"uuid":"9a2b40da-7361-4c4f-a9dc-a769b427a0fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6801","nonce":2629532556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6803","nonce":2629532556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6807","nonce":2629532556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6805","nonce":2629532556}]},"public_addr":"172.21.15.117:6801/2629532556","cluster_addr":"172.21.15.117:6803/2629532556","heartbeat_back_addr":"172.21.15.117:6807/2629532556","heartbeat_front_addr":"172.21.15.117:6805/2629532556","state":["exists","up"]},{"osd":2,"uuid":"5db919c1-90a7-4ba7-acf3-89eeb77ae131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6801","nonce":3208966770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6803","nonce":3208966770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6807","nonce":3208966770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6805","nonce":3208966770}]},"public_addr":"172.21.15.183:6801/3208966770","cluster_addr":"172.21.15.183:6803/3208966770","heartbeat_back_addr":"172.21.15.183:6807/3208966770","heartbeat_front_addr":"172.21.15.183:6805/3208966770","state":["exists","up"]},{"osd":3,"uuid":"bdc465f2-06a5-4667-9651-4e168700d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6811","nonce":2238128162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6813","nonce":2238128162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6817","nonce":2238128162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6815","nonce":2238128162}]},"public_addr":"172.21.15.103:6811/2238128162","cluster_addr":"172.21.15.103:6813/2238128162","heartbeat_back_addr":"172.21.15.103:6817/2238128162","heartbeat_front_addr":"172.21.15.103:6815/2238128162","state":["exists","up"]},{"osd":4,"uuid":"be86a5d2-5e86-4bf4-8464-9dff7a801e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6809","nonce":2368878504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6811","nonce":2368878504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6815","nonce":2368878504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6813","nonce":2368878504}]},"public_addr":"172.21.15.117:6809/2368878504","cluster_addr":"172.21.15.117:6811/2368878504","heartbeat_back_addr":"172.21.15.117:6815/2368878504","heartbeat_front_addr":"172.21.15.117:6813/2368878504","state":["exists","up"]},{"osd":5,"uuid":"090b20ec-d9ff-4e10-ad9f-52ab41dbf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6809","nonce":1668069547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6811","nonce":1668069547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6815","nonce":1668069547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6813","nonce":1668069547}]},"public_addr":"172.21.15.183:6809/1668069547","cluster_addr":"172.21.15.183:6811/1668069547","heartbeat_back_addr":"172.21.15.183:6815/1668069547","heartbeat_front_addr":"172.21.15.183:6813/1668069547","state":["exists","up"]},{"osd":6,"uuid":"19abe982-3522-40f9-a628-ddaef462cdb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6819","nonce":4203476972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6821","nonce":4203476972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6825","nonce":4203476972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6823","nonce":4203476972}]},"public_addr":"172.21.15.103:6819/4203476972","cluster_addr":"172.21.15.103:6821/4203476972","heartbeat_back_addr":"172.21.15.103:6825/4203476972","heartbeat_front_addr":"172.21.15.103:6823/4203476972","state":["exists","up"]},{"osd":7,"uuid":"e875ff09-805a-40ff-9d6a-dd2607ce3432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6817","nonce":1207680713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6819","nonce":1207680713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6823","nonce":1207680713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6821","nonce":1207680713}]},"public_addr":"172.21.15.117:6817/1207680713","cluster_addr":"172.21.15.117:6819/1207680713","heartbeat_back_addr":"172.21.15.117:6823/1207680713","heartbeat_front_addr":"172.21.15.117:6821/1207680713","state":["exists","up"]},{"osd":8,"uuid":"2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6817","nonce":2935820593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6819","nonce":2935820593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6823","nonce":2935820593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6821","nonce":2935820593}]},"public_addr":"172.21.15.183:6817/2935820593","cluster_addr":"172.21.15.183:6819/2935820593","heartbeat_back_addr":"172.21.15.183:6823/2935820593","heartbeat_front_addr":"172.21.15.183:6821/2935820593","state":["exists","up"]},{"osd":9,"uuid":"c36d17d2-0bc8-4322-a998-9c8eff970e58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6827","nonce":2104855877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6829","nonce":2104855877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6833","nonce":2104855877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6831","nonce":2104855877}]},"public_addr":"172.21.15.103:6827/2104855877","cluster_addr":"172.21.15.103:6829/2104855877","heartbeat_back_addr":"172.21.15.103:6833/2104855877","heartbeat_front_addr":"172.21.15.103:6831/2104855877","state":["exists","up"]},{"osd":10,"uuid":"e71bc5f7-a829-43cf-a10b-b2444da1d773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6825","nonce":3792981873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6827","nonce":3792981873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6831","nonce":3792981873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6829","nonce":3792981873}]},"public_addr":"172.21.15.117:6825/3792981873","cluster_addr":"172.21.15.117:6827/3792981873","heartbeat_back_addr":"172.21.15.117:6831/3792981873","heartbeat_front_addr":"172.21.15.117:6829/3792981873","state":["exists","up"]},{"osd":11,"uuid":"8f36697f-4d18-4efa-bf14-d68a13464958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6825","nonce":1250387289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6827","nonce":1250387289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6831","nonce":1250387289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6829","nonce":1250387289}]},"public_addr":"172.21.15.183:6825/1250387289","cluster_addr":"172.21.15.183:6827/1250387289","heartbeat_back_addr":"172.21.15.183:6831/1250387289","heartbeat_front_addr":"172.21.15.183:6829/1250387289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:59:39.916330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:06.042858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:30.703648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:59.493376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:25.190299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:50.480326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:20.815441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:46.398318+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:11.499922+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:41.895096+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:08.411538+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:32.943466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/366890372":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6800/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2372812363":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2844264136":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/2046654364":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6801/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/211510947":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6801/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6800/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/189409602":"2024-09-12T00:57:11.412015+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:04:39.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.376+0000 7f38bfe00640 1 -- 172.21.15.103:0/929772180 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f38a40b5390 msgr2=0x7f38a40b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:39.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.376+0000 7f38bfe00640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f38a40b5390 0x7f38a40b7850 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f38a8031440 tx=0x7f38a8005a20 comp rx=0 tx=0).stop 2024-09-11T01:04:39.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.376+0000 7f38bfe00640 1 -- 172.21.15.103:0/929772180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c0102c10 msgr2=0x7f38c019b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:39.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.376+0000 7f38bfe00640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c0102c10 0x7f38c019b220 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f38b000eb90 tx=0x7f38b000c6a0 comp rx=0 tx=0).stop 2024-09-11T01:04:39.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.376+0000 7f38bfe00640 1 -- 172.21.15.103:0/929772180 shutdown_connections 2024-09-11T01:04:39.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.376+0000 7f38bfe00640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f38a40b5390 0x7f38a40b7850 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:39.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.376+0000 7f38bfe00640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f38c0108fa0 0x7f38c01a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:39.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.376+0000 7f38bfe00640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f38c0108620 0x7f38c019b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:39.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.376+0000 7f38bfe00640 1 --2- 172.21.15.103:0/929772180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f38c0102c10 0x7f38c019b220 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:39.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.376+0000 7f38bfe00640 1 -- 172.21.15.103:0/929772180 >> 172.21.15.103:0/929772180 conn(0x7f38c00fe660 msgr2=0x7f38c0075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:39.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.376+0000 7f38bfe00640 1 -- 172.21.15.103:0/929772180 shutdown_connections 2024-09-11T01:04:39.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:39.376+0000 7f38bfe00640 1 -- 172.21.15.103:0/929772180 wait complete. 2024-09-11T01:04:39.760 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:39 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/929772180' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:04:39.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:39 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/929772180' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:04:39.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:39 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/929772180' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:04:40.299 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T01:00:33.745338+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-11T01:04:40.300 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-11T01:04:40.581 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:40 smithi103 ceph-mon[30562]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:40.666 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:04:40.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:40 smithi117 ceph-mon[35358]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:40 smithi183 ceph-mon[34992]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:41.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.252+0000 7f74bfc00640 1 -- 172.21.15.103:0/1819212227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8109130 msgr2=0x7f74b810f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:41.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.252+0000 7f74bfc00640 1 --2- 172.21.15.103:0/1819212227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8109130 0x7f74b810f930 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009ca0 tx=0x7f74b002a8c0 comp rx=0 tx=0).stop 2024-09-11T01:04:41.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.252+0000 7f74bfc00640 1 -- 172.21.15.103:0/1819212227 shutdown_connections 2024-09-11T01:04:41.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.252+0000 7f74bfc00640 1 --2- 172.21.15.103:0/1819212227 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8109130 0x7f74b810f930 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:41.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.252+0000 7f74bfc00640 1 --2- 172.21.15.103:0/1819212227 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74b81087b0 0x7f74b8108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:41.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.252+0000 7f74bfc00640 1 --2- 172.21.15.103:0/1819212227 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74b8102da0 0x7f74b8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:41.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.252+0000 7f74bfc00640 1 -- 172.21.15.103:0/1819212227 >> 172.21.15.103:0/1819212227 conn(0x7f74b80fe810 msgr2=0x7f74b8100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:41.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.252+0000 7f74bfc00640 1 -- 172.21.15.103:0/1819212227 shutdown_connections 2024-09-11T01:04:41.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.252+0000 7f74bfc00640 1 -- 172.21.15.103:0/1819212227 wait complete. 2024-09-11T01:04:41.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.253+0000 7f74bfc00640 1 Processor -- start 2024-09-11T01:04:41.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.254+0000 7f74bfc00640 1 -- start start 2024-09-11T01:04:41.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.254+0000 7f74bfc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74b8102da0 0x7f74b80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:41.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.254+0000 7f74bfc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b81087b0 0x7f74b80759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:41.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.254+0000 7f74bfc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74b8109130 0x7f74b8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:41.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.254+0000 7f74bfc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8112e00 con 0x7f74b81087b0 2024-09-11T01:04:41.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.254+0000 7f74bfc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8112c80 con 0x7f74b8109130 2024-09-11T01:04:41.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.254+0000 7f74bfc00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8112f80 con 0x7f74b8102da0 2024-09-11T01:04:41.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.254+0000 7f74afe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b81087b0 0x7f74b80759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:41.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.254+0000 7f74bd200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74b8102da0 0x7f74b80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:41.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.254+0000 7f74afe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b81087b0 0x7f74b80759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35574/0 (socket says 172.21.15.103:35574) 2024-09-11T01:04:41.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.254+0000 7f74afe00640 1 -- 172.21.15.103:0/1818764845 learned_addr learned my addr 172.21.15.103:0/1818764845 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:04:41.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.254+0000 7f74bdc00640 1 --2- 172.21.15.103:0/1818764845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74b8109130 0x7f74b8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:41.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.255+0000 7f74bd200640 1 -- 172.21.15.103:0/1818764845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74b8109130 msgr2=0x7f74b8075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:41.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.255+0000 7f74bd200640 1 --2- 172.21.15.103:0/1818764845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74b8109130 0x7f74b8075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:41.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.255+0000 7f74bd200640 1 -- 172.21.15.103:0/1818764845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b81087b0 msgr2=0x7f74b80759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:41.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.255+0000 7f74bd200640 1 --2- 172.21.15.103:0/1818764845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b81087b0 0x7f74b80759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:41.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.255+0000 7f74bd200640 1 -- 172.21.15.103:0/1818764845 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b81a7630 con 0x7f74b8102da0 2024-09-11T01:04:41.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.255+0000 7f74afe00640 1 --2- 172.21.15.103:0/1818764845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b81087b0 0x7f74b80759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:04:41.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.255+0000 7f74bd200640 1 --2- 172.21.15.103:0/1818764845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74b8102da0 0x7f74b80754a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f74a800e9f0 tx=0x7f74a800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:41.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.255+0000 7f74b6000640 1 -- 172.21.15.103:0/1818764845 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a800ccc0 con 0x7f74b8102da0 2024-09-11T01:04:41.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.255+0000 7f74bfc00640 1 -- 172.21.15.103:0/1818764845 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b81a7920 con 0x7f74b8102da0 2024-09-11T01:04:41.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.255+0000 7f74b6000640 1 -- 172.21.15.103:0/1818764845 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f74a80108e0 con 0x7f74b8102da0 2024-09-11T01:04:41.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.255+0000 7f74b6000640 1 -- 172.21.15.103:0/1818764845 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8018880 con 0x7f74b8102da0 2024-09-11T01:04:41.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.256+0000 7f74bfc00640 1 -- 172.21.15.103:0/1818764845 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b81a7e60 con 0x7f74b8102da0 2024-09-11T01:04:41.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.256+0000 7f74bfc00640 1 -- 172.21.15.103:0/1818764845 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b8103180 con 0x7f74b8102da0 2024-09-11T01:04:41.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.259+0000 7f74b6000640 1 -- 172.21.15.103:0/1818764845 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f74a8010430 con 0x7f74b8102da0 2024-09-11T01:04:41.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.260+0000 7f74b6000640 1 --2- 172.21.15.103:0/1818764845 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f749c0b52e0 0x7f749c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:41.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.260+0000 7f74b6000640 1 -- 172.21.15.103:0/1818764845 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f74a80e5f50 con 0x7f74b8102da0 2024-09-11T01:04:41.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.261+0000 7f74afe00640 1 --2- 172.21.15.103:0/1818764845 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f749c0b52e0 0x7f749c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:41.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.261+0000 7f74afe00640 1 --2- 172.21.15.103:0/1818764845 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f749c0b52e0 0x7f749c0b77a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f74b8076f90 tx=0x7f74a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:41.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.262+0000 7f74b6000640 1 -- 172.21.15.103:0/1818764845 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f74a80acbc0 con 0x7f74b8102da0 2024-09-11T01:04:41.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.445+0000 7f74bfc00640 1 -- 172.21.15.103:0/1818764845 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f74b802e5c0 con 0x7f74b8102da0 2024-09-11T01:04:41.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.446+0000 7f74b6000640 1 -- 172.21.15.103:0/1818764845 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f74a80b15f0 con 0x7f74b8102da0 2024-09-11T01:04:41.448 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-09-11T01:04:41.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.448+0000 7f74bfc00640 1 -- 172.21.15.103:0/1818764845 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f749c0b52e0 msgr2=0x7f749c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:41.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.448+0000 7f74bfc00640 1 --2- 172.21.15.103:0/1818764845 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f749c0b52e0 0x7f749c0b77a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f74b8076f90 tx=0x7f74a0005f90 comp rx=0 tx=0).stop 2024-09-11T01:04:41.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.448+0000 7f74bfc00640 1 -- 172.21.15.103:0/1818764845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74b8102da0 msgr2=0x7f74b80754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:41.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.448+0000 7f74bfc00640 1 --2- 172.21.15.103:0/1818764845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74b8102da0 0x7f74b80754a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f74a800e9f0 tx=0x7f74a800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:04:41.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.448+0000 7f74bfc00640 1 -- 172.21.15.103:0/1818764845 shutdown_connections 2024-09-11T01:04:41.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.448+0000 7f74bfc00640 1 --2- 172.21.15.103:0/1818764845 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f749c0b52e0 0x7f749c0b77a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:41.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.448+0000 7f74bfc00640 1 --2- 172.21.15.103:0/1818764845 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74b8109130 0x7f74b8075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:41.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.448+0000 7f74bfc00640 1 --2- 172.21.15.103:0/1818764845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b81087b0 0x7f74b80759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:41.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.448+0000 7f74bfc00640 1 --2- 172.21.15.103:0/1818764845 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74b8102da0 0x7f74b80754a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:41.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.448+0000 7f74bfc00640 1 -- 172.21.15.103:0/1818764845 >> 172.21.15.103:0/1818764845 conn(0x7f74b80fe810 msgr2=0x7f74b80ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:41.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.448+0000 7f74bfc00640 1 -- 172.21.15.103:0/1818764845 shutdown_connections 2024-09-11T01:04:41.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:41.448+0000 7f74bfc00640 1 -- 172.21.15.103:0/1818764845 wait complete. 2024-09-11T01:04:41.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:41 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1818764845' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T01:04:41.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:41 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1818764845' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T01:04:41.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:41 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1818764845' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T01:04:42.377 INFO:tasks.cephadm:Adding mds.a on smithi103 2024-09-11T01:04:42.378 INFO:tasks.cephadm:Adding mds.d on smithi103 2024-09-11T01:04:42.378 INFO:tasks.cephadm:Adding mds.g on smithi103 2024-09-11T01:04:42.378 INFO:tasks.cephadm:Adding mds.j on smithi103 2024-09-11T01:04:42.378 INFO:tasks.cephadm:Adding mds.b on smithi117 2024-09-11T01:04:42.378 INFO:tasks.cephadm:Adding mds.e on smithi117 2024-09-11T01:04:42.378 INFO:tasks.cephadm:Adding mds.h on smithi117 2024-09-11T01:04:42.378 INFO:tasks.cephadm:Adding mds.k on smithi117 2024-09-11T01:04:42.378 INFO:tasks.cephadm:Adding mds.c on smithi183 2024-09-11T01:04:42.378 INFO:tasks.cephadm:Adding mds.f on smithi183 2024-09-11T01:04:42.378 INFO:tasks.cephadm:Adding mds.i on smithi183 2024-09-11T01:04:42.378 INFO:tasks.cephadm:Adding mds.l on smithi183 2024-09-11T01:04:42.379 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph orch apply mds all '12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l' 2024-09-11T01:04:42.644 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T01:04:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:42 smithi183 ceph-mon[34992]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:42 smithi103 ceph-mon[30562]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:42.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:42 smithi117 ceph-mon[35358]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:43.080 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.053+0000 7f6700b36640 1 -- 172.21.15.183:0/2231309879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66fc101930 msgr2=0x7f66fc101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:43.080 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.053+0000 7f6700b36640 1 --2- 172.21.15.183:0/2231309879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66fc101930 0x7f66fc101d30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f66ec009960 tx=0x7f66ec02a460 comp rx=0 tx=0).stop 2024-09-11T01:04:43.080 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.053+0000 7f6700b36640 1 -- 172.21.15.183:0/2231309879 shutdown_connections 2024-09-11T01:04:43.081 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.053+0000 7f6700b36640 1 --2- 172.21.15.183:0/2231309879 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66fc103450 0x7f66fc109dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:43.081 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.053+0000 7f6700b36640 1 --2- 172.21.15.183:0/2231309879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66fc102a90 0x7f66fc102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:43.081 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.053+0000 7f6700b36640 1 --2- 172.21.15.183:0/2231309879 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66fc101930 0x7f66fc101d30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:43.081 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.053+0000 7f6700b36640 1 -- 172.21.15.183:0/2231309879 >> 172.21.15.183:0/2231309879 conn(0x7f66fc0fd220 msgr2=0x7f66fc0ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:43.081 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.053+0000 7f6700b36640 1 -- 172.21.15.183:0/2231309879 shutdown_connections 2024-09-11T01:04:43.081 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.053+0000 7f6700b36640 1 -- 172.21.15.183:0/2231309879 wait complete. 2024-09-11T01:04:43.082 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.054+0000 7f6700b36640 1 Processor -- start 2024-09-11T01:04:43.082 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.054+0000 7f6700b36640 1 -- start start 2024-09-11T01:04:43.082 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.054+0000 7f6700b36640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66fc101930 0x7f66fc10c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:43.082 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.054+0000 7f6700b36640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66fc102a90 0x7f66fc10aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:43.082 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.054+0000 7f6700b36640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66fc103450 0x7f66fc10af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:43.082 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.054+0000 7f6700b36640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc10e7a0 con 0x7f66fc101930 2024-09-11T01:04:43.082 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.054+0000 7f6700b36640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc10e620 con 0x7f66fc103450 2024-09-11T01:04:43.083 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.054+0000 7f6700b36640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f66fc10e920 con 0x7f66fc102a90 2024-09-11T01:04:43.083 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.054+0000 7f66f9d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66fc102a90 0x7f66fc10aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:43.083 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.054+0000 7f66f9d9b640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66fc102a90 0x7f66fc10aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.183:37596/0 (socket says 172.21.15.183:37596) 2024-09-11T01:04:43.083 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.054+0000 7f66f9d9b640 1 -- 172.21.15.183:0/3660763358 learned_addr learned my addr 172.21.15.183:0/3660763358 (peer_addr_for_me v2:172.21.15.183:0/0) 2024-09-11T01:04:43.083 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.054+0000 7f66fad9d640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66fc103450 0x7f66fc10af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:43.083 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.055+0000 7f66fa59c640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66fc101930 0x7f66fc10c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:43.083 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.055+0000 7f66f9d9b640 1 -- 172.21.15.183:0/3660763358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66fc103450 msgr2=0x7f66fc10af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:43.084 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.055+0000 7f66f9d9b640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66fc103450 0x7f66fc10af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:43.084 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.055+0000 7f66f9d9b640 1 -- 172.21.15.183:0/3660763358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66fc101930 msgr2=0x7f66fc10c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:43.084 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.055+0000 7f66f9d9b640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66fc101930 0x7f66fc10c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:43.084 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.055+0000 7f66f9d9b640 1 -- 172.21.15.183:0/3660763358 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66fc10b820 con 0x7f66fc102a90 2024-09-11T01:04:43.084 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.055+0000 7f66fa59c640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66fc101930 0x7f66fc10c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:04:43.085 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.055+0000 7f66f9d9b640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66fc102a90 0x7f66fc10aa20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f66f000b4a0 tx=0x7f66f000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:43.085 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.055+0000 7f66eb7fe640 1 -- 172.21.15.183:0/3660763358 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0014070 con 0x7f66fc102a90 2024-09-11T01:04:43.085 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.055+0000 7f6700b36640 1 -- 172.21.15.183:0/3660763358 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66fc1a3130 con 0x7f66fc102a90 2024-09-11T01:04:43.085 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.055+0000 7f66eb7fe640 1 -- 172.21.15.183:0/3660763358 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f66f0010ac0 con 0x7f66fc102a90 2024-09-11T01:04:43.085 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.055+0000 7f66eb7fe640 1 -- 172.21.15.183:0/3660763358 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f0017c30 con 0x7f66fc102a90 2024-09-11T01:04:43.085 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.055+0000 7f6700b36640 1 -- 172.21.15.183:0/3660763358 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66fc1a3710 con 0x7f66fc102a90 2024-09-11T01:04:43.085 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.056+0000 7f6700b36640 1 -- 172.21.15.183:0/3660763358 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66fc108dd0 con 0x7f66fc102a90 2024-09-11T01:04:43.085 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.058+0000 7f66eb7fe640 1 -- 172.21.15.183:0/3660763358 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f66f0010610 con 0x7f66fc102a90 2024-09-11T01:04:43.086 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.058+0000 7f66eb7fe640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f66e40b52e0 0x7f66e40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:43.086 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.058+0000 7f66eb7fe640 1 -- 172.21.15.183:0/3660763358 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f66f00e4ff0 con 0x7f66fc102a90 2024-09-11T01:04:43.086 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.059+0000 7f66fa59c640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f66e40b52e0 0x7f66e40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:43.086 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.059+0000 7f66fa59c640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f66e40b52e0 0x7f66e40b77a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f66ec031460 tx=0x7f66ec000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:43.086 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.062+0000 7f66eb7fe640 1 -- 172.21.15.183:0/3660763358 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f66f00ac350 con 0x7f66fc102a90 2024-09-11T01:04:43.258 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.256+0000 7f6700b36640 1 -- 172.21.15.183:0/3660763358 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l", "target": ["mon-mgr", ""]}) -- 0x7f66fc063690 con 0x7f66e40b52e0 2024-09-11T01:04:43.266 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.264+0000 7f66eb7fe640 1 -- 172.21.15.183:0/3660763358 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f66fc063690 con 0x7f66e40b52e0 2024-09-11T01:04:43.267 INFO:teuthology.orchestra.run.smithi183.stdout:Scheduled mds.all update... 2024-09-11T01:04:43.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.267+0000 7f6700b36640 1 -- 172.21.15.183:0/3660763358 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f66e40b52e0 msgr2=0x7f66e40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:43.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.267+0000 7f6700b36640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f66e40b52e0 0x7f66e40b77a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f66ec031460 tx=0x7f66ec000bc0 comp rx=0 tx=0).stop 2024-09-11T01:04:43.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.267+0000 7f6700b36640 1 -- 172.21.15.183:0/3660763358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66fc102a90 msgr2=0x7f66fc10aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:43.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.267+0000 7f6700b36640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66fc102a90 0x7f66fc10aa20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f66f000b4a0 tx=0x7f66f000b960 comp rx=0 tx=0).stop 2024-09-11T01:04:43.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.267+0000 7f6700b36640 1 -- 172.21.15.183:0/3660763358 shutdown_connections 2024-09-11T01:04:43.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.267+0000 7f6700b36640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f66e40b52e0 0x7f66e40b77a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:43.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.267+0000 7f6700b36640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66fc103450 0x7f66fc10af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:43.269 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.267+0000 7f6700b36640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f66fc102a90 0x7f66fc10aa20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:43.270 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.267+0000 7f6700b36640 1 --2- 172.21.15.183:0/3660763358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f66fc101930 0x7f66fc10c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:43.270 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.267+0000 7f6700b36640 1 -- 172.21.15.183:0/3660763358 >> 172.21.15.183:0/3660763358 conn(0x7f66fc0fd220 msgr2=0x7f66fc105fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:43.270 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.267+0000 7f6700b36640 1 -- 172.21.15.183:0/3660763358 shutdown_connections 2024-09-11T01:04:43.270 INFO:teuthology.orchestra.run.smithi183.stderr:2024-09-11T01:04:43.267+0000 7f6700b36640 1 -- 172.21.15.183:0/3660763358 wait complete. 2024-09-11T01:04:43.949 DEBUG:teuthology.orchestra.run.smithi103:mds.a> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.a.service 2024-09-11T01:04:43.953 DEBUG:teuthology.orchestra.run.smithi103:mds.d> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.d.service 2024-09-11T01:04:43.998 DEBUG:teuthology.orchestra.run.smithi103:mds.g> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.g.service 2024-09-11T01:04:44.042 DEBUG:teuthology.orchestra.run.smithi103:mds.j> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.j.service 2024-09-11T01:04:44.088 DEBUG:teuthology.orchestra.run.smithi117:mds.b> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.b.service 2024-09-11T01:04:44.090 DEBUG:teuthology.orchestra.run.smithi117:mds.e> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.e.service 2024-09-11T01:04:44.132 DEBUG:teuthology.orchestra.run.smithi117:mds.h> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.h.service 2024-09-11T01:04:44.175 DEBUG:teuthology.orchestra.run.smithi117:mds.k> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.k.service 2024-09-11T01:04:44.218 DEBUG:teuthology.orchestra.run.smithi183:mds.c> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.c.service 2024-09-11T01:04:44.221 DEBUG:teuthology.orchestra.run.smithi183:mds.f> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.f.service 2024-09-11T01:04:44.263 DEBUG:teuthology.orchestra.run.smithi183:mds.i> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.i.service 2024-09-11T01:04:44.306 DEBUG:teuthology.orchestra.run.smithi183:mds.l> sudo journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.l.service 2024-09-11T01:04:44.351 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-11T01:04:44.352 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:04:44.370 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:44 smithi183 ceph-mon[34992]: from='client.24544 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:04:44.370 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:44 smithi183 ceph-mon[34992]: Saving service mds.all spec with placement smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l;count:12 2024-09-11T01:04:44.371 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:44.371 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:44.371 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:44 smithi183 ceph-mon[34992]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:44.371 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:44.371 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:44.371 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:44.371 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:44.371 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:44.371 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:44 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:44.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:44 smithi117 ceph-mon[35358]: from='client.24544 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:04:44.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:44 smithi117 ceph-mon[35358]: Saving service mds.all spec with placement smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l;count:12 2024-09-11T01:04:44.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:44.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:44.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:44 smithi117 ceph-mon[35358]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:44.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:44.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:44.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:44.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:44.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:44.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:44 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:44.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:44 smithi103 ceph-mon[30562]: from='client.24544 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:04:44.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:44 smithi103 ceph-mon[30562]: Saving service mds.all spec with placement smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l;count:12 2024-09-11T01:04:44.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:44.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:04:44.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:44 smithi103 ceph-mon[30562]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:44.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:44.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:04:44.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:44.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:44.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:44.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:44 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:44.717 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:04:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.343+0000 7f58e1a00640 1 -- 172.21.15.103:0/2234779366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58dc102c10 msgr2=0x7f58dc102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.343+0000 7f58e1a00640 1 --2- 172.21.15.103:0/2234779366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58dc102c10 0x7f58dc102ff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009900 tx=0x7f58cc02a410 comp rx=0 tx=0).stop 2024-09-11T01:04:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.343+0000 7f58e1a00640 1 -- 172.21.15.103:0/2234779366 shutdown_connections 2024-09-11T01:04:45.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.343+0000 7f58e1a00640 1 --2- 172.21.15.103:0/2234779366 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58dc108fa0 0x7f58dc10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.343+0000 7f58e1a00640 1 --2- 172.21.15.103:0/2234779366 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58dc108620 0x7f58dc108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.343+0000 7f58e1a00640 1 --2- 172.21.15.103:0/2234779366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58dc102c10 0x7f58dc102ff0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.343+0000 7f58e1a00640 1 -- 172.21.15.103:0/2234779366 >> 172.21.15.103:0/2234779366 conn(0x7f58dc0fe660 msgr2=0x7f58dc100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.343+0000 7f58e1a00640 1 -- 172.21.15.103:0/2234779366 shutdown_connections 2024-09-11T01:04:45.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.343+0000 7f58e1a00640 1 -- 172.21.15.103:0/2234779366 wait complete. 2024-09-11T01:04:45.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.344+0000 7f58e1a00640 1 Processor -- start 2024-09-11T01:04:45.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.344+0000 7f58e1a00640 1 -- start start 2024-09-11T01:04:45.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.345+0000 7f58e1a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58dc102c10 0x7f58dc199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:45.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.345+0000 7f58e1a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58dc108620 0x7f58dc199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:45.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.345+0000 7f58e1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58dc108fa0 0x7f58dc19e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:45.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.345+0000 7f58e1a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f58dc112cb0 con 0x7f58dc108fa0 2024-09-11T01:04:45.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.345+0000 7f58e1a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f58dc112b30 con 0x7f58dc102c10 2024-09-11T01:04:45.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.345+0000 7f58e1a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f58dc112e30 con 0x7f58dc108620 2024-09-11T01:04:45.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.345+0000 7f58e1000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58dc108fa0 0x7f58dc19e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:45.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.345+0000 7f58dbe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58dc102c10 0x7f58dc199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:45.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.345+0000 7f58e1000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58dc108fa0 0x7f58dc19e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35592/0 (socket says 172.21.15.103:35592) 2024-09-11T01:04:45.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.345+0000 7f58e1000640 1 -- 172.21.15.103:0/3418804339 learned_addr learned my addr 172.21.15.103:0/3418804339 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:04:45.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.345+0000 7f58dbe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58dc102c10 0x7f58dc199020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38034/0 (socket says 172.21.15.103:38034) 2024-09-11T01:04:45.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.345+0000 7f58db400640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58dc108620 0x7f58dc199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:45.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.346+0000 7f58e1000640 1 -- 172.21.15.103:0/3418804339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58dc108620 msgr2=0x7f58dc199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:45.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.346+0000 7f58e1000640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58dc108620 0x7f58dc199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:45.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.346+0000 7f58e1000640 1 -- 172.21.15.103:0/3418804339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58dc102c10 msgr2=0x7f58dc199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:45.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.346+0000 7f58e1000640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58dc102c10 0x7f58dc199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:45.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.346+0000 7f58e1000640 1 -- 172.21.15.103:0/3418804339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58dc19f0d0 con 0x7f58dc108fa0 2024-09-11T01:04:45.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.346+0000 7f58db400640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58dc108620 0x7f58dc199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:04:45.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.346+0000 7f58dbe00640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58dc102c10 0x7f58dc199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:04:45.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.346+0000 7f58e1000640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58dc108fa0 0x7f58dc19e900 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f58d400eaa0 tx=0x7f58d400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:45.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.346+0000 7f58d8c00640 1 -- 172.21.15.103:0/3418804339 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d400cdb0 con 0x7f58dc108fa0 2024-09-11T01:04:45.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.346+0000 7f58d8c00640 1 -- 172.21.15.103:0/3418804339 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58d4005020 con 0x7f58dc108fa0 2024-09-11T01:04:45.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.346+0000 7f58e1a00640 1 -- 172.21.15.103:0/3418804339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58dc19f3c0 con 0x7f58dc108fa0 2024-09-11T01:04:45.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.346+0000 7f58d8c00640 1 -- 172.21.15.103:0/3418804339 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d40116d0 con 0x7f58dc108fa0 2024-09-11T01:04:45.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.346+0000 7f58e1a00640 1 -- 172.21.15.103:0/3418804339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58dc1a5c50 con 0x7f58dc108fa0 2024-09-11T01:04:45.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.347+0000 7f58e1a00640 1 -- 172.21.15.103:0/3418804339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58dc102ff0 con 0x7f58dc108fa0 2024-09-11T01:04:45.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.350+0000 7f58d8c00640 1 -- 172.21.15.103:0/3418804339 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f58d400f040 con 0x7f58dc108fa0 2024-09-11T01:04:45.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.351+0000 7f58d8c00640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f58c00b5410 0x7f58c00b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:45.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.351+0000 7f58d8c00640 1 -- 172.21.15.103:0/3418804339 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f58d40e59b0 con 0x7f58dc108fa0 2024-09-11T01:04:45.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.351+0000 7f58dbe00640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f58c00b5410 0x7f58c00b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:45.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.352+0000 7f58dbe00640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f58c00b5410 0x7f58c00b78d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58cc005ab0 tx=0x7f58cc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:45.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.353+0000 7f58d8c00640 1 -- 172.21.15.103:0/3418804339 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f58d4016030 con 0x7f58dc108fa0 2024-09-11T01:04:45.485 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:45 smithi183 ceph-mon[34992]: Deploying daemon mds.l on smithi183 2024-09-11T01:04:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.570+0000 7f58e1a00640 1 -- 172.21.15.103:0/3418804339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58dc1a5e20 con 0x7f58dc108fa0 2024-09-11T01:04:45.572 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:45 smithi103 ceph-mon[30562]: Deploying daemon mds.l on smithi183 2024-09-11T01:04:45.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.570+0000 7f58d8c00640 1 -- 172.21.15.103:0/3418804339 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f58d40accf0 con 0x7f58dc108fa0 2024-09-11T01:04:45.573 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:04:45.573 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"btime":"2024-09-11T00:56:46:242635+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-11T01:04:45.573 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 1 2024-09-11T01:04:45.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.573+0000 7f58e1a00640 1 -- 172.21.15.103:0/3418804339 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f58c00b5410 msgr2=0x7f58c00b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.573+0000 7f58e1a00640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f58c00b5410 0x7f58c00b78d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f58cc005ab0 tx=0x7f58cc005a20 comp rx=0 tx=0).stop 2024-09-11T01:04:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.573+0000 7f58e1a00640 1 -- 172.21.15.103:0/3418804339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58dc108fa0 msgr2=0x7f58dc19e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.573+0000 7f58e1a00640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58dc108fa0 0x7f58dc19e900 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f58d400eaa0 tx=0x7f58d400ef60 comp rx=0 tx=0).stop 2024-09-11T01:04:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.574+0000 7f58e1a00640 1 -- 172.21.15.103:0/3418804339 shutdown_connections 2024-09-11T01:04:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.574+0000 7f58e1a00640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f58c00b5410 0x7f58c00b78d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.574+0000 7f58e1a00640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f58dc108fa0 0x7f58dc19e900 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.574+0000 7f58e1a00640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f58dc108620 0x7f58dc199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.574+0000 7f58e1a00640 1 --2- 172.21.15.103:0/3418804339 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f58dc102c10 0x7f58dc199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.574+0000 7f58e1a00640 1 -- 172.21.15.103:0/3418804339 >> 172.21.15.103:0/3418804339 conn(0x7f58dc0fe660 msgr2=0x7f58dc101b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.574+0000 7f58e1a00640 1 -- 172.21.15.103:0/3418804339 shutdown_connections 2024-09-11T01:04:45.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:45.574+0000 7f58e1a00640 1 -- 172.21.15.103:0/3418804339 wait complete. 2024-09-11T01:04:45.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:45 smithi117 ceph-mon[35358]: Deploying daemon mds.l on smithi183 2024-09-11T01:04:45.885 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:04:45 smithi183 systemd[1]: Starting Ceph mds.l for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:04:46.137 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:04:45 smithi183 podman[64671]: 2024-09-11 01:04:45.785927276 +0000 UTC m=+0.016276665 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:04:46.137 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:04:45 smithi183 podman[64671]: 2024-09-11 01:04:45.900143775 +0000 UTC m=+0.130493154 container create dc6e3960506289f25359bdf6a3f4127b92bee2fe7cbeef4fbcf343972806bb82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-l, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True) 2024-09-11T01:04:46.138 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:04:46 smithi183 podman[64671]: 2024-09-11 01:04:46.136416315 +0000 UTC m=+0.366765688 container init dc6e3960506289f25359bdf6a3f4127b92bee2fe7cbeef4fbcf343972806bb82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-l, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-11T01:04:46.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:46 smithi183 ceph-mon[34992]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:46.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:46 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3418804339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:04:46.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:46 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.183:6832/3089120088,v1:172.21.15.183:6833/3089120088] up:boot 2024-09-11T01:04:46.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:46 smithi183 ceph-mon[34992]: fsmap 1 up:standby 2024-09-11T01:04:46.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:46 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-11T01:04:46.419 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:04:46 smithi183 podman[64671]: 2024-09-11 01:04:46.139283793 +0000 UTC m=+0.369633167 container start dc6e3960506289f25359bdf6a3f4127b92bee2fe7cbeef4fbcf343972806bb82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-l, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-11T01:04:46.420 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:04:46 smithi183 ceph-mds[64690]: -- 172.21.15.183:0/141372335 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5570ba7b7860 con 0x5570ba795000 2024-09-11T01:04:46.420 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:04:46 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-l[64686]: starting mds.l at 2024-09-11T01:04:46.420 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:04:46 smithi183 bash[64671]: dc6e3960506289f25359bdf6a3f4127b92bee2fe7cbeef4fbcf343972806bb82 2024-09-11T01:04:46.420 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:04:46 smithi183 systemd[1]: Started Ceph mds.l for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T01:04:46.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:46 smithi103 ceph-mon[30562]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:46.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:46 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3418804339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:04:46.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:46 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.183:6832/3089120088,v1:172.21.15.183:6833/3089120088] up:boot 2024-09-11T01:04:46.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:46 smithi103 ceph-mon[30562]: fsmap 1 up:standby 2024-09-11T01:04:46.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:46 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-11T01:04:46.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:46 smithi117 ceph-mon[35358]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:46.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:46 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3418804339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:04:46.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:46 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.183:6832/3089120088,v1:172.21.15.183:6833/3089120088] up:boot 2024-09-11T01:04:46.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:46 smithi117 ceph-mon[35358]: fsmap 1 up:standby 2024-09-11T01:04:46.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:46 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-11T01:04:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:47 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:47 smithi103 ceph-mon[30562]: Deploying daemon mds.k on smithi117 2024-09-11T01:04:47.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:47.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:47.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:47.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:47.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:47.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:47 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:47.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:47 smithi117 ceph-mon[35358]: Deploying daemon mds.k on smithi117 2024-09-11T01:04:47.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:47.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:47.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:47.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:47.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:47.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:47 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:47.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:47 smithi183 ceph-mon[34992]: Deploying daemon mds.k on smithi117 2024-09-11T01:04:48.365 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:04:48.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:48 smithi117 ceph-mon[35358]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:48.581 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:48 smithi103 ceph-mon[30562]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:48.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:48 smithi183 ceph-mon[34992]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:48.714 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 11 01:04:48 smithi117 podman[64070]: 2024-09-11 01:04:48.689237407 +0000 UTC m=+0.356219851 container start 90b23bd49b2bf76ab0e1cddf21e65ddd2870e17f014e97d30291d52b53b6f820 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T01:04:48.739 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:04:49.122 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 11 01:04:48 smithi117 ceph-mds[64089]: -- 172.21.15.117:0/3940021022 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d3435e3860 con 0x55d3435c1400 2024-09-11T01:04:49.122 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 11 01:04:48 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-k[64085]: starting mds.k at 2024-09-11T01:04:49.123 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 11 01:04:48 smithi117 bash[64070]: 90b23bd49b2bf76ab0e1cddf21e65ddd2870e17f014e97d30291d52b53b6f820 2024-09-11T01:04:49.123 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 11 01:04:48 smithi117 systemd[1]: Started Ceph mds.k for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T01:04:49.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.280+0000 7f6da4a00640 1 -- 172.21.15.103:0/2459061421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6da0104df0 msgr2=0x7f6da01051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:49.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.280+0000 7f6da4a00640 1 --2- 172.21.15.103:0/2459061421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6da0104df0 0x7f6da01051d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009900 tx=0x7f6d9002a3f0 comp rx=0 tx=0).stop 2024-09-11T01:04:49.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.280+0000 7f6da4a00640 1 -- 172.21.15.103:0/2459061421 shutdown_connections 2024-09-11T01:04:49.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.280+0000 7f6da4a00640 1 --2- 172.21.15.103:0/2459061421 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6da010b180 0x7f6da0111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:49.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.280+0000 7f6da4a00640 1 --2- 172.21.15.103:0/2459061421 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da010a800 0x7f6da010ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:49.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.280+0000 7f6da4a00640 1 --2- 172.21.15.103:0/2459061421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6da0104df0 0x7f6da01051d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:49.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.280+0000 7f6da4a00640 1 -- 172.21.15.103:0/2459061421 >> 172.21.15.103:0/2459061421 conn(0x7f6da0100840 msgr2=0x7f6da0102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:49.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.280+0000 7f6da4a00640 1 -- 172.21.15.103:0/2459061421 shutdown_connections 2024-09-11T01:04:49.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.280+0000 7f6da4a00640 1 -- 172.21.15.103:0/2459061421 wait complete. 2024-09-11T01:04:49.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.281+0000 7f6da4a00640 1 Processor -- start 2024-09-11T01:04:49.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.281+0000 7f6da4a00640 1 -- start start 2024-09-11T01:04:49.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6da4a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0104df0 0x7f6da019b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:49.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6da4a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6da010a800 0x7f6da019b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:49.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6da4a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6da010b180 0x7f6da01a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:49.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6da4a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6da0114e40 con 0x7f6da010a800 2024-09-11T01:04:49.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6da4a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6da0114cc0 con 0x7f6da010b180 2024-09-11T01:04:49.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6da4a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6da0114fc0 con 0x7f6da0104df0 2024-09-11T01:04:49.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6d9de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6da010a800 0x7f6da019b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:49.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6d9de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6da010a800 0x7f6da019b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35604/0 (socket says 172.21.15.103:35604) 2024-09-11T01:04:49.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6d9e800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0104df0 0x7f6da019b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:49.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6d9de00640 1 -- 172.21.15.103:0/907752 learned_addr learned my addr 172.21.15.103:0/907752 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:04:49.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6d9f200640 1 --2- 172.21.15.103:0/907752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6da010b180 0x7f6da01a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:49.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6d9de00640 1 -- 172.21.15.103:0/907752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0104df0 msgr2=0x7f6da019b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:49.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6d9de00640 1 --2- 172.21.15.103:0/907752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0104df0 0x7f6da019b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:49.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6d9de00640 1 -- 172.21.15.103:0/907752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6da010b180 msgr2=0x7f6da01a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:49.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6d9de00640 1 --2- 172.21.15.103:0/907752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6da010b180 0x7f6da01a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:49.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.282+0000 7f6d9de00640 1 -- 172.21.15.103:0/907752 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da01a1300 con 0x7f6da010a800 2024-09-11T01:04:49.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.283+0000 7f6d9de00640 1 --2- 172.21.15.103:0/907752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6da010a800 0x7f6da019b790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00e9f0 tx=0x7f6d8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:49.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.283+0000 7f6d97400640 1 -- 172.21.15.103:0/907752 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00cd80 con 0x7f6da010a800 2024-09-11T01:04:49.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.283+0000 7f6da4a00640 1 -- 172.21.15.103:0/907752 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da01a15f0 con 0x7f6da010a800 2024-09-11T01:04:49.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.283+0000 7f6d97400640 1 -- 172.21.15.103:0/907752 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6d8c0108e0 con 0x7f6da010a800 2024-09-11T01:04:49.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.283+0000 7f6d97400640 1 -- 172.21.15.103:0/907752 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c018980 con 0x7f6da010a800 2024-09-11T01:04:49.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.283+0000 7f6da4a00640 1 -- 172.21.15.103:0/907752 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da01a7cb0 con 0x7f6da010a800 2024-09-11T01:04:49.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.284+0000 7f6da4a00640 1 -- 172.21.15.103:0/907752 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da01051d0 con 0x7f6da010a800 2024-09-11T01:04:49.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.287+0000 7f6d97400640 1 -- 172.21.15.103:0/907752 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f6d8c010430 con 0x7f6da010a800 2024-09-11T01:04:49.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.288+0000 7f6d97400640 1 --2- 172.21.15.103:0/907752 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6d840b5390 0x7f6d840b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:49.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.289+0000 7f6d97400640 1 -- 172.21.15.103:0/907752 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f6d8c0e5ac0 con 0x7f6da010a800 2024-09-11T01:04:49.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.289+0000 7f6d9e800640 1 --2- 172.21.15.103:0/907752 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6d840b5390 0x7f6d840b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:49.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.289+0000 7f6d9e800640 1 --2- 172.21.15.103:0/907752 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6d840b5390 0x7f6d840b7850 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6d90031440 tx=0x7f6d90005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:49.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.292+0000 7f6d97400640 1 -- 172.21.15.103:0/907752 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6d8c0ac730 con 0x7f6da010a800 2024-09-11T01:04:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.536+0000 7f6da4a00640 1 -- 172.21.15.103:0/907752 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6da01a7fe0 con 0x7f6da010a800 2024-09-11T01:04:49.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.537+0000 7f6d97400640 1 -- 172.21.15.103:0/907752 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2266 (secure 0 0 0) 0x7f6d8c0b1160 con 0x7f6da010a800 2024-09-11T01:04:49.539 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:04:49.539 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":3,"btime":"2024-09-11T01:04:49:293135+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-11T01:04:49.539 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 3 2024-09-11T01:04:49.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.540+0000 7f6da4a00640 1 -- 172.21.15.103:0/907752 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6d840b5390 msgr2=0x7f6d840b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:49.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.540+0000 7f6da4a00640 1 --2- 172.21.15.103:0/907752 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6d840b5390 0x7f6d840b7850 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6d90031440 tx=0x7f6d90005b50 comp rx=0 tx=0).stop 2024-09-11T01:04:49.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.540+0000 7f6da4a00640 1 -- 172.21.15.103:0/907752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6da010a800 msgr2=0x7f6da019b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:49.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.540+0000 7f6da4a00640 1 --2- 172.21.15.103:0/907752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6da010a800 0x7f6da019b790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c00e9f0 tx=0x7f6d8c00eeb0 comp rx=0 tx=0).stop 2024-09-11T01:04:49.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.540+0000 7f6da4a00640 1 -- 172.21.15.103:0/907752 shutdown_connections 2024-09-11T01:04:49.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.540+0000 7f6da4a00640 1 --2- 172.21.15.103:0/907752 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6d840b5390 0x7f6d840b7850 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:49.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.540+0000 7f6da4a00640 1 --2- 172.21.15.103:0/907752 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6da010b180 0x7f6da01a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:49.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.540+0000 7f6da4a00640 1 --2- 172.21.15.103:0/907752 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6da010a800 0x7f6da019b790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:49.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.540+0000 7f6da4a00640 1 --2- 172.21.15.103:0/907752 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6da0104df0 0x7f6da019b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:49.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.540+0000 7f6da4a00640 1 -- 172.21.15.103:0/907752 >> 172.21.15.103:0/907752 conn(0x7f6da0100840 msgr2=0x7f6da0101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:49.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.540+0000 7f6da4a00640 1 -- 172.21.15.103:0/907752 shutdown_connections 2024-09-11T01:04:49.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:49.540+0000 7f6da4a00640 1 -- 172.21.15.103:0/907752 wait complete. 2024-09-11T01:04:50.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:50.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:50.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:50.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:50.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:50.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:50.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:49 smithi103 ceph-mon[30562]: Deploying daemon mds.j on smithi103 2024-09-11T01:04:50.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:49 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.117:6832/3818376861,v1:172.21.15.117:6833/3818376861] up:boot 2024-09-11T01:04:50.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:49 smithi103 ceph-mon[30562]: fsmap 2 up:standby 2024-09-11T01:04:50.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-11T01:04:50.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:49 smithi103 ceph-mon[30562]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:50.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:49 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/907752' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:04:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:49 smithi117 ceph-mon[35358]: Deploying daemon mds.j on smithi103 2024-09-11T01:04:50.124 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:49 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.117:6832/3818376861,v1:172.21.15.117:6833/3818376861] up:boot 2024-09-11T01:04:50.124 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:49 smithi117 ceph-mon[35358]: fsmap 2 up:standby 2024-09-11T01:04:50.124 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-11T01:04:50.124 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:49 smithi117 ceph-mon[35358]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:50.124 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:49 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/907752' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:04:50.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:50.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:50.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:50.170 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:50.171 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:50.171 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:50.171 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:49 smithi183 ceph-mon[34992]: Deploying daemon mds.j on smithi103 2024-09-11T01:04:50.172 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:49 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.117:6832/3818376861,v1:172.21.15.117:6833/3818376861] up:boot 2024-09-11T01:04:50.172 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:49 smithi183 ceph-mon[34992]: fsmap 2 up:standby 2024-09-11T01:04:50.172 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-11T01:04:50.173 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:49 smithi183 ceph-mon[34992]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:50.173 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:49 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/907752' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:04:52.082 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:04:51 smithi103 systemd[1]: Starting Ceph mds.j for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:04:52.486 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:04:52 smithi103 podman[72938]: 2024-09-11 01:04:52.066684679 +0000 UTC m=+0.026974036 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:04:52.486 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:04:52 smithi103 podman[72938]: 2024-09-11 01:04:52.198244504 +0000 UTC m=+0.158533837 container create a4e62f8d4046cbfb4baba83a2d72182521616642a249e0aa6698ea3b570a7c26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-11T01:04:52.486 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:04:52 smithi103 podman[72938]: 2024-09-11 01:04:52.48473806 +0000 UTC m=+0.445027394 container init a4e62f8d4046cbfb4baba83a2d72182521616642a249e0aa6698ea3b570a7c26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-11T01:04:52.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:52 smithi103 ceph-mon[30562]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:52.832 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:04:52 smithi103 podman[72938]: 2024-09-11 01:04:52.491599345 +0000 UTC m=+0.451888679 container start a4e62f8d4046cbfb4baba83a2d72182521616642a249e0aa6698ea3b570a7c26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-j, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-11T01:04:52.832 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:04:52 smithi103 ceph-mds[72957]: -- 172.21.15.103:0/3445215119 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5618a7cc3860 con 0x5618a7ca0800 2024-09-11T01:04:52.832 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:04:52 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-j[72953]: starting mds.j at 2024-09-11T01:04:52.832 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:04:52 smithi103 bash[72938]: a4e62f8d4046cbfb4baba83a2d72182521616642a249e0aa6698ea3b570a7c26 2024-09-11T01:04:52.832 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:04:52 smithi103 systemd[1]: Started Ceph mds.j for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T01:04:52.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:52 smithi117 ceph-mon[35358]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:52.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:52 smithi183 ceph-mon[34992]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:53.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:53 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.103:6834/1479863011,v1:172.21.15.103:6835/1479863011] up:boot 2024-09-11T01:04:53.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:53 smithi103 ceph-mon[30562]: fsmap 3 up:standby 2024-09-11T01:04:53.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-11T01:04:53.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:53.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:53.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:53.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:53.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:53.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:53 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:53.772 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:04:53.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:53 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.103:6834/1479863011,v1:172.21.15.103:6835/1479863011] up:boot 2024-09-11T01:04:53.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:53 smithi117 ceph-mon[35358]: fsmap 3 up:standby 2024-09-11T01:04:53.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-11T01:04:53.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:53.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:53.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:53.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:53.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:53.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:53 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:53.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:53 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.103:6834/1479863011,v1:172.21.15.103:6835/1479863011] up:boot 2024-09-11T01:04:53.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:53 smithi183 ceph-mon[34992]: fsmap 3 up:standby 2024-09-11T01:04:53.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-11T01:04:53.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:53.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:53.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:53.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:53.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:53.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:53 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:54.655 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:04:54.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:54 smithi183 ceph-mon[34992]: Deploying daemon mds.d on smithi103 2024-09-11T01:04:54.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:54 smithi183 ceph-mon[34992]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:54.815 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:54 smithi103 ceph-mon[30562]: Deploying daemon mds.d on smithi103 2024-09-11T01:04:54.815 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:54 smithi103 ceph-mon[30562]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:54.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:54 smithi117 ceph-mon[35358]: Deploying daemon mds.d on smithi103 2024-09-11T01:04:54.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:54 smithi117 ceph-mon[35358]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.457+0000 7f11fd400640 1 -- 172.21.15.103:0/4146587985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f810a800 msgr2=0x7f11f810ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.457+0000 7f11fd400640 1 --2- 172.21.15.103:0/4146587985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f810a800 0x7f11f810ac40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009860 tx=0x7f11e402a340 comp rx=0 tx=0).stop 2024-09-11T01:04:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.457+0000 7f11fd400640 1 -- 172.21.15.103:0/4146587985 shutdown_connections 2024-09-11T01:04:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.457+0000 7f11fd400640 1 --2- 172.21.15.103:0/4146587985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f810b180 0x7f11f8111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.457+0000 7f11fd400640 1 --2- 172.21.15.103:0/4146587985 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f810a800 0x7f11f810ac40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.457+0000 7f11fd400640 1 --2- 172.21.15.103:0/4146587985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8104df0 0x7f11f81051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.457+0000 7f11fd400640 1 -- 172.21.15.103:0/4146587985 >> 172.21.15.103:0/4146587985 conn(0x7f11f8100840 msgr2=0x7f11f8102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.457+0000 7f11fd400640 1 -- 172.21.15.103:0/4146587985 shutdown_connections 2024-09-11T01:04:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.457+0000 7f11fd400640 1 -- 172.21.15.103:0/4146587985 wait complete. 2024-09-11T01:04:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.458+0000 7f11fd400640 1 Processor -- start 2024-09-11T01:04:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.458+0000 7f11fd400640 1 -- start start 2024-09-11T01:04:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.458+0000 7f11fd400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8104df0 0x7f11f819b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11fd400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f810a800 0x7f11f819b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11fd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f810b180 0x7f11f81a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11fd400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8114e40 con 0x7f11f810b180 2024-09-11T01:04:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11fd400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8114cc0 con 0x7f11f8104df0 2024-09-11T01:04:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11fd400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8114fc0 con 0x7f11f810a800 2024-09-11T01:04:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11fca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f810b180 0x7f11f81a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11f7400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f810a800 0x7f11f819b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11fca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f810b180 0x7f11f81a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41196/0 (socket says 172.21.15.103:41196) 2024-09-11T01:04:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11fca00640 1 -- 172.21.15.103:0/748859212 learned_addr learned my addr 172.21.15.103:0/748859212 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:04:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11f7e00640 1 --2- 172.21.15.103:0/748859212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8104df0 0x7f11f819b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11f7400640 1 -- 172.21.15.103:0/748859212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8104df0 msgr2=0x7f11f819b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11f7400640 1 --2- 172.21.15.103:0/748859212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8104df0 0x7f11f819b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11f7400640 1 -- 172.21.15.103:0/748859212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f810b180 msgr2=0x7f11f81a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:55.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11f7400640 1 --2- 172.21.15.103:0/748859212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f810b180 0x7f11f81a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.459+0000 7f11f7400640 1 -- 172.21.15.103:0/748859212 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f81a12e0 con 0x7f11f810a800 2024-09-11T01:04:55.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.460+0000 7f11f7400640 1 --2- 172.21.15.103:0/748859212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f810a800 0x7f11f819b770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11e4035040 tx=0x7f11e4032dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:55.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.460+0000 7f11f4c00640 1 -- 172.21.15.103:0/748859212 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e4037040 con 0x7f11f810a800 2024-09-11T01:04:55.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.460+0000 7f11fd400640 1 -- 172.21.15.103:0/748859212 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f81a1570 con 0x7f11f810a800 2024-09-11T01:04:55.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.460+0000 7f11f4c00640 1 -- 172.21.15.103:0/748859212 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11e4030bd0 con 0x7f11f810a800 2024-09-11T01:04:55.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.460+0000 7f11f4c00640 1 -- 172.21.15.103:0/748859212 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e40035f0 con 0x7f11f810a800 2024-09-11T01:04:55.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.460+0000 7f11fd400640 1 -- 172.21.15.103:0/748859212 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f81a7c90 con 0x7f11f810a800 2024-09-11T01:04:55.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.461+0000 7f11fd400640 1 -- 172.21.15.103:0/748859212 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11f81051d0 con 0x7f11f810a800 2024-09-11T01:04:55.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.463+0000 7f11f4c00640 1 -- 172.21.15.103:0/748859212 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f11e4004050 con 0x7f11f810a800 2024-09-11T01:04:55.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.464+0000 7f11f4c00640 1 --2- 172.21.15.103:0/748859212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f11dc0b5390 0x7f11dc0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:04:55.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.465+0000 7f11f4c00640 1 -- 172.21.15.103:0/748859212 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f11e4104ca0 con 0x7f11f810a800 2024-09-11T01:04:55.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.465+0000 7f11f7e00640 1 --2- 172.21.15.103:0/748859212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f11dc0b5390 0x7f11dc0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:04:55.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.465+0000 7f11f7e00640 1 --2- 172.21.15.103:0/748859212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f11dc0b5390 0x7f11dc0b7850 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f11e8005fd0 tx=0x7f11e8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:04:55.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.466+0000 7f11f4c00640 1 -- 172.21.15.103:0/748859212 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f11e404a060 con 0x7f11f810a800 2024-09-11T01:04:55.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.727+0000 7f11fd400640 1 -- 172.21.15.103:0/748859212 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11f802e5c0 con 0x7f11f810a800 2024-09-11T01:04:55.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.727+0000 7f11f4c00640 1 -- 172.21.15.103:0/748859212 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3094 (secure 0 0 0) 0x7f11e4030d80 con 0x7f11f810a800 2024-09-11T01:04:55.730 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:04:55.730 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":4,"btime":"2024-09-11T01:04:52:551020+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-09-11T01:04:55.730 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 4 2024-09-11T01:04:55.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.730+0000 7f11fd400640 1 -- 172.21.15.103:0/748859212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f11dc0b5390 msgr2=0x7f11dc0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:55.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.730+0000 7f11fd400640 1 --2- 172.21.15.103:0/748859212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f11dc0b5390 0x7f11dc0b7850 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f11e8005fd0 tx=0x7f11e8009680 comp rx=0 tx=0).stop 2024-09-11T01:04:55.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.730+0000 7f11fd400640 1 -- 172.21.15.103:0/748859212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f810a800 msgr2=0x7f11f819b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:04:55.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.730+0000 7f11fd400640 1 --2- 172.21.15.103:0/748859212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f810a800 0x7f11f819b770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11e4035040 tx=0x7f11e4032dc0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.730+0000 7f11fd400640 1 -- 172.21.15.103:0/748859212 shutdown_connections 2024-09-11T01:04:55.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.730+0000 7f11fd400640 1 --2- 172.21.15.103:0/748859212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f11dc0b5390 0x7f11dc0b7850 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.730+0000 7f11fd400640 1 --2- 172.21.15.103:0/748859212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f810b180 0x7f11f81a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.730+0000 7f11fd400640 1 --2- 172.21.15.103:0/748859212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f810a800 0x7f11f819b770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.730+0000 7f11fd400640 1 --2- 172.21.15.103:0/748859212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8104df0 0x7f11f819b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:04:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.730+0000 7f11fd400640 1 -- 172.21.15.103:0/748859212 >> 172.21.15.103:0/748859212 conn(0x7f11f8100840 msgr2=0x7f11f8106db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:04:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.731+0000 7f11fd400640 1 -- 172.21.15.103:0/748859212 shutdown_connections 2024-09-11T01:04:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:04:55.731+0000 7f11fd400640 1 -- 172.21.15.103:0/748859212 wait complete. 2024-09-11T01:04:56.053 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 11 01:04:55 smithi103 podman[73329]: 2024-09-11 01:04:55.899217975 +0000 UTC m=+0.164160538 container create 4fab1b12de5f8f4c3be9564b2198508ebcbfe74cba57ff255221ca4a1c4061d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-11T01:04:56.673 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:56 smithi103 ceph-mon[30562]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:56.673 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:56 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/748859212' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:04:56.673 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 11 01:04:56 smithi103 podman[73329]: 2024-09-11 01:04:56.403643315 +0000 UTC m=+0.668585880 container init 4fab1b12de5f8f4c3be9564b2198508ebcbfe74cba57ff255221ca4a1c4061d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-d, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0) 2024-09-11T01:04:56.673 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 11 01:04:56 smithi103 podman[73329]: 2024-09-11 01:04:56.409987138 +0000 UTC m=+0.674929703 container start 4fab1b12de5f8f4c3be9564b2198508ebcbfe74cba57ff255221ca4a1c4061d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-d, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T01:04:56.674 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 11 01:04:56 smithi103 ceph-mds[73360]: -- 172.21.15.103:0/2233579557 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562f76fb9860 con 0x562f76f97000 2024-09-11T01:04:56.674 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 11 01:04:56 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-d[73356]: starting mds.d at 2024-09-11T01:04:56.674 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 11 01:04:56 smithi103 bash[73329]: 4fab1b12de5f8f4c3be9564b2198508ebcbfe74cba57ff255221ca4a1c4061d4 2024-09-11T01:04:56.674 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 11 01:04:56 smithi103 systemd[1]: Started Ceph mds.d for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T01:04:56.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:56 smithi117 ceph-mon[35358]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:56.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:56 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/748859212' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:04:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:56 smithi183 ceph-mon[34992]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:56.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:56 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/748859212' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:04:57.716 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:57 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.103:6836/556566266,v1:172.21.15.103:6837/556566266] up:boot 2024-09-11T01:04:57.716 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:57 smithi103 ceph-mon[30562]: fsmap 4 up:standby 2024-09-11T01:04:57.716 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:57 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-11T01:04:57.716 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:57 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:57.716 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:57 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:57.716 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:57 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:57.716 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:57 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:57.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:57 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:57.717 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:57 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:57.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:57 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.103:6836/556566266,v1:172.21.15.103:6837/556566266] up:boot 2024-09-11T01:04:57.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:57 smithi117 ceph-mon[35358]: fsmap 4 up:standby 2024-09-11T01:04:57.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:57 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-11T01:04:57.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:57 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:57.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:57 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:57.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:57 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:57.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:57 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:57.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:57 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:57.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:57 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:57.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:57 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.103:6836/556566266,v1:172.21.15.103:6837/556566266] up:boot 2024-09-11T01:04:57.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:57 smithi183 ceph-mon[34992]: fsmap 4 up:standby 2024-09-11T01:04:57.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:57 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-11T01:04:57.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:57 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:57.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:57 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:57.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:57 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:04:57.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:57 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:04:57.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:57 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:04:57.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:57 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:04:58.814 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:58 smithi117 ceph-mon[35358]: Deploying daemon mds.e on smithi117 2024-09-11T01:04:58.815 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:04:58 smithi117 ceph-mon[35358]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:58.815 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:04:58 smithi117 systemd[1]: Starting Ceph mds.e for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:04:58.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:58 smithi103 ceph-mon[30562]: Deploying daemon mds.e on smithi117 2024-09-11T01:04:58.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:04:58 smithi103 ceph-mon[30562]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:58 smithi183 ceph-mon[34992]: Deploying daemon mds.e on smithi117 2024-09-11T01:04:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:04:58 smithi183 ceph-mon[34992]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:04:59.076 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:04:58 smithi117 podman[64379]: 2024-09-11 01:04:58.71585155 +0000 UTC m=+0.015870050 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:04:59.076 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:04:58 smithi117 podman[64379]: 2024-09-11 01:04:58.838234069 +0000 UTC m=+0.138252567 container create 4421820a92d18a5ca7b2c6142daca7ef44aee23fd36542ed9d907fc4f7707cfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-e, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-11T01:04:59.089 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:04:59.373 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:04:59 smithi117 podman[64379]: 2024-09-11 01:04:59.074628295 +0000 UTC m=+0.374646786 container init 4421820a92d18a5ca7b2c6142daca7ef44aee23fd36542ed9d907fc4f7707cfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-e, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-11T01:04:59.373 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:04:59 smithi117 podman[64379]: 2024-09-11 01:04:59.077702462 +0000 UTC m=+0.377720953 container start 4421820a92d18a5ca7b2c6142daca7ef44aee23fd36542ed9d907fc4f7707cfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-11T01:04:59.373 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:04:59 smithi117 ceph-mds[64398]: -- 172.21.15.117:0/2379705476 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55bccd383860 con 0x55bccd361400 2024-09-11T01:04:59.373 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:04:59 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-e[64394]: starting mds.e at 2024-09-11T01:04:59.373 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:04:59 smithi117 bash[64379]: 4421820a92d18a5ca7b2c6142daca7ef44aee23fd36542ed9d907fc4f7707cfc 2024-09-11T01:04:59.373 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:04:59 smithi117 systemd[1]: Started Ceph mds.e for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T01:04:59.466 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:00.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.041+0000 7f8dd3200640 1 -- 172.21.15.103:0/3609305620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dd410b180 msgr2=0x7f8dd4111980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:00.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.041+0000 7f8dd3200640 1 --2- 172.21.15.103:0/3609305620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dd410b180 0x7f8dd4111980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc009ca0 tx=0x7f8dcc02a8c0 comp rx=0 tx=0).stop 2024-09-11T01:05:00.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.041+0000 7f8dd3200640 1 -- 172.21.15.103:0/3609305620 shutdown_connections 2024-09-11T01:05:00.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.041+0000 7f8dd3200640 1 --2- 172.21.15.103:0/3609305620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dd410b180 0x7f8dd4111980 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:00.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.041+0000 7f8dd3200640 1 --2- 172.21.15.103:0/3609305620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd410a800 0x7f8dd410ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:00.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.041+0000 7f8dd3200640 1 --2- 172.21.15.103:0/3609305620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd4104df0 0x7f8dd41051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:00.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.041+0000 7f8dd3200640 1 -- 172.21.15.103:0/3609305620 >> 172.21.15.103:0/3609305620 conn(0x7f8dd4100840 msgr2=0x7f8dd4102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:00.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.041+0000 7f8dd3200640 1 -- 172.21.15.103:0/3609305620 shutdown_connections 2024-09-11T01:05:00.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.041+0000 7f8dd3200640 1 -- 172.21.15.103:0/3609305620 wait complete. 2024-09-11T01:05:00.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.042+0000 7f8dd3200640 1 Processor -- start 2024-09-11T01:05:00.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.042+0000 7f8dd3200640 1 -- start start 2024-09-11T01:05:00.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.042+0000 7f8dd3200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd4104df0 0x7f8dd419b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:00.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.042+0000 7f8dd3200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd410a800 0x7f8dd419b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:00.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.042+0000 7f8dd3200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dd410b180 0x7f8dd41a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:00.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.042+0000 7f8dd3200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd4114e00 con 0x7f8dd4104df0 2024-09-11T01:05:00.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.042+0000 7f8dd3200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd4114c80 con 0x7f8dd410a800 2024-09-11T01:05:00.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.042+0000 7f8dd3200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd4114f80 con 0x7f8dd410b180 2024-09-11T01:05:00.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.043+0000 7f8dd1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd4104df0 0x7f8dd419b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:00.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.043+0000 7f8dd1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd4104df0 0x7f8dd419b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58624/0 (socket says 172.21.15.103:58624) 2024-09-11T01:05:00.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.043+0000 7f8dd1e00640 1 -- 172.21.15.103:0/787723279 learned_addr learned my addr 172.21.15.103:0/787723279 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:00.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.043+0000 7f8dd1400640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd410a800 0x7f8dd419b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:00.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.043+0000 7f8dd2800640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dd410b180 0x7f8dd41a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:00.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.043+0000 7f8dd1e00640 1 -- 172.21.15.103:0/787723279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dd410b180 msgr2=0x7f8dd41a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:00.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.043+0000 7f8dd1e00640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dd410b180 0x7f8dd41a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:00.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.043+0000 7f8dd1e00640 1 -- 172.21.15.103:0/787723279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd410a800 msgr2=0x7f8dd419b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:00.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.043+0000 7f8dd1e00640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd410a800 0x7f8dd419b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:00.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.043+0000 7f8dd1e00640 1 -- 172.21.15.103:0/787723279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd41a12a0 con 0x7f8dd4104df0 2024-09-11T01:05:00.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.043+0000 7f8dd1400640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd410a800 0x7f8dd419b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:05:00.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.043+0000 7f8dd1e00640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd4104df0 0x7f8dd419b1f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400ea60 tx=0x7f8dc400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:00.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.044+0000 7f8dcaa00640 1 -- 172.21.15.103:0/787723279 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc400cde0 con 0x7f8dd4104df0 2024-09-11T01:05:00.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.044+0000 7f8dcaa00640 1 -- 172.21.15.103:0/787723279 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8dc40035f0 con 0x7f8dd4104df0 2024-09-11T01:05:00.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.044+0000 7f8dd3200640 1 -- 172.21.15.103:0/787723279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dd41a1590 con 0x7f8dd4104df0 2024-09-11T01:05:00.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.044+0000 7f8dcaa00640 1 -- 172.21.15.103:0/787723279 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4010690 con 0x7f8dd4104df0 2024-09-11T01:05:00.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.044+0000 7f8dd3200640 1 -- 172.21.15.103:0/787723279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dd41a7e20 con 0x7f8dd4104df0 2024-09-11T01:05:00.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.045+0000 7f8dd3200640 1 -- 172.21.15.103:0/787723279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dd41051d0 con 0x7f8dd4104df0 2024-09-11T01:05:00.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.047+0000 7f8dcaa00640 1 -- 172.21.15.103:0/787723279 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f8dc4004000 con 0x7f8dd4104df0 2024-09-11T01:05:00.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.048+0000 7f8dcaa00640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8db80b5410 0x7f8db80b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:00.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.049+0000 7f8dcaa00640 1 -- 172.21.15.103:0/787723279 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f8dc40e5a10 con 0x7f8dd4104df0 2024-09-11T01:05:00.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.049+0000 7f8dd1400640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8db80b5410 0x7f8db80b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:00.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.049+0000 7f8dd1400640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8db80b5410 0x7f8db80b78d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4107360 tx=0x7f8dc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:00.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.050+0000 7f8dcaa00640 1 -- 172.21.15.103:0/787723279 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8dc40accd0 con 0x7f8dd4104df0 2024-09-11T01:05:00.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.274+0000 7f8dd3200640 1 -- 172.21.15.103:0/787723279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8dd419c320 con 0x7f8dd4104df0 2024-09-11T01:05:00.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.274+0000 7f8dcaa00640 1 -- 172.21.15.103:0/787723279 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4747 (secure 0 0 0) 0x7f8dd419c320 con 0x7f8dd4104df0 2024-09-11T01:05:00.276 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:05:00.277 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"btime":"2024-09-11T01:04:59:569644+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-11T01:05:00.277 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2024-09-11T01:05:00.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.277+0000 7f8dd3200640 1 -- 172.21.15.103:0/787723279 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8db80b5410 msgr2=0x7f8db80b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:00.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.277+0000 7f8dd3200640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8db80b5410 0x7f8db80b78d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4107360 tx=0x7f8dc0005f90 comp rx=0 tx=0).stop 2024-09-11T01:05:00.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.277+0000 7f8dd3200640 1 -- 172.21.15.103:0/787723279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd4104df0 msgr2=0x7f8dd419b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:00.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.277+0000 7f8dd3200640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd4104df0 0x7f8dd419b1f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400ea60 tx=0x7f8dc400ef20 comp rx=0 tx=0).stop 2024-09-11T01:05:00.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.277+0000 7f8dd3200640 1 -- 172.21.15.103:0/787723279 shutdown_connections 2024-09-11T01:05:00.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.277+0000 7f8dd3200640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8db80b5410 0x7f8db80b78d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:00.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.277+0000 7f8dd3200640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8dd410b180 0x7f8dd41a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:00.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.277+0000 7f8dd3200640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8dd410a800 0x7f8dd419b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:00.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.277+0000 7f8dd3200640 1 --2- 172.21.15.103:0/787723279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8dd4104df0 0x7f8dd419b1f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:00.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.277+0000 7f8dd3200640 1 -- 172.21.15.103:0/787723279 >> 172.21.15.103:0/787723279 conn(0x7f8dd4100840 msgr2=0x7f8dd4103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:00.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.277+0000 7f8dd3200640 1 -- 172.21.15.103:0/787723279 shutdown_connections 2024-09-11T01:05:00.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:00.277+0000 7f8dd3200640 1 -- 172.21.15.103:0/787723279 wait complete. 2024-09-11T01:05:00.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:00 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:00.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:00 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:00.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:00 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:00.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:00 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:00.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:00 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:00.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:00 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:00.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:00 smithi103 ceph-mon[30562]: Deploying daemon mds.f on smithi183 2024-09-11T01:05:00.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:00 smithi103 ceph-mon[30562]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:00.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:00 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.117:6834/3506900188,v1:172.21.15.117:6835/3506900188] up:boot 2024-09-11T01:05:00.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:00 smithi103 ceph-mon[30562]: fsmap 5 up:standby 2024-09-11T01:05:00.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:00 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T01:05:00.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:00 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:00.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:00 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:00.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:00 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:00.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:00 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:00.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:00 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:00.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:00 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:00.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:00 smithi117 ceph-mon[35358]: Deploying daemon mds.f on smithi183 2024-09-11T01:05:00.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:00 smithi117 ceph-mon[35358]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:00.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:00 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.117:6834/3506900188,v1:172.21.15.117:6835/3506900188] up:boot 2024-09-11T01:05:00.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:00 smithi117 ceph-mon[35358]: fsmap 5 up:standby 2024-09-11T01:05:00.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:00 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T01:05:00.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:00 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:00.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:00 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:00.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:00 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:00.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:00 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:00.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:00 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:00.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:00 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:00.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:00 smithi183 ceph-mon[34992]: Deploying daemon mds.f on smithi183 2024-09-11T01:05:00.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:00 smithi183 ceph-mon[34992]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:00.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:00 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.117:6834/3506900188,v1:172.21.15.117:6835/3506900188] up:boot 2024-09-11T01:05:00.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:00 smithi183 ceph-mon[34992]: fsmap 5 up:standby 2024-09-11T01:05:00.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:00 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T01:05:01.232 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:05:01 smithi183 systemd[1]: Starting Ceph mds.f for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:05:01.568 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:01 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/787723279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:01.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:01 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/787723279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:01.622 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:01 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/787723279' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:01.623 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:05:01 smithi183 podman[64982]: 2024-09-11 01:05:01.272071703 +0000 UTC m=+0.015669342 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:05:01.623 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:05:01 smithi183 podman[64982]: 2024-09-11 01:05:01.431544584 +0000 UTC m=+0.175142221 container create 8cc09629b9d1b1be8a646bd226c02ee602535d6c8ce0dac1f27590721f63ea9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T01:05:02.168 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:05:01 smithi183 podman[64982]: 2024-09-11 01:05:01.740039178 +0000 UTC m=+0.483636817 container init 8cc09629b9d1b1be8a646bd226c02ee602535d6c8ce0dac1f27590721f63ea9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T01:05:02.169 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:05:01 smithi183 podman[64982]: 2024-09-11 01:05:01.742772118 +0000 UTC m=+0.486369756 container start 8cc09629b9d1b1be8a646bd226c02ee602535d6c8ce0dac1f27590721f63ea9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-f, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-11T01:05:02.169 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:05:01 smithi183 ceph-mds[65001]: -- 172.21.15.183:0/2159236144 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ac372a5860 con 0x55ac37283400 2024-09-11T01:05:02.169 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:05:01 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-f[64997]: starting mds.f at 2024-09-11T01:05:02.169 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:05:01 smithi183 bash[64982]: 8cc09629b9d1b1be8a646bd226c02ee602535d6c8ce0dac1f27590721f63ea9c 2024-09-11T01:05:02.169 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:05:01 smithi183 systemd[1]: Started Ceph mds.f for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T01:05:02.563 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:02 smithi183 ceph-mon[34992]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:02.564 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:02.564 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:02.564 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:02.564 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:02.565 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:02.565 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:02.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:02 smithi103 ceph-mon[30562]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:02.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:02.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:02.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:02.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:02.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:02.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:02.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:02 smithi117 ceph-mon[35358]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:02.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:02.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:02.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:02.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:02.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:02.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:03.156 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:05:03.518 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:03 smithi183 ceph-mon[34992]: Deploying daemon mds.c on smithi183 2024-09-11T01:05:03.518 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:03 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.183:6834/2084396200,v1:172.21.15.183:6835/2084396200] up:boot 2024-09-11T01:05:03.518 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:03 smithi183 ceph-mon[34992]: fsmap 6 up:standby 2024-09-11T01:05:03.518 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:03 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T01:05:03.534 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:03.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:03 smithi103 ceph-mon[30562]: Deploying daemon mds.c on smithi183 2024-09-11T01:05:03.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:03 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.183:6834/2084396200,v1:172.21.15.183:6835/2084396200] up:boot 2024-09-11T01:05:03.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:03 smithi103 ceph-mon[30562]: fsmap 6 up:standby 2024-09-11T01:05:03.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:03 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T01:05:03.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:03 smithi117 ceph-mon[35358]: Deploying daemon mds.c on smithi183 2024-09-11T01:05:03.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:03 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.183:6834/2084396200,v1:172.21.15.183:6835/2084396200] up:boot 2024-09-11T01:05:03.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:03 smithi117 ceph-mon[35358]: fsmap 6 up:standby 2024-09-11T01:05:03.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:03 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T01:05:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.123+0000 7fe3fec00640 1 -- 172.21.15.103:0/3333070424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3f81087d0 msgr2=0x7fe3f8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.123+0000 7fe3fec00640 1 --2- 172.21.15.103:0/3333070424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3f81087d0 0x7fe3f8108c10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009900 tx=0x7fe3e002a410 comp rx=0 tx=0).stop 2024-09-11T01:05:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.124+0000 7fe3fec00640 1 -- 172.21.15.103:0/3333070424 shutdown_connections 2024-09-11T01:05:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.124+0000 7fe3fec00640 1 --2- 172.21.15.103:0/3333070424 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3f8109150 0x7fe3f810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.124+0000 7fe3fec00640 1 --2- 172.21.15.103:0/3333070424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3f81087d0 0x7fe3f8108c10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.124+0000 7fe3fec00640 1 --2- 172.21.15.103:0/3333070424 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f8102dc0 0x7fe3f81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.124+0000 7fe3fec00640 1 -- 172.21.15.103:0/3333070424 >> 172.21.15.103:0/3333070424 conn(0x7fe3f80fe830 msgr2=0x7fe3f8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.124+0000 7fe3fec00640 1 -- 172.21.15.103:0/3333070424 shutdown_connections 2024-09-11T01:05:04.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.124+0000 7fe3fec00640 1 -- 172.21.15.103:0/3333070424 wait complete. 2024-09-11T01:05:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.125+0000 7fe3fec00640 1 Processor -- start 2024-09-11T01:05:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.125+0000 7fe3fec00640 1 -- start start 2024-09-11T01:05:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.125+0000 7fe3fec00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3f8102dc0 0x7fe3f8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.125+0000 7fe3fec00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f81087d0 0x7fe3f81997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.125+0000 7fe3fec00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3f8109150 0x7fe3f819eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.125+0000 7fe3fec00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f8112e60 con 0x7fe3f8109150 2024-09-11T01:05:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.125+0000 7fe3fec00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f8112ce0 con 0x7fe3f81087d0 2024-09-11T01:05:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.125+0000 7fe3fec00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe3f8112fe0 con 0x7fe3f8102dc0 2024-09-11T01:05:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.125+0000 7fe3f7e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3f8102dc0 0x7fe3f8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.125+0000 7fe3f7e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3f8102dc0 0x7fe3f8199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:38302/0 (socket says 172.21.15.103:38302) 2024-09-11T01:05:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.125+0000 7fe3f7e00640 1 -- 172.21.15.103:0/721594793 learned_addr learned my addr 172.21.15.103:0/721594793 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.125+0000 7fe3fcc00640 1 --2- 172.21.15.103:0/721594793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3f8109150 0x7fe3f819eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.125+0000 7fe3efe00640 1 --2- 172.21.15.103:0/721594793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f81087d0 0x7fe3f81997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.126+0000 7fe3f7e00640 1 -- 172.21.15.103:0/721594793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f81087d0 msgr2=0x7fe3f81997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.126+0000 7fe3f7e00640 1 --2- 172.21.15.103:0/721594793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f81087d0 0x7fe3f81997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.126+0000 7fe3f7e00640 1 -- 172.21.15.103:0/721594793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3f8109150 msgr2=0x7fe3f819eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.126+0000 7fe3f7e00640 1 --2- 172.21.15.103:0/721594793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3f8109150 0x7fe3f819eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.126+0000 7fe3f7e00640 1 -- 172.21.15.103:0/721594793 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f819f340 con 0x7fe3f8102dc0 2024-09-11T01:05:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.126+0000 7fe3f7e00640 1 --2- 172.21.15.103:0/721594793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3f8102dc0 0x7fe3f8199290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800e9f0 tx=0x7fe3e800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.126+0000 7fe3f5600640 1 -- 172.21.15.103:0/721594793 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e800cd80 con 0x7fe3f8102dc0 2024-09-11T01:05:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.126+0000 7fe3fec00640 1 -- 172.21.15.103:0/721594793 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3f819f630 con 0x7fe3f8102dc0 2024-09-11T01:05:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.126+0000 7fe3f5600640 1 -- 172.21.15.103:0/721594793 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe3e80108e0 con 0x7fe3f8102dc0 2024-09-11T01:05:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.126+0000 7fe3f5600640 1 -- 172.21.15.103:0/721594793 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8018980 con 0x7fe3f8102dc0 2024-09-11T01:05:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.126+0000 7fe3fec00640 1 -- 172.21.15.103:0/721594793 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3f81a5cf0 con 0x7fe3f8102dc0 2024-09-11T01:05:04.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.127+0000 7fe3fec00640 1 -- 172.21.15.103:0/721594793 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3f81031a0 con 0x7fe3f8102dc0 2024-09-11T01:05:04.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.130+0000 7fe3f5600640 1 -- 172.21.15.103:0/721594793 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fe3e8010430 con 0x7fe3f8102dc0 2024-09-11T01:05:04.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.131+0000 7fe3f5600640 1 --2- 172.21.15.103:0/721594793 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe3dc0b52e0 0x7fe3dc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:04.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.131+0000 7fe3f5600640 1 -- 172.21.15.103:0/721594793 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fe3e80e5d70 con 0x7fe3f8102dc0 2024-09-11T01:05:04.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.131+0000 7fe3efe00640 1 --2- 172.21.15.103:0/721594793 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe3dc0b52e0 0x7fe3dc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:04.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.132+0000 7fe3efe00640 1 --2- 172.21.15.103:0/721594793 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe3dc0b52e0 0x7fe3dc0b77a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0005ab0 tx=0x7fe3e0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:04.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.133+0000 7fe3f5600640 1 -- 172.21.15.103:0/721594793 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe3e80ac9e0 con 0x7fe3f8102dc0 2024-09-11T01:05:04.331 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:04 smithi103 ceph-mon[30562]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:04.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.355+0000 7fe3fec00640 1 -- 172.21.15.103:0/721594793 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe3f802e5c0 con 0x7fe3f8102dc0 2024-09-11T01:05:04.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.356+0000 7fe3f5600640 1 -- 172.21.15.103:0/721594793 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5575 (secure 0 0 0) 0x7fe3e80b1410 con 0x7fe3f8102dc0 2024-09-11T01:05:04.358 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:05:04.358 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":7,"btime":"2024-09-11T01:05:02:231280+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-11T01:05:04.359 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 7 2024-09-11T01:05:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.358+0000 7fe3fec00640 1 -- 172.21.15.103:0/721594793 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe3dc0b52e0 msgr2=0x7fe3dc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.358+0000 7fe3fec00640 1 --2- 172.21.15.103:0/721594793 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe3dc0b52e0 0x7fe3dc0b77a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0005ab0 tx=0x7fe3e0005a20 comp rx=0 tx=0).stop 2024-09-11T01:05:04.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.358+0000 7fe3fec00640 1 -- 172.21.15.103:0/721594793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3f8102dc0 msgr2=0x7fe3f8199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:04.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.358+0000 7fe3fec00640 1 --2- 172.21.15.103:0/721594793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3f8102dc0 0x7fe3f8199290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800e9f0 tx=0x7fe3e800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:05:04.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.359+0000 7fe3fec00640 1 -- 172.21.15.103:0/721594793 shutdown_connections 2024-09-11T01:05:04.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.359+0000 7fe3fec00640 1 --2- 172.21.15.103:0/721594793 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe3dc0b52e0 0x7fe3dc0b77a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:04.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.359+0000 7fe3fec00640 1 --2- 172.21.15.103:0/721594793 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe3f8109150 0x7fe3f819eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:04.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.359+0000 7fe3fec00640 1 --2- 172.21.15.103:0/721594793 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe3f81087d0 0x7fe3f81997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:04.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.359+0000 7fe3fec00640 1 --2- 172.21.15.103:0/721594793 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe3f8102dc0 0x7fe3f8199290 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:04.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.359+0000 7fe3fec00640 1 -- 172.21.15.103:0/721594793 >> 172.21.15.103:0/721594793 conn(0x7fe3f80fe830 msgr2=0x7fe3f8100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:04.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.359+0000 7fe3fec00640 1 -- 172.21.15.103:0/721594793 shutdown_connections 2024-09-11T01:05:04.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:04.359+0000 7fe3fec00640 1 -- 172.21.15.103:0/721594793 wait complete. 2024-09-11T01:05:04.595 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:04 smithi183 ceph-mon[34992]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:04.595 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:05:04 smithi183 systemd[1]: Starting Ceph mds.c for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:05:04.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:04 smithi117 ceph-mon[35358]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:04.857 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:05:04 smithi183 podman[65284]: 2024-09-11 01:05:04.495930762 +0000 UTC m=+0.016012188 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:05:04.857 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:05:04 smithi183 podman[65284]: 2024-09-11 01:05:04.61138613 +0000 UTC m=+0.131467546 container create adefb5b2ca3fbc8968525331894dd3a5bb6dcb2f214b23975dbdedc4f119a3e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-c, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-11T01:05:04.857 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:05:04 smithi183 podman[65284]: 2024-09-11 01:05:04.85591751 +0000 UTC m=+0.375998923 container init adefb5b2ca3fbc8968525331894dd3a5bb6dcb2f214b23975dbdedc4f119a3e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T01:05:05.168 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:05:04 smithi183 podman[65284]: 2024-09-11 01:05:04.858806166 +0000 UTC m=+0.378887585 container start adefb5b2ca3fbc8968525331894dd3a5bb6dcb2f214b23975dbdedc4f119a3e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-c, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T01:05:05.169 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:05:04 smithi183 ceph-mds[65303]: -- 172.21.15.183:0/3287172623 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56324818b860 con 0x563248169400 2024-09-11T01:05:05.169 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:05:04 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-c[65299]: starting mds.c at 2024-09-11T01:05:05.169 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:05:04 smithi183 bash[65284]: adefb5b2ca3fbc8968525331894dd3a5bb6dcb2f214b23975dbdedc4f119a3e3 2024-09-11T01:05:05.169 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:05:04 smithi183 systemd[1]: Started Ceph mds.c for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T01:05:05.581 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:05 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/721594793' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:05.581 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:05.581 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:05.581 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:05.582 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:05.582 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:05.582 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:05.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:05 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/721594793' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:05.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:05.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:05.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:05.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:05.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:05.584 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:05.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:05 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/721594793' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:05.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:05.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:05.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:05.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:05.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:05.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:06.526 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:06 smithi117 ceph-mon[35358]: Deploying daemon mds.h on smithi117 2024-09-11T01:05:06.526 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:06 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.183:6836/1863510967,v1:172.21.15.183:6837/1863510967] up:boot 2024-09-11T01:05:06.526 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:06 smithi117 ceph-mon[35358]: fsmap 7 up:standby 2024-09-11T01:05:06.526 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:06 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T01:05:06.526 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:06 smithi117 ceph-mon[35358]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:06.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:06 smithi103 ceph-mon[30562]: Deploying daemon mds.h on smithi117 2024-09-11T01:05:06.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:06 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.183:6836/1863510967,v1:172.21.15.183:6837/1863510967] up:boot 2024-09-11T01:05:06.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:06 smithi103 ceph-mon[30562]: fsmap 7 up:standby 2024-09-11T01:05:06.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:06 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T01:05:06.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:06 smithi103 ceph-mon[30562]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:06.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:06 smithi183 ceph-mon[34992]: Deploying daemon mds.h on smithi117 2024-09-11T01:05:06.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:06 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.183:6836/1863510967,v1:172.21.15.183:6837/1863510967] up:boot 2024-09-11T01:05:06.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:06 smithi183 ceph-mon[34992]: fsmap 7 up:standby 2024-09-11T01:05:06.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:06 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T01:05:06.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:06 smithi183 ceph-mon[34992]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:07.123 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:05:06 smithi117 systemd[1]: Starting Ceph mds.h for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:05:07.129 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:05:07.473 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:05:07 smithi117 podman[64682]: 2024-09-11 01:05:07.089181749 +0000 UTC m=+0.015539761 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:05:07.473 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:05:07 smithi117 podman[64682]: 2024-09-11 01:05:07.210568287 +0000 UTC m=+0.136926338 container create 6add133a429adbc02d76b6fe41a0b863cbb2f3950a9999749c1aa4262a8738a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-h, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-11T01:05:07.473 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:05:07 smithi117 podman[64682]: 2024-09-11 01:05:07.471527474 +0000 UTC m=+0.397885492 container init 6add133a429adbc02d76b6fe41a0b863cbb2f3950a9999749c1aa4262a8738a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-h, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-11T01:05:07.508 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:07.872 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:05:07 smithi117 podman[64682]: 2024-09-11 01:05:07.47429894 +0000 UTC m=+0.400656946 container start 6add133a429adbc02d76b6fe41a0b863cbb2f3950a9999749c1aa4262a8738a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-h, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T01:05:07.873 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:05:07 smithi117 ceph-mds[64701]: -- 172.21.15.117:0/3467260933 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5612eff4d860 con 0x5612eff2b000 2024-09-11T01:05:07.873 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:05:07 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-h[64697]: starting mds.h at 2024-09-11T01:05:07.873 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:05:07 smithi117 bash[64682]: 6add133a429adbc02d76b6fe41a0b863cbb2f3950a9999749c1aa4262a8738a0 2024-09-11T01:05:07.873 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:05:07 smithi117 systemd[1]: Started Ceph mds.h for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T01:05:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.082+0000 7fca2ae00640 1 -- 172.21.15.103:0/2409929639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca2410f3e0 msgr2=0x7fca241117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.082+0000 7fca2ae00640 1 --2- 172.21.15.103:0/2409929639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca2410f3e0 0x7fca241117d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009ca0 tx=0x7fca1c02a8c0 comp rx=0 tx=0).stop 2024-09-11T01:05:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.082+0000 7fca2ae00640 1 -- 172.21.15.103:0/2409929639 shutdown_connections 2024-09-11T01:05:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.082+0000 7fca2ae00640 1 --2- 172.21.15.103:0/2409929639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca2410f3e0 0x7fca241117d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.082+0000 7fca2ae00640 1 --2- 172.21.15.103:0/2409929639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca24075f40 0x7fca2410ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.082+0000 7fca2ae00640 1 --2- 172.21.15.103:0/2409929639 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca24075540 0x7fca24075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.082+0000 7fca2ae00640 1 -- 172.21.15.103:0/2409929639 >> 172.21.15.103:0/2409929639 conn(0x7fca240fe830 msgr2=0x7fca24100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.082+0000 7fca2ae00640 1 -- 172.21.15.103:0/2409929639 shutdown_connections 2024-09-11T01:05:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.082+0000 7fca2ae00640 1 -- 172.21.15.103:0/2409929639 wait complete. 2024-09-11T01:05:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.083+0000 7fca2ae00640 1 Processor -- start 2024-09-11T01:05:08.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.083+0000 7fca2ae00640 1 -- start start 2024-09-11T01:05:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.084+0000 7fca2ae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca24075540 0x7fca2419b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.084+0000 7fca2ae00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca24075f40 0x7fca2419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.084+0000 7fca2ae00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca2410f3e0 0x7fca241a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.084+0000 7fca2ae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca24114f50 con 0x7fca24075540 2024-09-11T01:05:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.084+0000 7fca2ae00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fca24114dd0 con 0x7fca2410f3e0 2024-09-11T01:05:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.084+0000 7fca2ae00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fca241150d0 con 0x7fca24075f40 2024-09-11T01:05:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.084+0000 7fca23e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca24075540 0x7fca2419b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:08.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.084+0000 7fca23e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca24075540 0x7fca2419b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58654/0 (socket says 172.21.15.103:58654) 2024-09-11T01:05:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.084+0000 7fca23e00640 1 -- 172.21.15.103:0/2313138704 learned_addr learned my addr 172.21.15.103:0/2313138704 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.084+0000 7fca1be00640 1 --2- 172.21.15.103:0/2313138704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca24075f40 0x7fca2419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.084+0000 7fca28e00640 1 --2- 172.21.15.103:0/2313138704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca2410f3e0 0x7fca241a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.085+0000 7fca23e00640 1 -- 172.21.15.103:0/2313138704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca24075f40 msgr2=0x7fca2419b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.085+0000 7fca23e00640 1 --2- 172.21.15.103:0/2313138704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca24075f40 0x7fca2419b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.085+0000 7fca23e00640 1 -- 172.21.15.103:0/2313138704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca2410f3e0 msgr2=0x7fca241a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.085+0000 7fca23e00640 1 --2- 172.21.15.103:0/2313138704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca2410f3e0 0x7fca241a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.085+0000 7fca23e00640 1 -- 172.21.15.103:0/2313138704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca241a1510 con 0x7fca24075540 2024-09-11T01:05:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.085+0000 7fca23e00640 1 --2- 172.21.15.103:0/2313138704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca24075540 0x7fca2419b460 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fca1400e9f0 tx=0x7fca1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.085+0000 7fca21600640 1 -- 172.21.15.103:0/2313138704 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca1400cd80 con 0x7fca24075540 2024-09-11T01:05:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.085+0000 7fca21600640 1 -- 172.21.15.103:0/2313138704 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fca140108e0 con 0x7fca24075540 2024-09-11T01:05:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.085+0000 7fca2ae00640 1 -- 172.21.15.103:0/2313138704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca241a1800 con 0x7fca24075540 2024-09-11T01:05:08.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.085+0000 7fca21600640 1 -- 172.21.15.103:0/2313138704 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca14018980 con 0x7fca24075540 2024-09-11T01:05:08.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.085+0000 7fca2ae00640 1 -- 172.21.15.103:0/2313138704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca241a7ec0 con 0x7fca24075540 2024-09-11T01:05:08.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.087+0000 7fca2ae00640 1 -- 172.21.15.103:0/2313138704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca24075920 con 0x7fca24075540 2024-09-11T01:05:08.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.088+0000 7fca21600640 1 -- 172.21.15.103:0/2313138704 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fca14010430 con 0x7fca24075540 2024-09-11T01:05:08.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.091+0000 7fca21600640 1 --2- 172.21.15.103:0/2313138704 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fca080b52e0 0x7fca080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:08.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.091+0000 7fca21600640 1 -- 172.21.15.103:0/2313138704 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fca140e5ac0 con 0x7fca24075540 2024-09-11T01:05:08.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.091+0000 7fca1be00640 1 --2- 172.21.15.103:0/2313138704 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fca080b52e0 0x7fca080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:08.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.092+0000 7fca1be00640 1 --2- 172.21.15.103:0/2313138704 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fca080b52e0 0x7fca080b77a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fca24101040 tx=0x7fca0c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:08.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.095+0000 7fca21600640 1 -- 172.21.15.103:0/2313138704 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fca140ac730 con 0x7fca24075540 2024-09-11T01:05:08.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.315+0000 7fca2ae00640 1 -- 172.21.15.103:0/2313138704 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca241a8200 con 0x7fca24075540 2024-09-11T01:05:08.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.316+0000 7fca21600640 1 -- 172.21.15.103:0/2313138704 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7228 (secure 0 0 0) 0x7fca140b1160 con 0x7fca24075540 2024-09-11T01:05:08.318 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:05:08.318 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-09-11T01:05:07:553080+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-11T01:05:08.318 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-09-11T01:05:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.318+0000 7fca2ae00640 1 -- 172.21.15.103:0/2313138704 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fca080b52e0 msgr2=0x7fca080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:08.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.318+0000 7fca2ae00640 1 --2- 172.21.15.103:0/2313138704 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fca080b52e0 0x7fca080b77a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fca24101040 tx=0x7fca0c005f90 comp rx=0 tx=0).stop 2024-09-11T01:05:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.318+0000 7fca2ae00640 1 -- 172.21.15.103:0/2313138704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca24075540 msgr2=0x7fca2419b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.318+0000 7fca2ae00640 1 --2- 172.21.15.103:0/2313138704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca24075540 0x7fca2419b460 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fca1400e9f0 tx=0x7fca1400eeb0 comp rx=0 tx=0).stop 2024-09-11T01:05:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.318+0000 7fca2ae00640 1 -- 172.21.15.103:0/2313138704 shutdown_connections 2024-09-11T01:05:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.318+0000 7fca2ae00640 1 --2- 172.21.15.103:0/2313138704 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fca080b52e0 0x7fca080b77a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.318+0000 7fca2ae00640 1 --2- 172.21.15.103:0/2313138704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca2410f3e0 0x7fca241a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.318+0000 7fca2ae00640 1 --2- 172.21.15.103:0/2313138704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fca24075f40 0x7fca2419b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:08.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.318+0000 7fca2ae00640 1 --2- 172.21.15.103:0/2313138704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca24075540 0x7fca2419b460 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.318+0000 7fca2ae00640 1 -- 172.21.15.103:0/2313138704 >> 172.21.15.103:0/2313138704 conn(0x7fca240fe830 msgr2=0x7fca241115a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.318+0000 7fca2ae00640 1 -- 172.21.15.103:0/2313138704 shutdown_connections 2024-09-11T01:05:08.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:08.318+0000 7fca2ae00640 1 -- 172.21.15.103:0/2313138704 wait complete. 2024-09-11T01:05:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:08 smithi103 ceph-mon[30562]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:08 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] up:boot 2024-09-11T01:05:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:08 smithi103 ceph-mon[30562]: fsmap 8 up:standby 2024-09-11T01:05:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T01:05:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:08 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:08 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2313138704' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:08 smithi117 ceph-mon[35358]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:08 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] up:boot 2024-09-11T01:05:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:08 smithi117 ceph-mon[35358]: fsmap 8 up:standby 2024-09-11T01:05:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T01:05:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:08 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:08.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:08 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2313138704' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:08.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:08 smithi183 ceph-mon[34992]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:08.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:08 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] up:boot 2024-09-11T01:05:08.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:08 smithi183 ceph-mon[34992]: fsmap 8 up:standby 2024-09-11T01:05:08.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T01:05:08.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:08.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:08.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:08.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:08.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:08.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:08 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:08.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:08 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2313138704' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:09.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:09 smithi103 ceph-mon[30562]: Deploying daemon mds.i on smithi183 2024-09-11T01:05:09.839 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:09 smithi183 ceph-mon[34992]: Deploying daemon mds.i on smithi183 2024-09-11T01:05:09.840 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:05:09 smithi183 systemd[1]: Starting Ceph mds.i for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:05:09.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:09 smithi117 ceph-mon[35358]: Deploying daemon mds.i on smithi183 2024-09-11T01:05:10.123 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:05:09 smithi183 podman[65584]: 2024-09-11 01:05:09.740935685 +0000 UTC m=+0.015817967 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:05:10.123 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:05:09 smithi183 podman[65584]: 2024-09-11 01:05:09.841217822 +0000 UTC m=+0.116100128 container create 41a1d2a651bd918286dc1e7476a9029b08e4061adb6c95da237d16016cc60165 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T01:05:10.123 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:05:10 smithi183 podman[65584]: 2024-09-11 01:05:10.122160201 +0000 UTC m=+0.397042465 container init 41a1d2a651bd918286dc1e7476a9029b08e4061adb6c95da237d16016cc60165 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-11T01:05:10.418 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:05:10 smithi183 podman[65584]: 2024-09-11 01:05:10.125122776 +0000 UTC m=+0.400005047 container start 41a1d2a651bd918286dc1e7476a9029b08e4061adb6c95da237d16016cc60165 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T01:05:10.418 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:05:10 smithi183 ceph-mds[65603]: -- 172.21.15.183:0/4008054485 <== mon.1 v2:172.21.15.183:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563c48407860 con 0x563c483e5400 2024-09-11T01:05:10.418 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:05:10 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-i[65599]: starting mds.i at 2024-09-11T01:05:10.419 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:05:10 smithi183 bash[65584]: 41a1d2a651bd918286dc1e7476a9029b08e4061adb6c95da237d16016cc60165 2024-09-11T01:05:10.419 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:05:10 smithi183 systemd[1]: Started Ceph mds.i for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T01:05:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:10 smithi103 ceph-mon[30562]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:10 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:10 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:10 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:10 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:10 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:10 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:10.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:10 smithi117 ceph-mon[35358]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:10 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:10 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:10 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:10 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:10 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:10 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:10.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:10 smithi183 ceph-mon[34992]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:10.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:10 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:10.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:10 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:10.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:10 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:10.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:10 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:10.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:10 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:10.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:10 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:11.098 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:05:11.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:11 smithi117 ceph-mon[35358]: Deploying daemon mds.g on smithi103 2024-09-11T01:05:11.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:11 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] up:boot 2024-09-11T01:05:11.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:11 smithi117 ceph-mon[35358]: fsmap 9 up:standby 2024-09-11T01:05:11.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:11 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T01:05:11.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:11 smithi183 ceph-mon[34992]: Deploying daemon mds.g on smithi103 2024-09-11T01:05:11.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:11 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] up:boot 2024-09-11T01:05:11.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:11 smithi183 ceph-mon[34992]: fsmap 9 up:standby 2024-09-11T01:05:11.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:11 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T01:05:11.945 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:11 smithi103 ceph-mon[30562]: Deploying daemon mds.g on smithi103 2024-09-11T01:05:11.945 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:11 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] up:boot 2024-09-11T01:05:11.945 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:11 smithi103 ceph-mon[30562]: fsmap 9 up:standby 2024-09-11T01:05:11.945 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:11 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T01:05:12.143 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:12.822 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:12 smithi103 ceph-mon[30562]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.816+0000 7ff2a8a00640 1 -- 172.21.15.103:0/3703247206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2a4108610 msgr2=0x7ff2a4108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.816+0000 7ff2a8a00640 1 --2- 172.21.15.103:0/3703247206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2a4108610 0x7ff2a4108a50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff290009900 tx=0x7ff29002a410 comp rx=0 tx=0).stop 2024-09-11T01:05:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.816+0000 7ff2a8a00640 1 -- 172.21.15.103:0/3703247206 shutdown_connections 2024-09-11T01:05:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.816+0000 7ff2a8a00640 1 --2- 172.21.15.103:0/3703247206 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2a4108f90 0x7ff2a410f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.816+0000 7ff2a8a00640 1 --2- 172.21.15.103:0/3703247206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2a4108610 0x7ff2a4108a50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.816+0000 7ff2a8a00640 1 --2- 172.21.15.103:0/3703247206 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2a4102c00 0x7ff2a4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.816+0000 7ff2a8a00640 1 -- 172.21.15.103:0/3703247206 >> 172.21.15.103:0/3703247206 conn(0x7ff2a40fe6d0 msgr2=0x7ff2a4100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.816+0000 7ff2a8a00640 1 -- 172.21.15.103:0/3703247206 shutdown_connections 2024-09-11T01:05:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.816+0000 7ff2a8a00640 1 -- 172.21.15.103:0/3703247206 wait complete. 2024-09-11T01:05:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.817+0000 7ff2a8a00640 1 Processor -- start 2024-09-11T01:05:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.818+0000 7ff2a8a00640 1 -- start start 2024-09-11T01:05:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.818+0000 7ff2a8a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2a4102c00 0x7ff2a40754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.818+0000 7ff2a8a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2a4108610 0x7ff2a40759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.818+0000 7ff2a8a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2a4108f90 0x7ff2a4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.818+0000 7ff2a8a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a4112ca0 con 0x7ff2a4108610 2024-09-11T01:05:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.818+0000 7ff2a8a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a4112b20 con 0x7ff2a4102c00 2024-09-11T01:05:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.818+0000 7ff2a8a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a4112e20 con 0x7ff2a4108f90 2024-09-11T01:05:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.818+0000 7ff2a2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2a4108610 0x7ff2a40759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.818+0000 7ff2a3400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2a4102c00 0x7ff2a40754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.819+0000 7ff2a3400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2a4102c00 0x7ff2a40754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:52400/0 (socket says 172.21.15.103:52400) 2024-09-11T01:05:12.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.819+0000 7ff2a2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2a4108610 0x7ff2a40759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44524/0 (socket says 172.21.15.103:44524) 2024-09-11T01:05:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.819+0000 7ff2a3400640 1 -- 172.21.15.103:0/456649540 learned_addr learned my addr 172.21.15.103:0/456649540 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.819+0000 7ff2a3e00640 1 --2- 172.21.15.103:0/456649540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2a4108f90 0x7ff2a4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.819+0000 7ff2a3400640 1 -- 172.21.15.103:0/456649540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2a4108f90 msgr2=0x7ff2a4075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.819+0000 7ff2a3400640 1 --2- 172.21.15.103:0/456649540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2a4108f90 0x7ff2a4075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.819+0000 7ff2a3400640 1 -- 172.21.15.103:0/456649540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2a4108610 msgr2=0x7ff2a40759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.819+0000 7ff2a3400640 1 --2- 172.21.15.103:0/456649540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2a4108610 0x7ff2a40759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.819+0000 7ff2a3400640 1 -- 172.21.15.103:0/456649540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a41a7490 con 0x7ff2a4102c00 2024-09-11T01:05:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.819+0000 7ff2a3400640 1 --2- 172.21.15.103:0/456649540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2a4102c00 0x7ff2a40754a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff29400b4a0 tx=0x7ff29400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.820+0000 7ff29be00640 1 -- 172.21.15.103:0/456649540 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294014070 con 0x7ff2a4102c00 2024-09-11T01:05:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.820+0000 7ff29be00640 1 -- 172.21.15.103:0/456649540 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff294010ac0 con 0x7ff2a4102c00 2024-09-11T01:05:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.820+0000 7ff29be00640 1 -- 172.21.15.103:0/456649540 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294017c30 con 0x7ff2a4102c00 2024-09-11T01:05:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.820+0000 7ff2a8a00640 1 -- 172.21.15.103:0/456649540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a41a7780 con 0x7ff2a4102c00 2024-09-11T01:05:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.820+0000 7ff2a8a00640 1 -- 172.21.15.103:0/456649540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a41a7d10 con 0x7ff2a4102c00 2024-09-11T01:05:12.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.821+0000 7ff2a8a00640 1 -- 172.21.15.103:0/456649540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2a4102fe0 con 0x7ff2a4102c00 2024-09-11T01:05:12.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.823+0000 7ff29be00640 1 -- 172.21.15.103:0/456649540 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7ff294010610 con 0x7ff2a4102c00 2024-09-11T01:05:12.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.824+0000 7ff29be00640 1 --2- 172.21.15.103:0/456649540 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff2880b54e0 0x7ff2880b79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:12.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.825+0000 7ff29be00640 1 -- 172.21.15.103:0/456649540 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ff2940e4be0 con 0x7ff2a4102c00 2024-09-11T01:05:12.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.825+0000 7ff2a2a00640 1 --2- 172.21.15.103:0/456649540 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff2880b54e0 0x7ff2880b79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:12.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.825+0000 7ff2a2a00640 1 --2- 172.21.15.103:0/456649540 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff2880b54e0 0x7ff2880b79a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff290005ab0 tx=0x7ff290005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:12.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:12.828+0000 7ff29be00640 1 -- 172.21.15.103:0/456649540 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff2940ab850 con 0x7ff2a4102c00 2024-09-11T01:05:12.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:12 smithi117 ceph-mon[35358]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:12 smithi183 ceph-mon[34992]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:13.082 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:05:12 smithi103 systemd[1]: Starting Ceph mds.g for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:05:13.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:13.096+0000 7ff2a8a00640 1 -- 172.21.15.103:0/456649540 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff2a41a8070 con 0x7ff2a4102c00 2024-09-11T01:05:13.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:13.097+0000 7ff29be00640 1 -- 172.21.15.103:0/456649540 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8058 (secure 0 0 0) 0x7ff2940b0280 con 0x7ff2a4102c00 2024-09-11T01:05:13.101 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:05:13.101 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":10,"btime":"2024-09-11T01:05:10:565901+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24619,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-11T01:05:13.101 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 10 2024-09-11T01:05:13.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:13.100+0000 7ff2a8a00640 1 -- 172.21.15.103:0/456649540 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff2880b54e0 msgr2=0x7ff2880b79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:13.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:13.100+0000 7ff2a8a00640 1 --2- 172.21.15.103:0/456649540 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff2880b54e0 0x7ff2880b79a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff290005ab0 tx=0x7ff290005a20 comp rx=0 tx=0).stop 2024-09-11T01:05:13.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:13.100+0000 7ff2a8a00640 1 -- 172.21.15.103:0/456649540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2a4102c00 msgr2=0x7ff2a40754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:13.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:13.100+0000 7ff2a8a00640 1 --2- 172.21.15.103:0/456649540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2a4102c00 0x7ff2a40754a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff29400b4a0 tx=0x7ff29400b960 comp rx=0 tx=0).stop 2024-09-11T01:05:13.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:13.100+0000 7ff2a8a00640 1 -- 172.21.15.103:0/456649540 shutdown_connections 2024-09-11T01:05:13.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:13.100+0000 7ff2a8a00640 1 --2- 172.21.15.103:0/456649540 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff2880b54e0 0x7ff2880b79a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:13.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:13.100+0000 7ff2a8a00640 1 --2- 172.21.15.103:0/456649540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff2a4108f90 0x7ff2a4075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:13.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:13.100+0000 7ff2a8a00640 1 --2- 172.21.15.103:0/456649540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2a4108610 0x7ff2a40759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:13.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:13.100+0000 7ff2a8a00640 1 --2- 172.21.15.103:0/456649540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff2a4102c00 0x7ff2a40754a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:13.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:13.100+0000 7ff2a8a00640 1 -- 172.21.15.103:0/456649540 >> 172.21.15.103:0/456649540 conn(0x7ff2a40fe6d0 msgr2=0x7ff2a4100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:13.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:13.100+0000 7ff2a8a00640 1 -- 172.21.15.103:0/456649540 shutdown_connections 2024-09-11T01:05:13.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:13.100+0000 7ff2a8a00640 1 -- 172.21.15.103:0/456649540 wait complete. 2024-09-11T01:05:13.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:13 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/456649540' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:13.705 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:05:13 smithi103 podman[74097]: 2024-09-11 01:05:13.323219876 +0000 UTC m=+0.194204162 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:05:13.705 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:05:13 smithi103 podman[74097]: 2024-09-11 01:05:13.481381572 +0000 UTC m=+0.352365858 container create 9cf641a7d7ac647e159e40b6f04002c7042ccacc9bb871b7eb0b280c154a7b42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-11T01:05:13.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:13 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/456649540' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:13.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:13 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/456649540' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:13.958 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:05:13 smithi103 podman[74097]: 2024-09-11 01:05:13.829502614 +0000 UTC m=+0.700486900 container init 9cf641a7d7ac647e159e40b6f04002c7042ccacc9bb871b7eb0b280c154a7b42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T01:05:13.958 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:05:13 smithi103 podman[74097]: 2024-09-11 01:05:13.835840337 +0000 UTC m=+0.706824623 container start 9cf641a7d7ac647e159e40b6f04002c7042ccacc9bb871b7eb0b280c154a7b42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-g, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-11T01:05:13.958 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:05:13 smithi103 ceph-mds[74127]: -- 172.21.15.103:0/3096863391 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557bb8243c20 con 0x557bb8220800 2024-09-11T01:05:13.958 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:05:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-g[74122]: starting mds.g at 2024-09-11T01:05:13.958 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:05:13 smithi103 bash[74097]: 9cf641a7d7ac647e159e40b6f04002c7042ccacc9bb871b7eb0b280c154a7b42 2024-09-11T01:05:14.323 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:05:13 smithi103 systemd[1]: Started Ceph mds.g for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T01:05:14.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:14 smithi117 ceph-mon[35358]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:14.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:14 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:14.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:14 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:14.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:14 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:14.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:14 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:14.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:14 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:14.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:14 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:14 smithi183 ceph-mon[34992]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:14 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:14 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:14.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:14 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:14.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:14 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:14.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:14 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:14.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:14 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:14.952 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:14 smithi103 ceph-mon[30562]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:14.952 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:14.952 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:14.952 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:14.952 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:14.952 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:14.952 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:14 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:15.829 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:15 smithi103 ceph-mon[30562]: Deploying daemon mds.a on smithi103 2024-09-11T01:05:15.829 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:15 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.103:6838/83536310,v1:172.21.15.103:6839/83536310] up:boot 2024-09-11T01:05:15.829 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:15 smithi103 ceph-mon[30562]: fsmap 10 up:standby 2024-09-11T01:05:15.830 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:15 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-11T01:05:15.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:15 smithi117 ceph-mon[35358]: Deploying daemon mds.a on smithi103 2024-09-11T01:05:15.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:15 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.103:6838/83536310,v1:172.21.15.103:6839/83536310] up:boot 2024-09-11T01:05:15.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:15 smithi117 ceph-mon[35358]: fsmap 10 up:standby 2024-09-11T01:05:15.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:15 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-11T01:05:15.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:15 smithi183 ceph-mon[34992]: Deploying daemon mds.a on smithi103 2024-09-11T01:05:15.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:15 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.103:6838/83536310,v1:172.21.15.103:6839/83536310] up:boot 2024-09-11T01:05:15.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:15 smithi183 ceph-mon[34992]: fsmap 10 up:standby 2024-09-11T01:05:15.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:15 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-11T01:05:16.364 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:05:16.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:16 smithi117 ceph-mon[35358]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:16 smithi183 ceph-mon[34992]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:16.918 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:16 smithi103 ceph-mon[30562]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:17.245 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 11 01:05:16 smithi103 podman[74435]: 2024-09-11 01:05:16.97362565 +0000 UTC m=+0.180313361 container create 8a9d96eff071134c385a97e0b4315d0f23d84f07dddc058c3cf66d08d4024272 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-a, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-11T01:05:17.245 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 11 01:05:17 smithi103 podman[74435]: 2024-09-11 01:05:17.243519292 +0000 UTC m=+0.450207019 container init 8a9d96eff071134c385a97e0b4315d0f23d84f07dddc058c3cf66d08d4024272 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-11T01:05:17.427 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:17.568 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 11 01:05:17 smithi103 podman[74435]: 2024-09-11 01:05:17.250240477 +0000 UTC m=+0.456928189 container start 8a9d96eff071134c385a97e0b4315d0f23d84f07dddc058c3cf66d08d4024272 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-a, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T01:05:17.568 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 11 01:05:17 smithi103 ceph-mds[74471]: -- 172.21.15.103:0/1160083577 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556aaa749c20 con 0x556aaa727000 2024-09-11T01:05:17.569 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 11 01:05:17 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-a[74467]: starting mds.a at 2024-09-11T01:05:17.569 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 11 01:05:17 smithi103 bash[74435]: 8a9d96eff071134c385a97e0b4315d0f23d84f07dddc058c3cf66d08d4024272 2024-09-11T01:05:17.569 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 11 01:05:17 smithi103 systemd[1]: Started Ceph mds.a for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T01:05:18.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.081+0000 7f50c6a00640 1 -- 172.21.15.103:0/516709273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c01087b0 msgr2=0x7f50c0108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:18.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.081+0000 7f50c6a00640 1 --2- 172.21.15.103:0/516709273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c01087b0 0x7f50c0108bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f50a8009900 tx=0x7f50a802a400 comp rx=0 tx=0).stop 2024-09-11T01:05:18.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.081+0000 7f50c6a00640 1 -- 172.21.15.103:0/516709273 shutdown_connections 2024-09-11T01:05:18.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.081+0000 7f50c6a00640 1 --2- 172.21.15.103:0/516709273 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50c0109130 0x7f50c010f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:18.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.081+0000 7f50c6a00640 1 --2- 172.21.15.103:0/516709273 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c01087b0 0x7f50c0108bf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:18.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.081+0000 7f50c6a00640 1 --2- 172.21.15.103:0/516709273 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c0102da0 0x7f50c0103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:18.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.081+0000 7f50c6a00640 1 -- 172.21.15.103:0/516709273 >> 172.21.15.103:0/516709273 conn(0x7f50c00fe810 msgr2=0x7f50c0100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:18.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.081+0000 7f50c6a00640 1 -- 172.21.15.103:0/516709273 shutdown_connections 2024-09-11T01:05:18.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.081+0000 7f50c6a00640 1 -- 172.21.15.103:0/516709273 wait complete. 2024-09-11T01:05:18.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.082+0000 7f50c6a00640 1 Processor -- start 2024-09-11T01:05:18.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.083+0000 7f50c6a00640 1 -- start start 2024-09-11T01:05:18.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.083+0000 7f50c6a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50c0102da0 0x7f50c0199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:18.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.083+0000 7f50c6a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c01087b0 0x7f50c01997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:18.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.083+0000 7f50c6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c0109130 0x7f50c019eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:18.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.083+0000 7f50c6a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0112e00 con 0x7f50c0109130 2024-09-11T01:05:18.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.083+0000 7f50c6a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0112c80 con 0x7f50c01087b0 2024-09-11T01:05:18.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.083+0000 7f50c6a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f50c0112f80 con 0x7f50c0102da0 2024-09-11T01:05:18.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.083+0000 7f50b7400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c01087b0 0x7f50c01997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:18.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.083+0000 7f50b7400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c01087b0 0x7f50c01997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:52458/0 (socket says 172.21.15.103:52458) 2024-09-11T01:05:18.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.083+0000 7f50b7400640 1 -- 172.21.15.103:0/4140992235 learned_addr learned my addr 172.21.15.103:0/4140992235 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:18.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.083+0000 7f50c4a00640 1 --2- 172.21.15.103:0/4140992235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c0109130 0x7f50c019eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:18.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.083+0000 7f50bfe00640 1 --2- 172.21.15.103:0/4140992235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50c0102da0 0x7f50c0199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:18.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.084+0000 7f50b7400640 1 -- 172.21.15.103:0/4140992235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50c0102da0 msgr2=0x7f50c0199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:18.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.084+0000 7f50b7400640 1 --2- 172.21.15.103:0/4140992235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50c0102da0 0x7f50c0199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:18.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.084+0000 7f50b7400640 1 -- 172.21.15.103:0/4140992235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c0109130 msgr2=0x7f50c019eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:18.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.084+0000 7f50b7400640 1 --2- 172.21.15.103:0/4140992235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c0109130 0x7f50c019eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:18.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.084+0000 7f50b7400640 1 -- 172.21.15.103:0/4140992235 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c019f320 con 0x7f50c01087b0 2024-09-11T01:05:18.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.084+0000 7f50b7400640 1 --2- 172.21.15.103:0/4140992235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c01087b0 0x7f50c01997b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f50a8005ab0 tx=0x7f50a8003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:18.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.084+0000 7f50bd600640 1 -- 172.21.15.103:0/4140992235 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a803f070 con 0x7f50c01087b0 2024-09-11T01:05:18.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.084+0000 7f50bd600640 1 -- 172.21.15.103:0/4140992235 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f50a8031b60 con 0x7f50c01087b0 2024-09-11T01:05:18.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.084+0000 7f50bd600640 1 -- 172.21.15.103:0/4140992235 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50a8035030 con 0x7f50c01087b0 2024-09-11T01:05:18.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.084+0000 7f50c6a00640 1 -- 172.21.15.103:0/4140992235 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c019f5b0 con 0x7f50c01087b0 2024-09-11T01:05:18.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.084+0000 7f50c6a00640 1 -- 172.21.15.103:0/4140992235 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c01a5cd0 con 0x7f50c01087b0 2024-09-11T01:05:18.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.085+0000 7f50c6a00640 1 -- 172.21.15.103:0/4140992235 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c0103180 con 0x7f50c01087b0 2024-09-11T01:05:18.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.088+0000 7f50bd600640 1 -- 172.21.15.103:0/4140992235 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f50a803b460 con 0x7f50c01087b0 2024-09-11T01:05:18.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.089+0000 7f50bd600640 1 --2- 172.21.15.103:0/4140992235 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f50a40b5360 0x7f50a40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:18.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.089+0000 7f50bd600640 1 -- 172.21.15.103:0/4140992235 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f50a81064a0 con 0x7f50c01087b0 2024-09-11T01:05:18.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.089+0000 7f50bfe00640 1 --2- 172.21.15.103:0/4140992235 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f50a40b5360 0x7f50a40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:18.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.090+0000 7f50bfe00640 1 --2- 172.21.15.103:0/4140992235 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f50a40b5360 0x7f50a40b7820 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009bd0 tx=0x7f50b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:18.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.091+0000 7f50bd600640 1 -- 172.21.15.103:0/4140992235 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f50a80cd110 con 0x7f50c01087b0 2024-09-11T01:05:18.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.309+0000 7f50c6a00640 1 -- 172.21.15.103:0/4140992235 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50c002e5c0 con 0x7f50c01087b0 2024-09-11T01:05:18.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.310+0000 7f50bd600640 1 -- 172.21.15.103:0/4140992235 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9710 (secure 0 0 0) 0x7f50a80d1b40 con 0x7f50c01087b0 2024-09-11T01:05:18.312 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:05:18.313 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":12,"btime":"2024-09-11T01:05:17:604781+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24619,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-11T01:05:18.313 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 12 2024-09-11T01:05:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.312+0000 7f50c6a00640 1 -- 172.21.15.103:0/4140992235 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f50a40b5360 msgr2=0x7f50a40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.312+0000 7f50c6a00640 1 --2- 172.21.15.103:0/4140992235 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f50a40b5360 0x7f50a40b7820 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009bd0 tx=0x7f50b0005f90 comp rx=0 tx=0).stop 2024-09-11T01:05:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.312+0000 7f50c6a00640 1 -- 172.21.15.103:0/4140992235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c01087b0 msgr2=0x7f50c01997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.312+0000 7f50c6a00640 1 --2- 172.21.15.103:0/4140992235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c01087b0 0x7f50c01997b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f50a8005ab0 tx=0x7f50a8003c10 comp rx=0 tx=0).stop 2024-09-11T01:05:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.312+0000 7f50c6a00640 1 -- 172.21.15.103:0/4140992235 shutdown_connections 2024-09-11T01:05:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.312+0000 7f50c6a00640 1 --2- 172.21.15.103:0/4140992235 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f50a40b5360 0x7f50a40b7820 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:18.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.312+0000 7f50c6a00640 1 --2- 172.21.15.103:0/4140992235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50c0109130 0x7f50c019eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:18.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.312+0000 7f50c6a00640 1 --2- 172.21.15.103:0/4140992235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f50c01087b0 0x7f50c01997b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:18.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.312+0000 7f50c6a00640 1 --2- 172.21.15.103:0/4140992235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f50c0102da0 0x7f50c0199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:18.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.312+0000 7f50c6a00640 1 -- 172.21.15.103:0/4140992235 >> 172.21.15.103:0/4140992235 conn(0x7f50c00fe810 msgr2=0x7f50c0100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:18.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.312+0000 7f50c6a00640 1 -- 172.21.15.103:0/4140992235 shutdown_connections 2024-09-11T01:05:18.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:18.313+0000 7f50c6a00640 1 -- 172.21.15.103:0/4140992235 wait complete. 2024-09-11T01:05:18.571 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:18.572 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:18.572 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:18.572 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:18.572 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:18.572 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:18.572 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:18 smithi117 ceph-mon[35358]: Deploying daemon mds.b on smithi117 2024-09-11T01:05:18.572 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:18 smithi117 ceph-mon[35358]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:18.572 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:18 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.103:6840/4189792187,v1:172.21.15.103:6841/4189792187] up:boot 2024-09-11T01:05:18.572 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:18 smithi117 ceph-mon[35358]: fsmap 11 up:standby 2024-09-11T01:05:18.572 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:18 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-11T01:05:18.572 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:18 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/4140992235' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:18.581 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:18.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:18.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:18.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:18.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:18.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:18.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:18 smithi103 ceph-mon[30562]: Deploying daemon mds.b on smithi117 2024-09-11T01:05:18.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:18 smithi103 ceph-mon[30562]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:18.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:18 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.103:6840/4189792187,v1:172.21.15.103:6841/4189792187] up:boot 2024-09-11T01:05:18.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:18 smithi103 ceph-mon[30562]: fsmap 11 up:standby 2024-09-11T01:05:18.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:18 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-11T01:05:18.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:18 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/4140992235' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:18.925 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-11T01:05:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-11T01:05:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:18 smithi183 ceph-mon[34992]: Deploying daemon mds.b on smithi117 2024-09-11T01:05:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:18 smithi183 ceph-mon[34992]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:18 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.103:6840/4189792187,v1:172.21.15.103:6841/4189792187] up:boot 2024-09-11T01:05:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:18 smithi183 ceph-mon[34992]: fsmap 11 up:standby 2024-09-11T01:05:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:18 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-11T01:05:18.926 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:18 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/4140992235' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:19.566 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:05:19 smithi117 systemd[1]: Starting Ceph mds.b for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:05:19.818 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:05:19 smithi117 podman[64989]: 2024-09-11 01:05:19.467654551 +0000 UTC m=+0.015615810 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:05:19.818 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:05:19 smithi117 podman[64989]: 2024-09-11 01:05:19.589770989 +0000 UTC m=+0.137732306 container create 5b9ffb307d24ca1215c1c4185592db8d984aa5c3ac769c073ed3da6e52fc6ab8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True) 2024-09-11T01:05:19.818 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:05:19 smithi117 podman[64989]: 2024-09-11 01:05:19.817537911 +0000 UTC m=+0.365499169 container init 5b9ffb307d24ca1215c1c4185592db8d984aa5c3ac769c073ed3da6e52fc6ab8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T01:05:20.122 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:05:19 smithi117 podman[64989]: 2024-09-11 01:05:19.820843037 +0000 UTC m=+0.368804295 container start 5b9ffb307d24ca1215c1c4185592db8d984aa5c3ac769c073ed3da6e52fc6ab8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-b, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T01:05:20.123 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:05:19 smithi117 ceph-mds[65009]: -- 172.21.15.117:0/1984571841 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561d3dc2f860 con 0x561d3dc0d000 2024-09-11T01:05:20.123 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:05:19 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-b[65005]: starting mds.b at 2024-09-11T01:05:20.123 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:05:19 smithi117 bash[64989]: 5b9ffb307d24ca1215c1c4185592db8d984aa5c3ac769c073ed3da6e52fc6ab8 2024-09-11T01:05:20.123 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:05:19 smithi117 systemd[1]: Started Ceph mds.b for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T01:05:20.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:20 smithi103 ceph-mon[30562]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:20.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:20 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:20 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:20 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:20 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:20 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:20 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:05:20.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:20 smithi117 ceph-mon[35358]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:20.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:20 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:20 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:20 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:20 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:20 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:20 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:05:20.904 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:20 smithi183 ceph-mon[34992]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:20.905 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:20 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.905 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:20 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.905 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:20 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.905 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:20 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.905 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:20 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:20.905 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:20 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:05:21.144 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:05:21.726 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:21.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:21 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] up:boot 2024-09-11T01:05:21.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:21 smithi103 ceph-mon[30562]: fsmap 12 up:standby 2024-09-11T01:05:21.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:21 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T01:05:21.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:21 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:21.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:21 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:21.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:21 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] up:boot 2024-09-11T01:05:21.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:21 smithi117 ceph-mon[35358]: fsmap 12 up:standby 2024-09-11T01:05:21.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:21 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T01:05:21.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:21 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:21.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:21 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:21.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:21 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] up:boot 2024-09-11T01:05:21.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:21 smithi183 ceph-mon[34992]: fsmap 12 up:standby 2024-09-11T01:05:21.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:21 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T01:05:21.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:21 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:21.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:21 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:22.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.288+0000 7fbee6600640 1 -- 172.21.15.103:0/3516034675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee0102c10 msgr2=0x7fbee0102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:22.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.288+0000 7fbee6600640 1 --2- 172.21.15.103:0/3516034675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee0102c10 0x7fbee0102ff0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbed4009900 tx=0x7fbed402a3f0 comp rx=0 tx=0).stop 2024-09-11T01:05:22.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.288+0000 7fbee6600640 1 -- 172.21.15.103:0/3516034675 shutdown_connections 2024-09-11T01:05:22.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.288+0000 7fbee6600640 1 --2- 172.21.15.103:0/3516034675 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbee0108fa0 0x7fbee010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.288+0000 7fbee6600640 1 --2- 172.21.15.103:0/3516034675 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbee0108620 0x7fbee0108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.288+0000 7fbee6600640 1 --2- 172.21.15.103:0/3516034675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee0102c10 0x7fbee0102ff0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.288+0000 7fbee6600640 1 -- 172.21.15.103:0/3516034675 >> 172.21.15.103:0/3516034675 conn(0x7fbee00fe660 msgr2=0x7fbee0100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.288+0000 7fbee6600640 1 -- 172.21.15.103:0/3516034675 shutdown_connections 2024-09-11T01:05:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.288+0000 7fbee6600640 1 -- 172.21.15.103:0/3516034675 wait complete. 2024-09-11T01:05:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.289+0000 7fbee6600640 1 Processor -- start 2024-09-11T01:05:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.289+0000 7fbee6600640 1 -- start start 2024-09-11T01:05:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.289+0000 7fbee6600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbee0102c10 0x7fbee019b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.289+0000 7fbee6600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbee0108620 0x7fbee019b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.289+0000 7fbee6600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee0108fa0 0x7fbee01a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.289+0000 7fbee6600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbee0112c60 con 0x7fbee0108fa0 2024-09-11T01:05:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbee6600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbee0112ae0 con 0x7fbee0108620 2024-09-11T01:05:22.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbee6600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbee0112de0 con 0x7fbee0102c10 2024-09-11T01:05:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbee5c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee0108fa0 0x7fbee01a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbedfe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbee0108620 0x7fbee019b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbedfe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbee0108620 0x7fbee019b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:36060/0 (socket says 172.21.15.103:36060) 2024-09-11T01:05:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbedfe00640 1 -- 172.21.15.103:0/2497623742 learned_addr learned my addr 172.21.15.103:0/2497623742 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbee5c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee0108fa0 0x7fbee01a0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45758/0 (socket says 172.21.15.103:45758) 2024-09-11T01:05:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbee5200640 1 --2- 172.21.15.103:0/2497623742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbee0102c10 0x7fbee019b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbedfe00640 1 -- 172.21.15.103:0/2497623742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbee0102c10 msgr2=0x7fbee019b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbedfe00640 1 --2- 172.21.15.103:0/2497623742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbee0102c10 0x7fbee019b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbedfe00640 1 -- 172.21.15.103:0/2497623742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee0108fa0 msgr2=0x7fbee01a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbedfe00640 1 --2- 172.21.15.103:0/2497623742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee0108fa0 0x7fbee01a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbedfe00640 1 -- 172.21.15.103:0/2497623742 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbee01a1350 con 0x7fbee0108620 2024-09-11T01:05:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbee5c00640 1 --2- 172.21.15.103:0/2497623742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee0108fa0 0x7fbee01a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:05:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.290+0000 7fbedfe00640 1 --2- 172.21.15.103:0/2497623742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbee0108620 0x7fbee019b7e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00d770 tx=0x7fbecc00db70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:22.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.291+0000 7fbedd600640 1 -- 172.21.15.103:0/2497623742 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc017070 con 0x7fbee0108620 2024-09-11T01:05:22.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.291+0000 7fbedd600640 1 -- 172.21.15.103:0/2497623742 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbecc009820 con 0x7fbee0108620 2024-09-11T01:05:22.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.291+0000 7fbedd600640 1 -- 172.21.15.103:0/2497623742 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbecc004bc0 con 0x7fbee0108620 2024-09-11T01:05:22.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.291+0000 7fbee6600640 1 -- 172.21.15.103:0/2497623742 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbee01a1640 con 0x7fbee0108620 2024-09-11T01:05:22.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.291+0000 7fbee6600640 1 -- 172.21.15.103:0/2497623742 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbee01a7d00 con 0x7fbee0108620 2024-09-11T01:05:22.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.292+0000 7fbee6600640 1 -- 172.21.15.103:0/2497623742 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee0102ff0 con 0x7fbee0108620 2024-09-11T01:05:22.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.294+0000 7fbedd600640 1 -- 172.21.15.103:0/2497623742 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fbecc005220 con 0x7fbee0108620 2024-09-11T01:05:22.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.296+0000 7fbedd600640 1 --2- 172.21.15.103:0/2497623742 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbec80b5390 0x7fbec80b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:22.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.296+0000 7fbedd600640 1 -- 172.21.15.103:0/2497623742 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fbecc0e5230 con 0x7fbee0108620 2024-09-11T01:05:22.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.296+0000 7fbee5200640 1 --2- 172.21.15.103:0/2497623742 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbec80b5390 0x7fbec80b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:22.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.297+0000 7fbee5200640 1 --2- 172.21.15.103:0/2497623742 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbec80b5390 0x7fbec80b7850 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbed4031440 tx=0x7fbed4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:22.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.299+0000 7fbedd600640 1 -- 172.21.15.103:0/2497623742 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbecc0ac4f0 con 0x7fbee0108620 2024-09-11T01:05:22.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.543+0000 7fbee6600640 1 -- 172.21.15.103:0/2497623742 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbee002e5c0 con 0x7fbee0108620 2024-09-11T01:05:22.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.543+0000 7fbedd600640 1 -- 172.21.15.103:0/2497623742 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10539 (secure 0 0 0) 0x7fbecc0abdf0 con 0x7fbee0108620 2024-09-11T01:05:22.546 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:05:22.547 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":13,"btime":"2024-09-11T01:05:20:557184+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24619,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24665,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-11T01:05:22.547 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 13 2024-09-11T01:05:22.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.547+0000 7fbee6600640 1 -- 172.21.15.103:0/2497623742 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbec80b5390 msgr2=0x7fbec80b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:22.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.547+0000 7fbee6600640 1 --2- 172.21.15.103:0/2497623742 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbec80b5390 0x7fbec80b7850 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbed4031440 tx=0x7fbed4005b50 comp rx=0 tx=0).stop 2024-09-11T01:05:22.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.547+0000 7fbee6600640 1 -- 172.21.15.103:0/2497623742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbee0108620 msgr2=0x7fbee019b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:22.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.547+0000 7fbee6600640 1 --2- 172.21.15.103:0/2497623742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbee0108620 0x7fbee019b7e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbecc00d770 tx=0x7fbecc00db70 comp rx=0 tx=0).stop 2024-09-11T01:05:22.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.547+0000 7fbee6600640 1 -- 172.21.15.103:0/2497623742 shutdown_connections 2024-09-11T01:05:22.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.547+0000 7fbee6600640 1 --2- 172.21.15.103:0/2497623742 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbec80b5390 0x7fbec80b7850 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:22.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.547+0000 7fbee6600640 1 --2- 172.21.15.103:0/2497623742 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbee0108fa0 0x7fbee01a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:22.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.547+0000 7fbee6600640 1 --2- 172.21.15.103:0/2497623742 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbee0108620 0x7fbee019b7e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:22.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.547+0000 7fbee6600640 1 --2- 172.21.15.103:0/2497623742 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbee0102c10 0x7fbee019b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:22.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.547+0000 7fbee6600640 1 -- 172.21.15.103:0/2497623742 >> 172.21.15.103:0/2497623742 conn(0x7fbee00fe660 msgr2=0x7fbee0104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:22.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.547+0000 7fbee6600640 1 -- 172.21.15.103:0/2497623742 shutdown_connections 2024-09-11T01:05:22.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:22.547+0000 7fbee6600640 1 -- 172.21.15.103:0/2497623742 wait complete. 2024-09-11T01:05:22.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:22 smithi103 ceph-mon[30562]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:22.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:22 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:22.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:22 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:22.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:22 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2497623742' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:22.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:22 smithi117 ceph-mon[35358]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:22.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:22 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:22.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:22 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:22.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:22 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2497623742' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:22.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:22 smithi183 ceph-mon[34992]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:22.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:22 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:22.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:22 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:22.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:22 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2497623742' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:23.322 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-11T01:05:23.728 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.317+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1625429803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7b410b180 msgr2=0x7fd7b4111980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.317+0000 7fd7b3e00640 1 --2- 172.21.15.103:0/1625429803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7b410b180 0x7fd7b4111980 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009ca0 tx=0x7fd7ac02a8c0 comp rx=0 tx=0).stop 2024-09-11T01:05:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.317+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1625429803 shutdown_connections 2024-09-11T01:05:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.317+0000 7fd7b3e00640 1 --2- 172.21.15.103:0/1625429803 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7b410b180 0x7fd7b4111980 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.317+0000 7fd7b3e00640 1 --2- 172.21.15.103:0/1625429803 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b410a800 0x7fd7b410ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.317+0000 7fd7b3e00640 1 --2- 172.21.15.103:0/1625429803 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7b4104df0 0x7fd7b41051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.317+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1625429803 >> 172.21.15.103:0/1625429803 conn(0x7fd7b4100840 msgr2=0x7fd7b4102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:24.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.317+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1625429803 shutdown_connections 2024-09-11T01:05:24.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.318+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1625429803 wait complete. 2024-09-11T01:05:24.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.318+0000 7fd7b3e00640 1 Processor -- start 2024-09-11T01:05:24.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.319+0000 7fd7b3e00640 1 -- start start 2024-09-11T01:05:24.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.319+0000 7fd7b3e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7b4104df0 0x7fd7b419b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:24.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.319+0000 7fd7b3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b410a800 0x7fd7b419b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:24.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.319+0000 7fd7b3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7b410b180 0x7fd7b41a0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:24.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.319+0000 7fd7b3e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4114e90 con 0x7fd7b410a800 2024-09-11T01:05:24.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.319+0000 7fd7b3e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4114d10 con 0x7fd7b410b180 2024-09-11T01:05:24.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.319+0000 7fd7b3e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd7b4115010 con 0x7fd7b4104df0 2024-09-11T01:05:24.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.319+0000 7fd7b2a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7b4104df0 0x7fd7b419b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:24.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.319+0000 7fd7b2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b410a800 0x7fd7b419b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:24.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.319+0000 7fd7b2a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7b4104df0 0x7fd7b419b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:35060/0 (socket says 172.21.15.103:35060) 2024-09-11T01:05:24.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.319+0000 7fd7b2a00640 1 -- 172.21.15.103:0/1480831375 learned_addr learned my addr 172.21.15.103:0/1480831375 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:24.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.319+0000 7fd7b3400640 1 --2- 172.21.15.103:0/1480831375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7b410b180 0x7fd7b41a0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:24.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.320+0000 7fd7b2a00640 1 -- 172.21.15.103:0/1480831375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7b410b180 msgr2=0x7fd7b41a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:24.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.320+0000 7fd7b2a00640 1 --2- 172.21.15.103:0/1480831375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7b410b180 0x7fd7b41a0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:24.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.320+0000 7fd7b2a00640 1 -- 172.21.15.103:0/1480831375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b410a800 msgr2=0x7fd7b419b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:24.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.320+0000 7fd7b2a00640 1 --2- 172.21.15.103:0/1480831375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b410a800 0x7fd7b419b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:24.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.320+0000 7fd7b2a00640 1 -- 172.21.15.103:0/1480831375 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7b41a1210 con 0x7fd7b4104df0 2024-09-11T01:05:24.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.320+0000 7fd7b2a00640 1 --2- 172.21.15.103:0/1480831375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7b4104df0 0x7fd7b419b160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400e9f0 tx=0x7fd7a400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:24.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.320+0000 7fd7ab400640 1 -- 172.21.15.103:0/1480831375 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a400cd80 con 0x7fd7b4104df0 2024-09-11T01:05:24.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.320+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1480831375 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7b41a1500 con 0x7fd7b4104df0 2024-09-11T01:05:24.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.320+0000 7fd7ab400640 1 -- 172.21.15.103:0/1480831375 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7a40054d0 con 0x7fd7b4104df0 2024-09-11T01:05:24.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.320+0000 7fd7ab400640 1 -- 172.21.15.103:0/1480831375 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7a4010690 con 0x7fd7b4104df0 2024-09-11T01:05:24.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.320+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1480831375 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7b41a7bc0 con 0x7fd7b4104df0 2024-09-11T01:05:24.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.322+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1480831375 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7b41051d0 con 0x7fd7b4104df0 2024-09-11T01:05:24.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.324+0000 7fd7ab400640 1 -- 172.21.15.103:0/1480831375 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fd7a4004e90 con 0x7fd7b4104df0 2024-09-11T01:05:24.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.325+0000 7fd7ab400640 1 --2- 172.21.15.103:0/1480831375 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd7980b5410 0x7fd7980b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:24.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.325+0000 7fd7ab400640 1 -- 172.21.15.103:0/1480831375 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fd7a40e5b00 con 0x7fd7b4104df0 2024-09-11T01:05:24.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.325+0000 7fd7b2000640 1 --2- 172.21.15.103:0/1480831375 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd7980b5410 0x7fd7980b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:24.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.326+0000 7fd7b2000640 1 --2- 172.21.15.103:0/1480831375 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd7980b5410 0x7fd7980b78d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00095f0 tx=0x7fd7a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:24.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.328+0000 7fd7ab400640 1 -- 172.21.15.103:0/1480831375 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd7a40acdc0 con 0x7fd7b4104df0 2024-09-11T01:05:24.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.524+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1480831375 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd7b41a8020 con 0x7fd7b4104df0 2024-09-11T01:05:24.527 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:24.527 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:24.527 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:24 smithi103 ceph-mon[30562]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:24.527 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:24.527 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:05:24.527 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:24.527 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:24 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:05:24.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.524+0000 7fd7ab400640 1 -- 172.21.15.103:0/1480831375 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7fd7a40e3e20 con 0x7fd7b4104df0 2024-09-11T01:05:24.528 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:05:24.528 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-09-11T01:05:24.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:05:24.528 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-09-11T01:05:24.528 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-09-11T01:05:24.528 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:05:24.528 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-09-11T01:05:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.527+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1480831375 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd7980b5410 msgr2=0x7fd7980b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.527+0000 7fd7b3e00640 1 --2- 172.21.15.103:0/1480831375 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd7980b5410 0x7fd7980b78d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00095f0 tx=0x7fd7a0005f90 comp rx=0 tx=0).stop 2024-09-11T01:05:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.527+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1480831375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7b4104df0 msgr2=0x7fd7b419b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:24.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.527+0000 7fd7b3e00640 1 --2- 172.21.15.103:0/1480831375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7b4104df0 0x7fd7b419b160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd7a400e9f0 tx=0x7fd7a400edf0 comp rx=0 tx=0).stop 2024-09-11T01:05:24.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.527+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1480831375 shutdown_connections 2024-09-11T01:05:24.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.527+0000 7fd7b3e00640 1 --2- 172.21.15.103:0/1480831375 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd7980b5410 0x7fd7980b78d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:24.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.527+0000 7fd7b3e00640 1 --2- 172.21.15.103:0/1480831375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7b410b180 0x7fd7b41a0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:24.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.527+0000 7fd7b3e00640 1 --2- 172.21.15.103:0/1480831375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7b410a800 0x7fd7b419b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:24.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.527+0000 7fd7b3e00640 1 --2- 172.21.15.103:0/1480831375 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7b4104df0 0x7fd7b419b160 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:24.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.527+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1480831375 >> 172.21.15.103:0/1480831375 conn(0x7fd7b4100840 msgr2=0x7fd7b4100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:24.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.527+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1480831375 shutdown_connections 2024-09-11T01:05:24.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:24.527+0000 7fd7b3e00640 1 -- 172.21.15.103:0/1480831375 wait complete. 2024-09-11T01:05:24.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:24.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:24.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:24 smithi183 ceph-mon[34992]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:24.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:24.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:05:24.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:24.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:24 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:05:24.851 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:24.851 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:24.851 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:24 smithi117 ceph-mon[35358]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:24.851 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:24.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:05:24.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:24.852 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:24 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:05:25.360 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-11T01:05:25.360 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-11T01:05:25.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:25 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1480831375' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-11T01:05:25.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:25 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:25.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:25 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1480831375' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-11T01:05:25.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:25 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:25.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:25 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1480831375' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-11T01:05:25.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:25 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:26.627 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:26.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:26 smithi183 ceph-mon[34992]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:26.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:26.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:26.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:26.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:26 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:26.679 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:26 smithi103 ceph-mon[30562]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:26.679 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:26.679 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:26.679 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:26.679 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:26 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:26.774 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:26 smithi117 ceph-mon[35358]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:26.774 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:26.774 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:26.774 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:26.774 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:26 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:27.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.210+0000 7fb517e00640 1 -- 172.21.15.103:0/3156290457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb510077ff0 msgr2=0x7fb510113470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:27.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.210+0000 7fb517e00640 1 --2- 172.21.15.103:0/3156290457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb510077ff0 0x7fb510113470 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009900 tx=0x7fb4fc02a410 comp rx=0 tx=0).stop 2024-09-11T01:05:27.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.211+0000 7fb517e00640 1 -- 172.21.15.103:0/3156290457 shutdown_connections 2024-09-11T01:05:27.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.211+0000 7fb517e00640 1 --2- 172.21.15.103:0/3156290457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5101139b0 0x7fb510115da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:27.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.211+0000 7fb517e00640 1 --2- 172.21.15.103:0/3156290457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb510077ff0 0x7fb510113470 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:27.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.211+0000 7fb517e00640 1 --2- 172.21.15.103:0/3156290457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5100776d0 0x7fb510077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:27.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.211+0000 7fb517e00640 1 -- 172.21.15.103:0/3156290457 >> 172.21.15.103:0/3156290457 conn(0x7fb5101009f0 msgr2=0x7fb510102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:27.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.211+0000 7fb517e00640 1 -- 172.21.15.103:0/3156290457 shutdown_connections 2024-09-11T01:05:27.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.211+0000 7fb517e00640 1 -- 172.21.15.103:0/3156290457 wait complete. 2024-09-11T01:05:27.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.212+0000 7fb517e00640 1 Processor -- start 2024-09-11T01:05:27.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.212+0000 7fb517e00640 1 -- start start 2024-09-11T01:05:27.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.213+0000 7fb517e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5100776d0 0x7fb51019f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:27.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.213+0000 7fb517e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb510077ff0 0x7fb51019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:27.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.213+0000 7fb517e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5101139b0 0x7fb5101a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:27.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.213+0000 7fb517e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb510119390 con 0x7fb510077ff0 2024-09-11T01:05:27.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.213+0000 7fb517e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb510119210 con 0x7fb5101139b0 2024-09-11T01:05:27.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.213+0000 7fb517e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb510119510 con 0x7fb5100776d0 2024-09-11T01:05:27.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.213+0000 7fb514a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb510077ff0 0x7fb51019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:27.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.213+0000 7fb515400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5100776d0 0x7fb51019f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:27.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.213+0000 7fb515400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5100776d0 0x7fb51019f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:35082/0 (socket says 172.21.15.103:35082) 2024-09-11T01:05:27.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.213+0000 7fb514a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb510077ff0 0x7fb51019fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45796/0 (socket says 172.21.15.103:45796) 2024-09-11T01:05:27.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.213+0000 7fb515400640 1 -- 172.21.15.103:0/791377441 learned_addr learned my addr 172.21.15.103:0/791377441 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:27.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.213+0000 7fb515e00640 1 --2- 172.21.15.103:0/791377441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5101139b0 0x7fb5101a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:27.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.214+0000 7fb515e00640 1 -- 172.21.15.103:0/791377441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5100776d0 msgr2=0x7fb51019f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:27.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.214+0000 7fb515e00640 1 --2- 172.21.15.103:0/791377441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5100776d0 0x7fb51019f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:27.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.214+0000 7fb515e00640 1 -- 172.21.15.103:0/791377441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb510077ff0 msgr2=0x7fb51019fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:27.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.214+0000 7fb515e00640 1 --2- 172.21.15.103:0/791377441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb510077ff0 0x7fb51019fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:27.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.214+0000 7fb515e00640 1 -- 172.21.15.103:0/791377441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5101a5950 con 0x7fb5101139b0 2024-09-11T01:05:27.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.214+0000 7fb515e00640 1 --2- 172.21.15.103:0/791377441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5101139b0 0x7fb5101a5180 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb508005fd0 tx=0x7fb50800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:27.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.214+0000 7fb50e000640 1 -- 172.21.15.103:0/791377441 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508003b70 con 0x7fb5101139b0 2024-09-11T01:05:27.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.214+0000 7fb517e00640 1 -- 172.21.15.103:0/791377441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5101a5c40 con 0x7fb5101139b0 2024-09-11T01:05:27.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.214+0000 7fb517e00640 1 -- 172.21.15.103:0/791377441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5101ac300 con 0x7fb5101139b0 2024-09-11T01:05:27.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.214+0000 7fb50e000640 1 -- 172.21.15.103:0/791377441 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb508003d10 con 0x7fb5101139b0 2024-09-11T01:05:27.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.215+0000 7fb50e000640 1 -- 172.21.15.103:0/791377441 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5080107a0 con 0x7fb5101139b0 2024-09-11T01:05:27.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.216+0000 7fb517e00640 1 -- 172.21.15.103:0/791377441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb510077ab0 con 0x7fb5101139b0 2024-09-11T01:05:27.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.220+0000 7fb50e000640 1 -- 172.21.15.103:0/791377441 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fb508004b40 con 0x7fb5101139b0 2024-09-11T01:05:27.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.221+0000 7fb50e000640 1 --2- 172.21.15.103:0/791377441 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb4f80b5360 0x7fb4f80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:27.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.222+0000 7fb515400640 1 --2- 172.21.15.103:0/791377441 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb4f80b5360 0x7fb4f80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:27.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.222+0000 7fb50e000640 1 -- 172.21.15.103:0/791377441 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fb5080e5d10 con 0x7fb5101139b0 2024-09-11T01:05:27.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.222+0000 7fb50e000640 1 -- 172.21.15.103:0/791377441 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb5080a8bd0 con 0x7fb5101139b0 2024-09-11T01:05:27.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.223+0000 7fb515400640 1 --2- 172.21.15.103:0/791377441 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb4f80b5360 0x7fb4f80b7820 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb504009c90 tx=0x7fb504005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:27.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.472+0000 7fb517e00640 1 -- 172.21.15.103:0/791377441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb5101ac5e0 con 0x7fb5101139b0 2024-09-11T01:05:27.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.543+0000 7fb50e000640 1 -- 172.21.15.103:0/791377441 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7fb5080ad060 con 0x7fb5101139b0 2024-09-11T01:05:27.547 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2024-09-11T01:05:27.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.548+0000 7fb517e00640 1 -- 172.21.15.103:0/791377441 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb4f80b5360 msgr2=0x7fb4f80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:27.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.548+0000 7fb517e00640 1 --2- 172.21.15.103:0/791377441 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb4f80b5360 0x7fb4f80b7820 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb504009c90 tx=0x7fb504005f90 comp rx=0 tx=0).stop 2024-09-11T01:05:27.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.548+0000 7fb517e00640 1 -- 172.21.15.103:0/791377441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5101139b0 msgr2=0x7fb5101a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:27.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.548+0000 7fb517e00640 1 --2- 172.21.15.103:0/791377441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5101139b0 0x7fb5101a5180 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb508005fd0 tx=0x7fb50800c6a0 comp rx=0 tx=0).stop 2024-09-11T01:05:27.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.549+0000 7fb517e00640 1 -- 172.21.15.103:0/791377441 shutdown_connections 2024-09-11T01:05:27.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.549+0000 7fb517e00640 1 --2- 172.21.15.103:0/791377441 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb4f80b5360 0x7fb4f80b7820 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:27.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.549+0000 7fb517e00640 1 --2- 172.21.15.103:0/791377441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb5101139b0 0x7fb5101a5180 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:27.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.549+0000 7fb517e00640 1 --2- 172.21.15.103:0/791377441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb510077ff0 0x7fb51019fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:27.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.549+0000 7fb517e00640 1 --2- 172.21.15.103:0/791377441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb5100776d0 0x7fb51019f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:27.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.549+0000 7fb517e00640 1 -- 172.21.15.103:0/791377441 >> 172.21.15.103:0/791377441 conn(0x7fb5101009f0 msgr2=0x7fb510102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:27.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.549+0000 7fb517e00640 1 -- 172.21.15.103:0/791377441 shutdown_connections 2024-09-11T01:05:27.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:27.549+0000 7fb517e00640 1 -- 172.21.15.103:0/791377441 wait complete. 2024-09-11T01:05:27.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:27 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/791377441' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-11T01:05:27.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:27 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-11T01:05:27.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:27 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/791377441' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-11T01:05:27.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:27 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-11T01:05:27.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:27 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/791377441' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-11T01:05:27.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:27 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-11T01:05:28.562 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-11T01:05:28.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:28 smithi103 ceph-mon[30562]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:28.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:28 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T01:05:28.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:28 smithi103 ceph-mon[30562]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T01:05:28.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:28 smithi103 ceph-mon[30562]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T01:05:28.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:28 smithi117 ceph-mon[35358]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:28.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:28 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T01:05:28.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:28 smithi117 ceph-mon[35358]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T01:05:28.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:28 smithi117 ceph-mon[35358]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T01:05:28.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:28 smithi183 ceph-mon[34992]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:28.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:28 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-11T01:05:28.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:28 smithi183 ceph-mon[34992]: osdmap e74: 12 total, 12 up, 12 in 2024-09-11T01:05:28.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:28 smithi183 ceph-mon[34992]: osdmap e75: 12 total, 12 up, 12 in 2024-09-11T01:05:28.948 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:29.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.589+0000 7f3a14800640 1 -- 172.21.15.103:0/1007238887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a0c113990 msgr2=0x7f3a0c115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:29.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.589+0000 7f3a14800640 1 --2- 172.21.15.103:0/1007238887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a0c113990 0x7f3a0c115d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3a08009ca0 tx=0x7f3a0802a8c0 comp rx=0 tx=0).stop 2024-09-11T01:05:29.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.589+0000 7f3a14800640 1 -- 172.21.15.103:0/1007238887 shutdown_connections 2024-09-11T01:05:29.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.589+0000 7f3a14800640 1 --2- 172.21.15.103:0/1007238887 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a0c113990 0x7f3a0c115d80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:29.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.589+0000 7f3a14800640 1 --2- 172.21.15.103:0/1007238887 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a0c077ff0 0x7f3a0c113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:29.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.589+0000 7f3a14800640 1 --2- 172.21.15.103:0/1007238887 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a0c0776d0 0x7f3a0c077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:29.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.589+0000 7f3a14800640 1 -- 172.21.15.103:0/1007238887 >> 172.21.15.103:0/1007238887 conn(0x7f3a0c100a50 msgr2=0x7f3a0c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:29.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.589+0000 7f3a14800640 1 -- 172.21.15.103:0/1007238887 shutdown_connections 2024-09-11T01:05:29.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.589+0000 7f3a14800640 1 -- 172.21.15.103:0/1007238887 wait complete. 2024-09-11T01:05:29.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.591+0000 7f3a14800640 1 Processor -- start 2024-09-11T01:05:29.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.591+0000 7f3a14800640 1 -- start start 2024-09-11T01:05:29.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.591+0000 7f3a14800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a0c0776d0 0x7f3a0c19f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:29.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.591+0000 7f3a14800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a0c077ff0 0x7f3a0c19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:29.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.591+0000 7f3a14800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a0c113990 0x7f3a0c1a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:29.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.591+0000 7f3a14800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c119360 con 0x7f3a0c077ff0 2024-09-11T01:05:29.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.591+0000 7f3a14800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c1191e0 con 0x7f3a0c0776d0 2024-09-11T01:05:29.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.591+0000 7f3a14800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0c1194e0 con 0x7f3a0c113990 2024-09-11T01:05:29.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.591+0000 7f3a11400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a0c077ff0 0x7f3a0c19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:29.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.592+0000 7f3a11400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a0c077ff0 0x7f3a0c19fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45814/0 (socket says 172.21.15.103:45814) 2024-09-11T01:05:29.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.592+0000 7f3a11400640 1 -- 172.21.15.103:0/1239660494 learned_addr learned my addr 172.21.15.103:0/1239660494 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:29.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.592+0000 7f3a11e00640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a0c0776d0 0x7f3a0c19f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:29.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.592+0000 7f3a12800640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a0c113990 0x7f3a0c1a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:29.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.592+0000 7f3a11e00640 1 -- 172.21.15.103:0/1239660494 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a0c113990 msgr2=0x7f3a0c1a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:29.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.592+0000 7f3a11e00640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a0c113990 0x7f3a0c1a5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:29.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.592+0000 7f3a11e00640 1 -- 172.21.15.103:0/1239660494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a0c077ff0 msgr2=0x7f3a0c19fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:29.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.592+0000 7f3a11e00640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a0c077ff0 0x7f3a0c19fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:29.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.592+0000 7f3a11e00640 1 -- 172.21.15.103:0/1239660494 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0c1a58e0 con 0x7f3a0c0776d0 2024-09-11T01:05:29.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.592+0000 7f3a11400640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a0c077ff0 0x7f3a0c19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:05:29.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.592+0000 7f3a11e00640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a0c0776d0 0x7f3a0c19f830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000e9f0 tx=0x7f3a0000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:29.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.593+0000 7f3a06a00640 1 -- 172.21.15.103:0/1239660494 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0000ccc0 con 0x7f3a0c0776d0 2024-09-11T01:05:29.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.593+0000 7f3a14800640 1 -- 172.21.15.103:0/1239660494 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0c1a5bd0 con 0x7f3a0c0776d0 2024-09-11T01:05:29.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.593+0000 7f3a06a00640 1 -- 172.21.15.103:0/1239660494 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a000108e0 con 0x7f3a0c0776d0 2024-09-11T01:05:29.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.593+0000 7f3a06a00640 1 -- 172.21.15.103:0/1239660494 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a00018880 con 0x7f3a0c0776d0 2024-09-11T01:05:29.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.593+0000 7f3a14800640 1 -- 172.21.15.103:0/1239660494 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a0c1ac460 con 0x7f3a0c0776d0 2024-09-11T01:05:29.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.594+0000 7f3a14800640 1 -- 172.21.15.103:0/1239660494 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a0c077ab0 con 0x7f3a0c0776d0 2024-09-11T01:05:29.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.596+0000 7f3a06a00640 1 -- 172.21.15.103:0/1239660494 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f3a00010430 con 0x7f3a0c0776d0 2024-09-11T01:05:29.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.597+0000 7f3a06a00640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f39f40b52e0 0x7f39f40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:29.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.597+0000 7f3a06a00640 1 -- 172.21.15.103:0/1239660494 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7f3a000e5d20 con 0x7f3a0c0776d0 2024-09-11T01:05:29.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.597+0000 7f3a11400640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f39f40b52e0 0x7f39f40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:29.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.598+0000 7f3a11400640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f39f40b52e0 0x7f39f40b77a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c115fb0 tx=0x7f39fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:29.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.599+0000 7f3a06a00640 1 -- 172.21.15.103:0/1239660494 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3a000ace70 con 0x7f3a0c0776d0 2024-09-11T01:05:29.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:29.787+0000 7f3a14800640 1 -- 172.21.15.103:0/1239660494 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f3a0c1ac630 con 0x7f3a0c0776d0 2024-09-11T01:05:29.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:29 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:29.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:29 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:29.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:29 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:29.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:29 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:05:29.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:29 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:29.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:29 smithi183 ceph-mon[34992]: pgmap v300: 33 pgs: 6 active+clean, 1 creating+activating, 18 creating+peering, 8 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:29.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:29 smithi183 ceph-mon[34992]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T01:05:30.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:29 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:30.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:29 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:30.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:29 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:30.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:29 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:05:30.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:29 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:30.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:29 smithi103 ceph-mon[30562]: pgmap v300: 33 pgs: 6 active+clean, 1 creating+activating, 18 creating+peering, 8 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:30.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:29 smithi103 ceph-mon[30562]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T01:05:30.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:29 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:30.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:29 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:30.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:29 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:05:30.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:29 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:05:30.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:29 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:05:30.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:29 smithi117 ceph-mon[35358]: pgmap v300: 33 pgs: 6 active+clean, 1 creating+activating, 18 creating+peering, 8 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:30.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:29 smithi117 ceph-mon[35358]: osdmap e76: 12 total, 12 up, 12 in 2024-09-11T01:05:30.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:30.660+0000 7f3a06a00640 1 -- 172.21.15.103:0/1239660494 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v77) ==== 171+0+0 (secure 0 0 0) 0x7f3a000ac770 con 0x7f3a0c0776d0 2024-09-11T01:05:30.668 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2024-09-11T01:05:30.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:30.668+0000 7f3a14800640 1 -- 172.21.15.103:0/1239660494 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f39f40b52e0 msgr2=0x7f39f40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:30.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:30.668+0000 7f3a14800640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f39f40b52e0 0x7f39f40b77a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c115fb0 tx=0x7f39fc005f90 comp rx=0 tx=0).stop 2024-09-11T01:05:30.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:30.668+0000 7f3a14800640 1 -- 172.21.15.103:0/1239660494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a0c0776d0 msgr2=0x7f3a0c19f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:30.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:30.668+0000 7f3a14800640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a0c0776d0 0x7f3a0c19f830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3a0000e9f0 tx=0x7f3a0000eeb0 comp rx=0 tx=0).stop 2024-09-11T01:05:30.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:30.668+0000 7f3a14800640 1 -- 172.21.15.103:0/1239660494 shutdown_connections 2024-09-11T01:05:30.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:30.668+0000 7f3a14800640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f39f40b52e0 0x7f39f40b77a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:30.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:30.668+0000 7f3a14800640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a0c113990 0x7f3a0c1a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:30.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:30.668+0000 7f3a14800640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a0c077ff0 0x7f3a0c19fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:30.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:30.668+0000 7f3a14800640 1 --2- 172.21.15.103:0/1239660494 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a0c0776d0 0x7f3a0c19f830 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:30.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:30.668+0000 7f3a14800640 1 -- 172.21.15.103:0/1239660494 >> 172.21.15.103:0/1239660494 conn(0x7f3a0c100a50 msgr2=0x7f3a0c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:30.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:30.668+0000 7f3a14800640 1 -- 172.21.15.103:0/1239660494 shutdown_connections 2024-09-11T01:05:30.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:30.668+0000 7f3a14800640 1 -- 172.21.15.103:0/1239660494 wait complete. 2024-09-11T01:05:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:30 smithi183 ceph-mon[34992]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T01:05:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:30 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1239660494' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-11T01:05:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:30 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-11T01:05:31.053 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:30 smithi103 ceph-mon[30562]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T01:05:31.053 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:30 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1239660494' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-11T01:05:31.053 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:30 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-11T01:05:31.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:30 smithi117 ceph-mon[35358]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T01:05:31.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:30 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1239660494' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-11T01:05:31.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:30 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-11T01:05:31.575 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-11T01:05:31.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:31 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T01:05:31.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:31 smithi183 ceph-mon[34992]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T01:05:31.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:31 smithi183 ceph-mon[34992]: pgmap v303: 97 pgs: 12 active+clean, 1 creating+activating, 18 creating+peering, 66 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:31.963 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:32.081 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:31 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T01:05:32.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:31 smithi103 ceph-mon[30562]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T01:05:32.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:31 smithi103 ceph-mon[30562]: pgmap v303: 97 pgs: 12 active+clean, 1 creating+activating, 18 creating+peering, 66 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:32.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:31 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-11T01:05:32.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:31 smithi117 ceph-mon[35358]: osdmap e77: 12 total, 12 up, 12 in 2024-09-11T01:05:32.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:31 smithi117 ceph-mon[35358]: pgmap v303: 97 pgs: 12 active+clean, 1 creating+activating, 18 creating+peering, 66 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:32.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.527+0000 7f2b19800640 1 -- 172.21.15.103:0/69370677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b1410b1a0 msgr2=0x7f2b141119a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:32.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.527+0000 7f2b19800640 1 --2- 172.21.15.103:0/69370677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b1410b1a0 0x7f2b141119a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009ca0 tx=0x7f2b0c02a8c0 comp rx=0 tx=0).stop 2024-09-11T01:05:32.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.527+0000 7f2b19800640 1 -- 172.21.15.103:0/69370677 shutdown_connections 2024-09-11T01:05:32.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.527+0000 7f2b19800640 1 --2- 172.21.15.103:0/69370677 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b1410b1a0 0x7f2b141119a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:32.550 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.527+0000 7f2b19800640 1 --2- 172.21.15.103:0/69370677 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b1410a820 0x7f2b1410ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.527+0000 7f2b19800640 1 --2- 172.21.15.103:0/69370677 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b14104e10 0x7f2b141051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.527+0000 7f2b19800640 1 -- 172.21.15.103:0/69370677 >> 172.21.15.103:0/69370677 conn(0x7f2b14100840 msgr2=0x7f2b14102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.527+0000 7f2b19800640 1 -- 172.21.15.103:0/69370677 shutdown_connections 2024-09-11T01:05:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.527+0000 7f2b19800640 1 -- 172.21.15.103:0/69370677 wait complete. 2024-09-11T01:05:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.528+0000 7f2b19800640 1 Processor -- start 2024-09-11T01:05:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.528+0000 7f2b19800640 1 -- start start 2024-09-11T01:05:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.528+0000 7f2b19800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b14104e10 0x7f2b1419b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b19800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b1410a820 0x7f2b1419b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b19800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b1410b1a0 0x7f2b141a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b19800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2b14114eb0 con 0x7f2b1410b1a0 2024-09-11T01:05:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b19800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2b14114d30 con 0x7f2b14104e10 2024-09-11T01:05:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b19800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2b14115030 con 0x7f2b1410a820 2024-09-11T01:05:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b18e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b1410b1a0 0x7f2b141a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:32.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b13e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b14104e10 0x7f2b1419b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b18e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b1410b1a0 0x7f2b141a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38736/0 (socket says 172.21.15.103:38736) 2024-09-11T01:05:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b18e00640 1 -- 172.21.15.103:0/1981275704 learned_addr learned my addr 172.21.15.103:0/1981275704 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b13400640 1 --2- 172.21.15.103:0/1981275704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b1410a820 0x7f2b1419b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b13e00640 1 -- 172.21.15.103:0/1981275704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b1410a820 msgr2=0x7f2b1419b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b13e00640 1 --2- 172.21.15.103:0/1981275704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b1410a820 0x7f2b1419b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b13e00640 1 -- 172.21.15.103:0/1981275704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b1410b1a0 msgr2=0x7f2b141a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b13e00640 1 --2- 172.21.15.103:0/1981275704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b1410b1a0 0x7f2b141a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.529+0000 7f2b13e00640 1 -- 172.21.15.103:0/1981275704 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b141a1290 con 0x7f2b14104e10 2024-09-11T01:05:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.530+0000 7f2b13e00640 1 --2- 172.21.15.103:0/1981275704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b14104e10 0x7f2b1419b1e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400e9f0 tx=0x7f2b0400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.530+0000 7f2b10c00640 1 -- 172.21.15.103:0/1981275704 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b0400ccc0 con 0x7f2b14104e10 2024-09-11T01:05:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.530+0000 7f2b19800640 1 -- 172.21.15.103:0/1981275704 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b141a1580 con 0x7f2b14104e10 2024-09-11T01:05:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.530+0000 7f2b10c00640 1 -- 172.21.15.103:0/1981275704 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b04005020 con 0x7f2b14104e10 2024-09-11T01:05:32.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.530+0000 7f2b10c00640 1 -- 172.21.15.103:0/1981275704 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b04004a00 con 0x7f2b14104e10 2024-09-11T01:05:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.530+0000 7f2b19800640 1 -- 172.21.15.103:0/1981275704 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b141a7c40 con 0x7f2b14104e10 2024-09-11T01:05:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.531+0000 7f2b19800640 1 -- 172.21.15.103:0/1981275704 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b141051f0 con 0x7f2b14104e10 2024-09-11T01:05:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.534+0000 7f2b10c00640 1 -- 172.21.15.103:0/1981275704 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f2b04004ba0 con 0x7f2b14104e10 2024-09-11T01:05:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.535+0000 7f2b10c00640 1 --2- 172.21.15.103:0/1981275704 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2af80b5390 0x7f2af80b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.535+0000 7f2b10c00640 1 -- 172.21.15.103:0/1981275704 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7879+0+0 (secure 0 0 0) 0x7f2b040e5af0 con 0x7f2b14104e10 2024-09-11T01:05:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.535+0000 7f2b13400640 1 --2- 172.21.15.103:0/1981275704 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2af80b5390 0x7f2af80b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.536+0000 7f2b13400640 1 --2- 172.21.15.103:0/1981275704 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2af80b5390 0x7f2af80b7850 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2b1410a3e0 tx=0x7f2b00005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:32.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.537+0000 7f2b10c00640 1 -- 172.21.15.103:0/1981275704 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2b040acb50 con 0x7f2b14104e10 2024-09-11T01:05:32.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:32.764+0000 7f2b19800640 1 -- 172.21.15.103:0/1981275704 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f2b141a7f90 con 0x7f2b14104e10 2024-09-11T01:05:32.767 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:32 smithi103 ceph-mon[30562]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T01:05:32.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:32 smithi183 ceph-mon[34992]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T01:05:33.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:32 smithi117 ceph-mon[35358]: osdmap e78: 12 total, 12 up, 12 in 2024-09-11T01:05:33.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:33.677+0000 7f2b10c00640 1 -- 172.21.15.103:0/1981275704 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f2b040ac450 con 0x7f2b14104e10 2024-09-11T01:05:33.680 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 2 and data pool 3 2024-09-11T01:05:33.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:33.681+0000 7f2b19800640 1 -- 172.21.15.103:0/1981275704 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2af80b5390 msgr2=0x7f2af80b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:33.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:33.681+0000 7f2b19800640 1 --2- 172.21.15.103:0/1981275704 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2af80b5390 0x7f2af80b7850 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2b1410a3e0 tx=0x7f2b00005f90 comp rx=0 tx=0).stop 2024-09-11T01:05:33.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:33.681+0000 7f2b19800640 1 -- 172.21.15.103:0/1981275704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b14104e10 msgr2=0x7f2b1419b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:33.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:33.681+0000 7f2b19800640 1 --2- 172.21.15.103:0/1981275704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b14104e10 0x7f2b1419b1e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400e9f0 tx=0x7f2b0400eeb0 comp rx=0 tx=0).stop 2024-09-11T01:05:33.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:33.681+0000 7f2b19800640 1 -- 172.21.15.103:0/1981275704 shutdown_connections 2024-09-11T01:05:33.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:33.681+0000 7f2b19800640 1 --2- 172.21.15.103:0/1981275704 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2af80b5390 0x7f2af80b7850 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:33.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:33.681+0000 7f2b19800640 1 --2- 172.21.15.103:0/1981275704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2b1410b1a0 0x7f2b141a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:33.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:33.681+0000 7f2b19800640 1 --2- 172.21.15.103:0/1981275704 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2b1410a820 0x7f2b1419b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:33.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:33.681+0000 7f2b19800640 1 --2- 172.21.15.103:0/1981275704 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2b14104e10 0x7f2b1419b1e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:33.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:33.681+0000 7f2b19800640 1 -- 172.21.15.103:0/1981275704 >> 172.21.15.103:0/1981275704 conn(0x7f2b14100840 msgr2=0x7f2b14103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:33.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:33.683+0000 7f2b19800640 1 -- 172.21.15.103:0/1981275704 shutdown_connections 2024-09-11T01:05:33.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:33.684+0000 7f2b19800640 1 -- 172.21.15.103:0/1981275704 wait complete. 2024-09-11T01:05:34.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:33 smithi103 ceph-mon[30562]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T01:05:34.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:33 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1981275704' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-11T01:05:34.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:33 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-11T01:05:34.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:33 smithi103 ceph-mon[30562]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T01:05:34.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:33 smithi103 ceph-mon[30562]: pgmap v306: 97 pgs: 63 active+clean, 1 creating+activating, 8 creating+peering, 25 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:34.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:33 smithi117 ceph-mon[35358]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T01:05:34.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:33 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1981275704' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-11T01:05:34.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:33 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-11T01:05:34.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:33 smithi117 ceph-mon[35358]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T01:05:34.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:33 smithi117 ceph-mon[35358]: pgmap v306: 97 pgs: 63 active+clean, 1 creating+activating, 8 creating+peering, 25 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:34.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:33 smithi183 ceph-mon[34992]: osdmap e79: 12 total, 12 up, 12 in 2024-09-11T01:05:34.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:33 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1981275704' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-11T01:05:34.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:33 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-11T01:05:34.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:33 smithi183 ceph-mon[34992]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-11T01:05:34.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:33 smithi183 ceph-mon[34992]: pgmap v306: 97 pgs: 63 active+clean, 1 creating+activating, 8 creating+peering, 25 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:34.641 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-11T01:05:34.641 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-11T01:05:35.014 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:35.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:34 smithi103 ceph-mon[30562]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T01:05:35.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:34 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T01:05:35.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:34 smithi103 ceph-mon[30562]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T01:05:35.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:34 smithi103 ceph-mon[30562]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T01:05:35.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:34 smithi117 ceph-mon[35358]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T01:05:35.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:34 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T01:05:35.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:34 smithi117 ceph-mon[35358]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T01:05:35.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:34 smithi117 ceph-mon[35358]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T01:05:35.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:34 smithi183 ceph-mon[34992]: osdmap e80: 12 total, 12 up, 12 in 2024-09-11T01:05:35.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:34 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-11T01:05:35.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:34 smithi183 ceph-mon[34992]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-11T01:05:35.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:34 smithi183 ceph-mon[34992]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-11T01:05:35.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.622+0000 7fb9b0000640 1 -- 172.21.15.103:0/1189339222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9a81087d0 msgr2=0x7fb9a8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.623+0000 7fb9b0000640 1 --2- 172.21.15.103:0/1189339222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9a81087d0 0x7fb9a8108c10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb994009900 tx=0x7fb99402a410 comp rx=0 tx=0).stop 2024-09-11T01:05:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.623+0000 7fb9b0000640 1 -- 172.21.15.103:0/1189339222 shutdown_connections 2024-09-11T01:05:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.623+0000 7fb9b0000640 1 --2- 172.21.15.103:0/1189339222 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9a8109150 0x7fb9a810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.623+0000 7fb9b0000640 1 --2- 172.21.15.103:0/1189339222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9a81087d0 0x7fb9a8108c10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.623+0000 7fb9b0000640 1 --2- 172.21.15.103:0/1189339222 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a8102dc0 0x7fb9a81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.623+0000 7fb9b0000640 1 -- 172.21.15.103:0/1189339222 >> 172.21.15.103:0/1189339222 conn(0x7fb9a80fe830 msgr2=0x7fb9a8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.623+0000 7fb9b0000640 1 -- 172.21.15.103:0/1189339222 shutdown_connections 2024-09-11T01:05:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.623+0000 7fb9b0000640 1 -- 172.21.15.103:0/1189339222 wait complete. 2024-09-11T01:05:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.624+0000 7fb9b0000640 1 Processor -- start 2024-09-11T01:05:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.624+0000 7fb9b0000640 1 -- start start 2024-09-11T01:05:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.624+0000 7fb9b0000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a8102dc0 0x7fb9a819b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.624+0000 7fb9b0000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9a81087d0 0x7fb9a819b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:35.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.624+0000 7fb9b0000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9a8109150 0x7fb9a81a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.624+0000 7fb9b0000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a8112e10 con 0x7fb9a8109150 2024-09-11T01:05:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.624+0000 7fb9b0000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a8112c90 con 0x7fb9a81087d0 2024-09-11T01:05:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.624+0000 7fb9b0000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a8112f90 con 0x7fb9a8102dc0 2024-09-11T01:05:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.624+0000 7fb9ae000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9a8109150 0x7fb9a81a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.624+0000 7fb9ad600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a8102dc0 0x7fb9a819b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.624+0000 7fb9ad600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a8102dc0 0x7fb9a819b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:36692/0 (socket says 172.21.15.103:36692) 2024-09-11T01:05:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.624+0000 7fb9ad600640 1 -- 172.21.15.103:0/3231679900 learned_addr learned my addr 172.21.15.103:0/3231679900 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.625+0000 7fb9acc00640 1 --2- 172.21.15.103:0/3231679900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9a81087d0 0x7fb9a819b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.625+0000 7fb9ad600640 1 -- 172.21.15.103:0/3231679900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9a81087d0 msgr2=0x7fb9a819b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.625+0000 7fb9ad600640 1 --2- 172.21.15.103:0/3231679900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9a81087d0 0x7fb9a819b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.625+0000 7fb9ad600640 1 -- 172.21.15.103:0/3231679900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9a8109150 msgr2=0x7fb9a81a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.625+0000 7fb9ad600640 1 --2- 172.21.15.103:0/3231679900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9a8109150 0x7fb9a81a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.625+0000 7fb9ad600640 1 -- 172.21.15.103:0/3231679900 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a81a1550 con 0x7fb9a8102dc0 2024-09-11T01:05:35.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.625+0000 7fb9ae000640 1 --2- 172.21.15.103:0/3231679900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9a8109150 0x7fb9a81a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:05:35.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.625+0000 7fb9ad600640 1 --2- 172.21.15.103:0/3231679900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a8102dc0 0x7fb9a819b4a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00db80 tx=0x7fb99c00b630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:35.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.625+0000 7fb9a6000640 1 -- 172.21.15.103:0/3231679900 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c017070 con 0x7fb9a8102dc0 2024-09-11T01:05:35.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.625+0000 7fb9b0000640 1 -- 172.21.15.103:0/3231679900 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a81a1840 con 0x7fb9a8102dc0 2024-09-11T01:05:35.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.625+0000 7fb9a6000640 1 -- 172.21.15.103:0/3231679900 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb99c003b70 con 0x7fb9a8102dc0 2024-09-11T01:05:35.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.625+0000 7fb9a6000640 1 -- 172.21.15.103:0/3231679900 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99c0106c0 con 0x7fb9a8102dc0 2024-09-11T01:05:35.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.626+0000 7fb9b0000640 1 -- 172.21.15.103:0/3231679900 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a81a80d0 con 0x7fb9a8102dc0 2024-09-11T01:05:35.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.627+0000 7fb9b0000640 1 -- 172.21.15.103:0/3231679900 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a8104070 con 0x7fb9a8102dc0 2024-09-11T01:05:35.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.629+0000 7fb9a6000640 1 -- 172.21.15.103:0/3231679900 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fb99c023060 con 0x7fb9a8102dc0 2024-09-11T01:05:35.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.630+0000 7fb9a6000640 1 --2- 172.21.15.103:0/3231679900 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb9900b52e0 0x7fb9900b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:35.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.631+0000 7fb9a6000640 1 -- 172.21.15.103:0/3231679900 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fb99c0e5bb0 con 0x7fb9a8102dc0 2024-09-11T01:05:35.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.631+0000 7fb9acc00640 1 --2- 172.21.15.103:0/3231679900 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb9900b52e0 0x7fb9900b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:35.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.631+0000 7fb9acc00640 1 --2- 172.21.15.103:0/3231679900 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb9900b52e0 0x7fb9900b77a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb994031440 tx=0x7fb994005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:35.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.632+0000 7fb9a6000640 1 -- 172.21.15.103:0/3231679900 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb99c0acb20 con 0x7fb9a8102dc0 2024-09-11T01:05:35.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:35.827+0000 7fb9b0000640 1 -- 172.21.15.103:0/3231679900 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fb9a81031a0 con 0x7fb9a8102dc0 2024-09-11T01:05:35.830 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:35 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] up:active 2024-09-11T01:05:35.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:35 smithi103 ceph-mon[30562]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:05:35.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:35 smithi103 ceph-mon[30562]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:05:35.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:35 smithi103 ceph-mon[30562]: pgmap v308: 97 pgs: 89 active+clean, 8 creating+peering; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 843 B/s wr, 2 op/s 2024-09-11T01:05:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:35 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] up:active 2024-09-11T01:05:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:35 smithi117 ceph-mon[35358]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:05:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:35 smithi117 ceph-mon[35358]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:05:35.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:35 smithi117 ceph-mon[35358]: pgmap v308: 97 pgs: 89 active+clean, 8 creating+peering; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 843 B/s wr, 2 op/s 2024-09-11T01:05:35.873 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:05:35 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-b[65005]: 2024-09-11T01:05:35.567+0000 7f373c63f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-11T01:05:36.001 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:35 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] up:active 2024-09-11T01:05:36.001 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:35 smithi183 ceph-mon[34992]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:05:36.001 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:35 smithi183 ceph-mon[34992]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:05:36.001 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:35 smithi183 ceph-mon[34992]: pgmap v308: 97 pgs: 89 active+clean, 8 creating+peering; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 843 B/s wr, 2 op/s 2024-09-11T01:05:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:36.692+0000 7fb9a6000640 1 -- 172.21.15.103:0/3231679900 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v81) ==== 157+0+0 (secure 0 0 0) 0x7fb99c0ac420 con 0x7fb9a8102dc0 2024-09-11T01:05:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:36.695+0000 7fb9b0000640 1 -- 172.21.15.103:0/3231679900 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb9900b52e0 msgr2=0x7fb9900b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:36.695+0000 7fb9b0000640 1 --2- 172.21.15.103:0/3231679900 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb9900b52e0 0x7fb9900b77a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb994031440 tx=0x7fb994005b50 comp rx=0 tx=0).stop 2024-09-11T01:05:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:36.695+0000 7fb9b0000640 1 -- 172.21.15.103:0/3231679900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a8102dc0 msgr2=0x7fb9a819b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:36.695+0000 7fb9b0000640 1 --2- 172.21.15.103:0/3231679900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a8102dc0 0x7fb9a819b4a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00db80 tx=0x7fb99c00b630 comp rx=0 tx=0).stop 2024-09-11T01:05:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:36.695+0000 7fb9b0000640 1 -- 172.21.15.103:0/3231679900 shutdown_connections 2024-09-11T01:05:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:36.695+0000 7fb9b0000640 1 --2- 172.21.15.103:0/3231679900 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb9900b52e0 0x7fb9900b77a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:36.695+0000 7fb9b0000640 1 --2- 172.21.15.103:0/3231679900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb9a8109150 0x7fb9a81a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:36.695+0000 7fb9b0000640 1 --2- 172.21.15.103:0/3231679900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb9a81087d0 0x7fb9a819b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:36.695+0000 7fb9b0000640 1 --2- 172.21.15.103:0/3231679900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb9a8102dc0 0x7fb9a819b4a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:36.695+0000 7fb9b0000640 1 -- 172.21.15.103:0/3231679900 >> 172.21.15.103:0/3231679900 conn(0x7fb9a80fe830 msgr2=0x7fb9a8104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:36.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:36.696+0000 7fb9b0000640 1 -- 172.21.15.103:0/3231679900 shutdown_connections 2024-09-11T01:05:36.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:36.696+0000 7fb9b0000640 1 -- 172.21.15.103:0/3231679900 wait complete. 2024-09-11T01:05:37.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:36 smithi103 ceph-mon[30562]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T01:05:37.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:36 smithi103 ceph-mon[30562]: Cluster is now healthy 2024-09-11T01:05:37.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:36 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3231679900' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-11T01:05:37.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:36 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-11T01:05:37.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:36 smithi117 ceph-mon[35358]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T01:05:37.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:36 smithi117 ceph-mon[35358]: Cluster is now healthy 2024-09-11T01:05:37.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:36 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3231679900' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-11T01:05:37.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:36 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-11T01:05:37.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:36 smithi183 ceph-mon[34992]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-11T01:05:37.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:36 smithi183 ceph-mon[34992]: Cluster is now healthy 2024-09-11T01:05:37.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:36 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3231679900' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-11T01:05:37.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:36 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-11T01:05:37.732 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-11T01:05:38.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:37 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T01:05:38.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:37 smithi103 ceph-mon[30562]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T01:05:38.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:37 smithi103 ceph-mon[30562]: pgmap v310: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 700 B/s wr, 1 op/s 2024-09-11T01:05:38.107 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:38.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:37 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T01:05:38.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:37 smithi117 ceph-mon[35358]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T01:05:38.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:37 smithi117 ceph-mon[35358]: pgmap v310: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 700 B/s wr, 1 op/s 2024-09-11T01:05:38.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:37 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-11T01:05:38.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:37 smithi183 ceph-mon[34992]: osdmap e81: 12 total, 12 up, 12 in 2024-09-11T01:05:38.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:37 smithi183 ceph-mon[34992]: pgmap v310: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 700 B/s wr, 1 op/s 2024-09-11T01:05:38.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.694+0000 7f9416600640 1 -- 172.21.15.103:0/3676886456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941010b330 msgr2=0x7f9410111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:38.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.694+0000 7f9416600640 1 --2- 172.21.15.103:0/3676886456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941010b330 0x7f9410111b30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9408009ca0 tx=0x7f940802a8c0 comp rx=0 tx=0).stop 2024-09-11T01:05:38.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.694+0000 7f9416600640 1 -- 172.21.15.103:0/3676886456 shutdown_connections 2024-09-11T01:05:38.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.694+0000 7f9416600640 1 --2- 172.21.15.103:0/3676886456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941010b330 0x7f9410111b30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:38.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.694+0000 7f9416600640 1 --2- 172.21.15.103:0/3676886456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f941010a9b0 0x7f941010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:38.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.694+0000 7f9416600640 1 --2- 172.21.15.103:0/3676886456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9410104fa0 0x7f9410105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:38.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.694+0000 7f9416600640 1 -- 172.21.15.103:0/3676886456 >> 172.21.15.103:0/3676886456 conn(0x7f9410100a50 msgr2=0x7f9410102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:38.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.694+0000 7f9416600640 1 -- 172.21.15.103:0/3676886456 shutdown_connections 2024-09-11T01:05:38.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.694+0000 7f9416600640 1 -- 172.21.15.103:0/3676886456 wait complete. 2024-09-11T01:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.695+0000 7f9416600640 1 Processor -- start 2024-09-11T01:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.695+0000 7f9416600640 1 -- start start 2024-09-11T01:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f9416600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9410104fa0 0x7f941019b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f9416600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941010a9b0 0x7f941019b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f9416600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f941010b330 0x7f94101a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f9416600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9410114fb0 con 0x7f941010a9b0 2024-09-11T01:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f9416600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9410114e30 con 0x7f941010b330 2024-09-11T01:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f9416600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9410115130 con 0x7f9410104fa0 2024-09-11T01:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f940ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941010a9b0 0x7f941019b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f940ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941010a9b0 0x7f941019b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38768/0 (socket says 172.21.15.103:38768) 2024-09-11T01:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f940ea00640 1 -- 172.21.15.103:0/4233112493 learned_addr learned my addr 172.21.15.103:0/4233112493 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:38.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f940f400640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9410104fa0 0x7f941019b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f940fe00640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f941010b330 0x7f94101a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f940ea00640 1 -- 172.21.15.103:0/4233112493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9410104fa0 msgr2=0x7f941019b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f940ea00640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9410104fa0 0x7f941019b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f940ea00640 1 -- 172.21.15.103:0/4233112493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f941010b330 msgr2=0x7f94101a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.696+0000 7f940ea00640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f941010b330 0x7f94101a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.697+0000 7f940ea00640 1 -- 172.21.15.103:0/4233112493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94101a1550 con 0x7f941010a9b0 2024-09-11T01:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.697+0000 7f940f400640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9410104fa0 0x7f941019b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.697+0000 7f940ea00640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941010a9b0 0x7f941019b9e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00e9f0 tx=0x7f93fc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.697+0000 7f9407e00640 1 -- 172.21.15.103:0/4233112493 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc00cd80 con 0x7f941010a9b0 2024-09-11T01:05:38.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.697+0000 7f9407e00640 1 -- 172.21.15.103:0/4233112493 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93fc0108e0 con 0x7f941010a9b0 2024-09-11T01:05:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.697+0000 7f9416600640 1 -- 172.21.15.103:0/4233112493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94101a1840 con 0x7f941010a9b0 2024-09-11T01:05:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.697+0000 7f9407e00640 1 -- 172.21.15.103:0/4233112493 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93fc018980 con 0x7f941010a9b0 2024-09-11T01:05:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.697+0000 7f9416600640 1 -- 172.21.15.103:0/4233112493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94101a7f00 con 0x7f941010a9b0 2024-09-11T01:05:38.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.698+0000 7f9416600640 1 -- 172.21.15.103:0/4233112493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9410105380 con 0x7f941010a9b0 2024-09-11T01:05:38.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.701+0000 7f9407e00640 1 -- 172.21.15.103:0/4233112493 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f93fc010430 con 0x7f941010a9b0 2024-09-11T01:05:38.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.702+0000 7f9407e00640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f93f40b52e0 0x7f93f40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.702+0000 7f9407e00640 1 -- 172.21.15.103:0/4233112493 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8277+0+0 (secure 0 0 0) 0x7f93fc0e63d0 con 0x7f941010a9b0 2024-09-11T01:05:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.702+0000 7f940f400640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f93f40b52e0 0x7f93f40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:38.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.703+0000 7f940f400640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f93f40b52e0 0x7f93f40b77a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9400009fc0 tx=0x7f9400005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:38.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.704+0000 7f9407e00640 1 -- 172.21.15.103:0/4233112493 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f93fc0acbb0 con 0x7f941010a9b0 2024-09-11T01:05:38.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:38.891+0000 7f9416600640 1 -- 172.21.15.103:0/4233112493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f941019c5d0 con 0x7f941010a9b0 2024-09-11T01:05:39.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:38 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/4233112493' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-11T01:05:39.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:38 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/4233112493' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-11T01:05:39.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:38 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/4233112493' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-11T01:05:39.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:39.946+0000 7f9407e00640 1 -- 172.21.15.103:0/4233112493 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v83) ==== 228+0+0 (secure 0 0 0) 0x7f941019c5d0 con 0x7f941010a9b0 2024-09-11T01:05:39.949 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data_ec' created 2024-09-11T01:05:39.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:39.950+0000 7f9416600640 1 -- 172.21.15.103:0/4233112493 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f93f40b52e0 msgr2=0x7f93f40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:39.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:39.950+0000 7f9416600640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f93f40b52e0 0x7f93f40b77a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9400009fc0 tx=0x7f9400005f90 comp rx=0 tx=0).stop 2024-09-11T01:05:39.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:39.950+0000 7f9416600640 1 -- 172.21.15.103:0/4233112493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941010a9b0 msgr2=0x7f941019b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:39.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:39.950+0000 7f9416600640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941010a9b0 0x7f941019b9e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00e9f0 tx=0x7f93fc00eeb0 comp rx=0 tx=0).stop 2024-09-11T01:05:39.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:39.951+0000 7f9416600640 1 -- 172.21.15.103:0/4233112493 shutdown_connections 2024-09-11T01:05:39.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:39.951+0000 7f9416600640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f93f40b52e0 0x7f93f40b77a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:39.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:39.951+0000 7f9416600640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f941010b330 0x7f94101a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:39.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:39.951+0000 7f9416600640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f941010a9b0 0x7f941019b9e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:39.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:39.951+0000 7f9416600640 1 --2- 172.21.15.103:0/4233112493 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9410104fa0 0x7f941019b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:39.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:39.951+0000 7f9416600640 1 -- 172.21.15.103:0/4233112493 >> 172.21.15.103:0/4233112493 conn(0x7f9410100a50 msgr2=0x7f94101012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:39.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:39.951+0000 7f9416600640 1 -- 172.21.15.103:0/4233112493 shutdown_connections 2024-09-11T01:05:39.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:39.951+0000 7f9416600640 1 -- 172.21.15.103:0/4233112493 wait complete. 2024-09-11T01:05:40.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T01:05:40.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-11T01:05:40.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-11T01:05:40.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-11T01:05:40.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-11T01:05:40.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2024-09-11T01:05:40.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-11T01:05:40.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]} : dispatch 2024-09-11T01:05:40.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-11T01:05:40.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]} : dispatch 2024-09-11T01:05:40.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: pgmap v312: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-11T01:05:40.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/4233112493' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T01:05:40.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-11T01:05:40.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-11T01:05:40.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-11T01:05:40.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-11T01:05:40.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-11T01:05:40.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-11T01:05:40.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2024-09-11T01:05:40.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-11T01:05:40.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-11T01:05:40.334 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:39 smithi103 ceph-mon[30562]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T01:05:40.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T01:05:40.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-11T01:05:40.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-11T01:05:40.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-11T01:05:40.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-11T01:05:40.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2024-09-11T01:05:40.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-11T01:05:40.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]} : dispatch 2024-09-11T01:05:40.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-11T01:05:40.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]} : dispatch 2024-09-11T01:05:40.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: pgmap v312: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-11T01:05:40.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/4233112493' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T01:05:40.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-11T01:05:40.374 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-11T01:05:40.375 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-11T01:05:40.375 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-11T01:05:40.375 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-11T01:05:40.375 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-11T01:05:40.375 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2024-09-11T01:05:40.375 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-11T01:05:40.375 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-11T01:05:40.375 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:39 smithi117 ceph-mon[35358]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T01:05:40.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: osdmap e82: 12 total, 12 up, 12 in 2024-09-11T01:05:40.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]} : dispatch 2024-09-11T01:05:40.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]} : dispatch 2024-09-11T01:05:40.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]} : dispatch 2024-09-11T01:05:40.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-11T01:05:40.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]} : dispatch 2024-09-11T01:05:40.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]} : dispatch 2024-09-11T01:05:40.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]} : dispatch 2024-09-11T01:05:40.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]} : dispatch 2024-09-11T01:05:40.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]} : dispatch 2024-09-11T01:05:40.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: pgmap v312: 97 pgs: 97 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-09-11T01:05:40.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/4233112493' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-11T01:05:40.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-09-11T01:05:40.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-09-11T01:05:40.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-09-11T01:05:40.420 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-11T01:05:40.420 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [4, 8]}]': finished 2024-09-11T01:05:40.420 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.13", "id": [4, 9]}]': finished 2024-09-11T01:05:40.420 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2024-09-11T01:05:40.420 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-09-11T01:05:40.420 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2024-09-11T01:05:40.420 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:39 smithi183 ceph-mon[34992]: osdmap e83: 12 total, 12 up, 12 in 2024-09-11T01:05:40.890 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-11T01:05:41.276 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.886+0000 7ff726e00640 1 -- 172.21.15.103:0/1268803823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff720103cc0 msgr2=0x7ff7201040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.886+0000 7ff726e00640 1 --2- 172.21.15.103:0/1268803823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff720103cc0 0x7ff7201040a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff710009900 tx=0x7ff71002a3f0 comp rx=0 tx=0).stop 2024-09-11T01:05:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.886+0000 7ff726e00640 1 -- 172.21.15.103:0/1268803823 shutdown_connections 2024-09-11T01:05:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.886+0000 7ff726e00640 1 --2- 172.21.15.103:0/1268803823 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff72010d120 0x7ff72010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.886+0000 7ff726e00640 1 --2- 172.21.15.103:0/1268803823 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff7201045e0 0x7ff72010cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.886+0000 7ff726e00640 1 --2- 172.21.15.103:0/1268803823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff720103cc0 0x7ff7201040a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.886+0000 7ff726e00640 1 -- 172.21.15.103:0/1268803823 >> 172.21.15.103:0/1268803823 conn(0x7ff7200fd700 msgr2=0x7ff7200ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.886+0000 7ff726e00640 1 -- 172.21.15.103:0/1268803823 shutdown_connections 2024-09-11T01:05:41.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.886+0000 7ff726e00640 1 -- 172.21.15.103:0/1268803823 wait complete. 2024-09-11T01:05:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.887+0000 7ff726e00640 1 Processor -- start 2024-09-11T01:05:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.887+0000 7ff726e00640 1 -- start start 2024-09-11T01:05:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff726e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff720103cc0 0x7ff72019b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff726e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7201045e0 0x7ff72019ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff726e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72010d120 0x7ff7201a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff726e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff720112d90 con 0x7ff720103cc0 2024-09-11T01:05:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff726e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff720112c10 con 0x7ff72010d120 2024-09-11T01:05:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff726e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff720112f10 con 0x7ff7201045e0 2024-09-11T01:05:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff71fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff720103cc0 0x7ff72019b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff71fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff720103cc0 0x7ff72019b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53148/0 (socket says 172.21.15.103:53148) 2024-09-11T01:05:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff71f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7201045e0 0x7ff72019ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff71fe00640 1 -- 172.21.15.103:0/2461284876 learned_addr learned my addr 172.21.15.103:0/2461284876 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:41.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff724e00640 1 --2- 172.21.15.103:0/2461284876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72010d120 0x7ff7201a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff71fe00640 1 -- 172.21.15.103:0/2461284876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7201045e0 msgr2=0x7ff72019ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff71fe00640 1 --2- 172.21.15.103:0/2461284876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7201045e0 0x7ff72019ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff71fe00640 1 -- 172.21.15.103:0/2461284876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72010d120 msgr2=0x7ff7201a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff71fe00640 1 --2- 172.21.15.103:0/2461284876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72010d120 0x7ff7201a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.888+0000 7ff71fe00640 1 -- 172.21.15.103:0/2461284876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7201a1570 con 0x7ff720103cc0 2024-09-11T01:05:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.889+0000 7ff71fe00640 1 --2- 172.21.15.103:0/2461284876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff720103cc0 0x7ff72019b4c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff710005940 tx=0x7ff7100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.889+0000 7ff71cc00640 1 -- 172.21.15.103:0/2461284876 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71003f030 con 0x7ff720103cc0 2024-09-11T01:05:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.889+0000 7ff71cc00640 1 -- 172.21.15.103:0/2461284876 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff710003cb0 con 0x7ff720103cc0 2024-09-11T01:05:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.889+0000 7ff71cc00640 1 -- 172.21.15.103:0/2461284876 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff710035070 con 0x7ff720103cc0 2024-09-11T01:05:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.889+0000 7ff726e00640 1 -- 172.21.15.103:0/2461284876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7201a1800 con 0x7ff720103cc0 2024-09-11T01:05:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.889+0000 7ff726e00640 1 -- 172.21.15.103:0/2461284876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7201a7f20 con 0x7ff720103cc0 2024-09-11T01:05:41.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.890+0000 7ff726e00640 1 -- 172.21.15.103:0/2461284876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff72006bc10 con 0x7ff720103cc0 2024-09-11T01:05:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.893+0000 7ff71cc00640 1 -- 172.21.15.103:0/2461284876 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7ff71003bb50 con 0x7ff720103cc0 2024-09-11T01:05:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.894+0000 7ff71cc00640 1 --2- 172.21.15.103:0/2461284876 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff7040b52e0 0x7ff7040b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.894+0000 7ff71cc00640 1 -- 172.21.15.103:0/2461284876 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9031+0+0 (secure 0 0 0) 0x7ff710106cb0 con 0x7ff720103cc0 2024-09-11T01:05:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.894+0000 7ff71f400640 1 --2- 172.21.15.103:0/2461284876 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff7040b52e0 0x7ff7040b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.895+0000 7ff71f400640 1 --2- 172.21.15.103:0/2461284876 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff7040b52e0 0x7ff7040b77a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff72010e7d0 tx=0x7ff70c00b2e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:41.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:41.897+0000 7ff71cc00640 1 -- 172.21.15.103:0/2461284876 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff7100cd1a0 con 0x7ff720103cc0 2024-09-11T01:05:42.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:41 smithi103 ceph-mon[30562]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T01:05:42.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:41 smithi103 ceph-mon[30562]: pgmap v315: 129 pgs: 3 creating+peering, 3 peering, 29 unknown, 94 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 7 op/s 2024-09-11T01:05:42.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:42.083+0000 7ff726e00640 1 -- 172.21.15.103:0/2461284876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7ff7201040a0 con 0x7ff720103cc0 2024-09-11T01:05:42.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:41 smithi117 ceph-mon[35358]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T01:05:42.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:41 smithi117 ceph-mon[35358]: pgmap v315: 129 pgs: 3 creating+peering, 3 peering, 29 unknown, 94 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 7 op/s 2024-09-11T01:05:42.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:41 smithi183 ceph-mon[34992]: osdmap e84: 12 total, 12 up, 12 in 2024-09-11T01:05:42.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:41 smithi183 ceph-mon[34992]: pgmap v315: 129 pgs: 3 creating+peering, 3 peering, 29 unknown, 94 active+clean; 579 KiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 7 op/s 2024-09-11T01:05:42.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:42.963+0000 7ff71cc00640 1 -- 172.21.15.103:0/2461284876 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v86) ==== 169+0+0 (secure 0 0 0) 0x7ff7100d1bd0 con 0x7ff720103cc0 2024-09-11T01:05:42.965 INFO:teuthology.orchestra.run.smithi103.stderr:set pool 4 allow_ec_overwrites to true 2024-09-11T01:05:42.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:42.966+0000 7ff726e00640 1 -- 172.21.15.103:0/2461284876 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff7040b52e0 msgr2=0x7ff7040b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:42.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:42.966+0000 7ff726e00640 1 --2- 172.21.15.103:0/2461284876 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff7040b52e0 0x7ff7040b77a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff72010e7d0 tx=0x7ff70c00b2e0 comp rx=0 tx=0).stop 2024-09-11T01:05:42.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:42.966+0000 7ff726e00640 1 -- 172.21.15.103:0/2461284876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff720103cc0 msgr2=0x7ff72019b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:42.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:42.966+0000 7ff726e00640 1 --2- 172.21.15.103:0/2461284876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff720103cc0 0x7ff72019b4c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff710005940 tx=0x7ff7100042f0 comp rx=0 tx=0).stop 2024-09-11T01:05:42.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:42.966+0000 7ff726e00640 1 -- 172.21.15.103:0/2461284876 shutdown_connections 2024-09-11T01:05:42.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:42.966+0000 7ff726e00640 1 --2- 172.21.15.103:0/2461284876 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff7040b52e0 0x7ff7040b77a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:42.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:42.966+0000 7ff726e00640 1 --2- 172.21.15.103:0/2461284876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff72010d120 0x7ff7201a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:42.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:42.966+0000 7ff726e00640 1 --2- 172.21.15.103:0/2461284876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff7201045e0 0x7ff72019ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:42.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:42.966+0000 7ff726e00640 1 --2- 172.21.15.103:0/2461284876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff720103cc0 0x7ff72019b4c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:42.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:42.966+0000 7ff726e00640 1 -- 172.21.15.103:0/2461284876 >> 172.21.15.103:0/2461284876 conn(0x7ff7200fd700 msgr2=0x7ff7200ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:42.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:42.967+0000 7ff726e00640 1 -- 172.21.15.103:0/2461284876 shutdown_connections 2024-09-11T01:05:42.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:42.967+0000 7ff726e00640 1 -- 172.21.15.103:0/2461284876 wait complete. 2024-09-11T01:05:43.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:42 smithi103 ceph-mon[30562]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T01:05:43.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:42 smithi103 ceph-mon[30562]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T01:05:43.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:42 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2461284876' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-11T01:05:43.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:42 smithi117 ceph-mon[35358]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T01:05:43.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:42 smithi117 ceph-mon[35358]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T01:05:43.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:42 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2461284876' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-11T01:05:43.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:42 smithi183 ceph-mon[34992]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-11T01:05:43.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:42 smithi183 ceph-mon[34992]: osdmap e85: 12 total, 12 up, 12 in 2024-09-11T01:05:43.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:42 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2461284876' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-11T01:05:43.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-11T01:05:44.253 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:44.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:43 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2461284876' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T01:05:44.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:43 smithi103 ceph-mon[30562]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T01:05:44.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:43 smithi103 ceph-mon[30562]: pgmap v318: 129 pgs: 3 creating+peering, 3 peering, 9 unknown, 114 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:44.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:43 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2461284876' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T01:05:44.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:43 smithi117 ceph-mon[35358]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T01:05:44.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:43 smithi117 ceph-mon[35358]: pgmap v318: 129 pgs: 3 creating+peering, 3 peering, 9 unknown, 114 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:44.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:43 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2461284876' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-11T01:05:44.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:43 smithi183 ceph-mon[34992]: osdmap e86: 12 total, 12 up, 12 in 2024-09-11T01:05:44.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:43 smithi183 ceph-mon[34992]: pgmap v318: 129 pgs: 3 creating+peering, 3 peering, 9 unknown, 114 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:44.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.836+0000 7f2e53a00640 1 -- 172.21.15.103:0/3323143524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4c1087b0 msgr2=0x7f2e4c108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:44.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.836+0000 7f2e53a00640 1 --2- 172.21.15.103:0/3323143524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4c1087b0 0x7f2e4c108bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009900 tx=0x7f2e3802a410 comp rx=0 tx=0).stop 2024-09-11T01:05:44.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.837+0000 7f2e53a00640 1 -- 172.21.15.103:0/3323143524 shutdown_connections 2024-09-11T01:05:44.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.837+0000 7f2e53a00640 1 --2- 172.21.15.103:0/3323143524 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e4c109130 0x7f2e4c10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:44.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.837+0000 7f2e53a00640 1 --2- 172.21.15.103:0/3323143524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4c1087b0 0x7f2e4c108bf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:44.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.837+0000 7f2e53a00640 1 --2- 172.21.15.103:0/3323143524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e4c102da0 0x7f2e4c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:44.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.837+0000 7f2e53a00640 1 -- 172.21.15.103:0/3323143524 >> 172.21.15.103:0/3323143524 conn(0x7f2e4c0fe810 msgr2=0x7f2e4c100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:44.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.837+0000 7f2e53a00640 1 -- 172.21.15.103:0/3323143524 shutdown_connections 2024-09-11T01:05:44.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.837+0000 7f2e53a00640 1 -- 172.21.15.103:0/3323143524 wait complete. 2024-09-11T01:05:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.838+0000 7f2e53a00640 1 Processor -- start 2024-09-11T01:05:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.838+0000 7f2e53a00640 1 -- start start 2024-09-11T01:05:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.838+0000 7f2e53a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e4c102da0 0x7f2e4c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.838+0000 7f2e53a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e4c1087b0 0x7f2e4c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.838+0000 7f2e53a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4c109130 0x7f2e4c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.838+0000 7f2e53a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4c112e40 con 0x7f2e4c109130 2024-09-11T01:05:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.838+0000 7f2e53a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4c112cc0 con 0x7f2e4c102da0 2024-09-11T01:05:44.871 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.838+0000 7f2e53a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4c112fc0 con 0x7f2e4c1087b0 2024-09-11T01:05:44.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.838+0000 7f2e4be00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e4c1087b0 0x7f2e4c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:44.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.838+0000 7f2e51a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4c109130 0x7f2e4c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:44.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.838+0000 7f2e4be00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e4c1087b0 0x7f2e4c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:42270/0 (socket says 172.21.15.103:42270) 2024-09-11T01:05:44.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.838+0000 7f2e4be00640 1 -- 172.21.15.103:0/3895776082 learned_addr learned my addr 172.21.15.103:0/3895776082 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:44.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.838+0000 7f2e51000640 1 --2- 172.21.15.103:0/3895776082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e4c102da0 0x7f2e4c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:44.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.839+0000 7f2e4be00640 1 -- 172.21.15.103:0/3895776082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e4c102da0 msgr2=0x7f2e4c0754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:44.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.839+0000 7f2e4be00640 1 --2- 172.21.15.103:0/3895776082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e4c102da0 0x7f2e4c0754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:44.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.839+0000 7f2e4be00640 1 -- 172.21.15.103:0/3895776082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4c109130 msgr2=0x7f2e4c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:44.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.839+0000 7f2e4be00640 1 --2- 172.21.15.103:0/3895776082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4c109130 0x7f2e4c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:44.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.839+0000 7f2e4be00640 1 -- 172.21.15.103:0/3895776082 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e4c1a7690 con 0x7f2e4c1087b0 2024-09-11T01:05:44.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.839+0000 7f2e4be00640 1 --2- 172.21.15.103:0/3895776082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e4c1087b0 0x7f2e4c0759e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2e38005ab0 tx=0x7f2e38003cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:44.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.839+0000 7f2e49600640 1 -- 172.21.15.103:0/3895776082 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3803f070 con 0x7f2e4c1087b0 2024-09-11T01:05:44.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.839+0000 7f2e53a00640 1 -- 172.21.15.103:0/3895776082 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e4c1a7920 con 0x7f2e4c1087b0 2024-09-11T01:05:44.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.839+0000 7f2e49600640 1 -- 172.21.15.103:0/3895776082 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e38031d60 con 0x7f2e4c1087b0 2024-09-11T01:05:44.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.839+0000 7f2e49600640 1 -- 172.21.15.103:0/3895776082 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e38035030 con 0x7f2e4c1087b0 2024-09-11T01:05:44.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.840+0000 7f2e53a00640 1 -- 172.21.15.103:0/3895776082 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e4c1a7e00 con 0x7f2e4c1087b0 2024-09-11T01:05:44.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.841+0000 7f2e53a00640 1 -- 172.21.15.103:0/3895776082 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e4c103180 con 0x7f2e4c1087b0 2024-09-11T01:05:44.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.843+0000 7f2e49600640 1 -- 172.21.15.103:0/3895776082 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f2e3803b560 con 0x7f2e4c1087b0 2024-09-11T01:05:44.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.844+0000 7f2e49600640 1 --2- 172.21.15.103:0/3895776082 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2e300b52e0 0x7f2e300b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:44.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.844+0000 7f2e49600640 1 -- 172.21.15.103:0/3895776082 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9031+0+0 (secure 0 0 0) 0x7f2e38106ff0 con 0x7f2e4c1087b0 2024-09-11T01:05:44.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.844+0000 7f2e51000640 1 --2- 172.21.15.103:0/3895776082 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2e300b52e0 0x7f2e300b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:44.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.845+0000 7f2e51000640 1 --2- 172.21.15.103:0/3895776082 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2e300b52e0 0x7f2e300b77a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00bbe0 tx=0x7f2e3c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:44.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:44.846+0000 7f2e49600640 1 -- 172.21.15.103:0/3895776082 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2e380cd4e0 con 0x7f2e4c1087b0 2024-09-11T01:05:45.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:45.067+0000 7f2e53a00640 1 -- 172.21.15.103:0/3895776082 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f2e4c0767a0 con 0x7f2e4c1087b0 2024-09-11T01:05:45.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:45.129+0000 7f2e49600640 1 -- 172.21.15.103:0/3895776082 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f2e380d1f10 con 0x7f2e4c1087b0 2024-09-11T01:05:45.131 INFO:teuthology.orchestra.run.smithi103.stderr:added data pool 4 to fsmap 2024-09-11T01:05:45.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:45.132+0000 7f2e53a00640 1 -- 172.21.15.103:0/3895776082 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2e300b52e0 msgr2=0x7f2e300b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:45.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:45.132+0000 7f2e53a00640 1 --2- 172.21.15.103:0/3895776082 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2e300b52e0 0x7f2e300b77a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2e3c00bbe0 tx=0x7f2e3c00b390 comp rx=0 tx=0).stop 2024-09-11T01:05:45.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:45.132+0000 7f2e53a00640 1 -- 172.21.15.103:0/3895776082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e4c1087b0 msgr2=0x7f2e4c0759e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:45.132+0000 7f2e53a00640 1 --2- 172.21.15.103:0/3895776082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e4c1087b0 0x7f2e4c0759e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2e38005ab0 tx=0x7f2e38003cd0 comp rx=0 tx=0).stop 2024-09-11T01:05:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:45.132+0000 7f2e53a00640 1 -- 172.21.15.103:0/3895776082 shutdown_connections 2024-09-11T01:05:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:45.132+0000 7f2e53a00640 1 --2- 172.21.15.103:0/3895776082 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2e300b52e0 0x7f2e300b77a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:45.132+0000 7f2e53a00640 1 --2- 172.21.15.103:0/3895776082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2e4c109130 0x7f2e4c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:45.132+0000 7f2e53a00640 1 --2- 172.21.15.103:0/3895776082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2e4c1087b0 0x7f2e4c0759e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:45.132+0000 7f2e53a00640 1 --2- 172.21.15.103:0/3895776082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e4c102da0 0x7f2e4c0754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:45.132+0000 7f2e53a00640 1 -- 172.21.15.103:0/3895776082 >> 172.21.15.103:0/3895776082 conn(0x7f2e4c0fe810 msgr2=0x7f2e4c100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:45.132+0000 7f2e53a00640 1 -- 172.21.15.103:0/3895776082 shutdown_connections 2024-09-11T01:05:45.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:45.132+0000 7f2e53a00640 1 -- 172.21.15.103:0/3895776082 wait complete. 2024-09-11T01:05:45.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:45 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3895776082' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-11T01:05:45.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:45 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-11T01:05:45.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:45 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3895776082' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-11T01:05:45.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:45 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-11T01:05:45.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:45 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3895776082' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-11T01:05:45.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:45 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-11T01:05:45.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:05:46.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:46 smithi103 ceph-mon[30562]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T01:05:46.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:46 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T01:05:46.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:46 smithi103 ceph-mon[30562]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:05:46.333 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:46 smithi103 ceph-mon[30562]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 361 B/s, 2 keys/s, 2 objects/s recovering 2024-09-11T01:05:46.349 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:46.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:46 smithi183 ceph-mon[34992]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T01:05:46.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:46 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T01:05:46.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:46 smithi183 ceph-mon[34992]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:05:46.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:46 smithi183 ceph-mon[34992]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 361 B/s, 2 keys/s, 2 objects/s recovering 2024-09-11T01:05:46.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:46 smithi117 ceph-mon[35358]: osdmap e87: 12 total, 12 up, 12 in 2024-09-11T01:05:46.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:46 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-11T01:05:46.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:46 smithi117 ceph-mon[35358]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:05:46.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:46 smithi117 ceph-mon[35358]: pgmap v320: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 361 B/s, 2 keys/s, 2 objects/s recovering 2024-09-11T01:05:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.927+0000 7fb99b800640 1 -- 172.21.15.103:0/2612831082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb99410a9c0 msgr2=0x7fb99410ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.927+0000 7fb99b800640 1 --2- 172.21.15.103:0/2612831082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb99410a9c0 0x7fb99410ae00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb980009900 tx=0x7fb98002a410 comp rx=0 tx=0).stop 2024-09-11T01:05:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.927+0000 7fb99b800640 1 -- 172.21.15.103:0/2612831082 shutdown_connections 2024-09-11T01:05:46.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.927+0000 7fb99b800640 1 --2- 172.21.15.103:0/2612831082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb99410b340 0x7fb994111b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:46.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.927+0000 7fb99b800640 1 --2- 172.21.15.103:0/2612831082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb99410a9c0 0x7fb99410ae00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:46.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.927+0000 7fb99b800640 1 --2- 172.21.15.103:0/2612831082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb994104fb0 0x7fb994105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:46.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.927+0000 7fb99b800640 1 -- 172.21.15.103:0/2612831082 >> 172.21.15.103:0/2612831082 conn(0x7fb994100a20 msgr2=0x7fb994102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:46.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.927+0000 7fb99b800640 1 -- 172.21.15.103:0/2612831082 shutdown_connections 2024-09-11T01:05:46.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.927+0000 7fb99b800640 1 -- 172.21.15.103:0/2612831082 wait complete. 2024-09-11T01:05:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.928+0000 7fb99b800640 1 Processor -- start 2024-09-11T01:05:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.928+0000 7fb99b800640 1 -- start start 2024-09-11T01:05:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb99b800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb994104fb0 0x7fb99419b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb99b800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb99410a9c0 0x7fb99419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb99b800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb99410b340 0x7fb9941a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:46.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb99b800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb994114fb0 con 0x7fb99410a9c0 2024-09-11T01:05:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb99b800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb994114e30 con 0x7fb99410b340 2024-09-11T01:05:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb99b800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb994115130 con 0x7fb994104fb0 2024-09-11T01:05:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb993e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb99410a9c0 0x7fb99419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb998e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb994104fb0 0x7fb99419b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb998e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb994104fb0 0x7fb99419b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:42274/0 (socket says 172.21.15.103:42274) 2024-09-11T01:05:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb998e00640 1 -- 172.21.15.103:0/4129713415 learned_addr learned my addr 172.21.15.103:0/4129713415 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb999800640 1 --2- 172.21.15.103:0/4129713415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb99410b340 0x7fb9941a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb998e00640 1 -- 172.21.15.103:0/4129713415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb99410b340 msgr2=0x7fb9941a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb998e00640 1 --2- 172.21.15.103:0/4129713415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb99410b340 0x7fb9941a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb998e00640 1 -- 172.21.15.103:0/4129713415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb99410a9c0 msgr2=0x7fb99419ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb998e00640 1 --2- 172.21.15.103:0/4129713415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb99410a9c0 0x7fb99419ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb998e00640 1 -- 172.21.15.103:0/4129713415 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9941a1570 con 0x7fb994104fb0 2024-09-11T01:05:46.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.929+0000 7fb999800640 1 --2- 172.21.15.103:0/4129713415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb99410b340 0x7fb9941a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:05:46.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.930+0000 7fb998e00640 1 --2- 172.21.15.103:0/4129713415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb994104fb0 0x7fb99419b4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb98800e9f0 tx=0x7fb98800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:46.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.930+0000 7fb991600640 1 -- 172.21.15.103:0/4129713415 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98800cd80 con 0x7fb994104fb0 2024-09-11T01:05:46.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.930+0000 7fb99b800640 1 -- 172.21.15.103:0/4129713415 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9941a1860 con 0x7fb994104fb0 2024-09-11T01:05:46.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.930+0000 7fb991600640 1 -- 172.21.15.103:0/4129713415 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9880054d0 con 0x7fb994104fb0 2024-09-11T01:05:46.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.930+0000 7fb991600640 1 -- 172.21.15.103:0/4129713415 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988010690 con 0x7fb994104fb0 2024-09-11T01:05:46.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.930+0000 7fb99b800640 1 -- 172.21.15.103:0/4129713415 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9941a7f20 con 0x7fb994104fb0 2024-09-11T01:05:46.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.931+0000 7fb99b800640 1 -- 172.21.15.103:0/4129713415 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb994105390 con 0x7fb994104fb0 2024-09-11T01:05:46.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.933+0000 7fb991600640 1 -- 172.21.15.103:0/4129713415 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fb988004e30 con 0x7fb994104fb0 2024-09-11T01:05:46.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.935+0000 7fb991600640 1 --2- 172.21.15.103:0/4129713415 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb97c0b52e0 0x7fb97c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:46.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.935+0000 7fb991600640 1 -- 172.21.15.103:0/4129713415 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7fb9880e6580 con 0x7fb994104fb0 2024-09-11T01:05:46.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.935+0000 7fb993e00640 1 --2- 172.21.15.103:0/4129713415 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb97c0b52e0 0x7fb97c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:46.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.936+0000 7fb993e00640 1 --2- 172.21.15.103:0/4129713415 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb97c0b52e0 0x7fb97c0b77a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb980005ab0 tx=0x7fb980005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:46.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:46.937+0000 7fb991600640 1 -- 172.21.15.103:0/4129713415 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb988056220 con 0x7fb994104fb0 2024-09-11T01:05:47.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:47.160+0000 7fb99b800640 1 -- 172.21.15.103:0/4129713415 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb99419c5f0 con 0x7fb994104fb0 2024-09-11T01:05:47.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:47.161+0000 7fb991600640 1 -- 172.21.15.103:0/4129713415 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11857 (secure 0 0 0) 0x7fb9880ad100 con 0x7fb994104fb0 2024-09-11T01:05:47.163 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:05:47.164 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":17,"btime":"2024-09-11T01:05:45:120121+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24619,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:05:45.069729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24665},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24665,"qdb_cluster":[24665]},"id":1}]} 2024-09-11T01:05:47.164 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 17 2024-09-11T01:05:47.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:47.163+0000 7fb99b800640 1 -- 172.21.15.103:0/4129713415 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb97c0b52e0 msgr2=0x7fb97c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:47.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:47.163+0000 7fb99b800640 1 --2- 172.21.15.103:0/4129713415 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb97c0b52e0 0x7fb97c0b77a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb980005ab0 tx=0x7fb980005a20 comp rx=0 tx=0).stop 2024-09-11T01:05:47.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:47.163+0000 7fb99b800640 1 -- 172.21.15.103:0/4129713415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb994104fb0 msgr2=0x7fb99419b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:47.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:47.163+0000 7fb99b800640 1 --2- 172.21.15.103:0/4129713415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb994104fb0 0x7fb99419b4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb98800e9f0 tx=0x7fb98800edf0 comp rx=0 tx=0).stop 2024-09-11T01:05:47.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:47.163+0000 7fb99b800640 1 -- 172.21.15.103:0/4129713415 shutdown_connections 2024-09-11T01:05:47.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:47.163+0000 7fb99b800640 1 --2- 172.21.15.103:0/4129713415 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb97c0b52e0 0x7fb97c0b77a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:47.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:47.163+0000 7fb99b800640 1 --2- 172.21.15.103:0/4129713415 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb99410b340 0x7fb9941a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:47.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:47.164+0000 7fb99b800640 1 --2- 172.21.15.103:0/4129713415 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb99410a9c0 0x7fb99419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:47.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:47.164+0000 7fb99b800640 1 --2- 172.21.15.103:0/4129713415 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb994104fb0 0x7fb99419b4c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:47.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:47.164+0000 7fb99b800640 1 -- 172.21.15.103:0/4129713415 >> 172.21.15.103:0/4129713415 conn(0x7fb994100a20 msgr2=0x7fb994102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:47.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:47.164+0000 7fb99b800640 1 -- 172.21.15.103:0/4129713415 shutdown_connections 2024-09-11T01:05:47.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:47.164+0000 7fb99b800640 1 -- 172.21.15.103:0/4129713415 wait complete. 2024-09-11T01:05:47.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:47 smithi183 ceph-mon[34992]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T01:05:47.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:47 smithi183 ceph-mon[34992]: Cluster is now healthy 2024-09-11T01:05:47.559 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:47 smithi103 ceph-mon[30562]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T01:05:47.559 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:47 smithi103 ceph-mon[30562]: Cluster is now healthy 2024-09-11T01:05:47.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:47 smithi117 ceph-mon[35358]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-11T01:05:47.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:47 smithi117 ceph-mon[35358]: Cluster is now healthy 2024-09-11T01:05:48.117 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T01:05:48.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:48 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/4129713415' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:48.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:48 smithi103 ceph-mon[30562]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 274 B/s, 1 keys/s, 1 objects/s recovering 2024-09-11T01:05:48.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:48 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/4129713415' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:48.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:48 smithi183 ceph-mon[34992]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 274 B/s, 1 keys/s, 1 objects/s recovering 2024-09-11T01:05:48.488 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:48.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:48 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/4129713415' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:48.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:48 smithi117 ceph-mon[35358]: pgmap v321: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 274 B/s, 1 keys/s, 1 objects/s recovering 2024-09-11T01:05:49.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.054+0000 7f2033e00640 1 -- 172.21.15.103:0/2609681870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f202c106f70 msgr2=0x7f202c10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:49.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.054+0000 7f2033e00640 1 --2- 172.21.15.103:0/2609681870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f202c106f70 0x7f202c10e820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2024009ca0 tx=0x7f202402a8c0 comp rx=0 tx=0).stop 2024-09-11T01:05:49.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.054+0000 7f2033e00640 1 -- 172.21.15.103:0/2609681870 shutdown_connections 2024-09-11T01:05:49.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.054+0000 7f2033e00640 1 --2- 172.21.15.103:0/2609681870 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f202c106f70 0x7f202c10e820 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:49.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.054+0000 7f2033e00640 1 --2- 172.21.15.103:0/2609681870 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f202c1065f0 0x7f202c106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:49.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.054+0000 7f2033e00640 1 --2- 172.21.15.103:0/2609681870 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f202c1078d0 0x7f202c107cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:49.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.054+0000 7f2033e00640 1 -- 172.21.15.103:0/2609681870 >> 172.21.15.103:0/2609681870 conn(0x7f202c0fca20 msgr2=0x7f202c0fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:49.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.054+0000 7f2033e00640 1 -- 172.21.15.103:0/2609681870 shutdown_connections 2024-09-11T01:05:49.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.054+0000 7f2033e00640 1 -- 172.21.15.103:0/2609681870 wait complete. 2024-09-11T01:05:49.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.056+0000 7f2033e00640 1 Processor -- start 2024-09-11T01:05:49.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.056+0000 7f2033e00640 1 -- start start 2024-09-11T01:05:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.056+0000 7f2033e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f202c1065f0 0x7f202c19b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.056+0000 7f2033e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f202c106f70 0x7f202c19ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.056+0000 7f2033e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f202c1078d0 0x7f202c1a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.057+0000 7f2033e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f202c111ce0 con 0x7f202c106f70 2024-09-11T01:05:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.057+0000 7f2033e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f202c111b60 con 0x7f202c1078d0 2024-09-11T01:05:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.057+0000 7f2033e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f202c111e60 con 0x7f202c1065f0 2024-09-11T01:05:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.057+0000 7f2031400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f202c1065f0 0x7f202c19b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.057+0000 7f2031400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f202c1065f0 0x7f202c19b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:42300/0 (socket says 172.21.15.103:42300) 2024-09-11T01:05:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.057+0000 7f2031400640 1 -- 172.21.15.103:0/1979901000 learned_addr learned my addr 172.21.15.103:0/1979901000 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:49.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.057+0000 7f2030a00640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f202c106f70 0x7f202c19ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:49.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.057+0000 7f2031e00640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f202c1078d0 0x7f202c1a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:49.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.057+0000 7f2031400640 1 -- 172.21.15.103:0/1979901000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f202c1078d0 msgr2=0x7f202c1a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:49.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.057+0000 7f2031400640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f202c1078d0 0x7f202c1a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:49.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.057+0000 7f2031400640 1 -- 172.21.15.103:0/1979901000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f202c106f70 msgr2=0x7f202c19ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:49.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.057+0000 7f2031400640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f202c106f70 0x7f202c19ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:49.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.057+0000 7f2031400640 1 -- 172.21.15.103:0/1979901000 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202c1a15f0 con 0x7f202c1065f0 2024-09-11T01:05:49.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.057+0000 7f2031e00640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f202c1078d0 0x7f202c1a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:05:49.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.058+0000 7f2031400640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f202c1065f0 0x7f202c19b540 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f202000e9f0 tx=0x7f202000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.058+0000 7f202a000640 1 -- 172.21.15.103:0/1979901000 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202000cd80 con 0x7f202c1065f0 2024-09-11T01:05:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.058+0000 7f2033e00640 1 -- 172.21.15.103:0/1979901000 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202c1a18e0 con 0x7f202c1065f0 2024-09-11T01:05:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.058+0000 7f202a000640 1 -- 172.21.15.103:0/1979901000 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20200108e0 con 0x7f202c1065f0 2024-09-11T01:05:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.058+0000 7f202a000640 1 -- 172.21.15.103:0/1979901000 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2020018980 con 0x7f202c1065f0 2024-09-11T01:05:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.058+0000 7f2033e00640 1 -- 172.21.15.103:0/1979901000 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f202c1a8170 con 0x7f202c1065f0 2024-09-11T01:05:49.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.059+0000 7f2033e00640 1 -- 172.21.15.103:0/1979901000 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f202c100e20 con 0x7f202c1065f0 2024-09-11T01:05:49.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.061+0000 7f202a000640 1 -- 172.21.15.103:0/1979901000 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f2020010430 con 0x7f202c1065f0 2024-09-11T01:05:49.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.063+0000 7f202a000640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f20140b52e0 0x7f20140b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:49.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.063+0000 7f202a000640 1 -- 172.21.15.103:0/1979901000 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f20200e66c0 con 0x7f202c1065f0 2024-09-11T01:05:49.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.063+0000 7f2030a00640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f20140b52e0 0x7f20140b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:49.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.064+0000 7f2030a00640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f20140b52e0 0x7f20140b77a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f202c0ffde0 tx=0x7f2018005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:49.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.064+0000 7f202a000640 1 -- 172.21.15.103:0/1979901000 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f20200acb90 con 0x7f202c1065f0 2024-09-11T01:05:49.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.252+0000 7f2033e00640 1 -- 172.21.15.103:0/1979901000 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f202c1a8370 con 0x7f202c1065f0 2024-09-11T01:05:49.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.254+0000 7f202a000640 1 -- 172.21.15.103:0/1979901000 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24796 (secure 0 0 0) 0x7f20200b15c0 con 0x7f202c1065f0 2024-09-11T01:05:49.256 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:05:49.256 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":87,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","created":"2024-09-11T00:56:46.242882+0000","modified":"2024-09-11T01:05:45.069528+0000","last_up_change":"2024-09-11T01:04:34.895368+0000","last_in_change":"2024-09-11T01:04:11.663436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:00:33.745338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T01:05:27.486014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T01:05:29.797513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T01:05:38.956635+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1b3e4222-43fd-4af0-bf97-3ba1000221b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6803","nonce":1867193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6805","nonce":1867193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6809","nonce":1867193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6807","nonce":1867193874}]},"public_addr":"172.21.15.103:6803/1867193874","cluster_addr":"172.21.15.103:6805/1867193874","heartbeat_back_addr":"172.21.15.103:6809/1867193874","heartbeat_front_addr":"172.21.15.103:6807/1867193874","state":["exists","up"]},{"osd":1,"uuid":"9a2b40da-7361-4c4f-a9dc-a769b427a0fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6801","nonce":2629532556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6803","nonce":2629532556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6807","nonce":2629532556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6805","nonce":2629532556}]},"public_addr":"172.21.15.117:6801/2629532556","cluster_addr":"172.21.15.117:6803/2629532556","heartbeat_back_addr":"172.21.15.117:6807/2629532556","heartbeat_front_addr":"172.21.15.117:6805/2629532556","state":["exists","up"]},{"osd":2,"uuid":"5db919c1-90a7-4ba7-acf3-89eeb77ae131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6801","nonce":3208966770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6803","nonce":3208966770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6807","nonce":3208966770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6805","nonce":3208966770}]},"public_addr":"172.21.15.183:6801/3208966770","cluster_addr":"172.21.15.183:6803/3208966770","heartbeat_back_addr":"172.21.15.183:6807/3208966770","heartbeat_front_addr":"172.21.15.183:6805/3208966770","state":["exists","up"]},{"osd":3,"uuid":"bdc465f2-06a5-4667-9651-4e168700d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6811","nonce":2238128162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6813","nonce":2238128162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6817","nonce":2238128162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6815","nonce":2238128162}]},"public_addr":"172.21.15.103:6811/2238128162","cluster_addr":"172.21.15.103:6813/2238128162","heartbeat_back_addr":"172.21.15.103:6817/2238128162","heartbeat_front_addr":"172.21.15.103:6815/2238128162","state":["exists","up"]},{"osd":4,"uuid":"be86a5d2-5e86-4bf4-8464-9dff7a801e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6809","nonce":2368878504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6811","nonce":2368878504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6815","nonce":2368878504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6813","nonce":2368878504}]},"public_addr":"172.21.15.117:6809/2368878504","cluster_addr":"172.21.15.117:6811/2368878504","heartbeat_back_addr":"172.21.15.117:6815/2368878504","heartbeat_front_addr":"172.21.15.117:6813/2368878504","state":["exists","up"]},{"osd":5,"uuid":"090b20ec-d9ff-4e10-ad9f-52ab41dbf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6809","nonce":1668069547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6811","nonce":1668069547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6815","nonce":1668069547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6813","nonce":1668069547}]},"public_addr":"172.21.15.183:6809/1668069547","cluster_addr":"172.21.15.183:6811/1668069547","heartbeat_back_addr":"172.21.15.183:6815/1668069547","heartbeat_front_addr":"172.21.15.183:6813/1668069547","state":["exists","up"]},{"osd":6,"uuid":"19abe982-3522-40f9-a628-ddaef462cdb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6819","nonce":4203476972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6821","nonce":4203476972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6825","nonce":4203476972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6823","nonce":4203476972}]},"public_addr":"172.21.15.103:6819/4203476972","cluster_addr":"172.21.15.103:6821/4203476972","heartbeat_back_addr":"172.21.15.103:6825/4203476972","heartbeat_front_addr":"172.21.15.103:6823/4203476972","state":["exists","up"]},{"osd":7,"uuid":"e875ff09-805a-40ff-9d6a-dd2607ce3432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6817","nonce":1207680713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6819","nonce":1207680713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6823","nonce":1207680713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6821","nonce":1207680713}]},"public_addr":"172.21.15.117:6817/1207680713","cluster_addr":"172.21.15.117:6819/1207680713","heartbeat_back_addr":"172.21.15.117:6823/1207680713","heartbeat_front_addr":"172.21.15.117:6821/1207680713","state":["exists","up"]},{"osd":8,"uuid":"2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6817","nonce":2935820593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6819","nonce":2935820593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6823","nonce":2935820593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6821","nonce":2935820593}]},"public_addr":"172.21.15.183:6817/2935820593","cluster_addr":"172.21.15.183:6819/2935820593","heartbeat_back_addr":"172.21.15.183:6823/2935820593","heartbeat_front_addr":"172.21.15.183:6821/2935820593","state":["exists","up"]},{"osd":9,"uuid":"c36d17d2-0bc8-4322-a998-9c8eff970e58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6827","nonce":2104855877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6829","nonce":2104855877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6833","nonce":2104855877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6831","nonce":2104855877}]},"public_addr":"172.21.15.103:6827/2104855877","cluster_addr":"172.21.15.103:6829/2104855877","heartbeat_back_addr":"172.21.15.103:6833/2104855877","heartbeat_front_addr":"172.21.15.103:6831/2104855877","state":["exists","up"]},{"osd":10,"uuid":"e71bc5f7-a829-43cf-a10b-b2444da1d773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6825","nonce":3792981873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6827","nonce":3792981873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6831","nonce":3792981873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6829","nonce":3792981873}]},"public_addr":"172.21.15.117:6825/3792981873","cluster_addr":"172.21.15.117:6827/3792981873","heartbeat_back_addr":"172.21.15.117:6831/3792981873","heartbeat_front_addr":"172.21.15.117:6829/3792981873","state":["exists","up"]},{"osd":11,"uuid":"8f36697f-4d18-4efa-bf14-d68a13464958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6825","nonce":1250387289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6827","nonce":1250387289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6831","nonce":1250387289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6829","nonce":1250387289}]},"public_addr":"172.21.15.183:6825/1250387289","cluster_addr":"172.21.15.183:6827/1250387289","heartbeat_back_addr":"172.21.15.183:6831/1250387289","heartbeat_front_addr":"172.21.15.183:6829/1250387289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:59:39.916330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:06.042858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:30.703648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:59.493376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:25.190299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:50.480326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:20.815441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:46.398318+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:11.499922+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:41.895096+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:08.411538+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:32.943466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/366890372":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6800/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2372812363":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2844264136":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/2046654364":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6801/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/211510947":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6801/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6800/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/189409602":"2024-09-12T00:57:11.412015+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:05:49.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.257+0000 7f2033e00640 1 -- 172.21.15.103:0/1979901000 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f20140b52e0 msgr2=0x7f20140b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:49.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.257+0000 7f2033e00640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f20140b52e0 0x7f20140b77a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f202c0ffde0 tx=0x7f2018005f90 comp rx=0 tx=0).stop 2024-09-11T01:05:49.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.257+0000 7f2033e00640 1 -- 172.21.15.103:0/1979901000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f202c1065f0 msgr2=0x7f202c19b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:49.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.257+0000 7f2033e00640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f202c1065f0 0x7f202c19b540 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f202000e9f0 tx=0x7f202000eeb0 comp rx=0 tx=0).stop 2024-09-11T01:05:49.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.257+0000 7f2033e00640 1 -- 172.21.15.103:0/1979901000 shutdown_connections 2024-09-11T01:05:49.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.257+0000 7f2033e00640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f20140b52e0 0x7f20140b77a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:49.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.257+0000 7f2033e00640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f202c1078d0 0x7f202c1a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:49.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.257+0000 7f2033e00640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f202c106f70 0x7f202c19ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:49.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.257+0000 7f2033e00640 1 --2- 172.21.15.103:0/1979901000 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f202c1065f0 0x7f202c19b540 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:49.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.257+0000 7f2033e00640 1 -- 172.21.15.103:0/1979901000 >> 172.21.15.103:0/1979901000 conn(0x7f202c0fca20 msgr2=0x7f202c103670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:49.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.257+0000 7f2033e00640 1 -- 172.21.15.103:0/1979901000 shutdown_connections 2024-09-11T01:05:49.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:49.257+0000 7f2033e00640 1 -- 172.21.15.103:0/1979901000 wait complete. 2024-09-11T01:05:49.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:49 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1979901000' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:05:49.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:49 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1979901000' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:05:49.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:49 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1979901000' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:05:50.090 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T01:05:50.459 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:50.581 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:50 smithi103 ceph-mon[30562]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 217 B/s, 1 keys/s, 1 objects/s recovering 2024-09-11T01:05:50.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:50 smithi117 ceph-mon[35358]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 217 B/s, 1 keys/s, 1 objects/s recovering 2024-09-11T01:05:50.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:50 smithi183 ceph-mon[34992]: pgmap v322: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 217 B/s, 1 keys/s, 1 objects/s recovering 2024-09-11T01:05:51.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.079+0000 7fa331800640 1 -- 172.21.15.103:0/199941641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa32c104fa0 msgr2=0x7fa32c105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:51.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.079+0000 7fa331800640 1 --2- 172.21.15.103:0/199941641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa32c104fa0 0x7fa32c105380 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa31c009900 tx=0x7fa31c02a3f0 comp rx=0 tx=0).stop 2024-09-11T01:05:51.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.079+0000 7fa331800640 1 -- 172.21.15.103:0/199941641 shutdown_connections 2024-09-11T01:05:51.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.079+0000 7fa331800640 1 --2- 172.21.15.103:0/199941641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa32c10b330 0x7fa32c111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:51.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.079+0000 7fa331800640 1 --2- 172.21.15.103:0/199941641 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa32c10a9b0 0x7fa32c10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:51.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.079+0000 7fa331800640 1 --2- 172.21.15.103:0/199941641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa32c104fa0 0x7fa32c105380 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:51.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.079+0000 7fa331800640 1 -- 172.21.15.103:0/199941641 >> 172.21.15.103:0/199941641 conn(0x7fa32c100a50 msgr2=0x7fa32c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:51.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.080+0000 7fa331800640 1 -- 172.21.15.103:0/199941641 shutdown_connections 2024-09-11T01:05:51.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.080+0000 7fa331800640 1 -- 172.21.15.103:0/199941641 wait complete. 2024-09-11T01:05:51.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.081+0000 7fa331800640 1 Processor -- start 2024-09-11T01:05:51.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.081+0000 7fa331800640 1 -- start start 2024-09-11T01:05:51.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.081+0000 7fa331800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa32c104fa0 0x7fa32c19b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:51.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.081+0000 7fa331800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa32c10a9b0 0x7fa32c19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:51.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.081+0000 7fa331800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa32c10b330 0x7fa32c1a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:51.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.081+0000 7fa331800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c114f90 con 0x7fa32c104fa0 2024-09-11T01:05:51.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.081+0000 7fa331800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c114e10 con 0x7fa32c10b330 2024-09-11T01:05:51.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.081+0000 7fa331800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c115110 con 0x7fa32c10a9b0 2024-09-11T01:05:51.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.081+0000 7fa32aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa32c104fa0 0x7fa32c19b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:51.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.081+0000 7fa32aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa32c104fa0 0x7fa32c19b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51406/0 (socket says 172.21.15.103:51406) 2024-09-11T01:05:51.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.081+0000 7fa32aa00640 1 -- 172.21.15.103:0/2673916681 learned_addr learned my addr 172.21.15.103:0/2673916681 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:51.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.082+0000 7fa32a000640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa32c10a9b0 0x7fa32c19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:51.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.082+0000 7fa32b400640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa32c10b330 0x7fa32c1a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:51.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.082+0000 7fa32aa00640 1 -- 172.21.15.103:0/2673916681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa32c10a9b0 msgr2=0x7fa32c19b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:51.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.082+0000 7fa32aa00640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa32c10a9b0 0x7fa32c19b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:51.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.082+0000 7fa32aa00640 1 -- 172.21.15.103:0/2673916681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa32c10b330 msgr2=0x7fa32c1a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:51.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.082+0000 7fa32aa00640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa32c10b330 0x7fa32c1a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:51.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.082+0000 7fa32aa00640 1 -- 172.21.15.103:0/2673916681 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32c1a1530 con 0x7fa32c104fa0 2024-09-11T01:05:51.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.082+0000 7fa32b400640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa32c10b330 0x7fa32c1a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:05:51.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.082+0000 7fa32aa00640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa32c104fa0 0x7fa32c19b480 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa31c005ab0 tx=0x7fa31c003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:51.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.082+0000 7fa323400640 1 -- 172.21.15.103:0/2673916681 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c03f070 con 0x7fa32c104fa0 2024-09-11T01:05:51.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.082+0000 7fa323400640 1 -- 172.21.15.103:0/2673916681 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa31c031d60 con 0x7fa32c104fa0 2024-09-11T01:05:51.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.082+0000 7fa323400640 1 -- 172.21.15.103:0/2673916681 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31c035030 con 0x7fa32c104fa0 2024-09-11T01:05:51.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.083+0000 7fa331800640 1 -- 172.21.15.103:0/2673916681 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32c1a17c0 con 0x7fa32c104fa0 2024-09-11T01:05:51.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.083+0000 7fa331800640 1 -- 172.21.15.103:0/2673916681 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa32c1a7ee0 con 0x7fa32c104fa0 2024-09-11T01:05:51.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.084+0000 7fa331800640 1 -- 172.21.15.103:0/2673916681 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa32c105380 con 0x7fa32c104fa0 2024-09-11T01:05:51.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.086+0000 7fa323400640 1 -- 172.21.15.103:0/2673916681 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fa31c03b560 con 0x7fa32c104fa0 2024-09-11T01:05:51.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.088+0000 7fa323400640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3100b52e0 0x7fa3100b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:51.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.088+0000 7fa32a000640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3100b52e0 0x7fa3100b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:51.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.088+0000 7fa323400640 1 -- 172.21.15.103:0/2673916681 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7fa31c106bc0 con 0x7fa32c104fa0 2024-09-11T01:05:51.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.089+0000 7fa32a000640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3100b52e0 0x7fa3100b77a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa32c10a150 tx=0x7fa31800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:51.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.092+0000 7fa323400640 1 -- 172.21.15.103:0/2673916681 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa31c0cd6e0 con 0x7fa32c104fa0 2024-09-11T01:05:51.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.280+0000 7fa331800640 1 -- 172.21.15.103:0/2673916681 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa32c02e5c0 con 0x7fa32c104fa0 2024-09-11T01:05:51.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.282+0000 7fa323400640 1 -- 172.21.15.103:0/2673916681 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24796 (secure 0 0 0) 0x7fa31c0ccfe0 con 0x7fa32c104fa0 2024-09-11T01:05:51.284 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:05:51.284 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":87,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","created":"2024-09-11T00:56:46.242882+0000","modified":"2024-09-11T01:05:45.069528+0000","last_up_change":"2024-09-11T01:04:34.895368+0000","last_in_change":"2024-09-11T01:04:11.663436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:00:33.745338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T01:05:27.486014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T01:05:29.797513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T01:05:38.956635+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1b3e4222-43fd-4af0-bf97-3ba1000221b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6803","nonce":1867193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6805","nonce":1867193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6809","nonce":1867193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6807","nonce":1867193874}]},"public_addr":"172.21.15.103:6803/1867193874","cluster_addr":"172.21.15.103:6805/1867193874","heartbeat_back_addr":"172.21.15.103:6809/1867193874","heartbeat_front_addr":"172.21.15.103:6807/1867193874","state":["exists","up"]},{"osd":1,"uuid":"9a2b40da-7361-4c4f-a9dc-a769b427a0fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6801","nonce":2629532556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6803","nonce":2629532556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6807","nonce":2629532556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6805","nonce":2629532556}]},"public_addr":"172.21.15.117:6801/2629532556","cluster_addr":"172.21.15.117:6803/2629532556","heartbeat_back_addr":"172.21.15.117:6807/2629532556","heartbeat_front_addr":"172.21.15.117:6805/2629532556","state":["exists","up"]},{"osd":2,"uuid":"5db919c1-90a7-4ba7-acf3-89eeb77ae131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6801","nonce":3208966770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6803","nonce":3208966770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6807","nonce":3208966770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6805","nonce":3208966770}]},"public_addr":"172.21.15.183:6801/3208966770","cluster_addr":"172.21.15.183:6803/3208966770","heartbeat_back_addr":"172.21.15.183:6807/3208966770","heartbeat_front_addr":"172.21.15.183:6805/3208966770","state":["exists","up"]},{"osd":3,"uuid":"bdc465f2-06a5-4667-9651-4e168700d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6811","nonce":2238128162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6813","nonce":2238128162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6817","nonce":2238128162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6815","nonce":2238128162}]},"public_addr":"172.21.15.103:6811/2238128162","cluster_addr":"172.21.15.103:6813/2238128162","heartbeat_back_addr":"172.21.15.103:6817/2238128162","heartbeat_front_addr":"172.21.15.103:6815/2238128162","state":["exists","up"]},{"osd":4,"uuid":"be86a5d2-5e86-4bf4-8464-9dff7a801e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6809","nonce":2368878504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6811","nonce":2368878504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6815","nonce":2368878504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6813","nonce":2368878504}]},"public_addr":"172.21.15.117:6809/2368878504","cluster_addr":"172.21.15.117:6811/2368878504","heartbeat_back_addr":"172.21.15.117:6815/2368878504","heartbeat_front_addr":"172.21.15.117:6813/2368878504","state":["exists","up"]},{"osd":5,"uuid":"090b20ec-d9ff-4e10-ad9f-52ab41dbf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6809","nonce":1668069547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6811","nonce":1668069547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6815","nonce":1668069547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6813","nonce":1668069547}]},"public_addr":"172.21.15.183:6809/1668069547","cluster_addr":"172.21.15.183:6811/1668069547","heartbeat_back_addr":"172.21.15.183:6815/1668069547","heartbeat_front_addr":"172.21.15.183:6813/1668069547","state":["exists","up"]},{"osd":6,"uuid":"19abe982-3522-40f9-a628-ddaef462cdb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6819","nonce":4203476972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6821","nonce":4203476972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6825","nonce":4203476972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6823","nonce":4203476972}]},"public_addr":"172.21.15.103:6819/4203476972","cluster_addr":"172.21.15.103:6821/4203476972","heartbeat_back_addr":"172.21.15.103:6825/4203476972","heartbeat_front_addr":"172.21.15.103:6823/4203476972","state":["exists","up"]},{"osd":7,"uuid":"e875ff09-805a-40ff-9d6a-dd2607ce3432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6817","nonce":1207680713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6819","nonce":1207680713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6823","nonce":1207680713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6821","nonce":1207680713}]},"public_addr":"172.21.15.117:6817/1207680713","cluster_addr":"172.21.15.117:6819/1207680713","heartbeat_back_addr":"172.21.15.117:6823/1207680713","heartbeat_front_addr":"172.21.15.117:6821/1207680713","state":["exists","up"]},{"osd":8,"uuid":"2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6817","nonce":2935820593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6819","nonce":2935820593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6823","nonce":2935820593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6821","nonce":2935820593}]},"public_addr":"172.21.15.183:6817/2935820593","cluster_addr":"172.21.15.183:6819/2935820593","heartbeat_back_addr":"172.21.15.183:6823/2935820593","heartbeat_front_addr":"172.21.15.183:6821/2935820593","state":["exists","up"]},{"osd":9,"uuid":"c36d17d2-0bc8-4322-a998-9c8eff970e58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6827","nonce":2104855877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6829","nonce":2104855877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6833","nonce":2104855877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6831","nonce":2104855877}]},"public_addr":"172.21.15.103:6827/2104855877","cluster_addr":"172.21.15.103:6829/2104855877","heartbeat_back_addr":"172.21.15.103:6833/2104855877","heartbeat_front_addr":"172.21.15.103:6831/2104855877","state":["exists","up"]},{"osd":10,"uuid":"e71bc5f7-a829-43cf-a10b-b2444da1d773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6825","nonce":3792981873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6827","nonce":3792981873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6831","nonce":3792981873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6829","nonce":3792981873}]},"public_addr":"172.21.15.117:6825/3792981873","cluster_addr":"172.21.15.117:6827/3792981873","heartbeat_back_addr":"172.21.15.117:6831/3792981873","heartbeat_front_addr":"172.21.15.117:6829/3792981873","state":["exists","up"]},{"osd":11,"uuid":"8f36697f-4d18-4efa-bf14-d68a13464958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6825","nonce":1250387289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6827","nonce":1250387289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6831","nonce":1250387289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6829","nonce":1250387289}]},"public_addr":"172.21.15.183:6825/1250387289","cluster_addr":"172.21.15.183:6827/1250387289","heartbeat_back_addr":"172.21.15.183:6831/1250387289","heartbeat_front_addr":"172.21.15.183:6829/1250387289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:59:39.916330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:06.042858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:30.703648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:59.493376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:25.190299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:50.480326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:20.815441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:46.398318+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:11.499922+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:41.895096+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:08.411538+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:32.943466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/366890372":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6800/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2372812363":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2844264136":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/2046654364":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6801/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/211510947":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6801/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6800/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/189409602":"2024-09-12T00:57:11.412015+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:05:51.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.284+0000 7fa331800640 1 -- 172.21.15.103:0/2673916681 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3100b52e0 msgr2=0x7fa3100b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:51.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.284+0000 7fa331800640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3100b52e0 0x7fa3100b77a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa32c10a150 tx=0x7fa31800b410 comp rx=0 tx=0).stop 2024-09-11T01:05:51.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.284+0000 7fa331800640 1 -- 172.21.15.103:0/2673916681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa32c104fa0 msgr2=0x7fa32c19b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:51.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.284+0000 7fa331800640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa32c104fa0 0x7fa32c19b480 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa31c005ab0 tx=0x7fa31c003cd0 comp rx=0 tx=0).stop 2024-09-11T01:05:51.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.284+0000 7fa331800640 1 -- 172.21.15.103:0/2673916681 shutdown_connections 2024-09-11T01:05:51.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.284+0000 7fa331800640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3100b52e0 0x7fa3100b77a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:51.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.284+0000 7fa331800640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa32c10b330 0x7fa32c1a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:51.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.284+0000 7fa331800640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa32c10a9b0 0x7fa32c19b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:51.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.284+0000 7fa331800640 1 --2- 172.21.15.103:0/2673916681 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa32c104fa0 0x7fa32c19b480 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:51.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.284+0000 7fa331800640 1 -- 172.21.15.103:0/2673916681 >> 172.21.15.103:0/2673916681 conn(0x7fa32c100a50 msgr2=0x7fa32c101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:51.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.285+0000 7fa331800640 1 -- 172.21.15.103:0/2673916681 shutdown_connections 2024-09-11T01:05:51.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:51.285+0000 7fa331800640 1 -- 172.21.15.103:0/2673916681 wait complete. 2024-09-11T01:05:51.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:51 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2673916681' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:05:51.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:51 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2673916681' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:05:51.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:51 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2673916681' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:05:52.221 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:05:52.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:52 smithi103 ceph-mon[30562]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 192 B/s, 1 keys/s, 1 objects/s recovering 2024-09-11T01:05:52.592 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:52.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:52 smithi117 ceph-mon[35358]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 192 B/s, 1 keys/s, 1 objects/s recovering 2024-09-11T01:05:52.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:52 smithi183 ceph-mon[34992]: pgmap v323: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 192 B/s, 1 keys/s, 1 objects/s recovering 2024-09-11T01:05:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.182+0000 7f63ebe00640 1 -- 172.21.15.103:0/1678032576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63ec108620 msgr2=0x7f63ec108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.182+0000 7f63ebe00640 1 --2- 172.21.15.103:0/1678032576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63ec108620 0x7f63ec108a60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f63d4009900 tx=0x7f63d402a410 comp rx=0 tx=0).stop 2024-09-11T01:05:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.182+0000 7f63ebe00640 1 -- 172.21.15.103:0/1678032576 shutdown_connections 2024-09-11T01:05:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.182+0000 7f63ebe00640 1 --2- 172.21.15.103:0/1678032576 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63ec108fa0 0x7f63ec10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.182+0000 7f63ebe00640 1 --2- 172.21.15.103:0/1678032576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63ec108620 0x7f63ec108a60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.182+0000 7f63ebe00640 1 --2- 172.21.15.103:0/1678032576 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63ec102c10 0x7f63ec102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.182+0000 7f63ebe00640 1 -- 172.21.15.103:0/1678032576 >> 172.21.15.103:0/1678032576 conn(0x7f63ec0fe660 msgr2=0x7f63ec100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.182+0000 7f63ebe00640 1 -- 172.21.15.103:0/1678032576 shutdown_connections 2024-09-11T01:05:53.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.182+0000 7f63ebe00640 1 -- 172.21.15.103:0/1678032576 wait complete. 2024-09-11T01:05:53.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.183+0000 7f63ebe00640 1 Processor -- start 2024-09-11T01:05:53.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.183+0000 7f63ebe00640 1 -- start start 2024-09-11T01:05:53.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63ebe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63ec102c10 0x7f63ec19b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:53.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63ebe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63ec108620 0x7f63ec19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:53.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63ebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63ec108fa0 0x7f63ec1a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:53.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63ebe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec112c30 con 0x7f63ec108fa0 2024-09-11T01:05:53.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63ebe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec112ab0 con 0x7f63ec102c10 2024-09-11T01:05:53.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63ebe00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec112db0 con 0x7f63ec108620 2024-09-11T01:05:53.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63eb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63ec108fa0 0x7f63ec1a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:53.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63eaa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63ec102c10 0x7f63ec19b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:53.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63eb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63ec108fa0 0x7f63ec1a0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51418/0 (socket says 172.21.15.103:51418) 2024-09-11T01:05:53.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63eb400640 1 -- 172.21.15.103:0/3168555261 learned_addr learned my addr 172.21.15.103:0/3168555261 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:53.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63dbe00640 1 --2- 172.21.15.103:0/3168555261 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63ec108620 0x7f63ec19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63eb400640 1 -- 172.21.15.103:0/3168555261 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63ec108620 msgr2=0x7f63ec19b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63eb400640 1 --2- 172.21.15.103:0/3168555261 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63ec108620 0x7f63ec19b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63eb400640 1 -- 172.21.15.103:0/3168555261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63ec102c10 msgr2=0x7f63ec19b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63eb400640 1 --2- 172.21.15.103:0/3168555261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63ec102c10 0x7f63ec19b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.184+0000 7f63eb400640 1 -- 172.21.15.103:0/3168555261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ec1a1370 con 0x7f63ec108fa0 2024-09-11T01:05:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.185+0000 7f63eb400640 1 --2- 172.21.15.103:0/3168555261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63ec108fa0 0x7f63ec1a0ba0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f63e400e970 tx=0x7f63e400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.185+0000 7f63e3e00640 1 -- 172.21.15.103:0/3168555261 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e400ccc0 con 0x7f63ec108fa0 2024-09-11T01:05:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.185+0000 7f63e3e00640 1 -- 172.21.15.103:0/3168555261 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f63e400ce60 con 0x7f63ec108fa0 2024-09-11T01:05:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.185+0000 7f63ebe00640 1 -- 172.21.15.103:0/3168555261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ec1a1660 con 0x7f63ec108fa0 2024-09-11T01:05:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.185+0000 7f63e3e00640 1 -- 172.21.15.103:0/3168555261 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4010430 con 0x7f63ec108fa0 2024-09-11T01:05:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.185+0000 7f63ebe00640 1 -- 172.21.15.103:0/3168555261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ec1a7d20 con 0x7f63ec108fa0 2024-09-11T01:05:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.186+0000 7f63ebe00640 1 -- 172.21.15.103:0/3168555261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63ec102ff0 con 0x7f63ec108fa0 2024-09-11T01:05:53.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.188+0000 7f63e3e00640 1 -- 172.21.15.103:0/3168555261 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f63e4004f90 con 0x7f63ec108fa0 2024-09-11T01:05:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.190+0000 7f63e3e00640 1 --2- 172.21.15.103:0/3168555261 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f63cc0b5390 0x7f63cc0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.191+0000 7f63e3e00640 1 -- 172.21.15.103:0/3168555261 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f63e40e6350 con 0x7f63ec108fa0 2024-09-11T01:05:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.191+0000 7f63eaa00640 1 --2- 172.21.15.103:0/3168555261 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f63cc0b5390 0x7f63cc0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:53.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.191+0000 7f63eaa00640 1 --2- 172.21.15.103:0/3168555261 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f63cc0b5390 0x7f63cc0b7850 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f63dc005fd0 tx=0x7f63dc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:53.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.195+0000 7f63e3e00640 1 -- 172.21.15.103:0/3168555261 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f63e40ace70 con 0x7f63ec108fa0 2024-09-11T01:05:53.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.415+0000 7f63ebe00640 1 -- 172.21.15.103:0/3168555261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63ec19c3f0 con 0x7f63ec108fa0 2024-09-11T01:05:53.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.416+0000 7f63e3e00640 1 -- 172.21.15.103:0/3168555261 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11857 (secure 0 0 0) 0x7f63e40ac770 con 0x7f63ec108fa0 2024-09-11T01:05:53.418 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:05:53.418 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":17,"btime":"2024-09-11T01:05:45:120121+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24595,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24602,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24607,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24619,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:05:45.069729+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24665},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24665,"qdb_cluster":[24665]},"id":1}]} 2024-09-11T01:05:53.418 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 17 2024-09-11T01:05:53.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.418+0000 7f63ebe00640 1 -- 172.21.15.103:0/3168555261 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f63cc0b5390 msgr2=0x7f63cc0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:53.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.418+0000 7f63ebe00640 1 --2- 172.21.15.103:0/3168555261 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f63cc0b5390 0x7f63cc0b7850 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f63dc005fd0 tx=0x7f63dc009500 comp rx=0 tx=0).stop 2024-09-11T01:05:53.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.418+0000 7f63ebe00640 1 -- 172.21.15.103:0/3168555261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63ec108fa0 msgr2=0x7f63ec1a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:53.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.418+0000 7f63ebe00640 1 --2- 172.21.15.103:0/3168555261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63ec108fa0 0x7f63ec1a0ba0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f63e400e970 tx=0x7f63e400ed70 comp rx=0 tx=0).stop 2024-09-11T01:05:53.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.418+0000 7f63ebe00640 1 -- 172.21.15.103:0/3168555261 shutdown_connections 2024-09-11T01:05:53.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.418+0000 7f63ebe00640 1 --2- 172.21.15.103:0/3168555261 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f63cc0b5390 0x7f63cc0b7850 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:53.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.418+0000 7f63ebe00640 1 --2- 172.21.15.103:0/3168555261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f63ec108fa0 0x7f63ec1a0ba0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:53.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.418+0000 7f63ebe00640 1 --2- 172.21.15.103:0/3168555261 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f63ec108620 0x7f63ec19b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:53.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.418+0000 7f63ebe00640 1 --2- 172.21.15.103:0/3168555261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f63ec102c10 0x7f63ec19b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:53.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.418+0000 7f63ebe00640 1 -- 172.21.15.103:0/3168555261 >> 172.21.15.103:0/3168555261 conn(0x7f63ec0fe660 msgr2=0x7f63ec105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:53.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.419+0000 7f63ebe00640 1 -- 172.21.15.103:0/3168555261 shutdown_connections 2024-09-11T01:05:53.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:53.419+0000 7f63ebe00640 1 -- 172.21.15.103:0/3168555261 wait complete. 2024-09-11T01:05:53.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:53 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3168555261' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:53.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:53 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3168555261' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:53.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:53 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3168555261' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:05:54.294 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T01:05:54.581 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:54 smithi103 ceph-mon[30562]: pgmap v324: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 164 B/s, 0 keys/s, 0 objects/s recovering 2024-09-11T01:05:54.667 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:54.820 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:54 smithi183 ceph-mon[34992]: pgmap v324: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 164 B/s, 0 keys/s, 0 objects/s recovering 2024-09-11T01:05:54.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:54 smithi117 ceph-mon[35358]: pgmap v324: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 164 B/s, 0 keys/s, 0 objects/s recovering 2024-09-11T01:05:55.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.241+0000 7f9858c00640 1 -- 172.21.15.103:0/2409233377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f985410b350 msgr2=0x7f9854111b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:55.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.241+0000 7f9858c00640 1 --2- 172.21.15.103:0/2409233377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f985410b350 0x7f9854111b50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f984c009ca0 tx=0x7f984c02a8c0 comp rx=0 tx=0).stop 2024-09-11T01:05:55.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.241+0000 7f9858c00640 1 -- 172.21.15.103:0/2409233377 shutdown_connections 2024-09-11T01:05:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.241+0000 7f9858c00640 1 --2- 172.21.15.103:0/2409233377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f985410b350 0x7f9854111b50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.241+0000 7f9858c00640 1 --2- 172.21.15.103:0/2409233377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f985410a9d0 0x7f985410ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.241+0000 7f9858c00640 1 --2- 172.21.15.103:0/2409233377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9854104fc0 0x7f98541053a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.241+0000 7f9858c00640 1 -- 172.21.15.103:0/2409233377 >> 172.21.15.103:0/2409233377 conn(0x7f98541009f0 msgr2=0x7f9854102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.241+0000 7f9858c00640 1 -- 172.21.15.103:0/2409233377 shutdown_connections 2024-09-11T01:05:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.241+0000 7f9858c00640 1 -- 172.21.15.103:0/2409233377 wait complete. 2024-09-11T01:05:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.242+0000 7f9858c00640 1 Processor -- start 2024-09-11T01:05:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.243+0000 7f9858c00640 1 -- start start 2024-09-11T01:05:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.243+0000 7f9858c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9854104fc0 0x7f985419b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.243+0000 7f9858c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f985410a9d0 0x7f985419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.243+0000 7f9858c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f985410b350 0x7f98541a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:55.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.243+0000 7f9858c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9854114fd0 con 0x7f985410a9d0 2024-09-11T01:05:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.243+0000 7f9858c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9854114e50 con 0x7f985410b350 2024-09-11T01:05:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.243+0000 7f9858c00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9854115150 con 0x7f9854104fc0 2024-09-11T01:05:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.243+0000 7f9851400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f985410a9d0 0x7f985419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.243+0000 7f9851400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f985410a9d0 0x7f985419ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51438/0 (socket says 172.21.15.103:51438) 2024-09-11T01:05:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.243+0000 7f9851400640 1 -- 172.21.15.103:0/3115916140 learned_addr learned my addr 172.21.15.103:0/3115916140 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.243+0000 7f9851e00640 1 --2- 172.21.15.103:0/3115916140 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9854104fc0 0x7f985419b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.243+0000 7f9852800640 1 --2- 172.21.15.103:0/3115916140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f985410b350 0x7f98541a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.244+0000 7f9851400640 1 -- 172.21.15.103:0/3115916140 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9854104fc0 msgr2=0x7f985419b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.244+0000 7f9851400640 1 --2- 172.21.15.103:0/3115916140 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9854104fc0 0x7f985419b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.244+0000 7f9851400640 1 -- 172.21.15.103:0/3115916140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f985410b350 msgr2=0x7f98541a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.244+0000 7f9851400640 1 --2- 172.21.15.103:0/3115916140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f985410b350 0x7f98541a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.244+0000 7f9851400640 1 -- 172.21.15.103:0/3115916140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98541a1570 con 0x7f985410a9d0 2024-09-11T01:05:55.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.244+0000 7f9851400640 1 --2- 172.21.15.103:0/3115916140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f985410a9d0 0x7f985419ba00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f984000e9f0 tx=0x7f984000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.244+0000 7f984aa00640 1 -- 172.21.15.103:0/3115916140 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984000cd80 con 0x7f985410a9d0 2024-09-11T01:05:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.244+0000 7f9858c00640 1 -- 172.21.15.103:0/3115916140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98541a1860 con 0x7f985410a9d0 2024-09-11T01:05:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.244+0000 7f984aa00640 1 -- 172.21.15.103:0/3115916140 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98400054d0 con 0x7f985410a9d0 2024-09-11T01:05:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.244+0000 7f984aa00640 1 -- 172.21.15.103:0/3115916140 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9840010690 con 0x7f985410a9d0 2024-09-11T01:05:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.245+0000 7f9858c00640 1 -- 172.21.15.103:0/3115916140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98541a7f20 con 0x7f985410a9d0 2024-09-11T01:05:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.245+0000 7f9858c00640 1 -- 172.21.15.103:0/3115916140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98541053a0 con 0x7f985410a9d0 2024-09-11T01:05:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.248+0000 7f984aa00640 1 -- 172.21.15.103:0/3115916140 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f9840004e30 con 0x7f985410a9d0 2024-09-11T01:05:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.249+0000 7f984aa00640 1 --2- 172.21.15.103:0/3115916140 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f98380b52e0 0x7f98380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.249+0000 7f984aa00640 1 -- 172.21.15.103:0/3115916140 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f98400e6550 con 0x7f985410a9d0 2024-09-11T01:05:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.249+0000 7f9851e00640 1 --2- 172.21.15.103:0/3115916140 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f98380b52e0 0x7f98380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.250+0000 7f9851e00640 1 --2- 172.21.15.103:0/3115916140 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f98380b52e0 0x7f98380b77a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f98440095f0 tx=0x7f9844005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:55.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.251+0000 7f984aa00640 1 -- 172.21.15.103:0/3115916140 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f98400ad070 con 0x7f985410a9d0 2024-09-11T01:05:55.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.436+0000 7f9858c00640 1 -- 172.21.15.103:0/3115916140 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f985419c5f0 con 0x7f985410a9d0 2024-09-11T01:05:55.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.438+0000 7f984aa00640 1 -- 172.21.15.103:0/3115916140 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24796 (secure 0 0 0) 0x7f985419c5f0 con 0x7f985410a9d0 2024-09-11T01:05:55.440 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:05:55.440 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":87,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","created":"2024-09-11T00:56:46.242882+0000","modified":"2024-09-11T01:05:45.069528+0000","last_up_change":"2024-09-11T01:04:34.895368+0000","last_in_change":"2024-09-11T01:04:11.663436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:00:33.745338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T01:05:27.486014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T01:05:29.797513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T01:05:38.956635+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1b3e4222-43fd-4af0-bf97-3ba1000221b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6803","nonce":1867193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6805","nonce":1867193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6809","nonce":1867193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6807","nonce":1867193874}]},"public_addr":"172.21.15.103:6803/1867193874","cluster_addr":"172.21.15.103:6805/1867193874","heartbeat_back_addr":"172.21.15.103:6809/1867193874","heartbeat_front_addr":"172.21.15.103:6807/1867193874","state":["exists","up"]},{"osd":1,"uuid":"9a2b40da-7361-4c4f-a9dc-a769b427a0fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6801","nonce":2629532556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6803","nonce":2629532556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6807","nonce":2629532556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6805","nonce":2629532556}]},"public_addr":"172.21.15.117:6801/2629532556","cluster_addr":"172.21.15.117:6803/2629532556","heartbeat_back_addr":"172.21.15.117:6807/2629532556","heartbeat_front_addr":"172.21.15.117:6805/2629532556","state":["exists","up"]},{"osd":2,"uuid":"5db919c1-90a7-4ba7-acf3-89eeb77ae131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6801","nonce":3208966770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6803","nonce":3208966770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6807","nonce":3208966770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6805","nonce":3208966770}]},"public_addr":"172.21.15.183:6801/3208966770","cluster_addr":"172.21.15.183:6803/3208966770","heartbeat_back_addr":"172.21.15.183:6807/3208966770","heartbeat_front_addr":"172.21.15.183:6805/3208966770","state":["exists","up"]},{"osd":3,"uuid":"bdc465f2-06a5-4667-9651-4e168700d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6811","nonce":2238128162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6813","nonce":2238128162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6817","nonce":2238128162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6815","nonce":2238128162}]},"public_addr":"172.21.15.103:6811/2238128162","cluster_addr":"172.21.15.103:6813/2238128162","heartbeat_back_addr":"172.21.15.103:6817/2238128162","heartbeat_front_addr":"172.21.15.103:6815/2238128162","state":["exists","up"]},{"osd":4,"uuid":"be86a5d2-5e86-4bf4-8464-9dff7a801e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6809","nonce":2368878504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6811","nonce":2368878504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6815","nonce":2368878504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6813","nonce":2368878504}]},"public_addr":"172.21.15.117:6809/2368878504","cluster_addr":"172.21.15.117:6811/2368878504","heartbeat_back_addr":"172.21.15.117:6815/2368878504","heartbeat_front_addr":"172.21.15.117:6813/2368878504","state":["exists","up"]},{"osd":5,"uuid":"090b20ec-d9ff-4e10-ad9f-52ab41dbf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6809","nonce":1668069547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6811","nonce":1668069547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6815","nonce":1668069547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6813","nonce":1668069547}]},"public_addr":"172.21.15.183:6809/1668069547","cluster_addr":"172.21.15.183:6811/1668069547","heartbeat_back_addr":"172.21.15.183:6815/1668069547","heartbeat_front_addr":"172.21.15.183:6813/1668069547","state":["exists","up"]},{"osd":6,"uuid":"19abe982-3522-40f9-a628-ddaef462cdb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6819","nonce":4203476972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6821","nonce":4203476972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6825","nonce":4203476972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6823","nonce":4203476972}]},"public_addr":"172.21.15.103:6819/4203476972","cluster_addr":"172.21.15.103:6821/4203476972","heartbeat_back_addr":"172.21.15.103:6825/4203476972","heartbeat_front_addr":"172.21.15.103:6823/4203476972","state":["exists","up"]},{"osd":7,"uuid":"e875ff09-805a-40ff-9d6a-dd2607ce3432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6817","nonce":1207680713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6819","nonce":1207680713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6823","nonce":1207680713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6821","nonce":1207680713}]},"public_addr":"172.21.15.117:6817/1207680713","cluster_addr":"172.21.15.117:6819/1207680713","heartbeat_back_addr":"172.21.15.117:6823/1207680713","heartbeat_front_addr":"172.21.15.117:6821/1207680713","state":["exists","up"]},{"osd":8,"uuid":"2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6817","nonce":2935820593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6819","nonce":2935820593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6823","nonce":2935820593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6821","nonce":2935820593}]},"public_addr":"172.21.15.183:6817/2935820593","cluster_addr":"172.21.15.183:6819/2935820593","heartbeat_back_addr":"172.21.15.183:6823/2935820593","heartbeat_front_addr":"172.21.15.183:6821/2935820593","state":["exists","up"]},{"osd":9,"uuid":"c36d17d2-0bc8-4322-a998-9c8eff970e58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6827","nonce":2104855877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6829","nonce":2104855877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6833","nonce":2104855877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6831","nonce":2104855877}]},"public_addr":"172.21.15.103:6827/2104855877","cluster_addr":"172.21.15.103:6829/2104855877","heartbeat_back_addr":"172.21.15.103:6833/2104855877","heartbeat_front_addr":"172.21.15.103:6831/2104855877","state":["exists","up"]},{"osd":10,"uuid":"e71bc5f7-a829-43cf-a10b-b2444da1d773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6825","nonce":3792981873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6827","nonce":3792981873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6831","nonce":3792981873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6829","nonce":3792981873}]},"public_addr":"172.21.15.117:6825/3792981873","cluster_addr":"172.21.15.117:6827/3792981873","heartbeat_back_addr":"172.21.15.117:6831/3792981873","heartbeat_front_addr":"172.21.15.117:6829/3792981873","state":["exists","up"]},{"osd":11,"uuid":"8f36697f-4d18-4efa-bf14-d68a13464958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6825","nonce":1250387289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6827","nonce":1250387289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6831","nonce":1250387289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6829","nonce":1250387289}]},"public_addr":"172.21.15.183:6825/1250387289","cluster_addr":"172.21.15.183:6827/1250387289","heartbeat_back_addr":"172.21.15.183:6831/1250387289","heartbeat_front_addr":"172.21.15.183:6829/1250387289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:59:39.916330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:06.042858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:30.703648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:59.493376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:25.190299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:50.480326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:20.815441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:46.398318+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:11.499922+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:41.895096+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:08.411538+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:32.943466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/366890372":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6800/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2372812363":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2844264136":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/2046654364":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6801/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/211510947":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6801/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6800/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/189409602":"2024-09-12T00:57:11.412015+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:05:55.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.440+0000 7f9858c00640 1 -- 172.21.15.103:0/3115916140 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f98380b52e0 msgr2=0x7f98380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:55.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.440+0000 7f9858c00640 1 --2- 172.21.15.103:0/3115916140 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f98380b52e0 0x7f98380b77a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f98440095f0 tx=0x7f9844005f90 comp rx=0 tx=0).stop 2024-09-11T01:05:55.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.440+0000 7f9858c00640 1 -- 172.21.15.103:0/3115916140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f985410a9d0 msgr2=0x7f985419ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:55.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.440+0000 7f9858c00640 1 --2- 172.21.15.103:0/3115916140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f985410a9d0 0x7f985419ba00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f984000e9f0 tx=0x7f984000edf0 comp rx=0 tx=0).stop 2024-09-11T01:05:55.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.440+0000 7f9858c00640 1 -- 172.21.15.103:0/3115916140 shutdown_connections 2024-09-11T01:05:55.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.440+0000 7f9858c00640 1 --2- 172.21.15.103:0/3115916140 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f98380b52e0 0x7f98380b77a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:55.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.440+0000 7f9858c00640 1 --2- 172.21.15.103:0/3115916140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f985410b350 0x7f98541a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:55.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.440+0000 7f9858c00640 1 --2- 172.21.15.103:0/3115916140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f985410a9d0 0x7f985419ba00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:55.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.440+0000 7f9858c00640 1 --2- 172.21.15.103:0/3115916140 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9854104fc0 0x7f985419b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:55.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.440+0000 7f9858c00640 1 -- 172.21.15.103:0/3115916140 >> 172.21.15.103:0/3115916140 conn(0x7f98541009f0 msgr2=0x7f9854102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:55.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.441+0000 7f9858c00640 1 -- 172.21.15.103:0/3115916140 shutdown_connections 2024-09-11T01:05:55.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:55.441+0000 7f9858c00640 1 -- 172.21.15.103:0/3115916140 wait complete. 2024-09-11T01:05:55.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:55 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3115916140' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:05:55.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:55 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3115916140' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:05:55.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:55 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3115916140' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:05:56.397 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-11T01:05:32.767364+0000', 'modified': '2024-09-11T01:05:45.069729+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24665}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24665': {'gid': 24665, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.117:6839/1820809235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6838', 'nonce': 1820809235}, {'type': 'v1', 'addr': '172.21.15.117:6839', 'nonce': 1820809235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24665, 'qdb_cluster': [24665]} 2024-09-11T01:05:56.398 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-11T01:05:56.398 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T01:05:56.770 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:56.774 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:56 smithi117 ceph-mon[35358]: pgmap v325: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-11T01:05:56.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:56 smithi103 ceph-mon[30562]: pgmap v325: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-11T01:05:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:56 smithi183 ceph-mon[34992]: pgmap v325: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3 B/s, 0 keys/s, 0 objects/s recovering 2024-09-11T01:05:57.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.380+0000 7f492fe00640 1 -- 172.21.15.103:0/4105110457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4930102c00 msgr2=0x7f4930102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:57.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.380+0000 7f492fe00640 1 --2- 172.21.15.103:0/4105110457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4930102c00 0x7f4930102fe0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4920009860 tx=0x7f492002a340 comp rx=0 tx=0).stop 2024-09-11T01:05:57.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.380+0000 7f492fe00640 1 -- 172.21.15.103:0/4105110457 shutdown_connections 2024-09-11T01:05:57.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.380+0000 7f492fe00640 1 --2- 172.21.15.103:0/4105110457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4930108f90 0x7f493010f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.380+0000 7f492fe00640 1 --2- 172.21.15.103:0/4105110457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4930108610 0x7f4930108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.380+0000 7f492fe00640 1 --2- 172.21.15.103:0/4105110457 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4930102c00 0x7f4930102fe0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.380+0000 7f492fe00640 1 -- 172.21.15.103:0/4105110457 >> 172.21.15.103:0/4105110457 conn(0x7f49300fe6d0 msgr2=0x7f4930100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:57.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.380+0000 7f492fe00640 1 -- 172.21.15.103:0/4105110457 shutdown_connections 2024-09-11T01:05:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.380+0000 7f492fe00640 1 -- 172.21.15.103:0/4105110457 wait complete. 2024-09-11T01:05:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.381+0000 7f492fe00640 1 Processor -- start 2024-09-11T01:05:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.381+0000 7f492fe00640 1 -- start start 2024-09-11T01:05:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.382+0000 7f492fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4930102c00 0x7f493019b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.382+0000 7f492fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4930108610 0x7f493019b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.382+0000 7f492fe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4930108f90 0x7f49301a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.382+0000 7f492fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4930112c50 con 0x7f4930108610 2024-09-11T01:05:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.382+0000 7f492fe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4930112ad0 con 0x7f4930102c00 2024-09-11T01:05:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.382+0000 7f492fe00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4930112dd0 con 0x7f4930108f90 2024-09-11T01:05:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.382+0000 7f492e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4930108610 0x7f493019b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.382+0000 7f492ea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4930102c00 0x7f493019b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.382+0000 7f492f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4930108f90 0x7f49301a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.382+0000 7f492ea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4930102c00 0x7f493019b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:34668/0 (socket says 172.21.15.103:34668) 2024-09-11T01:05:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.382+0000 7f492ea00640 1 -- 172.21.15.103:0/2520298113 learned_addr learned my addr 172.21.15.103:0/2520298113 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.382+0000 7f492ea00640 1 -- 172.21.15.103:0/2520298113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4930108f90 msgr2=0x7f49301a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.382+0000 7f492ea00640 1 --2- 172.21.15.103:0/2520298113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4930108f90 0x7f49301a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.383+0000 7f492ea00640 1 -- 172.21.15.103:0/2520298113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4930108610 msgr2=0x7f493019b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.383+0000 7f492ea00640 1 --2- 172.21.15.103:0/2520298113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4930108610 0x7f493019b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.383+0000 7f492ea00640 1 -- 172.21.15.103:0/2520298113 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49301a1310 con 0x7f4930102c00 2024-09-11T01:05:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.383+0000 7f492f400640 1 --2- 172.21.15.103:0/2520298113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4930108f90 0x7f49301a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:05:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.383+0000 7f492e000640 1 --2- 172.21.15.103:0/2520298113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4930108610 0x7f493019b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:05:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.383+0000 7f492ea00640 1 --2- 172.21.15.103:0/2520298113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4930102c00 0x7f493019b260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f49200303f0 tx=0x7f4920032da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.383+0000 7f4927400640 1 -- 172.21.15.103:0/2520298113 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4920040020 con 0x7f4930102c00 2024-09-11T01:05:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.383+0000 7f492fe00640 1 -- 172.21.15.103:0/2520298113 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49301a15a0 con 0x7f4930102c00 2024-09-11T01:05:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.383+0000 7f4927400640 1 -- 172.21.15.103:0/2520298113 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4920030dd0 con 0x7f4930102c00 2024-09-11T01:05:57.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.383+0000 7f4927400640 1 -- 172.21.15.103:0/2520298113 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4920037040 con 0x7f4930102c00 2024-09-11T01:05:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.383+0000 7f492fe00640 1 -- 172.21.15.103:0/2520298113 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49301a7cc0 con 0x7f4930102c00 2024-09-11T01:05:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.386+0000 7f4938249740 1 Processor -- start 2024-09-11T01:05:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.386+0000 7f4938249740 1 -- start start 2024-09-11T01:05:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f4938249740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b72400 0x564a93b727e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f4938249740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 0x564a93b7e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f4938249740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b7ecb0 0x564a93b810a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f4938249740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564a93ae9d50 con 0x564a93b7ecb0 2024-09-11T01:05:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f4938249740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564a93ad9180 con 0x564a93b72d20 2024-09-11T01:05:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f4938249740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564a93adcf90 con 0x564a93b72400 2024-09-11T01:05:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f492f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b72400 0x564a93b727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f492f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b72400 0x564a93b727e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:46138/0 (socket says 172.21.15.103:46138) 2024-09-11T01:05:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f492f400640 1 -- 172.21.15.103:0/1559500389 learned_addr learned my addr 172.21.15.103:0/1559500389 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:57.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f492e000640 1 --2- 172.21.15.103:0/1559500389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b7ecb0 0x564a93b810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f4927400640 1 -- 172.21.15.103:0/2520298113 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f4920030450 con 0x7f4930102c00 2024-09-11T01:05:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f492f400640 1 -- 172.21.15.103:0/1559500389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 msgr2=0x564a93b7e770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T01:05:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f492f400640 1 --2- 172.21.15.103:0/1559500389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 0x564a93b7e770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f492f400640 1 -- 172.21.15.103:0/1559500389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b7ecb0 msgr2=0x564a93b810a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:05:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f492f400640 1 --2- 172.21.15.103:0/1559500389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b7ecb0 0x564a93b810a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f492f400640 1 -- 172.21.15.103:0/1559500389 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a93aa3a70 con 0x564a93b72400 2024-09-11T01:05:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.387+0000 7f492e000640 1 --2- 172.21.15.103:0/1559500389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b7ecb0 0x564a93b810a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:05:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.388+0000 7f492f400640 1 --2- 172.21.15.103:0/1559500389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b72400 0x564a93b727e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f492800e920 tx=0x7f49280095c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e19d3618aa2b145 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.388+0000 7f491b400640 1 -- 172.21.15.103:0/1559500389 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492800de90 con 0x564a93b72400 2024-09-11T01:05:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.388+0000 7f491b400640 1 -- 172.21.15.103:0/1559500389 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f492801c070 con 0x564a93b72400 2024-09-11T01:05:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.388+0000 7f491b400640 1 -- 172.21.15.103:0/1559500389 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928016620 con 0x564a93b72400 2024-09-11T01:05:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.389+0000 7f4938249740 1 -- 172.21.15.103:0/1559500389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b72400 msgr2=0x564a93b727e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.389+0000 7f4938249740 1 --2- 172.21.15.103:0/1559500389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b72400 0x564a93b727e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f492800e920 tx=0x7f49280095c0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.389+0000 7f4927400640 1 --2- 172.21.15.103:0/2520298113 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f49140b5390 0x7f49140b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.389+0000 7f4927400640 1 -- 172.21.15.103:0/2520298113 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f4920105dc0 con 0x7f4930102c00 2024-09-11T01:05:57.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.389+0000 7f4938249740 1 -- 172.21.15.103:0/1559500389 shutdown_connections 2024-09-11T01:05:57.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.389+0000 7f4938249740 1 --2- 172.21.15.103:0/1559500389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b7ecb0 0x564a93b810a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.389+0000 7f4938249740 1 --2- 172.21.15.103:0/1559500389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 0x564a93b7e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.389+0000 7f4938249740 1 --2- 172.21.15.103:0/1559500389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b72400 0x564a93b727e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.389+0000 7f4938249740 1 -- 172.21.15.103:0/1559500389 >> 172.21.15.103:0/1559500389 conn(0x564a93b70230 msgr2=0x564a93b713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:57.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.389+0000 7f492f400640 1 --2- 172.21.15.103:0/2520298113 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f49140b5390 0x7f49140b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.390+0000 7f4938249740 1 -- 172.21.15.103:0/1559500389 shutdown_connections 2024-09-11T01:05:57.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.390+0000 7f4938249740 1 -- 172.21.15.103:0/1559500389 wait complete. 2024-09-11T01:05:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.390+0000 7f4938249740 1 -- start start 2024-09-11T01:05:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.390+0000 7f492f400640 1 --2- 172.21.15.103:0/2520298113 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f49140b5390 0x7f49140b7850 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4928005fd0 tx=0x7f4928000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.390+0000 7f4938249740 1 Processor -- start 2024-09-11T01:05:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.391+0000 7f4938249740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72400 0x564a93b7bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.391+0000 7f4938249740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72d20 0x564a93b7c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.391+0000 7f4938249740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93b7c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.391+0000 7f4938249740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564a9393a5f0 con 0x564a93b72d20 2024-09-11T01:05:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.391+0000 7f4938249740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564a93a74460 con 0x564a93b72400 2024-09-11T01:05:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.391+0000 7f4938249740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564a93b81a00 con 0x564a93b7ecb0 2024-09-11T01:05:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.391+0000 7f4938249740 10 client.0 _ll_register_callbacks cb 0x564a93a84210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:05:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.391+0000 7f492ea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72400 0x564a93b7bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.391+0000 7f492e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72d20 0x564a93b7c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.391+0000 7f492ea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72400 0x564a93b7bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:34696/0 (socket says 172.21.15.103:34696) 2024-09-11T01:05:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.391+0000 7f492ea00640 1 -- 172.21.15.103:0/3597608085 learned_addr learned my addr 172.21.15.103:0/3597608085 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.391+0000 7f492f400640 1 --2- 172.21.15.103:0/3597608085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93b7c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.392+0000 7f492ea00640 1 -- 172.21.15.103:0/3597608085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 msgr2=0x564a93b7c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:05:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.392+0000 7f492ea00640 1 --2- 172.21.15.103:0/3597608085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93b7c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.392+0000 7f492ea00640 1 -- 172.21.15.103:0/3597608085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72d20 msgr2=0x564a93b7c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:05:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.392+0000 7f492ea00640 1 --2- 172.21.15.103:0/3597608085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72d20 0x564a93b7c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.392+0000 7f492ea00640 1 -- 172.21.15.103:0/3597608085 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a93837540 con 0x564a93b72400 2024-09-11T01:05:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.392+0000 7f492e000640 1 --2- 172.21.15.103:0/3597608085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72d20 0x564a93b7c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:05:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.392+0000 7f492ea00640 1 --2- 172.21.15.103:0/3597608085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72400 0x564a93b7bd20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f49200cbee0 tx=0x7f4920032f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2419e353af03211 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.392+0000 7f490fe00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:05:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.392+0000 7f490fe00640 1 -- 172.21.15.103:0/3597608085 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49200cbb30 con 0x564a93b72400 2024-09-11T01:05:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.392+0000 7f490fe00640 1 -- 172.21.15.103:0/3597608085 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f49200eddc0 con 0x564a93b72400 2024-09-11T01:05:57.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.392+0000 7f4938249740 1 -- 172.21.15.103:0/3597608085 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564a93a76a70 con 0x564a93b72400 2024-09-11T01:05:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.392+0000 7f490fe00640 1 -- 172.21.15.103:0/3597608085 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f49200cb950 con 0x564a93b72400 2024-09-11T01:05:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.392+0000 7f4938249740 10 client.24758 fetch_fsmap learned FSMap version 17 2024-09-11T01:05:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.392+0000 7f4938249740 1 -- 172.21.15.103:0/3597608085 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x564a93a916f0 con 0x564a93b72400 2024-09-11T01:05:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.393+0000 7f490fe00640 1 -- 172.21.15.103:0/3597608085 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x564a93a76a70 con 0x564a93b72400 2024-09-11T01:05:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.393+0000 7f490fe00640 1 -- 172.21.15.103:0/3597608085 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f49200c7b30 con 0x564a93b72400 2024-09-11T01:05:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.393+0000 7f4938249740 10 client.24758 fetch_fsmap finished waiting for FSMap version 17 2024-09-11T01:05:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.393+0000 7f4938249740 10 client.24758 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T01:05:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.393+0000 7f4938249740 20 client.24758 populate_metadata read hostname 'smithi103' 2024-09-11T01:05:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.393+0000 7f4938249740 1 --2- 172.21.15.103:0/3597608085 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564a93b98260 0x564a93b996d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.393+0000 7f4938249740 4 client.24758 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:05:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.393+0000 7f4938249740 1 -- 172.21.15.103:0/3597608085 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a93aebca0 con 0x564a93b98260 2024-09-11T01:05:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.393+0000 7f492e000640 1 --2- 172.21.15.103:0/3597608085 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564a93b98260 0x564a93b996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.394+0000 7f490fe00640 10 client.24758 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:05:57.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.394+0000 7f492e000640 1 --2- 172.21.15.103:0/3597608085 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564a93b98260 0x564a93b996d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7945200eed64b5f9 server_cookie=1da135da0f28c0b5 in_seq=0 out_seq=0 2024-09-11T01:05:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f490fe00640 1 -- 172.21.15.103:0/3597608085 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564a93aebca0 con 0x564a93b98260 2024-09-11T01:05:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f490fe00640 10 client.24758 handle_command_reply: tid=0 2024-09-11T01:05:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f4938249740 1 client.24758 shutdown 2024-09-11T01:05:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f4938249740 1 -- 172.21.15.103:0/3597608085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72400 msgr2=0x564a93b7bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f4938249740 1 --2- 172.21.15.103:0/3597608085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72400 0x564a93b7bd20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f49200cbee0 tx=0x7f4920032f10 comp rx=0 tx=0).stop 2024-09-11T01:05:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f4938249740 1 -- 172.21.15.103:0/3597608085 shutdown_connections 2024-09-11T01:05:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f4938249740 1 --2- 172.21.15.103:0/3597608085 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564a93b98260 0x564a93b996d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f4938249740 1 --2- 172.21.15.103:0/3597608085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93b7c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f4938249740 1 --2- 172.21.15.103:0/3597608085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72d20 0x564a93b7c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f4938249740 1 --2- 172.21.15.103:0/3597608085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72400 0x564a93b7bd20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f490fe00640 0 client.24758 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:05:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f4938249740 1 -- 172.21.15.103:0/3597608085 >> 172.21.15.103:0/3597608085 conn(0x564a93b70230 msgr2=0x564a93b75dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:57.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f4938249740 1 -- 172.21.15.103:0/3597608085 shutdown_connections 2024-09-11T01:05:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f4938249740 1 -- 172.21.15.103:0/3597608085 wait complete. 2024-09-11T01:05:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.395+0000 7f4938249740 20 client.24758 trim_cache size 0 max 16384 2024-09-11T01:05:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.414+0000 7f4938249740 1 Processor -- start 2024-09-11T01:05:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.414+0000 7f4938249740 1 -- start start 2024-09-11T01:05:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.414+0000 7f4938249740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72400 0x564a93b99000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f4938249740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 0x564a93b76470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f4938249740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93b7a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f4938249740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564a93b97a10 con 0x564a93b72400 2024-09-11T01:05:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f4938249740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564a93b980e0 con 0x564a93b72d20 2024-09-11T01:05:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f4938249740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564a93b987b0 con 0x564a93b7ecb0 2024-09-11T01:05:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f492f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93b7a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f492f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93b7a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:46158/0 (socket says 172.21.15.103:46158) 2024-09-11T01:05:57.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f492f400640 1 -- 172.21.15.103:0/1426465052 learned_addr learned my addr 172.21.15.103:0/1426465052 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f492ea00640 1 --2- 172.21.15.103:0/1426465052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72400 0x564a93b99000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f492e000640 1 --2- 172.21.15.103:0/1426465052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 0x564a93b76470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f492f400640 1 -- 172.21.15.103:0/1426465052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 msgr2=0x564a93b76470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:05:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f492f400640 1 --2- 172.21.15.103:0/1426465052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 0x564a93b76470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f492f400640 1 -- 172.21.15.103:0/1426465052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72400 msgr2=0x564a93b99000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:05:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f492f400640 1 --2- 172.21.15.103:0/1426465052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72400 0x564a93b99000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.415+0000 7f492f400640 1 -- 172.21.15.103:0/1426465052 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a93b70cb0 con 0x564a93b7ecb0 2024-09-11T01:05:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.416+0000 7f492f400640 1 --2- 172.21.15.103:0/1426465052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93b7a5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f49280097f0 tx=0x7f4928009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b7d04c94b9897b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.416+0000 7f491aa00640 1 -- 172.21.15.103:0/1426465052 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928005790 con 0x564a93b7ecb0 2024-09-11T01:05:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.416+0000 7f491aa00640 1 -- 172.21.15.103:0/1426465052 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4928026070 con 0x564a93b7ecb0 2024-09-11T01:05:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.416+0000 7f491aa00640 1 -- 172.21.15.103:0/1426465052 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4928004610 con 0x564a93b7ecb0 2024-09-11T01:05:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.417+0000 7f4938249740 1 -- 172.21.15.103:0/1426465052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 msgr2=0x564a93b7a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:57.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.417+0000 7f4938249740 1 --2- 172.21.15.103:0/1426465052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93b7a5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f49280097f0 tx=0x7f4928009780 comp rx=0 tx=0).stop 2024-09-11T01:05:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.417+0000 7f4938249740 1 -- 172.21.15.103:0/1426465052 shutdown_connections 2024-09-11T01:05:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.417+0000 7f4938249740 1 --2- 172.21.15.103:0/1426465052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93b7a5a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.417+0000 7f4938249740 1 --2- 172.21.15.103:0/1426465052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 0x564a93b76470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.417+0000 7f4938249740 1 --2- 172.21.15.103:0/1426465052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72400 0x564a93b99000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.417+0000 7f4938249740 1 -- 172.21.15.103:0/1426465052 >> 172.21.15.103:0/1426465052 conn(0x564a93b70230 msgr2=0x564a93b70f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.417+0000 7f4938249740 1 -- 172.21.15.103:0/1426465052 shutdown_connections 2024-09-11T01:05:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.417+0000 7f4938249740 1 -- 172.21.15.103:0/1426465052 wait complete. 2024-09-11T01:05:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.417+0000 7f4938249740 1 -- start start 2024-09-11T01:05:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.418+0000 7f4938249740 1 Processor -- start 2024-09-11T01:05:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.418+0000 7f4938249740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72400 0x564a93b9bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.418+0000 7f4938249740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 0x564a93b9c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.418+0000 7f4938249740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93ba1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.418+0000 7f4938249740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564a93b99550 con 0x564a93b72400 2024-09-11T01:05:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.418+0000 7f4938249740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564a93b98e80 con 0x564a93b72d20 2024-09-11T01:05:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.418+0000 7f4938249740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564a93b99c20 con 0x564a93b7ecb0 2024-09-11T01:05:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.418+0000 7f4938249740 10 client.0 _ll_register_callbacks cb 0x7f49200c8830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:05:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.418+0000 7f492f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93ba1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.418+0000 7f492f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93ba1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:46172/0 (socket says 172.21.15.103:46172) 2024-09-11T01:05:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.418+0000 7f492f400640 1 -- 172.21.15.103:0/4195134729 learned_addr learned my addr 172.21.15.103:0/4195134729 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.418+0000 7f492ea00640 1 --2- 172.21.15.103:0/4195134729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72400 0x564a93b9bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.418+0000 7f492e000640 1 --2- 172.21.15.103:0/4195134729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 0x564a93b9c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.419+0000 7f492f400640 1 -- 172.21.15.103:0/4195134729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 msgr2=0x564a93b9c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:05:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.419+0000 7f492f400640 1 --2- 172.21.15.103:0/4195134729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 0x564a93b9c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.419+0000 7f492f400640 1 -- 172.21.15.103:0/4195134729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72400 msgr2=0x564a93b9bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:05:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.419+0000 7f492f400640 1 --2- 172.21.15.103:0/4195134729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72400 0x564a93b9bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.419+0000 7f492f400640 1 -- 172.21.15.103:0/4195134729 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a93ba1990 con 0x564a93b7ecb0 2024-09-11T01:05:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.419+0000 7f492e000640 1 --2- 172.21.15.103:0/4195134729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 0x564a93b9c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:05:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.419+0000 7f492f400640 1 --2- 172.21.15.103:0/4195134729 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93ba1450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f492800e890 tx=0x7f4928004e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d909ad4eb0916bb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.419+0000 7f490fe00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:05:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.419+0000 7f490fe00640 1 -- 172.21.15.103:0/4195134729 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49280057a0 con 0x564a93b7ecb0 2024-09-11T01:05:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.419+0000 7f4938249740 1 -- 172.21.15.103:0/4195134729 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4928026070 con 0x564a93b7ecb0 2024-09-11T01:05:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.419+0000 7f490fe00640 1 -- 172.21.15.103:0/4195134729 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f4928004290 con 0x564a93b7ecb0 2024-09-11T01:05:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.419+0000 7f490fe00640 1 -- 172.21.15.103:0/4195134729 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f492804c050 con 0x564a93b7ecb0 2024-09-11T01:05:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.419+0000 7f4938249740 10 client.24742 fetch_fsmap learned FSMap version 17 2024-09-11T01:05:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.419+0000 7f4938249740 1 -- 172.21.15.103:0/4195134729 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x564a93c052e0 con 0x564a93b7ecb0 2024-09-11T01:05:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.420+0000 7f490fe00640 1 -- 172.21.15.103:0/4195134729 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4928026070 con 0x564a93b7ecb0 2024-09-11T01:05:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.420+0000 7f490fe00640 1 -- 172.21.15.103:0/4195134729 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f492800b040 con 0x564a93b7ecb0 2024-09-11T01:05:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.420+0000 7f4938249740 10 client.24742 fetch_fsmap finished waiting for FSMap version 17 2024-09-11T01:05:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.420+0000 7f4938249740 10 client.24742 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T01:05:57.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.420+0000 7f4938249740 20 client.24742 populate_metadata read hostname 'smithi103' 2024-09-11T01:05:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.420+0000 7f4938249740 1 --2- 172.21.15.103:0/4195134729 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564a93c09830 0x564a93c08540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.420+0000 7f4938249740 4 client.24742 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T01:05:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.420+0000 7f4938249740 1 -- 172.21.15.103:0/4195134729 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "status"}) -- 0x564a93ae7750 con 0x564a93c09830 2024-09-11T01:05:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.421+0000 7f492ea00640 1 --2- 172.21.15.103:0/4195134729 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564a93c09830 0x564a93c08540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.421+0000 7f492ea00640 1 --2- 172.21.15.103:0/4195134729 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564a93c09830 0x564a93c08540 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b980328e38f05429 server_cookie=a3c6378045b5402e in_seq=0 out_seq=0 2024-09-11T01:05:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.421+0000 7f490fe00640 10 client.24742 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:05:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.421+0000 7f490fe00640 1 -- 172.21.15.103:0/4195134729 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564a93ae7750 con 0x564a93c09830 2024-09-11T01:05:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.421+0000 7f490fe00640 10 client.24742 handle_command_reply: tid=0 2024-09-11T01:05:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.421+0000 7f4938249740 1 client.24742 shutdown 2024-09-11T01:05:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.421+0000 7f4938249740 1 -- 172.21.15.103:0/4195134729 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 msgr2=0x564a93ba1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.421+0000 7f4938249740 1 --2- 172.21.15.103:0/4195134729 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93ba1450 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f492800e890 tx=0x7f4928004e20 comp rx=0 tx=0).stop 2024-09-11T01:05:57.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.422+0000 7f4938249740 1 -- 172.21.15.103:0/4195134729 shutdown_connections 2024-09-11T01:05:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.422+0000 7f4938249740 1 --2- 172.21.15.103:0/4195134729 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564a93c09830 0x564a93c08540 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.422+0000 7f4938249740 1 --2- 172.21.15.103:0/4195134729 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564a93b7ecb0 0x564a93ba1450 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.422+0000 7f4938249740 1 --2- 172.21.15.103:0/4195134729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564a93b72d20 0x564a93b9c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.422+0000 7f4938249740 1 --2- 172.21.15.103:0/4195134729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564a93b72400 0x564a93b9bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.422+0000 7f4938249740 1 -- 172.21.15.103:0/4195134729 >> 172.21.15.103:0/4195134729 conn(0x564a93b70230 msgr2=0x564a93b7a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.422+0000 7f490fe00640 0 client.24742 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:05:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.422+0000 7f4938249740 1 -- 172.21.15.103:0/4195134729 shutdown_connections 2024-09-11T01:05:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.422+0000 7f4938249740 1 -- 172.21.15.103:0/4195134729 wait complete. 2024-09-11T01:05:57.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.423+0000 7f4938249740 20 client.24742 trim_cache size 0 max 16384 2024-09-11T01:05:57.442 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:05:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "917288bc-6fd8-11ef-bcea-c7b262605968", 2024-09-11T01:05:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-11T01:05:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24665, 2024-09-11T01:05:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-11T01:05:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-11T01:05:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-11T01:05:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 23.746543022000001, 2024-09-11T01:05:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 17, 2024-09-11T01:05:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 87, 2024-09-11T01:05:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 87, 2024-09-11T01:05:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 37.574942071000002 2024-09-11T01:05:57.443 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:05:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.423+0000 7f492fe00640 1 -- 172.21.15.103:0/2520298113 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f49140b5390 msgr2=0x7f49140b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.423+0000 7f492fe00640 1 --2- 172.21.15.103:0/2520298113 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f49140b5390 0x7f49140b7850 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4928005fd0 tx=0x7f4928000f40 comp rx=0 tx=0).stop 2024-09-11T01:05:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.423+0000 7f492fe00640 1 -- 172.21.15.103:0/2520298113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4930102c00 msgr2=0x7f493019b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.423+0000 7f492fe00640 1 --2- 172.21.15.103:0/2520298113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4930102c00 0x7f493019b260 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f49200303f0 tx=0x7f4920032da0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.423+0000 7f492fe00640 1 -- 172.21.15.103:0/2520298113 shutdown_connections 2024-09-11T01:05:57.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.423+0000 7f492fe00640 1 --2- 172.21.15.103:0/2520298113 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f49140b5390 0x7f49140b7850 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.423+0000 7f492fe00640 1 --2- 172.21.15.103:0/2520298113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4930108f90 0x7f49301a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.423+0000 7f492fe00640 1 --2- 172.21.15.103:0/2520298113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4930108610 0x7f493019b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.423+0000 7f492fe00640 1 --2- 172.21.15.103:0/2520298113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4930102c00 0x7f493019b260 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.423+0000 7f492fe00640 1 -- 172.21.15.103:0/2520298113 >> 172.21.15.103:0/2520298113 conn(0x7f49300fe6d0 msgr2=0x7f49301043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.424+0000 7f492fe00640 1 -- 172.21.15.103:0/2520298113 shutdown_connections 2024-09-11T01:05:57.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:57.424+0000 7f492fe00640 1 -- 172.21.15.103:0/2520298113 wait complete. 2024-09-11T01:05:58.616 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T01:05:58.616 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T01:05:58.616 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T01:05:58.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:05:58 smithi103 ceph-mon[30562]: pgmap v326: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:58.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:05:58 smithi117 ceph-mon[35358]: pgmap v326: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:05:58 smithi183 ceph-mon[34992]: pgmap v326: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:05:58.987 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:05:59.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.573+0000 7fb74dc00640 1 -- 172.21.15.103:0/405983665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb74810b1a0 msgr2=0x7fb7481119a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:59.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.573+0000 7fb74dc00640 1 --2- 172.21.15.103:0/405983665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb74810b1a0 0x7fb7481119a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb740009ca0 tx=0x7fb74002a8c0 comp rx=0 tx=0).stop 2024-09-11T01:05:59.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.573+0000 7fb74dc00640 1 -- 172.21.15.103:0/405983665 shutdown_connections 2024-09-11T01:05:59.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.573+0000 7fb74dc00640 1 --2- 172.21.15.103:0/405983665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb74810b1a0 0x7fb7481119a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:59.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.573+0000 7fb74dc00640 1 --2- 172.21.15.103:0/405983665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb74810a820 0x7fb74810ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:59.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.573+0000 7fb74dc00640 1 --2- 172.21.15.103:0/405983665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb748104e10 0x7fb7481051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:59.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.573+0000 7fb74dc00640 1 -- 172.21.15.103:0/405983665 >> 172.21.15.103:0/405983665 conn(0x7fb748100840 msgr2=0x7fb748102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:59.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.573+0000 7fb74dc00640 1 -- 172.21.15.103:0/405983665 shutdown_connections 2024-09-11T01:05:59.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.573+0000 7fb74dc00640 1 -- 172.21.15.103:0/405983665 wait complete. 2024-09-11T01:05:59.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.574+0000 7fb74dc00640 1 Processor -- start 2024-09-11T01:05:59.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.574+0000 7fb74dc00640 1 -- start start 2024-09-11T01:05:59.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.575+0000 7fb74dc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb748104e10 0x7fb74819b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:59.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.575+0000 7fb74dc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb74810a820 0x7fb74819b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:59.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.575+0000 7fb74dc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb74810b1a0 0x7fb7481a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:59.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.575+0000 7fb74dc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb748114e70 con 0x7fb74810b1a0 2024-09-11T01:05:59.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.575+0000 7fb74dc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb748114cf0 con 0x7fb748104e10 2024-09-11T01:05:59.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.575+0000 7fb74dc00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb748114ff0 con 0x7fb74810a820 2024-09-11T01:05:59.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.575+0000 7fb747400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb74810a820 0x7fb74819b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:59.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.575+0000 7fb74d200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb74810b1a0 0x7fb7481a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.575+0000 7fb747400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb74810a820 0x7fb74819b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:46190/0 (socket says 172.21.15.103:46190) 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.575+0000 7fb747400640 1 -- 172.21.15.103:0/424766977 learned_addr learned my addr 172.21.15.103:0/424766977 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.575+0000 7fb747e00640 1 --2- 172.21.15.103:0/424766977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb748104e10 0x7fb74819b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.576+0000 7fb747400640 1 -- 172.21.15.103:0/424766977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb748104e10 msgr2=0x7fb74819b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.576+0000 7fb747400640 1 --2- 172.21.15.103:0/424766977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb748104e10 0x7fb74819b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.576+0000 7fb747400640 1 -- 172.21.15.103:0/424766977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb74810b1a0 msgr2=0x7fb7481a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.576+0000 7fb747400640 1 --2- 172.21.15.103:0/424766977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb74810b1a0 0x7fb7481a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.576+0000 7fb747400640 1 -- 172.21.15.103:0/424766977 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7481a1310 con 0x7fb74810a820 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.576+0000 7fb747e00640 1 --2- 172.21.15.103:0/424766977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb748104e10 0x7fb74819b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.576+0000 7fb747400640 1 --2- 172.21.15.103:0/424766977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb74810a820 0x7fb74819b7a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb73400e9f0 tx=0x7fb73400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.576+0000 7fb744c00640 1 -- 172.21.15.103:0/424766977 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73400cd80 con 0x7fb74810a820 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.576+0000 7fb744c00640 1 -- 172.21.15.103:0/424766977 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7340108e0 con 0x7fb74810a820 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.576+0000 7fb74dc00640 1 -- 172.21.15.103:0/424766977 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7481a1600 con 0x7fb74810a820 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.576+0000 7fb744c00640 1 -- 172.21.15.103:0/424766977 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb734018980 con 0x7fb74810a820 2024-09-11T01:05:59.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.576+0000 7fb74dc00640 1 -- 172.21.15.103:0/424766977 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7481a7cc0 con 0x7fb74810a820 2024-09-11T01:05:59.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.577+0000 7fb74dc00640 1 -- 172.21.15.103:0/424766977 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7481051f0 con 0x7fb74810a820 2024-09-11T01:05:59.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.580+0000 7fb744c00640 1 -- 172.21.15.103:0/424766977 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fb734010430 con 0x7fb74810a820 2024-09-11T01:05:59.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.582+0000 7fb744c00640 1 --2- 172.21.15.103:0/424766977 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb72c0b5390 0x7fb72c0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:05:59.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.582+0000 7fb744c00640 1 -- 172.21.15.103:0/424766977 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7fb7340e64a0 con 0x7fb74810a820 2024-09-11T01:05:59.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.582+0000 7fb747e00640 1 --2- 172.21.15.103:0/424766977 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb72c0b5390 0x7fb72c0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:05:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.582+0000 7fb747e00640 1 --2- 172.21.15.103:0/424766977 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb72c0b5390 0x7fb72c0b7850 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb738009fc0 tx=0x7fb738005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:05:59.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.583+0000 7fb744c00640 1 -- 172.21.15.103:0/424766977 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb7340ac970 con 0x7fb74810a820 2024-09-11T01:05:59.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.805+0000 7fb74dc00640 1 -- 172.21.15.103:0/424766977 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb7481a8030 con 0x7fb74810a820 2024-09-11T01:05:59.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.805+0000 7fb744c00640 1 -- 172.21.15.103:0/424766977 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fb7340b13a0 con 0x7fb74810a820 2024-09-11T01:05:59.807 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T01:05:59.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.808+0000 7fb74dc00640 1 -- 172.21.15.103:0/424766977 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb72c0b5390 msgr2=0x7fb72c0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:59.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.808+0000 7fb74dc00640 1 --2- 172.21.15.103:0/424766977 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb72c0b5390 0x7fb72c0b7850 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb738009fc0 tx=0x7fb738005f90 comp rx=0 tx=0).stop 2024-09-11T01:05:59.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.808+0000 7fb74dc00640 1 -- 172.21.15.103:0/424766977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb74810a820 msgr2=0x7fb74819b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:05:59.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.808+0000 7fb74dc00640 1 --2- 172.21.15.103:0/424766977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb74810a820 0x7fb74819b7a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb73400e9f0 tx=0x7fb73400eeb0 comp rx=0 tx=0).stop 2024-09-11T01:05:59.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.808+0000 7fb74dc00640 1 -- 172.21.15.103:0/424766977 shutdown_connections 2024-09-11T01:05:59.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.808+0000 7fb74dc00640 1 --2- 172.21.15.103:0/424766977 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb72c0b5390 0x7fb72c0b7850 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:59.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.808+0000 7fb74dc00640 1 --2- 172.21.15.103:0/424766977 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb74810b1a0 0x7fb7481a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:59.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.808+0000 7fb74dc00640 1 --2- 172.21.15.103:0/424766977 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb74810a820 0x7fb74819b7a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:59.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.808+0000 7fb74dc00640 1 --2- 172.21.15.103:0/424766977 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb748104e10 0x7fb74819b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:05:59.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.808+0000 7fb74dc00640 1 -- 172.21.15.103:0/424766977 >> 172.21.15.103:0/424766977 conn(0x7fb748100840 msgr2=0x7fb748100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:05:59.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.808+0000 7fb74dc00640 1 -- 172.21.15.103:0/424766977 shutdown_connections 2024-09-11T01:05:59.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:05:59.809+0000 7fb74dc00640 1 -- 172.21.15.103:0/424766977 wait complete. 2024-09-11T01:06:00.737 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-11T01:06:00.737 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T01:06:00.737 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-11T01:06:00.737 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-11T01:06:00.737 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-11T01:06:00.737 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-11T01:06:00.737 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T01:06:00.737 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T01:06:00.737 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T01:06:00.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:06:00.738 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-11T01:06:00.774 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T01:06:00.774 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T01:06:00.774 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T01:06:00.774 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-11T01:06:00.774 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-11T01:06:00.774 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-11T01:06:00.775 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T01:06:00.775 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-11T01:06:00.775 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-11T01:06:00.775 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T01:06:00.775 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-11T01:06:00.775 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-11T01:06:00.775 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T01:06:00.775 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-11T01:06:00.775 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T01:06:00.775 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-11T01:06:00.775 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T01:06:00.775 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42147sec preferred_lft 42147sec 2024-09-11T01:06:00.775 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-11T01:06:00.775 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-11T01:06:00.776 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T01:06:00.776 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T01:06:00.776 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-11T01:06:00.776 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-09-11T01:06:00.777 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-09-11T01:06:00.777 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-09-11T01:06:00.777 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T01:06:00.777 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-11T01:06:00.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:00 smithi103 ceph-mon[30562]: pgmap v327: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:06:00.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:00 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/424766977' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-11T01:06:00.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:00 smithi117 ceph-mon[35358]: pgmap v327: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:06:00.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:00 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/424766977' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-11T01:06:00.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T01:06:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:00 smithi183 ceph-mon[34992]: pgmap v327: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:06:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:00 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/424766977' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-11T01:06:01.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:06:01.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:06:01.202 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T01:06:01.297 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-11T01:06:01.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:06:01.301 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-11T01:06:01.356 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-11T01:06:01.356 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T01:06:01.356 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T01:06:01.357 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T01:06:01.357 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T01:06:01.357 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T01:06:01.357 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-11T01:06:01.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T01:06:01.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T01:06:01.357 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T01:06:01.357 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-11T01:06:01.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T01:06:02.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:06:02.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:06:02.083 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-11T01:06:02.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:06:02.118 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-09-11T01:06:02.194 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T01:06:02.194 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-11T01:06:02.194 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T01:06:02.194 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-11T01:06:02.194 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-11T01:06:02.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T01:06:02.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:06:02.375 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-11T01:06:02.376 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T01:06:02.376 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-11T01:06:02.376 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-11T01:06:02.376 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T01:06:02.376 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-11T01:06:02.376 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-11T01:06:02.376 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-11T01:06:02.376 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-11T01:06:02.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T01:06:02.598 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:02 smithi103 ceph-mon[30562]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:06:02.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:06:02.617 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T01:06:02.617 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-11T01:06:02.618 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-11T01:06:02.618 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T01:06:02.618 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-11T01:06:02.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T01:06:02.777 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:06:02.785 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-11T01:06:02.785 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T01:06:02.785 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-11T01:06:02.820 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-11T01:06:02.821 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T01:06:02.821 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-11T01:06:02.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:02 smithi117 ceph-mon[35358]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:06:02.897 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-11T01:06:02.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:02 smithi183 ceph-mon[34992]: pgmap v328: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:06:02.996 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T01:06:03.033 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-11T01:06:03.034 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-11T01:06:03.034 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-11T01:06:03.034 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-11T01:06:03.034 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-11T01:06:03.034 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-11T01:06:03.034 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-11T01:06:03.035 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-11T01:06:03.035 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-11T01:06:03.035 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-11T01:06:03.035 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-11T01:06:03.035 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-11T01:06:03.035 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T01:06:03.035 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-11T01:06:03.035 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-11T01:06:03.035 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-11T01:06:03.035 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-11T01:06:03.035 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-11T01:06:03.035 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T01:06:03.036 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-11T01:06:03.036 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T01:06:03.036 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T01:06:03.036 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T01:06:03.036 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-11T01:06:03.036 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-11T01:06:03.036 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay 2024-09-11T01:06:03.036 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/9e3fe79cf30ea98fc211b2eb873a4441b049babd120ab1918019fc51335b1f77/merged 2024-09-11T01:06:03.036 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/a3c751d60a77010bfc64634155ead11214ab9c995a245bb41bc930f0c4e61d18/merged 2024-09-11T01:06:03.036 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/0 2024-09-11T01:06:03.036 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T01:06:03.036 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/3b93a4aac0cab2969864b250eef10f8855192b2f85ac74d385e3534efb16d3b2/merged 2024-09-11T01:06:03.036 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/31d249bd55cc182b78d5f7a6276c944391fe5d277702c91ca826c7ce05bac30e/merged 2024-09-11T01:06:03.037 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/3a91cc56346ab82af9af30ccfa371af0a5ea1252c2aa1d4bcdc8b08fc0d90d88/merged 2024-09-11T01:06:03.037 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/f180ee1cb6f792dcfb7dbc18d8f7a2a0fbabacf7e6330a00b19259707d60dce6/merged 2024-09-11T01:06:03.037 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/1aeafc8d9142fc781a2a2dc8b08f810ee8004897eb5639d17f5f4355c9576163/merged 2024-09-11T01:06:03.037 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/c1f3b3d08e949aeb65b0b08ceda805c00a7a4c94d4b445e15cbb43b3f0c5d4d0/merged 2024-09-11T01:06:03.037 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/ba831c1c60d530c5d6ac42df7ac6fd283790e32022f68c023cf6fdb5c8ba2802/merged 2024-09-11T01:06:03.037 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/a2ea4160f9d1f3d61daba6a75cb7828ae7f5fac31d1e7e5af0346bff17067ae6/merged 2024-09-11T01:06:03.037 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-11T01:06:03.037 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T01:06:03.037 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T01:06:03.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:06:03.039 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-11T01:06:03.118 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-11T01:06:03.118 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-11T01:06:03.164 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-11T01:06:03.222 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T01:06:03.258 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-11T01:06:03.258 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-11T01:06:03.259 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-11T01:06:03.259 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-11T01:06:03.259 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-11T01:06:03.259 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-11T01:06:03.259 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-11T01:06:03.259 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-11T01:06:03.259 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-11T01:06:03.259 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-11T01:06:03.259 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-11T01:06:03.259 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-11T01:06:03.259 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T01:06:03.259 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-11T01:06:03.260 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-11T01:06:03.260 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-11T01:06:03.260 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-11T01:06:03.260 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-11T01:06:03.260 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T01:06:03.260 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-11T01:06:03.260 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T01:06:03.260 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T01:06:03.260 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T01:06:03.260 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-11T01:06:03.260 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-11T01:06:03.260 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay 2024-09-11T01:06:03.260 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/9e3fe79cf30ea98fc211b2eb873a4441b049babd120ab1918019fc51335b1f77/merged 2024-09-11T01:06:03.260 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/a3c751d60a77010bfc64634155ead11214ab9c995a245bb41bc930f0c4e61d18/merged 2024-09-11T01:06:03.261 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/0 2024-09-11T01:06:03.261 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T01:06:03.261 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/3b93a4aac0cab2969864b250eef10f8855192b2f85ac74d385e3534efb16d3b2/merged 2024-09-11T01:06:03.261 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/31d249bd55cc182b78d5f7a6276c944391fe5d277702c91ca826c7ce05bac30e/merged 2024-09-11T01:06:03.261 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/3a91cc56346ab82af9af30ccfa371af0a5ea1252c2aa1d4bcdc8b08fc0d90d88/merged 2024-09-11T01:06:03.261 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/f180ee1cb6f792dcfb7dbc18d8f7a2a0fbabacf7e6330a00b19259707d60dce6/merged 2024-09-11T01:06:03.261 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/1aeafc8d9142fc781a2a2dc8b08f810ee8004897eb5639d17f5f4355c9576163/merged 2024-09-11T01:06:03.261 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/c1f3b3d08e949aeb65b0b08ceda805c00a7a4c94d4b445e15cbb43b3f0c5d4d0/merged 2024-09-11T01:06:03.261 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/ba831c1c60d530c5d6ac42df7ac6fd283790e32022f68c023cf6fdb5c8ba2802/merged 2024-09-11T01:06:03.261 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/a2ea4160f9d1f3d61daba6a75cb7828ae7f5fac31d1e7e5af0346bff17067ae6/merged 2024-09-11T01:06:03.261 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-11T01:06:03.261 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T01:06:03.261 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T01:06:03.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:06:03.262 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-11T01:06:03.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:2024-09-11T01:06:03.338+0000 7fdaa46d3480 -1 init, newargv = 0x564af2b63750 newargc=15 2024-09-11T01:06:03.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[77680]: starting ceph client 2024-09-11T01:06:03.350 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[77680]: starting fuse 2024-09-11T01:06:04.441 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-09-11T01:06:04.506 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-09-11T01:06:04.544 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-09-11T01:06:04.544 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-09-11T01:06:04.544 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-09-11T01:06:04.544 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-09-11T01:06:04.544 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-09-11T01:06:04.545 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-09-11T01:06:04.545 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-09-11T01:06:04.545 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-09-11T01:06:04.545 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-09-11T01:06:04.545 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-09-11T01:06:04.545 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-09-11T01:06:04.545 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-09-11T01:06:04.545 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T01:06:04.545 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-09-11T01:06:04.545 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-09-11T01:06:04.545 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-09-11T01:06:04.545 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-09-11T01:06:04.546 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-09-11T01:06:04.546 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-09-11T01:06:04.546 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-09-11T01:06:04.546 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-11T01:06:04.546 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-11T01:06:04.546 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-09-11T01:06:04.546 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-09-11T01:06:04.546 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-09-11T01:06:04.546 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay 2024-09-11T01:06:04.546 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/9e3fe79cf30ea98fc211b2eb873a4441b049babd120ab1918019fc51335b1f77/merged 2024-09-11T01:06:04.546 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/a3c751d60a77010bfc64634155ead11214ab9c995a245bb41bc930f0c4e61d18/merged 2024-09-11T01:06:04.546 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/0 2024-09-11T01:06:04.547 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-09-11T01:06:04.547 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/3b93a4aac0cab2969864b250eef10f8855192b2f85ac74d385e3534efb16d3b2/merged 2024-09-11T01:06:04.547 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/31d249bd55cc182b78d5f7a6276c944391fe5d277702c91ca826c7ce05bac30e/merged 2024-09-11T01:06:04.547 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/3a91cc56346ab82af9af30ccfa371af0a5ea1252c2aa1d4bcdc8b08fc0d90d88/merged 2024-09-11T01:06:04.547 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/f180ee1cb6f792dcfb7dbc18d8f7a2a0fbabacf7e6330a00b19259707d60dce6/merged 2024-09-11T01:06:04.547 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/1aeafc8d9142fc781a2a2dc8b08f810ee8004897eb5639d17f5f4355c9576163/merged 2024-09-11T01:06:04.547 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/c1f3b3d08e949aeb65b0b08ceda805c00a7a4c94d4b445e15cbb43b3f0c5d4d0/merged 2024-09-11T01:06:04.547 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/ba831c1c60d530c5d6ac42df7ac6fd283790e32022f68c023cf6fdb5c8ba2802/merged 2024-09-11T01:06:04.547 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/a2ea4160f9d1f3d61daba6a75cb7828ae7f5fac31d1e7e5af0346bff17067ae6/merged 2024-09-11T01:06:04.547 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-09-11T01:06:04.547 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T01:06:04.547 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T01:06:04.548 INFO:teuthology.orchestra.run.smithi103.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-11T01:06:04.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:06:04.549 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-09-11T01:06:04.625 INFO:teuthology.orchestra.run.smithi103.stdout:120 2024-09-11T01:06:04.626 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-11T01:06:04.626 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-09-11T01:06:04.626 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-09-11T01:06:04.626 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-09-11T01:06:04.626 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-09-11T01:06:04.626 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-09-11T01:06:04.626 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-11T01:06:04.626 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-09-11T01:06:04.626 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-09-11T01:06:04.627 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-09-11T01:06:04.628 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-11T01:06:04.628 DEBUG:teuthology.orchestra.run.smithi103:> 2024-09-11T01:06:04.628 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.admin")) 2024-09-11T01:06:04.628 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-09-11T01:06:04.789 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.admin.77680.asok 2024-09-11T01:06:04.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:06:04.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:04 smithi103 ceph-mon[30562]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:06:04.803 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.77680.asok 2024-09-11T01:06:04.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:06:04.804 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.77680.asok status 2024-09-11T01:06:04.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:04 smithi117 ceph-mon[35358]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:06:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:04 smithi183 ceph-mon[34992]: pgmap v329: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:06:04.990 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:06:04.990 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-09-11T01:06:04.990 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "8f219c476cb4f26fc5719c661c0323719a45cb30", 2024-09-11T01:06:04.990 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.3.0-4854-g8f219c47 (8f219c476cb4f26fc5719c661c0323719a45cb30) squid (dev)", 2024-09-11T01:06:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "admin", 2024-09-11T01:06:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-09-11T01:06:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-11T01:06:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "77680", 2024-09-11T01:06:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-09-11T01:06:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:06:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-09-11T01:06:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-09-11T01:06:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 14763, 2024-09-11T01:06:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-09-11T01:06:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-09-11T01:06:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-09-11T01:06:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 14763 2024-09-11T01:06:04.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:06:04.992 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-11T01:06:04.992 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-11T01:06:04.992 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-11T01:06:04.992 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3302874336 2024-09-11T01:06:04.992 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:06:04.992 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:06:04.992 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-09-11T01:06:04.992 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-11T01:06:04.992 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-09-11T01:06:04.992 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3302874336 2024-09-11T01:06:04.992 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:06:04.992 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.14763 192.168.0.1:0/3302874336", 2024-09-11T01:06:04.992 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/3302874336", 2024-09-11T01:06:04.993 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-09-11T01:06:04.993 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 17, 2024-09-11T01:06:04.993 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 87, 2024-09-11T01:06:04.993 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-09-11T01:06:04.993 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-09-11T01:06:04.993 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-09-11T01:06:04.993 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:06:05.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:06:05.003 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-09-11T01:06:05.003 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-11T01:06:05.041 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-09-11T01:06:05.041 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-11T01:06:05.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:06:05.042 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-11T01:06:05.140 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-11T01:06:05.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:05 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T01:06:05.248 INFO:teuthology.orchestra.run.smithi103.stdout:# file: . 2024-09-11T01:06:05.248 INFO:teuthology.orchestra.run.smithi103.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-11T01:06:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:06:05.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:06:05.257 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T01:06:05.257 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T01:06:05.294 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T01:06:05.705 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:06.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.318+0000 7f5690200640 1 -- 172.21.15.103:0/769722394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56881045b0 msgr2=0x7f568810caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:06.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.318+0000 7f5690200640 1 --2- 172.21.15.103:0/769722394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56881045b0 0x7f568810caa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5674009900 tx=0x7f567402a400 comp rx=0 tx=0).stop 2024-09-11T01:06:06.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.318+0000 7f5690200640 1 -- 172.21.15.103:0/769722394 shutdown_connections 2024-09-11T01:06:06.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.318+0000 7f5690200640 1 --2- 172.21.15.103:0/769722394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f568810d0f0 0x7f568810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:06.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.318+0000 7f5690200640 1 --2- 172.21.15.103:0/769722394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56881045b0 0x7f568810caa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:06.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.318+0000 7f5690200640 1 --2- 172.21.15.103:0/769722394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5688103c90 0x7f5688104070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:06.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.318+0000 7f5690200640 1 -- 172.21.15.103:0/769722394 >> 172.21.15.103:0/769722394 conn(0x7f56880fd710 msgr2=0x7f56880ffb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:06.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.318+0000 7f5690200640 1 -- 172.21.15.103:0/769722394 shutdown_connections 2024-09-11T01:06:06.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.319+0000 7f5690200640 1 -- 172.21.15.103:0/769722394 wait complete. 2024-09-11T01:06:06.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.319+0000 7f5690200640 1 Processor -- start 2024-09-11T01:06:06.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.319+0000 7f5690200640 1 -- start start 2024-09-11T01:06:06.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.320+0000 7f5690200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5688103c90 0x7f5688101940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:06.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.320+0000 7f5690200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56881045b0 0x7f5688101e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:06.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.320+0000 7f5690200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f568810d0f0 0x7f56881023c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:06.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.320+0000 7f5690200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5688112db0 con 0x7f56881045b0 2024-09-11T01:06:06.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.320+0000 7f5690200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5688112c30 con 0x7f568810d0f0 2024-09-11T01:06:06.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.320+0000 7f5690200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5688112f30 con 0x7f5688103c90 2024-09-11T01:06:06.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.320+0000 7f568ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56881045b0 0x7f5688101e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:06.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.320+0000 7f568ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56881045b0 0x7f5688101e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36106/0 (socket says 172.21.15.103:36106) 2024-09-11T01:06:06.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.320+0000 7f568ce00640 1 -- 172.21.15.103:0/210429525 learned_addr learned my addr 172.21.15.103:0/210429525 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:06.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.320+0000 7f568d800640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5688103c90 0x7f5688101940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:06.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.320+0000 7f568e200640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f568810d0f0 0x7f56881023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:06.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.321+0000 7f568d800640 1 -- 172.21.15.103:0/210429525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f568810d0f0 msgr2=0x7f56881023c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:06.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.321+0000 7f568d800640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f568810d0f0 0x7f56881023c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:06.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.321+0000 7f568d800640 1 -- 172.21.15.103:0/210429525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56881045b0 msgr2=0x7f5688101e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:06.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.321+0000 7f568d800640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56881045b0 0x7f5688101e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:06.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.321+0000 7f568d800640 1 -- 172.21.15.103:0/210429525 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56881a76c0 con 0x7f5688103c90 2024-09-11T01:06:06.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.321+0000 7f568ce00640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56881045b0 0x7f5688101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:06.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.321+0000 7f568d800640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5688103c90 0x7f5688101940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f567c00e9f0 tx=0x7f567c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:06.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.321+0000 7f5686000640 1 -- 172.21.15.103:0/210429525 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c00ccc0 con 0x7f5688103c90 2024-09-11T01:06:06.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.321+0000 7f5686000640 1 -- 172.21.15.103:0/210429525 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f567c0108e0 con 0x7f5688103c90 2024-09-11T01:06:06.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.321+0000 7f5690200640 1 -- 172.21.15.103:0/210429525 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56881a79b0 con 0x7f5688103c90 2024-09-11T01:06:06.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.321+0000 7f5686000640 1 -- 172.21.15.103:0/210429525 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c018880 con 0x7f5688103c90 2024-09-11T01:06:06.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.321+0000 7f5690200640 1 -- 172.21.15.103:0/210429525 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56881a7ec0 con 0x7f5688103c90 2024-09-11T01:06:06.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.322+0000 7f5690200640 1 -- 172.21.15.103:0/210429525 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5688104070 con 0x7f5688103c90 2024-09-11T01:06:06.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.325+0000 7f5686000640 1 -- 172.21.15.103:0/210429525 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f567c010430 con 0x7f5688103c90 2024-09-11T01:06:06.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.326+0000 7f5686000640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f56700b52e0 0x7f56700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:06.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.326+0000 7f5686000640 1 -- 172.21.15.103:0/210429525 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f567c0e66f0 con 0x7f5688103c90 2024-09-11T01:06:06.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.326+0000 7f568ce00640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f56700b52e0 0x7f56700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:06.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.327+0000 7f568ce00640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f56700b52e0 0x7f56700b77a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5674000c00 tx=0x7f5674005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:06.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.328+0000 7f5686000640 1 -- 172.21.15.103:0/210429525 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f567c0acbc0 con 0x7f5688103c90 2024-09-11T01:06:06.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.526+0000 7f5690200640 1 -- 172.21.15.103:0/210429525 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5688102c40 con 0x7f5688103c90 2024-09-11T01:06:06.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.526+0000 7f5686000640 1 -- 172.21.15.103:0/210429525 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+597 (secure 0 0 0) 0x7f567c0b15f0 con 0x7f5688103c90 2024-09-11T01:06:06.529 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/366890372 2024-09-12T00:57:39.411408+0000 2024-09-11T01:06:06.529 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/115727473 2024-09-12T00:57:39.411408+0000 2024-09-11T01:06:06.529 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2372812363 2024-09-12T00:57:39.411408+0000 2024-09-11T01:06:06.529 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2844264136 2024-09-12T00:57:11.412015+0000 2024-09-11T01:06:06.529 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2046654364 2024-09-12T00:57:39.411408+0000 2024-09-11T01:06:06.530 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/115727473 2024-09-12T00:57:39.411408+0000 2024-09-11T01:06:06.530 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/211510947 2024-09-12T00:57:11.412015+0000 2024-09-11T01:06:06.530 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/2110498702 2024-09-12T00:57:11.412015+0000 2024-09-11T01:06:06.530 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/2110498702 2024-09-12T00:57:11.412015+0000 2024-09-11T01:06:06.530 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/189409602 2024-09-12T00:57:11.412015+0000 2024-09-11T01:06:06.530 INFO:teuthology.orchestra.run.smithi103.stderr:listed 10 entries 2024-09-11T01:06:06.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.530+0000 7f5690200640 1 -- 172.21.15.103:0/210429525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f56700b52e0 msgr2=0x7f56700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:06.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.530+0000 7f5690200640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f56700b52e0 0x7f56700b77a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5674000c00 tx=0x7f5674005a20 comp rx=0 tx=0).stop 2024-09-11T01:06:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.530+0000 7f5690200640 1 -- 172.21.15.103:0/210429525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5688103c90 msgr2=0x7f5688101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.530+0000 7f5690200640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5688103c90 0x7f5688101940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f567c00e9f0 tx=0x7f567c00eeb0 comp rx=0 tx=0).stop 2024-09-11T01:06:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.530+0000 7f5690200640 1 -- 172.21.15.103:0/210429525 shutdown_connections 2024-09-11T01:06:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.530+0000 7f5690200640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f56700b52e0 0x7f56700b77a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.530+0000 7f5690200640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f568810d0f0 0x7f56881023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.530+0000 7f5690200640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f56881045b0 0x7f5688101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.530+0000 7f5690200640 1 --2- 172.21.15.103:0/210429525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5688103c90 0x7f5688101940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.530+0000 7f5690200640 1 -- 172.21.15.103:0/210429525 >> 172.21.15.103:0/210429525 conn(0x7f56880fd710 msgr2=0x7f56880fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.530+0000 7f5690200640 1 -- 172.21.15.103:0/210429525 shutdown_connections 2024-09-11T01:06:06.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:06.530+0000 7f5690200640 1 -- 172.21.15.103:0/210429525 wait complete. 2024-09-11T01:06:06.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:06 smithi103 ceph-mon[30562]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-11T01:06:06.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:06 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/210429525' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T01:06:06.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:06 smithi117 ceph-mon[35358]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-11T01:06:06.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:06 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/210429525' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T01:06:06.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:06 smithi183 ceph-mon[34992]: pgmap v330: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-11T01:06:06.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:06 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/210429525' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T01:06:07.495 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T01:06:07.495 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T01:06:07.532 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T01:06:07.949 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:08.594 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:08 smithi103 ceph-mon[30562]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-11T01:06:08.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.694+0000 7ff506a00640 1 -- 172.21.15.103:0/2049088955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff500075540 msgr2=0x7ff500075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:08.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.694+0000 7ff506a00640 1 --2- 172.21.15.103:0/2049088955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff500075540 0x7ff500075920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4009900 tx=0x7ff4f402a410 comp rx=0 tx=0).stop 2024-09-11T01:06:08.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.694+0000 7ff506a00640 1 -- 172.21.15.103:0/2049088955 shutdown_connections 2024-09-11T01:06:08.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.694+0000 7ff506a00640 1 --2- 172.21.15.103:0/2049088955 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff50010f230 0x7ff500111620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:08.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.694+0000 7ff506a00640 1 --2- 172.21.15.103:0/2049088955 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff500075f40 0x7ff50010ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:08.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.694+0000 7ff506a00640 1 --2- 172.21.15.103:0/2049088955 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff500075540 0x7ff500075920 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:08.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.694+0000 7ff506a00640 1 -- 172.21.15.103:0/2049088955 >> 172.21.15.103:0/2049088955 conn(0x7ff5000fe6c0 msgr2=0x7ff500100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:08.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.694+0000 7ff506a00640 1 -- 172.21.15.103:0/2049088955 shutdown_connections 2024-09-11T01:06:08.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.694+0000 7ff506a00640 1 -- 172.21.15.103:0/2049088955 wait complete. 2024-09-11T01:06:08.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.695+0000 7ff506a00640 1 Processor -- start 2024-09-11T01:06:08.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.695+0000 7ff506a00640 1 -- start start 2024-09-11T01:06:08.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.695+0000 7ff506a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff500075540 0x7ff50019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:08.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.695+0000 7ff506a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff500075f40 0x7ff50019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:08.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.695+0000 7ff506a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50010f230 0x7ff5001a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:08.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.695+0000 7ff506a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff500114de0 con 0x7ff50010f230 2024-09-11T01:06:08.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.695+0000 7ff506a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff500114c60 con 0x7ff500075540 2024-09-11T01:06:08.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.695+0000 7ff506a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff500114f60 con 0x7ff500075f40 2024-09-11T01:06:08.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.696+0000 7ff506000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50010f230 0x7ff5001a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:08.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.696+0000 7ff506000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50010f230 0x7ff5001a0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36136/0 (socket says 172.21.15.103:36136) 2024-09-11T01:06:08.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.696+0000 7ff506000640 1 -- 172.21.15.103:0/1535405958 learned_addr learned my addr 172.21.15.103:0/1535405958 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:08.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.696+0000 7ff505600640 1 --2- 172.21.15.103:0/1535405958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff500075540 0x7ff50019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:08.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.696+0000 7ff504c00640 1 --2- 172.21.15.103:0/1535405958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff500075f40 0x7ff50019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:08.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.696+0000 7ff506000640 1 -- 172.21.15.103:0/1535405958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff500075f40 msgr2=0x7ff50019b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:08.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.696+0000 7ff506000640 1 --2- 172.21.15.103:0/1535405958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff500075f40 0x7ff50019b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:08.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.696+0000 7ff506000640 1 -- 172.21.15.103:0/1535405958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff500075540 msgr2=0x7ff50019b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:08.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.696+0000 7ff506000640 1 --2- 172.21.15.103:0/1535405958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff500075540 0x7ff50019b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:08.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.696+0000 7ff506000640 1 -- 172.21.15.103:0/1535405958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5001a13c0 con 0x7ff50010f230 2024-09-11T01:06:08.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.696+0000 7ff506000640 1 --2- 172.21.15.103:0/1535405958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50010f230 0x7ff5001a0bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800eb40 tx=0x7ff4f800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:08.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.697+0000 7ff4fe000640 1 -- 172.21.15.103:0/1535405958 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8004b20 con 0x7ff50010f230 2024-09-11T01:06:08.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.697+0000 7ff4fe000640 1 -- 172.21.15.103:0/1535405958 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4f8004cc0 con 0x7ff50010f230 2024-09-11T01:06:08.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.697+0000 7ff506a00640 1 -- 172.21.15.103:0/1535405958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5001a16b0 con 0x7ff50010f230 2024-09-11T01:06:08.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.697+0000 7ff4fe000640 1 -- 172.21.15.103:0/1535405958 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8010720 con 0x7ff50010f230 2024-09-11T01:06:08.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.697+0000 7ff506a00640 1 -- 172.21.15.103:0/1535405958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5001a7d70 con 0x7ff50010f230 2024-09-11T01:06:08.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.698+0000 7ff506a00640 1 -- 172.21.15.103:0/1535405958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff500075920 con 0x7ff50010f230 2024-09-11T01:06:08.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.700+0000 7ff4fe000640 1 -- 172.21.15.103:0/1535405958 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7ff4f8005560 con 0x7ff50010f230 2024-09-11T01:06:08.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.702+0000 7ff4fe000640 1 --2- 172.21.15.103:0/1535405958 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff4e80b5390 0x7ff4e80b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:08.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.702+0000 7ff4fe000640 1 -- 172.21.15.103:0/1535405958 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7ff4f80e6670 con 0x7ff50010f230 2024-09-11T01:06:08.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.702+0000 7ff505600640 1 --2- 172.21.15.103:0/1535405958 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff4e80b5390 0x7ff4e80b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:08.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.703+0000 7ff505600640 1 --2- 172.21.15.103:0/1535405958 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff4e80b5390 0x7ff4e80b7850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4031440 tx=0x7ff4f4005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:08.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.703+0000 7ff4fe000640 1 -- 172.21.15.103:0/1535405958 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff4f80ad190 con 0x7ff50010f230 2024-09-11T01:06:08.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:08 smithi117 ceph-mon[35358]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-11T01:06:08.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.901+0000 7ff506a00640 1 -- 172.21.15.103:0/1535405958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff50019c440 con 0x7ff50010f230 2024-09-11T01:06:08.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.901+0000 7ff4fe000640 1 -- 172.21.15.103:0/1535405958 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+597 (secure 0 0 0) 0x7ff4f80aca90 con 0x7ff50010f230 2024-09-11T01:06:08.904 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/366890372 2024-09-12T00:57:39.411408+0000 2024-09-11T01:06:08.905 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/115727473 2024-09-12T00:57:39.411408+0000 2024-09-11T01:06:08.905 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2372812363 2024-09-12T00:57:39.411408+0000 2024-09-11T01:06:08.905 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2844264136 2024-09-12T00:57:11.412015+0000 2024-09-11T01:06:08.905 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2046654364 2024-09-12T00:57:39.411408+0000 2024-09-11T01:06:08.905 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/115727473 2024-09-12T00:57:39.411408+0000 2024-09-11T01:06:08.905 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/211510947 2024-09-12T00:57:11.412015+0000 2024-09-11T01:06:08.905 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/2110498702 2024-09-12T00:57:11.412015+0000 2024-09-11T01:06:08.905 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/2110498702 2024-09-12T00:57:11.412015+0000 2024-09-11T01:06:08.905 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/189409602 2024-09-12T00:57:11.412015+0000 2024-09-11T01:06:08.905 INFO:teuthology.orchestra.run.smithi103.stderr:listed 10 entries 2024-09-11T01:06:08.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.904+0000 7ff506a00640 1 -- 172.21.15.103:0/1535405958 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff4e80b5390 msgr2=0x7ff4e80b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:08.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.904+0000 7ff506a00640 1 --2- 172.21.15.103:0/1535405958 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff4e80b5390 0x7ff4e80b7850 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4031440 tx=0x7ff4f4005b50 comp rx=0 tx=0).stop 2024-09-11T01:06:08.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.904+0000 7ff506a00640 1 -- 172.21.15.103:0/1535405958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50010f230 msgr2=0x7ff5001a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:08.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.904+0000 7ff506a00640 1 --2- 172.21.15.103:0/1535405958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50010f230 0x7ff5001a0bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800eb40 tx=0x7ff4f800c2d0 comp rx=0 tx=0).stop 2024-09-11T01:06:08.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.904+0000 7ff506a00640 1 -- 172.21.15.103:0/1535405958 shutdown_connections 2024-09-11T01:06:08.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.904+0000 7ff506a00640 1 --2- 172.21.15.103:0/1535405958 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff4e80b5390 0x7ff4e80b7850 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:08.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.904+0000 7ff506a00640 1 --2- 172.21.15.103:0/1535405958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff50010f230 0x7ff5001a0bf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:08.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.904+0000 7ff506a00640 1 --2- 172.21.15.103:0/1535405958 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff500075f40 0x7ff50019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:08.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.904+0000 7ff506a00640 1 --2- 172.21.15.103:0/1535405958 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff500075540 0x7ff50019b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:08.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.904+0000 7ff506a00640 1 -- 172.21.15.103:0/1535405958 >> 172.21.15.103:0/1535405958 conn(0x7ff5000fe6c0 msgr2=0x7ff5000ff2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:08.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.904+0000 7ff506a00640 1 -- 172.21.15.103:0/1535405958 shutdown_connections 2024-09-11T01:06:08.908 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:08.904+0000 7ff506a00640 1 -- 172.21.15.103:0/1535405958 wait complete. 2024-09-11T01:06:08.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:08 smithi183 ceph-mon[34992]: pgmap v331: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-11T01:06:09.755 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:09 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1535405958' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T01:06:09.792 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-09-11T01:06:09.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:06:09.792 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-11T01:06:09.847 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[77680]: fuse finished with error 0 and tester_r 0 2024-09-11T01:06:09.851 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T01:06:09.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:09 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1535405958' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T01:06:09.917 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T01:06:09.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:06:09.917 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-11T01:06:09.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:09 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1535405958' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T01:06:09.969 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T01:06:10.339 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:10.773 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:10 smithi103 ceph-mon[30562]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-11T01:06:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:10 smithi117 ceph-mon[35358]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-11T01:06:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.880+0000 7f42aa200640 1 -- 172.21.15.103:0/1884583042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42a41087b0 msgr2=0x7f42a4108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.880+0000 7f42aa200640 1 --2- 172.21.15.103:0/1884583042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42a41087b0 0x7f42a4108bf0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f428c009900 tx=0x7f428c02a410 comp rx=0 tx=0).stop 2024-09-11T01:06:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.880+0000 7f42aa200640 1 -- 172.21.15.103:0/1884583042 shutdown_connections 2024-09-11T01:06:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.880+0000 7f42aa200640 1 --2- 172.21.15.103:0/1884583042 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42a4109130 0x7f42a410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.880+0000 7f42aa200640 1 --2- 172.21.15.103:0/1884583042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42a41087b0 0x7f42a4108bf0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.880+0000 7f42aa200640 1 --2- 172.21.15.103:0/1884583042 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42a4102da0 0x7f42a4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.880+0000 7f42aa200640 1 -- 172.21.15.103:0/1884583042 >> 172.21.15.103:0/1884583042 conn(0x7f42a40fe810 msgr2=0x7f42a4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.880+0000 7f42aa200640 1 -- 172.21.15.103:0/1884583042 shutdown_connections 2024-09-11T01:06:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.880+0000 7f42aa200640 1 -- 172.21.15.103:0/1884583042 wait complete. 2024-09-11T01:06:10.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.881+0000 7f42aa200640 1 Processor -- start 2024-09-11T01:06:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.881+0000 7f42aa200640 1 -- start start 2024-09-11T01:06:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.881+0000 7f42aa200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42a4102da0 0x7f42a419b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.881+0000 7f42aa200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42a41087b0 0x7f42a419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f42aa200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42a4109130 0x7f42a41a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f42aa200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f42a4112df0 con 0x7f42a4109130 2024-09-11T01:06:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f42aa200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f42a4112c70 con 0x7f42a41087b0 2024-09-11T01:06:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f42aa200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f42a4112f70 con 0x7f42a4102da0 2024-09-11T01:06:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f42a3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42a4109130 0x7f42a41a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f42a3400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42a4102da0 0x7f42a419b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f42a3400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42a4102da0 0x7f42a419b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:47786/0 (socket says 172.21.15.103:47786) 2024-09-11T01:06:10.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f42a3400640 1 -- 172.21.15.103:0/830839682 learned_addr learned my addr 172.21.15.103:0/830839682 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f429be00640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42a41087b0 0x7f42a419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f42a3400640 1 -- 172.21.15.103:0/830839682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42a41087b0 msgr2=0x7f42a419ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f42a3400640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42a41087b0 0x7f42a419ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f42a3400640 1 -- 172.21.15.103:0/830839682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42a4109130 msgr2=0x7f42a41a0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f42a3400640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42a4109130 0x7f42a41a0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f42a3400640 1 -- 172.21.15.103:0/830839682 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a41a15d0 con 0x7f42a4102da0 2024-09-11T01:06:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f42a3e00640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42a4109130 0x7f42a41a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.882+0000 7f429be00640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42a41087b0 0x7f42a419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.883+0000 7f42a3400640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42a4102da0 0x7f42a419b520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f429400e9f0 tx=0x7f429400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.883+0000 7f42a0c00640 1 -- 172.21.15.103:0/830839682 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f429400cd80 con 0x7f42a4102da0 2024-09-11T01:06:10.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.883+0000 7f42a0c00640 1 -- 172.21.15.103:0/830839682 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f42940108e0 con 0x7f42a4102da0 2024-09-11T01:06:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.883+0000 7f42aa200640 1 -- 172.21.15.103:0/830839682 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a41a18c0 con 0x7f42a4102da0 2024-09-11T01:06:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.883+0000 7f42a0c00640 1 -- 172.21.15.103:0/830839682 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4294018980 con 0x7f42a4102da0 2024-09-11T01:06:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.883+0000 7f42aa200640 1 -- 172.21.15.103:0/830839682 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a41a8150 con 0x7f42a4102da0 2024-09-11T01:06:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.884+0000 7f42aa200640 1 -- 172.21.15.103:0/830839682 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a4104050 con 0x7f42a4102da0 2024-09-11T01:06:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.886+0000 7f42a0c00640 1 -- 172.21.15.103:0/830839682 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f4294010430 con 0x7f42a4102da0 2024-09-11T01:06:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.888+0000 7f42a0c00640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f42880b5360 0x7f42880b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.888+0000 7f42a0c00640 1 -- 172.21.15.103:0/830839682 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f42940e6470 con 0x7f42a4102da0 2024-09-11T01:06:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.888+0000 7f429be00640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f42880b5360 0x7f42880b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.889+0000 7f429be00640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f42880b5360 0x7f42880b7820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f428c031440 tx=0x7f428c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:10.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:10.889+0000 7f42a0c00640 1 -- 172.21.15.103:0/830839682 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f42940ac940 con 0x7f42a4102da0 2024-09-11T01:06:10.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:10 smithi183 ceph-mon[34992]: pgmap v332: 129 pgs: 129 active+clean; 579 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 170 B/s wr, 0 op/s 2024-09-11T01:06:11.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:11.074+0000 7f42aa200640 1 -- 172.21.15.103:0/830839682 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42a4103180 con 0x7f42a4102da0 2024-09-11T01:06:11.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:11.075+0000 7f42a0c00640 1 -- 172.21.15.103:0/830839682 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24796 (secure 0 0 0) 0x7f42940b1370 con 0x7f42a4102da0 2024-09-11T01:06:11.078 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:06:11.079 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":87,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","created":"2024-09-11T00:56:46.242882+0000","modified":"2024-09-11T01:05:45.069528+0000","last_up_change":"2024-09-11T01:04:34.895368+0000","last_in_change":"2024-09-11T01:04:11.663436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:00:33.745338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T01:05:27.486014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T01:05:29.797513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T01:05:38.956635+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1b3e4222-43fd-4af0-bf97-3ba1000221b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6803","nonce":1867193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6805","nonce":1867193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6809","nonce":1867193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6807","nonce":1867193874}]},"public_addr":"172.21.15.103:6803/1867193874","cluster_addr":"172.21.15.103:6805/1867193874","heartbeat_back_addr":"172.21.15.103:6809/1867193874","heartbeat_front_addr":"172.21.15.103:6807/1867193874","state":["exists","up"]},{"osd":1,"uuid":"9a2b40da-7361-4c4f-a9dc-a769b427a0fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6801","nonce":2629532556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6803","nonce":2629532556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6807","nonce":2629532556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6805","nonce":2629532556}]},"public_addr":"172.21.15.117:6801/2629532556","cluster_addr":"172.21.15.117:6803/2629532556","heartbeat_back_addr":"172.21.15.117:6807/2629532556","heartbeat_front_addr":"172.21.15.117:6805/2629532556","state":["exists","up"]},{"osd":2,"uuid":"5db919c1-90a7-4ba7-acf3-89eeb77ae131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6801","nonce":3208966770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6803","nonce":3208966770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6807","nonce":3208966770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6805","nonce":3208966770}]},"public_addr":"172.21.15.183:6801/3208966770","cluster_addr":"172.21.15.183:6803/3208966770","heartbeat_back_addr":"172.21.15.183:6807/3208966770","heartbeat_front_addr":"172.21.15.183:6805/3208966770","state":["exists","up"]},{"osd":3,"uuid":"bdc465f2-06a5-4667-9651-4e168700d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6811","nonce":2238128162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6813","nonce":2238128162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6817","nonce":2238128162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6815","nonce":2238128162}]},"public_addr":"172.21.15.103:6811/2238128162","cluster_addr":"172.21.15.103:6813/2238128162","heartbeat_back_addr":"172.21.15.103:6817/2238128162","heartbeat_front_addr":"172.21.15.103:6815/2238128162","state":["exists","up"]},{"osd":4,"uuid":"be86a5d2-5e86-4bf4-8464-9dff7a801e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6809","nonce":2368878504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6811","nonce":2368878504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6815","nonce":2368878504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6813","nonce":2368878504}]},"public_addr":"172.21.15.117:6809/2368878504","cluster_addr":"172.21.15.117:6811/2368878504","heartbeat_back_addr":"172.21.15.117:6815/2368878504","heartbeat_front_addr":"172.21.15.117:6813/2368878504","state":["exists","up"]},{"osd":5,"uuid":"090b20ec-d9ff-4e10-ad9f-52ab41dbf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6809","nonce":1668069547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6811","nonce":1668069547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6815","nonce":1668069547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6813","nonce":1668069547}]},"public_addr":"172.21.15.183:6809/1668069547","cluster_addr":"172.21.15.183:6811/1668069547","heartbeat_back_addr":"172.21.15.183:6815/1668069547","heartbeat_front_addr":"172.21.15.183:6813/1668069547","state":["exists","up"]},{"osd":6,"uuid":"19abe982-3522-40f9-a628-ddaef462cdb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6819","nonce":4203476972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6821","nonce":4203476972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6825","nonce":4203476972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6823","nonce":4203476972}]},"public_addr":"172.21.15.103:6819/4203476972","cluster_addr":"172.21.15.103:6821/4203476972","heartbeat_back_addr":"172.21.15.103:6825/4203476972","heartbeat_front_addr":"172.21.15.103:6823/4203476972","state":["exists","up"]},{"osd":7,"uuid":"e875ff09-805a-40ff-9d6a-dd2607ce3432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6817","nonce":1207680713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6819","nonce":1207680713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6823","nonce":1207680713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6821","nonce":1207680713}]},"public_addr":"172.21.15.117:6817/1207680713","cluster_addr":"172.21.15.117:6819/1207680713","heartbeat_back_addr":"172.21.15.117:6823/1207680713","heartbeat_front_addr":"172.21.15.117:6821/1207680713","state":["exists","up"]},{"osd":8,"uuid":"2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6817","nonce":2935820593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6819","nonce":2935820593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6823","nonce":2935820593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6821","nonce":2935820593}]},"public_addr":"172.21.15.183:6817/2935820593","cluster_addr":"172.21.15.183:6819/2935820593","heartbeat_back_addr":"172.21.15.183:6823/2935820593","heartbeat_front_addr":"172.21.15.183:6821/2935820593","state":["exists","up"]},{"osd":9,"uuid":"c36d17d2-0bc8-4322-a998-9c8eff970e58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6827","nonce":2104855877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6829","nonce":2104855877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6833","nonce":2104855877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6831","nonce":2104855877}]},"public_addr":"172.21.15.103:6827/2104855877","cluster_addr":"172.21.15.103:6829/2104855877","heartbeat_back_addr":"172.21.15.103:6833/2104855877","heartbeat_front_addr":"172.21.15.103:6831/2104855877","state":["exists","up"]},{"osd":10,"uuid":"e71bc5f7-a829-43cf-a10b-b2444da1d773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6825","nonce":3792981873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6827","nonce":3792981873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6831","nonce":3792981873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6829","nonce":3792981873}]},"public_addr":"172.21.15.117:6825/3792981873","cluster_addr":"172.21.15.117:6827/3792981873","heartbeat_back_addr":"172.21.15.117:6831/3792981873","heartbeat_front_addr":"172.21.15.117:6829/3792981873","state":["exists","up"]},{"osd":11,"uuid":"8f36697f-4d18-4efa-bf14-d68a13464958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6825","nonce":1250387289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6827","nonce":1250387289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6831","nonce":1250387289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6829","nonce":1250387289}]},"public_addr":"172.21.15.183:6825/1250387289","cluster_addr":"172.21.15.183:6827/1250387289","heartbeat_back_addr":"172.21.15.183:6831/1250387289","heartbeat_front_addr":"172.21.15.183:6829/1250387289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:59:39.916330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:06.042858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:30.703648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:59.493376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:25.190299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:50.480326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:20.815441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:46.398318+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:11.499922+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:41.895096+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:08.411538+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:32.943466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/366890372":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6800/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2372812363":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2844264136":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/2046654364":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6801/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/211510947":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6801/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6800/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/189409602":"2024-09-12T00:57:11.412015+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:06:11.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:11.078+0000 7f42aa200640 1 -- 172.21.15.103:0/830839682 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f42880b5360 msgr2=0x7f42880b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:11.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:11.078+0000 7f42aa200640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f42880b5360 0x7f42880b7820 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f428c031440 tx=0x7f428c005b50 comp rx=0 tx=0).stop 2024-09-11T01:06:11.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:11.078+0000 7f42aa200640 1 -- 172.21.15.103:0/830839682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42a4102da0 msgr2=0x7f42a419b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:11.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:11.078+0000 7f42aa200640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42a4102da0 0x7f42a419b520 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f429400e9f0 tx=0x7f429400eeb0 comp rx=0 tx=0).stop 2024-09-11T01:06:11.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:11.078+0000 7f42aa200640 1 -- 172.21.15.103:0/830839682 shutdown_connections 2024-09-11T01:06:11.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:11.078+0000 7f42aa200640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f42880b5360 0x7f42880b7820 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:11.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:11.078+0000 7f42aa200640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f42a4109130 0x7f42a41a0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:11.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:11.078+0000 7f42aa200640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42a41087b0 0x7f42a419ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:11.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:11.078+0000 7f42aa200640 1 --2- 172.21.15.103:0/830839682 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f42a4102da0 0x7f42a419b520 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:11.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:11.078+0000 7f42aa200640 1 -- 172.21.15.103:0/830839682 >> 172.21.15.103:0/830839682 conn(0x7f42a40fe810 msgr2=0x7f42a4104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:11.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:11.078+0000 7f42aa200640 1 -- 172.21.15.103:0/830839682 shutdown_connections 2024-09-11T01:06:11.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:11.078+0000 7f42aa200640 1 -- 172.21.15.103:0/830839682 wait complete. 2024-09-11T01:06:11.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:11 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/830839682' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:11.865 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T01:06:11.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:11 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/830839682' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:11.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:11 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/830839682' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:12.237 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:12.679 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:12 smithi103 ceph-mon[30562]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T01:06:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.786+0000 7fba41e00640 1 -- 172.21.15.103:0/2652040283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c1087b0 msgr2=0x7fba3c108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.786+0000 7fba41e00640 1 --2- 172.21.15.103:0/2652040283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c1087b0 0x7fba3c108bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fba28009900 tx=0x7fba2802a410 comp rx=0 tx=0).stop 2024-09-11T01:06:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.786+0000 7fba41e00640 1 -- 172.21.15.103:0/2652040283 shutdown_connections 2024-09-11T01:06:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.786+0000 7fba41e00640 1 --2- 172.21.15.103:0/2652040283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c109130 0x7fba3c10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.786+0000 7fba41e00640 1 --2- 172.21.15.103:0/2652040283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c1087b0 0x7fba3c108bf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:12.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.786+0000 7fba41e00640 1 --2- 172.21.15.103:0/2652040283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba3c102da0 0x7fba3c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.786+0000 7fba41e00640 1 -- 172.21.15.103:0/2652040283 >> 172.21.15.103:0/2652040283 conn(0x7fba3c0fe810 msgr2=0x7fba3c100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.786+0000 7fba41e00640 1 -- 172.21.15.103:0/2652040283 shutdown_connections 2024-09-11T01:06:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.786+0000 7fba41e00640 1 -- 172.21.15.103:0/2652040283 wait complete. 2024-09-11T01:06:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.787+0000 7fba41e00640 1 Processor -- start 2024-09-11T01:06:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.787+0000 7fba41e00640 1 -- start start 2024-09-11T01:06:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba41e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c102da0 0x7fba3c0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba41e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba3c1087b0 0x7fba3c0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba41e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c109130 0x7fba3c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba41e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c112d80 con 0x7fba3c102da0 2024-09-11T01:06:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba41e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c112c00 con 0x7fba3c109130 2024-09-11T01:06:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba41e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c112f00 con 0x7fba3c1087b0 2024-09-11T01:06:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba3aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c102da0 0x7fba3c0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba3a000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba3c1087b0 0x7fba3c0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:12.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba3b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c109130 0x7fba3c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba3a000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba3c1087b0 0x7fba3c0759e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:47804/0 (socket says 172.21.15.103:47804) 2024-09-11T01:06:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba3a000640 1 -- 172.21.15.103:0/4148825868 learned_addr learned my addr 172.21.15.103:0/4148825868 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba3aa00640 1 -- 172.21.15.103:0/4148825868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba3c1087b0 msgr2=0x7fba3c0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba3aa00640 1 --2- 172.21.15.103:0/4148825868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba3c1087b0 0x7fba3c0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba3aa00640 1 -- 172.21.15.103:0/4148825868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c109130 msgr2=0x7fba3c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba3aa00640 1 --2- 172.21.15.103:0/4148825868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c109130 0x7fba3c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba3aa00640 1 -- 172.21.15.103:0/4148825868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c1a76b0 con 0x7fba3c102da0 2024-09-11T01:06:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.788+0000 7fba3b400640 1 --2- 172.21.15.103:0/4148825868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c109130 0x7fba3c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.789+0000 7fba3aa00640 1 --2- 172.21.15.103:0/4148825868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c102da0 0x7fba3c0754a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fba2c005fd0 tx=0x7fba2c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.789+0000 7fba40a00640 1 -- 172.21.15.103:0/4148825868 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c009c30 con 0x7fba3c102da0 2024-09-11T01:06:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.789+0000 7fba40a00640 1 -- 172.21.15.103:0/4148825868 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba2c009dd0 con 0x7fba3c102da0 2024-09-11T01:06:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.789+0000 7fba41e00640 1 -- 172.21.15.103:0/4148825868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3c1a79a0 con 0x7fba3c102da0 2024-09-11T01:06:12.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.789+0000 7fba40a00640 1 -- 172.21.15.103:0/4148825868 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba2c010460 con 0x7fba3c102da0 2024-09-11T01:06:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.789+0000 7fba41e00640 1 -- 172.21.15.103:0/4148825868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3c1a7f00 con 0x7fba3c102da0 2024-09-11T01:06:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.790+0000 7fba41e00640 1 -- 172.21.15.103:0/4148825868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba3c103180 con 0x7fba3c102da0 2024-09-11T01:06:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.792+0000 7fba40a00640 1 -- 172.21.15.103:0/4148825868 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fba2c003e80 con 0x7fba3c102da0 2024-09-11T01:06:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.794+0000 7fba40a00640 1 --2- 172.21.15.103:0/4148825868 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fba200b5360 0x7fba200b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.794+0000 7fba40a00640 1 -- 172.21.15.103:0/4148825868 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7fba2c0e5e20 con 0x7fba3c102da0 2024-09-11T01:06:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.794+0000 7fba3a000640 1 --2- 172.21.15.103:0/4148825868 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fba200b5360 0x7fba200b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.795+0000 7fba3a000640 1 --2- 172.21.15.103:0/4148825868 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fba200b5360 0x7fba200b7820 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fba28031440 tx=0x7fba280058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:12.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.796+0000 7fba40a00640 1 -- 172.21.15.103:0/4148825868 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fba2c017020 con 0x7fba3c102da0 2024-09-11T01:06:12.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:12 smithi117 ceph-mon[35358]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T01:06:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:12 smithi183 ceph-mon[34992]: pgmap v333: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T01:06:12.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.981+0000 7fba41e00640 1 -- 172.21.15.103:0/4148825868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fba3c0767a0 con 0x7fba3c102da0 2024-09-11T01:06:12.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.982+0000 7fba40a00640 1 -- 172.21.15.103:0/4148825868 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24796 (secure 0 0 0) 0x7fba2c0ac370 con 0x7fba3c102da0 2024-09-11T01:06:12.986 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:06:12.986 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":87,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","created":"2024-09-11T00:56:46.242882+0000","modified":"2024-09-11T01:05:45.069528+0000","last_up_change":"2024-09-11T01:04:34.895368+0000","last_in_change":"2024-09-11T01:04:11.663436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:00:33.745338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T01:05:27.486014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T01:05:29.797513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T01:05:38.956635+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1b3e4222-43fd-4af0-bf97-3ba1000221b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6803","nonce":1867193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6805","nonce":1867193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6809","nonce":1867193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6807","nonce":1867193874}]},"public_addr":"172.21.15.103:6803/1867193874","cluster_addr":"172.21.15.103:6805/1867193874","heartbeat_back_addr":"172.21.15.103:6809/1867193874","heartbeat_front_addr":"172.21.15.103:6807/1867193874","state":["exists","up"]},{"osd":1,"uuid":"9a2b40da-7361-4c4f-a9dc-a769b427a0fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6801","nonce":2629532556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6803","nonce":2629532556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6807","nonce":2629532556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6805","nonce":2629532556}]},"public_addr":"172.21.15.117:6801/2629532556","cluster_addr":"172.21.15.117:6803/2629532556","heartbeat_back_addr":"172.21.15.117:6807/2629532556","heartbeat_front_addr":"172.21.15.117:6805/2629532556","state":["exists","up"]},{"osd":2,"uuid":"5db919c1-90a7-4ba7-acf3-89eeb77ae131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6801","nonce":3208966770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6803","nonce":3208966770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6807","nonce":3208966770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6805","nonce":3208966770}]},"public_addr":"172.21.15.183:6801/3208966770","cluster_addr":"172.21.15.183:6803/3208966770","heartbeat_back_addr":"172.21.15.183:6807/3208966770","heartbeat_front_addr":"172.21.15.183:6805/3208966770","state":["exists","up"]},{"osd":3,"uuid":"bdc465f2-06a5-4667-9651-4e168700d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6811","nonce":2238128162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6813","nonce":2238128162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6817","nonce":2238128162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6815","nonce":2238128162}]},"public_addr":"172.21.15.103:6811/2238128162","cluster_addr":"172.21.15.103:6813/2238128162","heartbeat_back_addr":"172.21.15.103:6817/2238128162","heartbeat_front_addr":"172.21.15.103:6815/2238128162","state":["exists","up"]},{"osd":4,"uuid":"be86a5d2-5e86-4bf4-8464-9dff7a801e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6809","nonce":2368878504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6811","nonce":2368878504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6815","nonce":2368878504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6813","nonce":2368878504}]},"public_addr":"172.21.15.117:6809/2368878504","cluster_addr":"172.21.15.117:6811/2368878504","heartbeat_back_addr":"172.21.15.117:6815/2368878504","heartbeat_front_addr":"172.21.15.117:6813/2368878504","state":["exists","up"]},{"osd":5,"uuid":"090b20ec-d9ff-4e10-ad9f-52ab41dbf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6809","nonce":1668069547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6811","nonce":1668069547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6815","nonce":1668069547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6813","nonce":1668069547}]},"public_addr":"172.21.15.183:6809/1668069547","cluster_addr":"172.21.15.183:6811/1668069547","heartbeat_back_addr":"172.21.15.183:6815/1668069547","heartbeat_front_addr":"172.21.15.183:6813/1668069547","state":["exists","up"]},{"osd":6,"uuid":"19abe982-3522-40f9-a628-ddaef462cdb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6819","nonce":4203476972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6821","nonce":4203476972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6825","nonce":4203476972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6823","nonce":4203476972}]},"public_addr":"172.21.15.103:6819/4203476972","cluster_addr":"172.21.15.103:6821/4203476972","heartbeat_back_addr":"172.21.15.103:6825/4203476972","heartbeat_front_addr":"172.21.15.103:6823/4203476972","state":["exists","up"]},{"osd":7,"uuid":"e875ff09-805a-40ff-9d6a-dd2607ce3432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6817","nonce":1207680713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6819","nonce":1207680713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6823","nonce":1207680713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6821","nonce":1207680713}]},"public_addr":"172.21.15.117:6817/1207680713","cluster_addr":"172.21.15.117:6819/1207680713","heartbeat_back_addr":"172.21.15.117:6823/1207680713","heartbeat_front_addr":"172.21.15.117:6821/1207680713","state":["exists","up"]},{"osd":8,"uuid":"2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6817","nonce":2935820593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6819","nonce":2935820593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6823","nonce":2935820593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6821","nonce":2935820593}]},"public_addr":"172.21.15.183:6817/2935820593","cluster_addr":"172.21.15.183:6819/2935820593","heartbeat_back_addr":"172.21.15.183:6823/2935820593","heartbeat_front_addr":"172.21.15.183:6821/2935820593","state":["exists","up"]},{"osd":9,"uuid":"c36d17d2-0bc8-4322-a998-9c8eff970e58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6827","nonce":2104855877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6829","nonce":2104855877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6833","nonce":2104855877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6831","nonce":2104855877}]},"public_addr":"172.21.15.103:6827/2104855877","cluster_addr":"172.21.15.103:6829/2104855877","heartbeat_back_addr":"172.21.15.103:6833/2104855877","heartbeat_front_addr":"172.21.15.103:6831/2104855877","state":["exists","up"]},{"osd":10,"uuid":"e71bc5f7-a829-43cf-a10b-b2444da1d773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6825","nonce":3792981873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6827","nonce":3792981873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6831","nonce":3792981873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6829","nonce":3792981873}]},"public_addr":"172.21.15.117:6825/3792981873","cluster_addr":"172.21.15.117:6827/3792981873","heartbeat_back_addr":"172.21.15.117:6831/3792981873","heartbeat_front_addr":"172.21.15.117:6829/3792981873","state":["exists","up"]},{"osd":11,"uuid":"8f36697f-4d18-4efa-bf14-d68a13464958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6825","nonce":1250387289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6827","nonce":1250387289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6831","nonce":1250387289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6829","nonce":1250387289}]},"public_addr":"172.21.15.183:6825/1250387289","cluster_addr":"172.21.15.183:6827/1250387289","heartbeat_back_addr":"172.21.15.183:6831/1250387289","heartbeat_front_addr":"172.21.15.183:6829/1250387289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:59:39.916330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:06.042858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:30.703648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:59.493376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:25.190299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:50.480326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:20.815441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:46.398318+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:11.499922+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:41.895096+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:08.411538+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:32.943466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/366890372":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6800/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2372812363":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2844264136":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/2046654364":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6801/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/211510947":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6801/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6800/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/189409602":"2024-09-12T00:57:11.412015+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:06:12.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.985+0000 7fba41e00640 1 -- 172.21.15.103:0/4148825868 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fba200b5360 msgr2=0x7fba200b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:12.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.985+0000 7fba41e00640 1 --2- 172.21.15.103:0/4148825868 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fba200b5360 0x7fba200b7820 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fba28031440 tx=0x7fba280058d0 comp rx=0 tx=0).stop 2024-09-11T01:06:12.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.985+0000 7fba41e00640 1 -- 172.21.15.103:0/4148825868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c102da0 msgr2=0x7fba3c0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:12.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.985+0000 7fba41e00640 1 --2- 172.21.15.103:0/4148825868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c102da0 0x7fba3c0754a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fba2c005fd0 tx=0x7fba2c00dde0 comp rx=0 tx=0).stop 2024-09-11T01:06:12.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.985+0000 7fba41e00640 1 -- 172.21.15.103:0/4148825868 shutdown_connections 2024-09-11T01:06:12.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.985+0000 7fba41e00640 1 --2- 172.21.15.103:0/4148825868 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fba200b5360 0x7fba200b7820 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.985+0000 7fba41e00640 1 --2- 172.21.15.103:0/4148825868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba3c109130 0x7fba3c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.985+0000 7fba41e00640 1 --2- 172.21.15.103:0/4148825868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fba3c1087b0 0x7fba3c0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.985+0000 7fba41e00640 1 --2- 172.21.15.103:0/4148825868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fba3c102da0 0x7fba3c0754a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.985+0000 7fba41e00640 1 -- 172.21.15.103:0/4148825868 >> 172.21.15.103:0/4148825868 conn(0x7fba3c0fe810 msgr2=0x7fba3c100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.985+0000 7fba41e00640 1 -- 172.21.15.103:0/4148825868 shutdown_connections 2024-09-11T01:06:12.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:12.985+0000 7fba41e00640 1 -- 172.21.15.103:0/4148825868 wait complete. 2024-09-11T01:06:13.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:13 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/4148825868' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:13.748 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-11T01:06:13.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:13 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/4148825868' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:13.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:13 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/4148825868' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:14.118 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:14.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.683+0000 7f7977a00640 1 -- 172.21.15.103:0/4291972626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797010b320 msgr2=0x7f7970111b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.683+0000 7f7977a00640 1 --2- 172.21.15.103:0/4291972626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797010b320 0x7f7970111b20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7968009ca0 tx=0x7f796802a8c0 comp rx=0 tx=0).stop 2024-09-11T01:06:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.683+0000 7f7977a00640 1 -- 172.21.15.103:0/4291972626 shutdown_connections 2024-09-11T01:06:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.683+0000 7f7977a00640 1 --2- 172.21.15.103:0/4291972626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797010b320 0x7f7970111b20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.683+0000 7f7977a00640 1 --2- 172.21.15.103:0/4291972626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f797010a9a0 0x7f797010ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:14.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.683+0000 7f7977a00640 1 --2- 172.21.15.103:0/4291972626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7970104f90 0x7f7970105370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:14.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.683+0000 7f7977a00640 1 -- 172.21.15.103:0/4291972626 >> 172.21.15.103:0/4291972626 conn(0x7f7970100a00 msgr2=0x7f7970102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:14.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.683+0000 7f7977a00640 1 -- 172.21.15.103:0/4291972626 shutdown_connections 2024-09-11T01:06:14.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.683+0000 7f7977a00640 1 -- 172.21.15.103:0/4291972626 wait complete. 2024-09-11T01:06:14.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.684+0000 7f7977a00640 1 Processor -- start 2024-09-11T01:06:14.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.684+0000 7f7977a00640 1 -- start start 2024-09-11T01:06:14.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.684+0000 7f7977a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7970104f90 0x7f797019b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:14.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.684+0000 7f7977a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f797010a9a0 0x7f797019b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:14.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.684+0000 7f7977a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797010b320 0x7f79701a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:14.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.684+0000 7f7977a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7970114f50 con 0x7f797010b320 2024-09-11T01:06:14.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.684+0000 7f7977a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7970114dd0 con 0x7f7970104f90 2024-09-11T01:06:14.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.684+0000 7f7977a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f79701150d0 con 0x7f797010a9a0 2024-09-11T01:06:14.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.684+0000 7f7975000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7970104f90 0x7f797019b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.684+0000 7f7975a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797010b320 0x7f79701a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.684+0000 7f7975000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7970104f90 0x7f797019b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:43622/0 (socket says 172.21.15.103:43622) 2024-09-11T01:06:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.684+0000 7f7975000640 1 -- 172.21.15.103:0/1356684798 learned_addr learned my addr 172.21.15.103:0/1356684798 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.684+0000 7f7967e00640 1 --2- 172.21.15.103:0/1356684798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f797010a9a0 0x7f797019b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.685+0000 7f7975000640 1 -- 172.21.15.103:0/1356684798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f797010a9a0 msgr2=0x7f797019b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.685+0000 7f7975000640 1 --2- 172.21.15.103:0/1356684798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f797010a9a0 0x7f797019b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.685+0000 7f7975000640 1 -- 172.21.15.103:0/1356684798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797010b320 msgr2=0x7f79701a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.685+0000 7f7975000640 1 --2- 172.21.15.103:0/1356684798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797010b320 0x7f79701a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.685+0000 7f7975000640 1 -- 172.21.15.103:0/1356684798 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79701a14f0 con 0x7f7970104f90 2024-09-11T01:06:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.685+0000 7f7975000640 1 --2- 172.21.15.103:0/1356684798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7970104f90 0x7f797019b440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f796000e9f0 tx=0x7f796000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.685+0000 7f796e000640 1 -- 172.21.15.103:0/1356684798 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f796000cd80 con 0x7f7970104f90 2024-09-11T01:06:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.685+0000 7f796e000640 1 -- 172.21.15.103:0/1356684798 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f79600108e0 con 0x7f7970104f90 2024-09-11T01:06:14.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.685+0000 7f7977a00640 1 -- 172.21.15.103:0/1356684798 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79701a17e0 con 0x7f7970104f90 2024-09-11T01:06:14.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.685+0000 7f796e000640 1 -- 172.21.15.103:0/1356684798 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960018980 con 0x7f7970104f90 2024-09-11T01:06:14.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.685+0000 7f7977a00640 1 -- 172.21.15.103:0/1356684798 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79701a7ea0 con 0x7f7970104f90 2024-09-11T01:06:14.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.687+0000 7f7977a00640 1 -- 172.21.15.103:0/1356684798 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7970105370 con 0x7f7970104f90 2024-09-11T01:06:14.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.689+0000 7f796e000640 1 -- 172.21.15.103:0/1356684798 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f7960010430 con 0x7f7970104f90 2024-09-11T01:06:14.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.690+0000 7f796e000640 1 --2- 172.21.15.103:0/1356684798 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f79540b52e0 0x7f79540b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:14.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.690+0000 7f796e000640 1 -- 172.21.15.103:0/1356684798 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f79600e62c0 con 0x7f7970104f90 2024-09-11T01:06:14.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.691+0000 7f7967e00640 1 --2- 172.21.15.103:0/1356684798 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f79540b52e0 0x7f79540b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:14.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.691+0000 7f7967e00640 1 --2- 172.21.15.103:0/1356684798 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f79540b52e0 0x7f79540b77a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7970104340 tx=0x7f7958005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:14.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.694+0000 7f796e000640 1 -- 172.21.15.103:0/1356684798 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f79600ac790 con 0x7f7970104f90 2024-09-11T01:06:14.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:14 smithi103 ceph-mon[30562]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T01:06:14.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:14 smithi117 ceph-mon[35358]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T01:06:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:14 smithi183 ceph-mon[34992]: pgmap v334: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-11T01:06:14.925 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:14.923+0000 7f7977a00640 1 -- 172.21.15.103:0/1356684798 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f797002e5c0 con 0x7f7970104f90 2024-09-11T01:06:15.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:15.618+0000 7f796e000640 1 -- 172.21.15.103:0/1356684798 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f79600b11c0 con 0x7f7970104f90 2024-09-11T01:06:15.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:15.620+0000 7f7977a00640 1 -- 172.21.15.103:0/1356684798 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f79540b52e0 msgr2=0x7f79540b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:15.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:15.620+0000 7f7977a00640 1 --2- 172.21.15.103:0/1356684798 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f79540b52e0 0x7f79540b77a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7970104340 tx=0x7f7958005f90 comp rx=0 tx=0).stop 2024-09-11T01:06:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:15.620+0000 7f7977a00640 1 -- 172.21.15.103:0/1356684798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7970104f90 msgr2=0x7f797019b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:15.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:15.620+0000 7f7977a00640 1 --2- 172.21.15.103:0/1356684798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7970104f90 0x7f797019b440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f796000e9f0 tx=0x7f796000eeb0 comp rx=0 tx=0).stop 2024-09-11T01:06:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:15.620+0000 7f7977a00640 1 -- 172.21.15.103:0/1356684798 shutdown_connections 2024-09-11T01:06:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:15.620+0000 7f7977a00640 1 --2- 172.21.15.103:0/1356684798 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f79540b52e0 0x7f79540b77a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:15.620+0000 7f7977a00640 1 --2- 172.21.15.103:0/1356684798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f797010b320 0x7f79701a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:15.620+0000 7f7977a00640 1 --2- 172.21.15.103:0/1356684798 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f797010a9a0 0x7f797019b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:15.620+0000 7f7977a00640 1 --2- 172.21.15.103:0/1356684798 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7970104f90 0x7f797019b440 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:15.620+0000 7f7977a00640 1 -- 172.21.15.103:0/1356684798 >> 172.21.15.103:0/1356684798 conn(0x7f7970100a00 msgr2=0x7f7970102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:15.620+0000 7f7977a00640 1 -- 172.21.15.103:0/1356684798 shutdown_connections 2024-09-11T01:06:15.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:15.620+0000 7f7977a00640 1 -- 172.21.15.103:0/1356684798 wait complete. 2024-09-11T01:06:15.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:15 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1356684798' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-11T01:06:15.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:15 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-11T01:06:15.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:15 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1356684798' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-11T01:06:15.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:15 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-11T01:06:16.018 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:15 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1356684798' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-11T01:06:16.018 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:15 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-11T01:06:16.414 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-09-11T01:06:16.415 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-11T01:06:16.788 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:16 smithi103 ceph-mon[30562]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T01:06:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:16 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T01:06:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:16 smithi103 ceph-mon[30562]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:06:16.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:16 smithi117 ceph-mon[35358]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T01:06:16.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:16 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T01:06:16.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:16 smithi117 ceph-mon[35358]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:06:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:16 smithi183 ceph-mon[34992]: pgmap v335: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-11T01:06:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:16 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-11T01:06:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:16 smithi183 ceph-mon[34992]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:06:17.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.383+0000 7f0721400640 1 -- 172.21.15.103:0/3472969656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f071c104fa0 msgr2=0x7f071c105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:17.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.383+0000 7f0721400640 1 --2- 172.21.15.103:0/3472969656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f071c104fa0 0x7f071c105380 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f070c009ca0 tx=0x7f070c02a8c0 comp rx=0 tx=0).stop 2024-09-11T01:06:17.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.383+0000 7f0721400640 1 -- 172.21.15.103:0/3472969656 shutdown_connections 2024-09-11T01:06:17.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.383+0000 7f0721400640 1 --2- 172.21.15.103:0/3472969656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f071c10b330 0x7f071c111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:17.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.383+0000 7f0721400640 1 --2- 172.21.15.103:0/3472969656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f071c10a9b0 0x7f071c10adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:17.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.383+0000 7f0721400640 1 --2- 172.21.15.103:0/3472969656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f071c104fa0 0x7f071c105380 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:17.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.384+0000 7f0721400640 1 -- 172.21.15.103:0/3472969656 >> 172.21.15.103:0/3472969656 conn(0x7f071c100a50 msgr2=0x7f071c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:17.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.384+0000 7f0721400640 1 -- 172.21.15.103:0/3472969656 shutdown_connections 2024-09-11T01:06:17.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.384+0000 7f0721400640 1 -- 172.21.15.103:0/3472969656 wait complete. 2024-09-11T01:06:17.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.384+0000 7f0721400640 1 Processor -- start 2024-09-11T01:06:17.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.385+0000 7f0721400640 1 -- start start 2024-09-11T01:06:17.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.385+0000 7f0721400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f071c104fa0 0x7f071c19b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.385+0000 7f0721400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f071c10a9b0 0x7f071c19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.385+0000 7f0721400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f071c10b330 0x7f071c1a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.385+0000 7f0721400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f071c114f40 con 0x7f071c104fa0 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.385+0000 7f0721400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f071c114dc0 con 0x7f071c10b330 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.385+0000 7f0721400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f071c1150c0 con 0x7f071c10a9b0 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.385+0000 7f071a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f071c104fa0 0x7f071c19b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.385+0000 7f071a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f071c104fa0 0x7f071c19b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59172/0 (socket says 172.21.15.103:59172) 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.385+0000 7f071a800640 1 -- 172.21.15.103:0/1205541231 learned_addr learned my addr 172.21.15.103:0/1205541231 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.385+0000 7f0719e00640 1 --2- 172.21.15.103:0/1205541231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f071c10a9b0 0x7f071c19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.385+0000 7f071b200640 1 --2- 172.21.15.103:0/1205541231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f071c10b330 0x7f071c1a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.386+0000 7f071a800640 1 -- 172.21.15.103:0/1205541231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f071c10a9b0 msgr2=0x7f071c19b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.386+0000 7f071a800640 1 --2- 172.21.15.103:0/1205541231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f071c10a9b0 0x7f071c19b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.386+0000 7f071a800640 1 -- 172.21.15.103:0/1205541231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f071c10b330 msgr2=0x7f071c1a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.386+0000 7f071a800640 1 --2- 172.21.15.103:0/1205541231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f071c10b330 0x7f071c1a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:17.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.386+0000 7f071a800640 1 -- 172.21.15.103:0/1205541231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071c1a1520 con 0x7f071c104fa0 2024-09-11T01:06:17.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.386+0000 7f071a800640 1 --2- 172.21.15.103:0/1205541231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f071c104fa0 0x7f071c19b470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f070c006010 tx=0x7f070c0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:17.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.386+0000 7f0713400640 1 -- 172.21.15.103:0/1205541231 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c003bf0 con 0x7f071c104fa0 2024-09-11T01:06:17.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.386+0000 7f0721400640 1 -- 172.21.15.103:0/1205541231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f071c1a17b0 con 0x7f071c104fa0 2024-09-11T01:06:17.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.386+0000 7f0713400640 1 -- 172.21.15.103:0/1205541231 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f070c003d90 con 0x7f071c104fa0 2024-09-11T01:06:17.390 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.386+0000 7f0713400640 1 -- 172.21.15.103:0/1205541231 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c02fc20 con 0x7f071c104fa0 2024-09-11T01:06:17.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.387+0000 7f0721400640 1 -- 172.21.15.103:0/1205541231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f071c1a7ed0 con 0x7f071c104fa0 2024-09-11T01:06:17.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.388+0000 7f0721400640 1 -- 172.21.15.103:0/1205541231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f071c105380 con 0x7f071c104fa0 2024-09-11T01:06:17.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.390+0000 7f0713400640 1 -- 172.21.15.103:0/1205541231 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f070c0046a0 con 0x7f071c104fa0 2024-09-11T01:06:17.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.392+0000 7f0713400640 1 --2- 172.21.15.103:0/1205541231 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f07000b5360 0x7f07000b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:17.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.392+0000 7f0713400640 1 -- 172.21.15.103:0/1205541231 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f070c1071a0 con 0x7f071c104fa0 2024-09-11T01:06:17.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.392+0000 7f0719e00640 1 --2- 172.21.15.103:0/1205541231 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f07000b5360 0x7f07000b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:17.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.393+0000 7f0719e00640 1 --2- 172.21.15.103:0/1205541231 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f07000b5360 0x7f07000b7820 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f071c10a150 tx=0x7f070800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:17.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.396+0000 7f0713400640 1 -- 172.21.15.103:0/1205541231 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f070c0cdcc0 con 0x7f071c104fa0 2024-09-11T01:06:17.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:17.620+0000 7f0721400640 1 -- 172.21.15.103:0/1205541231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f071c02e5c0 con 0x7f071c104fa0 2024-09-11T01:06:18.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:18.611+0000 7f0713400640 1 -- 172.21.15.103:0/1205541231 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f070c0cd5c0 con 0x7f071c104fa0 2024-09-11T01:06:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:18.614+0000 7f0721400640 1 -- 172.21.15.103:0/1205541231 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f07000b5360 msgr2=0x7f07000b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:18.614+0000 7f0721400640 1 --2- 172.21.15.103:0/1205541231 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f07000b5360 0x7f07000b7820 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f071c10a150 tx=0x7f070800b390 comp rx=0 tx=0).stop 2024-09-11T01:06:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:18.614+0000 7f0721400640 1 -- 172.21.15.103:0/1205541231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f071c104fa0 msgr2=0x7f071c19b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:18.614+0000 7f0721400640 1 --2- 172.21.15.103:0/1205541231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f071c104fa0 0x7f071c19b470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f070c006010 tx=0x7f070c0319f0 comp rx=0 tx=0).stop 2024-09-11T01:06:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:18.614+0000 7f0721400640 1 -- 172.21.15.103:0/1205541231 shutdown_connections 2024-09-11T01:06:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:18.614+0000 7f0721400640 1 --2- 172.21.15.103:0/1205541231 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f07000b5360 0x7f07000b7820 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:18.614+0000 7f0721400640 1 --2- 172.21.15.103:0/1205541231 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f071c10b330 0x7f071c1a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:18.614+0000 7f0721400640 1 --2- 172.21.15.103:0/1205541231 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f071c10a9b0 0x7f071c19b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:18.614+0000 7f0721400640 1 --2- 172.21.15.103:0/1205541231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f071c104fa0 0x7f071c19b470 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:18.614+0000 7f0721400640 1 -- 172.21.15.103:0/1205541231 >> 172.21.15.103:0/1205541231 conn(0x7f071c100a50 msgr2=0x7f071c1013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:18.614+0000 7f0721400640 1 -- 172.21.15.103:0/1205541231 shutdown_connections 2024-09-11T01:06:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:18.615+0000 7f0721400640 1 -- 172.21.15.103:0/1205541231 wait complete. 2024-09-11T01:06:18.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:18 smithi117 ceph-mon[35358]: pgmap v336: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-11T01:06:18.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:18 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1205541231' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-11T01:06:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:18 smithi183 ceph-mon[34992]: pgmap v336: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-11T01:06:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:18 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1205541231' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-11T01:06:19.027 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:18 smithi103 ceph-mon[30562]: pgmap v336: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-11T01:06:19.027 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:18 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1205541231' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} : dispatch 2024-09-11T01:06:19.406 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-11T01:06:19.786 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:19.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:19 smithi183 ceph-mon[34992]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T01:06:19.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:19 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1205541231' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T01:06:19.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:19 smithi183 ceph-mon[34992]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T01:06:19.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:19 smithi183 ceph-mon[34992]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:06:19.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:19 smithi183 ceph-mon[34992]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-11T01:06:19.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:19 smithi183 ceph-mon[34992]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-11T01:06:19.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:19 smithi183 ceph-mon[34992]: pgmap v337: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-11T01:06:19.925 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:19 smithi103 ceph-mon[30562]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T01:06:19.925 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:19 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1205541231' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T01:06:19.925 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:19 smithi103 ceph-mon[30562]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T01:06:19.925 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:19 smithi103 ceph-mon[30562]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:06:19.925 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:19 smithi103 ceph-mon[30562]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-11T01:06:19.925 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:19 smithi103 ceph-mon[30562]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-11T01:06:19.925 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:19 smithi103 ceph-mon[30562]: pgmap v337: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-11T01:06:20.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:19 smithi117 ceph-mon[35358]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-11T01:06:20.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:19 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1205541231' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-11T01:06:20.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:19 smithi117 ceph-mon[35358]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-11T01:06:20.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:19 smithi117 ceph-mon[35358]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-11T01:06:20.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:19 smithi117 ceph-mon[35358]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-11T01:06:20.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:19 smithi117 ceph-mon[35358]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-11T01:06:20.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:19 smithi117 ceph-mon[35358]: pgmap v337: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 0 op/s 2024-09-11T01:06:20.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.368+0000 7f5e87200640 1 -- 172.21.15.103:0/928036389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e80103cc0 msgr2=0x7f5e801040a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:20.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.368+0000 7f5e87200640 1 --2- 172.21.15.103:0/928036389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e80103cc0 0x7f5e801040a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009ca0 tx=0x7f5e7002a8c0 comp rx=0 tx=0).stop 2024-09-11T01:06:20.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.368+0000 7f5e87200640 1 -- 172.21.15.103:0/928036389 shutdown_connections 2024-09-11T01:06:20.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.368+0000 7f5e87200640 1 --2- 172.21.15.103:0/928036389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e8010d120 0x7f5e8010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:20.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.368+0000 7f5e87200640 1 --2- 172.21.15.103:0/928036389 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e801045e0 0x7f5e8010cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:20.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.368+0000 7f5e87200640 1 --2- 172.21.15.103:0/928036389 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e80103cc0 0x7f5e801040a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:20.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.368+0000 7f5e87200640 1 -- 172.21.15.103:0/928036389 >> 172.21.15.103:0/928036389 conn(0x7f5e800fd700 msgr2=0x7f5e800ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:20.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.368+0000 7f5e87200640 1 -- 172.21.15.103:0/928036389 shutdown_connections 2024-09-11T01:06:20.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.368+0000 7f5e87200640 1 -- 172.21.15.103:0/928036389 wait complete. 2024-09-11T01:06:20.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.369+0000 7f5e87200640 1 Processor -- start 2024-09-11T01:06:20.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.369+0000 7f5e87200640 1 -- start start 2024-09-11T01:06:20.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.369+0000 7f5e87200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e80103cc0 0x7f5e80101970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:20.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.369+0000 7f5e87200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e801045e0 0x7f5e80101eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:20.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.369+0000 7f5e87200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e8010d120 0x7f5e801023f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:20.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.369+0000 7f5e87200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5e80112de0 con 0x7f5e801045e0 2024-09-11T01:06:20.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.369+0000 7f5e87200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5e80112c60 con 0x7f5e8010d120 2024-09-11T01:06:20.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.370+0000 7f5e87200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5e80112f60 con 0x7f5e80103cc0 2024-09-11T01:06:20.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.370+0000 7f5e7f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e801045e0 0x7f5e80101eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:20.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.370+0000 7f5e7fe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e80103cc0 0x7f5e80101970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:20.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.370+0000 7f5e7fe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e80103cc0 0x7f5e80101970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:43098/0 (socket says 172.21.15.103:43098) 2024-09-11T01:06:20.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.370+0000 7f5e7fe00640 1 -- 172.21.15.103:0/3070521380 learned_addr learned my addr 172.21.15.103:0/3070521380 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:20.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.370+0000 7f5e85200640 1 --2- 172.21.15.103:0/3070521380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e8010d120 0x7f5e801023f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:20.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.370+0000 7f5e7f400640 1 -- 172.21.15.103:0/3070521380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e80103cc0 msgr2=0x7f5e80101970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:20.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.370+0000 7f5e7f400640 1 --2- 172.21.15.103:0/3070521380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e80103cc0 0x7f5e80101970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:20.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.370+0000 7f5e7f400640 1 -- 172.21.15.103:0/3070521380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e8010d120 msgr2=0x7f5e801023f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:20.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.370+0000 7f5e7f400640 1 --2- 172.21.15.103:0/3070521380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e8010d120 0x7f5e801023f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:20.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.370+0000 7f5e7f400640 1 -- 172.21.15.103:0/3070521380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e801a76f0 con 0x7f5e801045e0 2024-09-11T01:06:20.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.371+0000 7f5e7f400640 1 --2- 172.21.15.103:0/3070521380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e801045e0 0x7f5e80101eb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00e790 tx=0x7f5e6c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:20.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.371+0000 7f5e7cc00640 1 -- 172.21.15.103:0/3070521380 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c00eea0 con 0x7f5e801045e0 2024-09-11T01:06:20.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.371+0000 7f5e7cc00640 1 -- 172.21.15.103:0/3070521380 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e6c00ccc0 con 0x7f5e801045e0 2024-09-11T01:06:20.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.371+0000 7f5e7cc00640 1 -- 172.21.15.103:0/3070521380 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c010430 con 0x7f5e801045e0 2024-09-11T01:06:20.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.371+0000 7f5e87200640 1 -- 172.21.15.103:0/3070521380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e801a79e0 con 0x7f5e801045e0 2024-09-11T01:06:20.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.371+0000 7f5e87200640 1 -- 172.21.15.103:0/3070521380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e801a7f20 con 0x7f5e801045e0 2024-09-11T01:06:20.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.372+0000 7f5e87200640 1 -- 172.21.15.103:0/3070521380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e801040a0 con 0x7f5e801045e0 2024-09-11T01:06:20.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.374+0000 7f5e7cc00640 1 -- 172.21.15.103:0/3070521380 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f5e6c003f20 con 0x7f5e801045e0 2024-09-11T01:06:20.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.376+0000 7f5e7cc00640 1 --2- 172.21.15.103:0/3070521380 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5e640b5360 0x7f5e640b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:20.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.377+0000 7f5e7cc00640 1 -- 172.21.15.103:0/3070521380 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f5e6c0e6180 con 0x7f5e801045e0 2024-09-11T01:06:20.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.377+0000 7f5e7fe00640 1 --2- 172.21.15.103:0/3070521380 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5e640b5360 0x7f5e640b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:20.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.377+0000 7f5e7fe00640 1 --2- 172.21.15.103:0/3070521380 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5e640b5360 0x7f5e640b7820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009a60 tx=0x7f5e70005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:20.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.380+0000 7f5e7cc00640 1 -- 172.21.15.103:0/3070521380 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5e6c0acca0 con 0x7f5e801045e0 2024-09-11T01:06:20.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.608+0000 7f5e87200640 1 -- 172.21.15.103:0/3070521380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f5e8002e5c0 con 0x7f5e801045e0 2024-09-11T01:06:20.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.633+0000 7f5e7cc00640 1 -- 172.21.15.103:0/3070521380 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7f5e6c0ac5a0 con 0x7f5e801045e0 2024-09-11T01:06:20.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.635+0000 7f5e87200640 1 -- 172.21.15.103:0/3070521380 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5e640b5360 msgr2=0x7f5e640b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:20.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.635+0000 7f5e87200640 1 --2- 172.21.15.103:0/3070521380 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5e640b5360 0x7f5e640b7820 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009a60 tx=0x7f5e70005d80 comp rx=0 tx=0).stop 2024-09-11T01:06:20.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.635+0000 7f5e87200640 1 -- 172.21.15.103:0/3070521380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e801045e0 msgr2=0x7f5e80101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:20.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.635+0000 7f5e87200640 1 --2- 172.21.15.103:0/3070521380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e801045e0 0x7f5e80101eb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00e790 tx=0x7f5e6c00ec50 comp rx=0 tx=0).stop 2024-09-11T01:06:20.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.636+0000 7f5e87200640 1 -- 172.21.15.103:0/3070521380 shutdown_connections 2024-09-11T01:06:20.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.636+0000 7f5e87200640 1 --2- 172.21.15.103:0/3070521380 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5e640b5360 0x7f5e640b7820 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:20.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.636+0000 7f5e87200640 1 --2- 172.21.15.103:0/3070521380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e8010d120 0x7f5e801023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:20.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.636+0000 7f5e87200640 1 --2- 172.21.15.103:0/3070521380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e801045e0 0x7f5e80101eb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:20.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.636+0000 7f5e87200640 1 --2- 172.21.15.103:0/3070521380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e80103cc0 0x7f5e80101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:20.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.636+0000 7f5e87200640 1 -- 172.21.15.103:0/3070521380 >> 172.21.15.103:0/3070521380 conn(0x7f5e800fd700 msgr2=0x7f5e800fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:20.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.636+0000 7f5e87200640 1 -- 172.21.15.103:0/3070521380 shutdown_connections 2024-09-11T01:06:20.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:20.636+0000 7f5e87200640 1 -- 172.21.15.103:0/3070521380 wait complete. 2024-09-11T01:06:20.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:20 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] up:active 2024-09-11T01:06:20.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:20 smithi183 ceph-mon[34992]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T01:06:20.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:20 smithi183 ceph-mon[34992]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T01:06:20.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:20 smithi183 ceph-mon[34992]: Cluster is now healthy 2024-09-11T01:06:20.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:20 smithi183 ceph-mon[34992]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-11T01:06:20.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:20 smithi183 ceph-mon[34992]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-11T01:06:20.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:20 smithi183 ceph-mon[34992]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-11T01:06:20.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:20 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3070521380' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-11T01:06:20.996 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:20 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] up:active 2024-09-11T01:06:20.997 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:20 smithi103 ceph-mon[30562]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T01:06:20.997 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:20 smithi103 ceph-mon[30562]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T01:06:20.997 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:20 smithi103 ceph-mon[30562]: Cluster is now healthy 2024-09-11T01:06:20.997 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:20 smithi103 ceph-mon[30562]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-11T01:06:20.997 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:20 smithi103 ceph-mon[30562]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-11T01:06:20.997 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:20 smithi103 ceph-mon[30562]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-11T01:06:20.997 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:20 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3070521380' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-11T01:06:21.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:20 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] up:active 2024-09-11T01:06:21.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:20 smithi117 ceph-mon[35358]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-11T01:06:21.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:20 smithi117 ceph-mon[35358]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-11T01:06:21.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:20 smithi117 ceph-mon[35358]: Cluster is now healthy 2024-09-11T01:06:21.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:20 smithi117 ceph-mon[35358]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-11T01:06:21.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:20 smithi117 ceph-mon[35358]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-11T01:06:21.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:20 smithi117 ceph-mon[35358]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-11T01:06:21.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:20 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3070521380' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-11T01:06:21.427 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-11T01:06:21.801 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:21.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:21 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3070521380' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T01:06:21.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:21 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] up:active 2024-09-11T01:06:21.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:21 smithi103 ceph-mon[30562]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-11T01:06:21.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:21 smithi103 ceph-mon[30562]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:06:21.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:21 smithi103 ceph-mon[30562]: pgmap v338: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2024-09-11T01:06:21.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:21 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3070521380' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T01:06:21.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:21 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] up:active 2024-09-11T01:06:21.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:21 smithi183 ceph-mon[34992]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-11T01:06:21.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:21 smithi183 ceph-mon[34992]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:06:21.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:21 smithi183 ceph-mon[34992]: pgmap v338: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2024-09-11T01:06:22.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:21 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3070521380' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-11T01:06:22.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:21 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] up:active 2024-09-11T01:06:22.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:21 smithi117 ceph-mon[35358]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-11T01:06:22.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:21 smithi117 ceph-mon[35358]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:06:22.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:21 smithi117 ceph-mon[35358]: pgmap v338: 129 pgs: 129 active+clean; 581 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 2 op/s 2024-09-11T01:06:22.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.395+0000 7f91a3a00640 1 -- 172.21.15.103:0/1124575390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f919c0754c0 msgr2=0x7f919c0758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:22.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.395+0000 7f91a3a00640 1 --2- 172.21.15.103:0/1124575390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f919c0754c0 0x7f919c0758a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f918c009900 tx=0x7f918c02a410 comp rx=0 tx=0).stop 2024-09-11T01:06:22.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.395+0000 7f91a3a00640 1 -- 172.21.15.103:0/1124575390 shutdown_connections 2024-09-11T01:06:22.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.395+0000 7f91a3a00640 1 --2- 172.21.15.103:0/1124575390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f919c10f3b0 0x7f919c1117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:22.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.395+0000 7f91a3a00640 1 --2- 172.21.15.103:0/1124575390 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f919c075de0 0x7f919c10ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:22.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.395+0000 7f91a3a00640 1 --2- 172.21.15.103:0/1124575390 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f919c0754c0 0x7f919c0758a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:22.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.395+0000 7f91a3a00640 1 -- 172.21.15.103:0/1124575390 >> 172.21.15.103:0/1124575390 conn(0x7f919c0fe810 msgr2=0x7f919c100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:22.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.395+0000 7f91a3a00640 1 -- 172.21.15.103:0/1124575390 shutdown_connections 2024-09-11T01:06:22.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.395+0000 7f91a3a00640 1 -- 172.21.15.103:0/1124575390 wait complete. 2024-09-11T01:06:22.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.396+0000 7f91a3a00640 1 Processor -- start 2024-09-11T01:06:22.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.396+0000 7f91a3a00640 1 -- start start 2024-09-11T01:06:22.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.396+0000 7f91a3a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f919c0754c0 0x7f919c19b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:22.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f91a3a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f919c075de0 0x7f919c19ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:22.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f91a3a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f919c10f3b0 0x7f919c1a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:22.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f91a3a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f919c114fa0 con 0x7f919c075de0 2024-09-11T01:06:22.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f91a3a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f919c114e20 con 0x7f919c10f3b0 2024-09-11T01:06:22.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f91a3a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f919c115120 con 0x7f919c0754c0 2024-09-11T01:06:22.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f919be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f919c075de0 0x7f919c19ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:22.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f919be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f919c075de0 0x7f919c19ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45444/0 (socket says 172.21.15.103:45444) 2024-09-11T01:06:22.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f919be00640 1 -- 172.21.15.103:0/1278631882 learned_addr learned my addr 172.21.15.103:0/1278631882 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:22.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f91a1000640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f919c0754c0 0x7f919c19b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:22.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f91a1a00640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f919c10f3b0 0x7f919c1a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:22.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f91a1000640 1 -- 172.21.15.103:0/1278631882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f919c10f3b0 msgr2=0x7f919c1a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:22.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f91a1000640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f919c10f3b0 0x7f919c1a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:22.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f91a1000640 1 -- 172.21.15.103:0/1278631882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f919c075de0 msgr2=0x7f919c19ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:22.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f91a1000640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f919c075de0 0x7f919c19ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:22.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f91a1000640 1 -- 172.21.15.103:0/1278631882 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919c1a15c0 con 0x7f919c0754c0 2024-09-11T01:06:22.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.397+0000 7f919be00640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f919c075de0 0x7f919c19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:22.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.398+0000 7f91a1000640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f919c0754c0 0x7f919c19b510 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f918c02a930 tx=0x7f918c031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:22.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.398+0000 7f9199600640 1 -- 172.21.15.103:0/1278631882 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c03f030 con 0x7f919c0754c0 2024-09-11T01:06:22.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.398+0000 7f91a3a00640 1 -- 172.21.15.103:0/1278631882 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f919c1a1850 con 0x7f919c0754c0 2024-09-11T01:06:22.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.398+0000 7f9199600640 1 -- 172.21.15.103:0/1278631882 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f918c004490 con 0x7f919c0754c0 2024-09-11T01:06:22.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.398+0000 7f9199600640 1 -- 172.21.15.103:0/1278631882 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918c035070 con 0x7f919c0754c0 2024-09-11T01:06:22.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.398+0000 7f91a3a00640 1 -- 172.21.15.103:0/1278631882 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f919c1a7f70 con 0x7f919c0754c0 2024-09-11T01:06:22.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.399+0000 7f91a3a00640 1 -- 172.21.15.103:0/1278631882 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f919c0758a0 con 0x7f919c0754c0 2024-09-11T01:06:22.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.402+0000 7f9199600640 1 -- 172.21.15.103:0/1278631882 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f918c03ba30 con 0x7f919c0754c0 2024-09-11T01:06:22.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.403+0000 7f9199600640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f91800b52e0 0x7f91800b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:22.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.403+0000 7f9199600640 1 -- 172.21.15.103:0/1278631882 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f918c1066e0 con 0x7f919c0754c0 2024-09-11T01:06:22.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.403+0000 7f919be00640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f91800b52e0 0x7f91800b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:22.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.404+0000 7f919be00640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f91800b52e0 0x7f91800b77a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f919c101130 tx=0x7f9188005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:22.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.405+0000 7f9199600640 1 -- 172.21.15.103:0/1278631882 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f918c0ccbb0 con 0x7f919c0754c0 2024-09-11T01:06:22.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.627+0000 7f91a3a00640 1 -- 172.21.15.103:0/1278631882 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f919c02e5c0 con 0x7f919c0754c0 2024-09-11T01:06:22.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.652+0000 7f9199600640 1 -- 172.21.15.103:0/1278631882 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f918c0d15e0 con 0x7f919c0754c0 2024-09-11T01:06:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.654+0000 7f91a3a00640 1 -- 172.21.15.103:0/1278631882 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f91800b52e0 msgr2=0x7f91800b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.654+0000 7f91a3a00640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f91800b52e0 0x7f91800b77a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f919c101130 tx=0x7f9188005f90 comp rx=0 tx=0).stop 2024-09-11T01:06:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.654+0000 7f91a3a00640 1 -- 172.21.15.103:0/1278631882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f919c0754c0 msgr2=0x7f919c19b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.654+0000 7f91a3a00640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f919c0754c0 0x7f919c19b510 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f918c02a930 tx=0x7f918c031a20 comp rx=0 tx=0).stop 2024-09-11T01:06:22.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.654+0000 7f91a3a00640 1 -- 172.21.15.103:0/1278631882 shutdown_connections 2024-09-11T01:06:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.654+0000 7f91a3a00640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f91800b52e0 0x7f91800b77a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.654+0000 7f91a3a00640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f919c10f3b0 0x7f919c1a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.654+0000 7f91a3a00640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f919c075de0 0x7f919c19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.654+0000 7f91a3a00640 1 --2- 172.21.15.103:0/1278631882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f919c0754c0 0x7f919c19b510 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.654+0000 7f91a3a00640 1 -- 172.21.15.103:0/1278631882 >> 172.21.15.103:0/1278631882 conn(0x7f919c0fe810 msgr2=0x7f919c0ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.654+0000 7f91a3a00640 1 -- 172.21.15.103:0/1278631882 shutdown_connections 2024-09-11T01:06:22.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:22.654+0000 7f91a3a00640 1 -- 172.21.15.103:0/1278631882 wait complete. 2024-09-11T01:06:22.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:22 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1278631882' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-11T01:06:22.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:22 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-11T01:06:23.048 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:22 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1278631882' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-11T01:06:23.048 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:22 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-11T01:06:23.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:22 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1278631882' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-11T01:06:23.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:22 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-11T01:06:23.469 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-09-11T01:06:23.469 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-11T01:06:23.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:23 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T01:06:23.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:23 smithi103 ceph-mon[30562]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:06:23.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:23 smithi103 ceph-mon[30562]: pgmap v339: 129 pgs: 129 active+clean; 583 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T01:06:23.844 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:23.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:23 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T01:06:23.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:23 smithi183 ceph-mon[34992]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:06:23.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:23 smithi183 ceph-mon[34992]: pgmap v339: 129 pgs: 129 active+clean; 583 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T01:06:24.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:23 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-11T01:06:24.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:23 smithi117 ceph-mon[35358]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:06:24.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:23 smithi117 ceph-mon[35358]: pgmap v339: 129 pgs: 129 active+clean; 583 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-11T01:06:24.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.446+0000 7fd1c2200640 1 -- 172.21.15.103:0/2449636360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1bc1087b0 msgr2=0x7fd1bc108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:24.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.446+0000 7fd1c2200640 1 --2- 172.21.15.103:0/2449636360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1bc1087b0 0x7fd1bc108bf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009900 tx=0x7fd1a402a410 comp rx=0 tx=0).stop 2024-09-11T01:06:24.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.447+0000 7fd1c2200640 1 -- 172.21.15.103:0/2449636360 shutdown_connections 2024-09-11T01:06:24.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.447+0000 7fd1c2200640 1 --2- 172.21.15.103:0/2449636360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1bc109130 0x7fd1bc10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:24.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.447+0000 7fd1c2200640 1 --2- 172.21.15.103:0/2449636360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1bc1087b0 0x7fd1bc108bf0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:24.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.447+0000 7fd1c2200640 1 --2- 172.21.15.103:0/2449636360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1bc102da0 0x7fd1bc103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:24.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.447+0000 7fd1c2200640 1 -- 172.21.15.103:0/2449636360 >> 172.21.15.103:0/2449636360 conn(0x7fd1bc0fe810 msgr2=0x7fd1bc100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:24.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.447+0000 7fd1c2200640 1 -- 172.21.15.103:0/2449636360 shutdown_connections 2024-09-11T01:06:24.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.447+0000 7fd1c2200640 1 -- 172.21.15.103:0/2449636360 wait complete. 2024-09-11T01:06:24.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.448+0000 7fd1c2200640 1 Processor -- start 2024-09-11T01:06:24.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.448+0000 7fd1c2200640 1 -- start start 2024-09-11T01:06:24.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.448+0000 7fd1c2200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1bc102da0 0x7fd1bc199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:24.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.448+0000 7fd1c2200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1bc1087b0 0x7fd1bc199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:24.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.448+0000 7fd1c2200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1bc109130 0x7fd1bc19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:24.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.448+0000 7fd1c2200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd1bc112e40 con 0x7fd1bc109130 2024-09-11T01:06:24.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.448+0000 7fd1c2200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd1bc112cc0 con 0x7fd1bc102da0 2024-09-11T01:06:24.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.448+0000 7fd1c2200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd1bc112fc0 con 0x7fd1bc1087b0 2024-09-11T01:06:24.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.449+0000 7fd1bbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1bc109130 0x7fd1bc19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:24.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.449+0000 7fd1bb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1bc102da0 0x7fd1bc199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:24.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.449+0000 7fd1bbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1bc109130 0x7fd1bc19eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45452/0 (socket says 172.21.15.103:45452) 2024-09-11T01:06:24.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.449+0000 7fd1bbe00640 1 -- 172.21.15.103:0/408222625 learned_addr learned my addr 172.21.15.103:0/408222625 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:24.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.449+0000 7fd1b2a00640 1 --2- 172.21.15.103:0/408222625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1bc1087b0 0x7fd1bc199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:24.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.449+0000 7fd1bbe00640 1 -- 172.21.15.103:0/408222625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1bc1087b0 msgr2=0x7fd1bc199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:24.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.449+0000 7fd1bbe00640 1 --2- 172.21.15.103:0/408222625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1bc1087b0 0x7fd1bc199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:24.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.449+0000 7fd1bbe00640 1 -- 172.21.15.103:0/408222625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1bc102da0 msgr2=0x7fd1bc199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:24.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.449+0000 7fd1bbe00640 1 --2- 172.21.15.103:0/408222625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1bc102da0 0x7fd1bc199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:24.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.449+0000 7fd1bbe00640 1 -- 172.21.15.103:0/408222625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1bc19f2e0 con 0x7fd1bc109130 2024-09-11T01:06:24.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.449+0000 7fd1bb400640 1 --2- 172.21.15.103:0/408222625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1bc102da0 0x7fd1bc199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:24.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.449+0000 7fd1bbe00640 1 --2- 172.21.15.103:0/408222625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1bc109130 0x7fd1bc19eb10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400eb10 tx=0x7fd1b400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:24.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.450+0000 7fd1b8c00640 1 -- 172.21.15.103:0/408222625 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4004b20 con 0x7fd1bc109130 2024-09-11T01:06:24.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.450+0000 7fd1b8c00640 1 -- 172.21.15.103:0/408222625 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1b4004cc0 con 0x7fd1bc109130 2024-09-11T01:06:24.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.450+0000 7fd1c2200640 1 -- 172.21.15.103:0/408222625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1bc19f5d0 con 0x7fd1bc109130 2024-09-11T01:06:24.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.450+0000 7fd1b8c00640 1 -- 172.21.15.103:0/408222625 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4010670 con 0x7fd1bc109130 2024-09-11T01:06:24.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.450+0000 7fd1c2200640 1 -- 172.21.15.103:0/408222625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1bc075380 con 0x7fd1bc109130 2024-09-11T01:06:24.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.451+0000 7fd1c2200640 1 -- 172.21.15.103:0/408222625 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1bc103180 con 0x7fd1bc109130 2024-09-11T01:06:24.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.453+0000 7fd1b8c00640 1 -- 172.21.15.103:0/408222625 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7fd1b4005020 con 0x7fd1bc109130 2024-09-11T01:06:24.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.455+0000 7fd1b8c00640 1 --2- 172.21.15.103:0/408222625 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd1a00b5360 0x7fd1a00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:24.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.455+0000 7fd1b8c00640 1 -- 172.21.15.103:0/408222625 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7fd1b40e64b0 con 0x7fd1bc109130 2024-09-11T01:06:24.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.456+0000 7fd1bb400640 1 --2- 172.21.15.103:0/408222625 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd1a00b5360 0x7fd1a00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:24.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.456+0000 7fd1bb400640 1 --2- 172.21.15.103:0/408222625 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd1a00b5360 0x7fd1a00b7820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac009fc0 tx=0x7fd1ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:24.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.459+0000 7fd1b8c00640 1 -- 172.21.15.103:0/408222625 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd1b40acfd0 con 0x7fd1bc109130 2024-09-11T01:06:24.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.670+0000 7fd1c2200640 1 -- 172.21.15.103:0/408222625 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd1bc105d70 con 0x7fd1a00b5360 2024-09-11T01:06:24.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.708+0000 7fd1b8c00640 1 -- 172.21.15.103:0/408222625 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd1bc105d70 con 0x7fd1a00b5360 2024-09-11T01:06:24.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.710+0000 7fd1c2200640 1 -- 172.21.15.103:0/408222625 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd1a00b5360 msgr2=0x7fd1a00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:24.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.710+0000 7fd1c2200640 1 --2- 172.21.15.103:0/408222625 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd1a00b5360 0x7fd1a00b7820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac009fc0 tx=0x7fd1ac005f90 comp rx=0 tx=0).stop 2024-09-11T01:06:24.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.710+0000 7fd1c2200640 1 -- 172.21.15.103:0/408222625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1bc109130 msgr2=0x7fd1bc19eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:24.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.710+0000 7fd1c2200640 1 --2- 172.21.15.103:0/408222625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1bc109130 0x7fd1bc19eb10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400eb10 tx=0x7fd1b400c2d0 comp rx=0 tx=0).stop 2024-09-11T01:06:24.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.710+0000 7fd1c2200640 1 -- 172.21.15.103:0/408222625 shutdown_connections 2024-09-11T01:06:24.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.710+0000 7fd1c2200640 1 --2- 172.21.15.103:0/408222625 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd1a00b5360 0x7fd1a00b7820 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:24.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.710+0000 7fd1c2200640 1 --2- 172.21.15.103:0/408222625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1bc109130 0x7fd1bc19eb10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:24.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.710+0000 7fd1c2200640 1 --2- 172.21.15.103:0/408222625 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd1bc1087b0 0x7fd1bc199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:24.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.710+0000 7fd1c2200640 1 --2- 172.21.15.103:0/408222625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1bc102da0 0x7fd1bc199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:24.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.710+0000 7fd1c2200640 1 -- 172.21.15.103:0/408222625 >> 172.21.15.103:0/408222625 conn(0x7fd1bc0fe810 msgr2=0x7fd1bc100c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:24.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.710+0000 7fd1c2200640 1 -- 172.21.15.103:0/408222625 shutdown_connections 2024-09-11T01:06:24.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:24.710+0000 7fd1c2200640 1 -- 172.21.15.103:0/408222625 wait complete. 2024-09-11T01:06:25.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:06:24 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T01:06:24.677+0000 7f1fe8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T01:06:25.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:06:24 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T01:06:24.677+0000 7f1fe8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T01:06:25.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:06:24 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T01:06:24.677+0000 7f1fe8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T01:06:25.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:06:24 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T01:06:24.677+0000 7f1fe8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T01:06:25.082 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:06:24 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T01:06:24.677+0000 7f1fe8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T01:06:25.531 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-11T01:06:25.904 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:26.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.494+0000 7f8b96400640 1 -- 172.21.15.103:0/1439340838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b90102c10 msgr2=0x7f8b90102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:26.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.494+0000 7f8b96400640 1 --2- 172.21.15.103:0/1439340838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b90102c10 0x7f8b90102ff0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009860 tx=0x7f8b8402a340 comp rx=0 tx=0).stop 2024-09-11T01:06:26.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.494+0000 7f8b96400640 1 -- 172.21.15.103:0/1439340838 shutdown_connections 2024-09-11T01:06:26.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.494+0000 7f8b96400640 1 --2- 172.21.15.103:0/1439340838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b90108fa0 0x7f8b9010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:26.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.494+0000 7f8b96400640 1 --2- 172.21.15.103:0/1439340838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b90108620 0x7f8b90108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:26.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.494+0000 7f8b96400640 1 --2- 172.21.15.103:0/1439340838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b90102c10 0x7f8b90102ff0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:26.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.494+0000 7f8b96400640 1 -- 172.21.15.103:0/1439340838 >> 172.21.15.103:0/1439340838 conn(0x7f8b900fe660 msgr2=0x7f8b90100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:26.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.494+0000 7f8b96400640 1 -- 172.21.15.103:0/1439340838 shutdown_connections 2024-09-11T01:06:26.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.494+0000 7f8b96400640 1 -- 172.21.15.103:0/1439340838 wait complete. 2024-09-11T01:06:26.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.495+0000 7f8b96400640 1 Processor -- start 2024-09-11T01:06:26.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.495+0000 7f8b96400640 1 -- start start 2024-09-11T01:06:26.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.496+0000 7f8b96400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b90102c10 0x7f8b900754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:26.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.496+0000 7f8b96400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b90108620 0x7f8b900759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:26.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.496+0000 7f8b96400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b90108fa0 0x7f8b90075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:26.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.496+0000 7f8b96400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8b90112c30 con 0x7f8b90108620 2024-09-11T01:06:26.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.496+0000 7f8b96400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b90112ab0 con 0x7f8b90102c10 2024-09-11T01:06:26.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.496+0000 7f8b96400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8b90112db0 con 0x7f8b90108fa0 2024-09-11T01:06:26.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.496+0000 7f8b8fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b90108620 0x7f8b900759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:26.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.496+0000 7f8b95000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b90102c10 0x7f8b900754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:26.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.496+0000 7f8b95a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b90108fa0 0x7f8b90075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:26.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.496+0000 7f8b95000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b90102c10 0x7f8b900754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:60372/0 (socket says 172.21.15.103:60372) 2024-09-11T01:06:26.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.496+0000 7f8b95000640 1 -- 172.21.15.103:0/1814647796 learned_addr learned my addr 172.21.15.103:0/1814647796 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:26.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.497+0000 7f8b95000640 1 -- 172.21.15.103:0/1814647796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b90108fa0 msgr2=0x7f8b90075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:26.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.497+0000 7f8b95000640 1 --2- 172.21.15.103:0/1814647796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b90108fa0 0x7f8b90075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:26.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.497+0000 7f8b95000640 1 -- 172.21.15.103:0/1814647796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b90108620 msgr2=0x7f8b900759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:26.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.497+0000 7f8b95000640 1 --2- 172.21.15.103:0/1814647796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b90108620 0x7f8b900759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:26.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.497+0000 7f8b95000640 1 -- 172.21.15.103:0/1814647796 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b901a7470 con 0x7f8b90102c10 2024-09-11T01:06:26.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.497+0000 7f8b95000640 1 --2- 172.21.15.103:0/1814647796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b90102c10 0x7f8b900754a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b84035040 tx=0x7f8b84032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:26.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.497+0000 7f8b8d600640 1 -- 172.21.15.103:0/1814647796 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b84037040 con 0x7f8b90102c10 2024-09-11T01:06:26.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.497+0000 7f8b96400640 1 -- 172.21.15.103:0/1814647796 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b901a7700 con 0x7f8b90102c10 2024-09-11T01:06:26.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.497+0000 7f8b8d600640 1 -- 172.21.15.103:0/1814647796 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b84041070 con 0x7f8b90102c10 2024-09-11T01:06:26.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.497+0000 7f8b8d600640 1 -- 172.21.15.103:0/1814647796 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b840035f0 con 0x7f8b90102c10 2024-09-11T01:06:26.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.497+0000 7f8b96400640 1 -- 172.21.15.103:0/1814647796 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b901a7bd0 con 0x7f8b90102c10 2024-09-11T01:06:26.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.498+0000 7f8b96400640 1 -- 172.21.15.103:0/1814647796 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b90102ff0 con 0x7f8b90102c10 2024-09-11T01:06:26.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.502+0000 7f8b8d600640 1 -- 172.21.15.103:0/1814647796 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 16) ==== 153251+0+0 (secure 0 0 0) 0x7f8b84004050 con 0x7f8b90102c10 2024-09-11T01:06:26.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.503+0000 7f8b8d600640 1 --2- 172.21.15.103:0/1814647796 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8b780b5390 0x7f8b780b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:26.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.503+0000 7f8b8d600640 1 -- 172.21.15.103:0/1814647796 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f8b84106270 con 0x7f8b90102c10 2024-09-11T01:06:26.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.503+0000 7f8b8fe00640 1 --2- 172.21.15.103:0/1814647796 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8b780b5390 0x7f8b780b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:26.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.504+0000 7f8b8d600640 1 -- 172.21.15.103:0/1814647796 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8b840ccd90 con 0x7f8b90102c10 2024-09-11T01:06:26.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.504+0000 7f8b8fe00640 1 --2- 172.21.15.103:0/1814647796 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8b780b5390 0x7f8b780b7850 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8b90076f90 tx=0x7f8b7c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:26.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.596+0000 7f8b8d600640 1 -- 172.21.15.103:0/1814647796 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f8b840c8900 con 0x7f8b90102c10 2024-09-11T01:06:26.602 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:26 smithi103 ceph-mon[30562]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:26.602 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:26 smithi103 ceph-mon[30562]: pgmap v340: 129 pgs: 129 active+clean; 584 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-11T01:06:26.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.731+0000 7f8b96400640 1 -- 172.21.15.103:0/1814647796 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f8b90063590 con 0x7f8b780b5390 2024-09-11T01:06:26.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.756+0000 7f8b8d600640 1 -- 172.21.15.103:0/1814647796 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f8b90063590 con 0x7f8b780b5390 2024-09-11T01:06:26.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.758+0000 7f8b96400640 1 -- 172.21.15.103:0/1814647796 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8b780b5390 msgr2=0x7f8b780b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:26.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.758+0000 7f8b96400640 1 --2- 172.21.15.103:0/1814647796 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8b780b5390 0x7f8b780b7850 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8b90076f90 tx=0x7f8b7c009260 comp rx=0 tx=0).stop 2024-09-11T01:06:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.758+0000 7f8b96400640 1 -- 172.21.15.103:0/1814647796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b90102c10 msgr2=0x7f8b900754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.758+0000 7f8b96400640 1 --2- 172.21.15.103:0/1814647796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b90102c10 0x7f8b900754a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8b84035040 tx=0x7f8b84032d50 comp rx=0 tx=0).stop 2024-09-11T01:06:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.759+0000 7f8b96400640 1 -- 172.21.15.103:0/1814647796 shutdown_connections 2024-09-11T01:06:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.759+0000 7f8b96400640 1 --2- 172.21.15.103:0/1814647796 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8b780b5390 0x7f8b780b7850 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.759+0000 7f8b96400640 1 --2- 172.21.15.103:0/1814647796 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b90108fa0 0x7f8b90075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.759+0000 7f8b96400640 1 --2- 172.21.15.103:0/1814647796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b90108620 0x7f8b900759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.759+0000 7f8b96400640 1 --2- 172.21.15.103:0/1814647796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b90102c10 0x7f8b900754a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.759+0000 7f8b96400640 1 -- 172.21.15.103:0/1814647796 >> 172.21.15.103:0/1814647796 conn(0x7f8b900fe660 msgr2=0x7f8b90100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.759+0000 7f8b96400640 1 -- 172.21.15.103:0/1814647796 shutdown_connections 2024-09-11T01:06:26.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:26.759+0000 7f8b96400640 1 -- 172.21.15.103:0/1814647796 wait complete. 2024-09-11T01:06:26.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:26 smithi117 ceph-mon[35358]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:26.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:26 smithi117 ceph-mon[35358]: pgmap v340: 129 pgs: 129 active+clean; 584 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-11T01:06:26.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:26 smithi183 ceph-mon[34992]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:26.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:26 smithi183 ceph-mon[34992]: pgmap v340: 129 pgs: 129 active+clean; 584 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.1 KiB/s wr, 10 op/s 2024-09-11T01:06:27.582 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-11T01:06:27.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:27 smithi103 ceph-mon[30562]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-11T01:06:27.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:27 smithi117 ceph-mon[35358]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-11T01:06:27.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:27 smithi183 ceph-mon[34992]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-09-11T01:06:27.965 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.558+0000 7f67cee00640 1 -- 172.21.15.103:0/269871022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c8075f40 msgr2=0x7f67c810ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.558+0000 7f67cee00640 1 --2- 172.21.15.103:0/269871022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c8075f40 0x7f67c810ee10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009900 tx=0x7f67b002a410 comp rx=0 tx=0).stop 2024-09-11T01:06:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.558+0000 7f67cee00640 1 -- 172.21.15.103:0/269871022 shutdown_connections 2024-09-11T01:06:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.558+0000 7f67cee00640 1 --2- 172.21.15.103:0/269871022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67c810f3e0 0x7f67c81117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.558+0000 7f67cee00640 1 --2- 172.21.15.103:0/269871022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c8075f40 0x7f67c810ee10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:28.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.558+0000 7f67cee00640 1 --2- 172.21.15.103:0/269871022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67c8075540 0x7f67c8075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.558+0000 7f67cee00640 1 -- 172.21.15.103:0/269871022 >> 172.21.15.103:0/269871022 conn(0x7f67c80fe830 msgr2=0x7f67c8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.558+0000 7f67cee00640 1 -- 172.21.15.103:0/269871022 shutdown_connections 2024-09-11T01:06:28.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.558+0000 7f67cee00640 1 -- 172.21.15.103:0/269871022 wait complete. 2024-09-11T01:06:28.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.559+0000 7f67cee00640 1 Processor -- start 2024-09-11T01:06:28.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.559+0000 7f67cee00640 1 -- start start 2024-09-11T01:06:28.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.559+0000 7f67cee00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67c8075540 0x7f67c819b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:28.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.559+0000 7f67cee00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67c8075f40 0x7f67c819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:28.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.559+0000 7f67cee00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c810f3e0 0x7f67c81a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:28.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.559+0000 7f67cee00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f67c8114f80 con 0x7f67c810f3e0 2024-09-11T01:06:28.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.559+0000 7f67cee00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f67c8114e00 con 0x7f67c8075f40 2024-09-11T01:06:28.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.559+0000 7f67cee00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f67c8115100 con 0x7f67c8075540 2024-09-11T01:06:28.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.560+0000 7f67cce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c810f3e0 0x7f67c81a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:28.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.560+0000 7f67c7e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67c8075540 0x7f67c819b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:28.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.560+0000 7f67c7e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67c8075540 0x7f67c819b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:43172/0 (socket says 172.21.15.103:43172) 2024-09-11T01:06:28.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.560+0000 7f67c7e00640 1 -- 172.21.15.103:0/1661739135 learned_addr learned my addr 172.21.15.103:0/1661739135 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:28.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.560+0000 7f67bf400640 1 --2- 172.21.15.103:0/1661739135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67c8075f40 0x7f67c819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:28.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.560+0000 7f67bf400640 1 -- 172.21.15.103:0/1661739135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67c8075540 msgr2=0x7f67c819b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:28.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.560+0000 7f67bf400640 1 --2- 172.21.15.103:0/1661739135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67c8075540 0x7f67c819b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:28.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.560+0000 7f67bf400640 1 -- 172.21.15.103:0/1661739135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c810f3e0 msgr2=0x7f67c81a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:28.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.560+0000 7f67bf400640 1 --2- 172.21.15.103:0/1661739135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c810f3e0 0x7f67c81a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:28.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.560+0000 7f67bf400640 1 -- 172.21.15.103:0/1661739135 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67c81a1540 con 0x7f67c8075f40 2024-09-11T01:06:28.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.560+0000 7f67cce00640 1 --2- 172.21.15.103:0/1661739135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c810f3e0 0x7f67c81a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:28.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.561+0000 7f67bf400640 1 --2- 172.21.15.103:0/1661739135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67c8075f40 0x7f67c819b9d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f67b0006010 tx=0x7f67b0004060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:28.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.561+0000 7f67c5600640 1 -- 172.21.15.103:0/1661739135 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b003f070 con 0x7f67c8075f40 2024-09-11T01:06:28.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.561+0000 7f67cee00640 1 -- 172.21.15.103:0/1661739135 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67c81a17d0 con 0x7f67c8075f40 2024-09-11T01:06:28.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.561+0000 7f67c5600640 1 -- 172.21.15.103:0/1661739135 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67b0003ca0 con 0x7f67c8075f40 2024-09-11T01:06:28.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.561+0000 7f67c5600640 1 -- 172.21.15.103:0/1661739135 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67b0035070 con 0x7f67c8075f40 2024-09-11T01:06:28.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.561+0000 7f67cee00640 1 -- 172.21.15.103:0/1661739135 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67c81a7ef0 con 0x7f67c8075f40 2024-09-11T01:06:28.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.562+0000 7f67cee00640 1 -- 172.21.15.103:0/1661739135 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c8075920 con 0x7f67c8075f40 2024-09-11T01:06:28.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.565+0000 7f67c5600640 1 -- 172.21.15.103:0/1661739135 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f67b004b060 con 0x7f67c8075f40 2024-09-11T01:06:28.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.566+0000 7f67c5600640 1 --2- 172.21.15.103:0/1661739135 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f67ac0b5370 0x7f67ac0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:28.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.566+0000 7f67c5600640 1 -- 172.21.15.103:0/1661739135 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f67b01064f0 con 0x7f67c8075f40 2024-09-11T01:06:28.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.566+0000 7f67c7e00640 1 --2- 172.21.15.103:0/1661739135 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f67ac0b5370 0x7f67ac0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:28.568 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.567+0000 7f67c7e00640 1 --2- 172.21.15.103:0/1661739135 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f67ac0b5370 0x7f67ac0b7830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67b8005fd0 tx=0x7f67b800b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:28.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.568+0000 7f67c5600640 1 -- 172.21.15.103:0/1661739135 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f67b00cc860 con 0x7f67c8075f40 2024-09-11T01:06:28.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.784+0000 7f67cee00640 1 -- 172.21.15.103:0/1661739135 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f67c8100b50 con 0x7f67ac0b5370 2024-09-11T01:06:28.786 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:28 smithi103 ceph-mon[30562]: from='client.24842 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:28.786 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:28 smithi103 ceph-mon[30562]: pgmap v341: 129 pgs: 129 active+clean; 584 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-11T01:06:28.791 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.789+0000 7f67c5600640 1 -- 172.21.15.103:0/1661739135 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f67c8100b50 con 0x7f67ac0b5370 2024-09-11T01:06:28.791 INFO:teuthology.orchestra.run.smithi103.stdout:/volumes/qa/sv_0/6269cceb-1fbc-4e82-bf70-dfb817ef2bdd 2024-09-11T01:06:28.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.792+0000 7f67cee00640 1 -- 172.21.15.103:0/1661739135 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f67ac0b5370 msgr2=0x7f67ac0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.792+0000 7f67cee00640 1 --2- 172.21.15.103:0/1661739135 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f67ac0b5370 0x7f67ac0b7830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f67b8005fd0 tx=0x7f67b800b4a0 comp rx=0 tx=0).stop 2024-09-11T01:06:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.792+0000 7f67cee00640 1 -- 172.21.15.103:0/1661739135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67c8075f40 msgr2=0x7f67c819b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.792+0000 7f67cee00640 1 --2- 172.21.15.103:0/1661739135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67c8075f40 0x7f67c819b9d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f67b0006010 tx=0x7f67b0004060 comp rx=0 tx=0).stop 2024-09-11T01:06:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.792+0000 7f67cee00640 1 -- 172.21.15.103:0/1661739135 shutdown_connections 2024-09-11T01:06:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.792+0000 7f67cee00640 1 --2- 172.21.15.103:0/1661739135 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f67ac0b5370 0x7f67ac0b7830 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.792+0000 7f67cee00640 1 --2- 172.21.15.103:0/1661739135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67c810f3e0 0x7f67c81a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.792+0000 7f67cee00640 1 --2- 172.21.15.103:0/1661739135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f67c8075f40 0x7f67c819b9d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.792+0000 7f67cee00640 1 --2- 172.21.15.103:0/1661739135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f67c8075540 0x7f67c819b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.792+0000 7f67cee00640 1 -- 172.21.15.103:0/1661739135 >> 172.21.15.103:0/1661739135 conn(0x7f67c80fe830 msgr2=0x7f67c80ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.792+0000 7f67cee00640 1 -- 172.21.15.103:0/1661739135 shutdown_connections 2024-09-11T01:06:28.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:28.792+0000 7f67cee00640 1 -- 172.21.15.103:0/1661739135 wait complete. 2024-09-11T01:06:28.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:28 smithi117 ceph-mon[35358]: from='client.24842 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:28.876 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:28 smithi117 ceph-mon[35358]: pgmap v341: 129 pgs: 129 active+clean; 584 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-11T01:06:28.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:28 smithi183 ceph-mon[34992]: from='client.24842 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:28.924 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:28 smithi183 ceph-mon[34992]: pgmap v341: 129 pgs: 129 active+clean; 584 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-11T01:06:29.579 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-11T01:06:29.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:29 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:06:29.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:29 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:06:29.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:29 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:06:30.626 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:30.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:30 smithi117 ceph-mon[35358]: from='client.24848 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:30.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:30 smithi117 ceph-mon[35358]: pgmap v342: 129 pgs: 129 active+clean; 585 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-11T01:06:30.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:30 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:30.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:30 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:30.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:30 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:30.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:30 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:30.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:30 smithi103 ceph-mon[30562]: from='client.24848 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:30.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:30 smithi103 ceph-mon[30562]: pgmap v342: 129 pgs: 129 active+clean; 585 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-11T01:06:30.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:30 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:30.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:30 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:30.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:30 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:30.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:30 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:30 smithi183 ceph-mon[34992]: from='client.24848 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:30 smithi183 ceph-mon[34992]: pgmap v342: 129 pgs: 129 active+clean; 585 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 2.2 KiB/s wr, 11 op/s 2024-09-11T01:06:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:30 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:30 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:30 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:30 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:31.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.187+0000 7fb273200640 1 -- 172.21.15.103:0/960208425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb26c10cf70 msgr2=0x7fb26c10f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:31.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.187+0000 7fb273200640 1 --2- 172.21.15.103:0/960208425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb26c10cf70 0x7fb26c10f3d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb268009ca0 tx=0x7fb26802a8c0 comp rx=0 tx=0).stop 2024-09-11T01:06:31.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.187+0000 7fb273200640 1 -- 172.21.15.103:0/960208425 shutdown_connections 2024-09-11T01:06:31.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.187+0000 7fb273200640 1 --2- 172.21.15.103:0/960208425 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb26c10cf70 0x7fb26c10f3d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.187+0000 7fb273200640 1 --2- 172.21.15.103:0/960208425 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb26c104430 0x7fb26c10c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.187+0000 7fb273200640 1 --2- 172.21.15.103:0/960208425 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb26c103b10 0x7fb26c103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.187+0000 7fb273200640 1 -- 172.21.15.103:0/960208425 >> 172.21.15.103:0/960208425 conn(0x7fb26c0fd5b0 msgr2=0x7fb26c0ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.187+0000 7fb273200640 1 -- 172.21.15.103:0/960208425 shutdown_connections 2024-09-11T01:06:31.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.187+0000 7fb273200640 1 -- 172.21.15.103:0/960208425 wait complete. 2024-09-11T01:06:31.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.188+0000 7fb273200640 1 Processor -- start 2024-09-11T01:06:31.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.188+0000 7fb273200640 1 -- start start 2024-09-11T01:06:31.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.189+0000 7fb273200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb26c103b10 0x7fb26c19b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:31.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.189+0000 7fb273200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb26c104430 0x7fb26c19b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:31.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.189+0000 7fb273200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb26c10cf70 0x7fb26c1a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:31.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.189+0000 7fb273200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c112c30 con 0x7fb26c104430 2024-09-11T01:06:31.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.189+0000 7fb273200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c112ab0 con 0x7fb26c10cf70 2024-09-11T01:06:31.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.189+0000 7fb273200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c112db0 con 0x7fb26c103b10 2024-09-11T01:06:31.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.189+0000 7fb272800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb26c10cf70 0x7fb26c1a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.189+0000 7fb271e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb26c103b10 0x7fb26c19b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.189+0000 7fb271400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb26c104430 0x7fb26c19b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.189+0000 7fb272800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb26c10cf70 0x7fb26c1a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:59814/0 (socket says 172.21.15.103:59814) 2024-09-11T01:06:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.189+0000 7fb272800640 1 -- 172.21.15.103:0/3941276218 learned_addr learned my addr 172.21.15.103:0/3941276218 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.190+0000 7fb272800640 1 -- 172.21.15.103:0/3941276218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb26c103b10 msgr2=0x7fb26c19b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.190+0000 7fb272800640 1 --2- 172.21.15.103:0/3941276218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb26c103b10 0x7fb26c19b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.190+0000 7fb272800640 1 -- 172.21.15.103:0/3941276218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb26c104430 msgr2=0x7fb26c19b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.190+0000 7fb272800640 1 --2- 172.21.15.103:0/3941276218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb26c104430 0x7fb26c19b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.190+0000 7fb272800640 1 -- 172.21.15.103:0/3941276218 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c1a12a0 con 0x7fb26c10cf70 2024-09-11T01:06:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.190+0000 7fb271e00640 1 --2- 172.21.15.103:0/3941276218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb26c103b10 0x7fb26c19b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.190+0000 7fb272800640 1 --2- 172.21.15.103:0/3941276218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb26c10cf70 0x7fb26c1a0ad0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb26802f540 tx=0x7fb2680316f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.190+0000 7fb266a00640 1 -- 172.21.15.103:0/3941276218 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268003b70 con 0x7fb26c10cf70 2024-09-11T01:06:31.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.190+0000 7fb273200640 1 -- 172.21.15.103:0/3941276218 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb26c1a1530 con 0x7fb26c10cf70 2024-09-11T01:06:31.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.190+0000 7fb266a00640 1 -- 172.21.15.103:0/3941276218 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb268003d10 con 0x7fb26c10cf70 2024-09-11T01:06:31.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.190+0000 7fb266a00640 1 -- 172.21.15.103:0/3941276218 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26802f990 con 0x7fb26c10cf70 2024-09-11T01:06:31.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.190+0000 7fb273200640 1 -- 172.21.15.103:0/3941276218 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb26c1a7c50 con 0x7fb26c10cf70 2024-09-11T01:06:31.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.191+0000 7fb273200640 1 -- 172.21.15.103:0/3941276218 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26c103ef0 con 0x7fb26c10cf70 2024-09-11T01:06:31.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.193+0000 7fb266a00640 1 -- 172.21.15.103:0/3941276218 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7fb26802fb30 con 0x7fb26c10cf70 2024-09-11T01:06:31.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.195+0000 7fb266a00640 1 --2- 172.21.15.103:0/3941276218 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb2540b5410 0x7fb2540b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:31.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.195+0000 7fb266a00640 1 -- 172.21.15.103:0/3941276218 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7fb2681072c0 con 0x7fb26c10cf70 2024-09-11T01:06:31.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.195+0000 7fb271e00640 1 --2- 172.21.15.103:0/3941276218 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb2540b5410 0x7fb2540b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:31.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.195+0000 7fb271e00640 1 --2- 172.21.15.103:0/3941276218 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb2540b5410 0x7fb2540b78d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb260009fc0 tx=0x7fb260005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:31.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.198+0000 7fb266a00640 1 -- 172.21.15.103:0/3941276218 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb2680cdc80 con 0x7fb26c10cf70 2024-09-11T01:06:31.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.448+0000 7fb273200640 1 -- 172.21.15.103:0/3941276218 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb26c0ff0b0 con 0x7fb2540b5410 2024-09-11T01:06:31.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.473+0000 7fb266a00640 1 -- 172.21.15.103:0/3941276218 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb26c0ff0b0 con 0x7fb2540b5410 2024-09-11T01:06:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.475+0000 7fb273200640 1 -- 172.21.15.103:0/3941276218 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb2540b5410 msgr2=0x7fb2540b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.475+0000 7fb273200640 1 --2- 172.21.15.103:0/3941276218 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb2540b5410 0x7fb2540b78d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb260009fc0 tx=0x7fb260005f90 comp rx=0 tx=0).stop 2024-09-11T01:06:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.475+0000 7fb273200640 1 -- 172.21.15.103:0/3941276218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb26c10cf70 msgr2=0x7fb26c1a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.475+0000 7fb273200640 1 --2- 172.21.15.103:0/3941276218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb26c10cf70 0x7fb26c1a0ad0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb26802f540 tx=0x7fb2680316f0 comp rx=0 tx=0).stop 2024-09-11T01:06:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.475+0000 7fb273200640 1 -- 172.21.15.103:0/3941276218 shutdown_connections 2024-09-11T01:06:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.475+0000 7fb273200640 1 --2- 172.21.15.103:0/3941276218 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb2540b5410 0x7fb2540b78d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.475+0000 7fb273200640 1 --2- 172.21.15.103:0/3941276218 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb26c10cf70 0x7fb26c1a0ad0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:31.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.475+0000 7fb273200640 1 --2- 172.21.15.103:0/3941276218 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb26c104430 0x7fb26c19b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:31.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.475+0000 7fb273200640 1 --2- 172.21.15.103:0/3941276218 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb26c103b10 0x7fb26c19b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:31.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.476+0000 7fb273200640 1 -- 172.21.15.103:0/3941276218 >> 172.21.15.103:0/3941276218 conn(0x7fb26c0fd5b0 msgr2=0x7fb26c0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:31.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.476+0000 7fb273200640 1 -- 172.21.15.103:0/3941276218 shutdown_connections 2024-09-11T01:06:31.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:31.476+0000 7fb273200640 1 -- 172.21.15.103:0/3941276218 wait complete. 2024-09-11T01:06:32.305 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-11T01:06:32.708 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:32 smithi117 ceph-mon[35358]: from='client.24854 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:32 smithi117 ceph-mon[35358]: pgmap v343: 129 pgs: 129 active+clean; 605 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.4 KiB/s wr, 14 op/s 2024-09-11T01:06:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:32 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:32.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:32 smithi183 ceph-mon[34992]: from='client.24854 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:32.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:32 smithi183 ceph-mon[34992]: pgmap v343: 129 pgs: 129 active+clean; 605 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.4 KiB/s wr, 14 op/s 2024-09-11T01:06:32.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:32.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:32 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:32.919 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:32 smithi103 ceph-mon[30562]: from='client.24854 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:32.919 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:32 smithi103 ceph-mon[30562]: pgmap v343: 129 pgs: 129 active+clean; 605 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 4.4 KiB/s wr, 14 op/s 2024-09-11T01:06:32.919 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:32.919 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:32 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:33.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.353+0000 7f0ffca00640 1 -- 172.21.15.103:0/4193278622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff810f220 msgr2=0x7f0ff8111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:33.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.353+0000 7f0ffca00640 1 --2- 172.21.15.103:0/4193278622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff810f220 0x7f0ff8111610 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0009ca0 tx=0x7f0ff002a8c0 comp rx=0 tx=0).stop 2024-09-11T01:06:33.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.353+0000 7f0ffca00640 1 -- 172.21.15.103:0/4193278622 shutdown_connections 2024-09-11T01:06:33.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.353+0000 7f0ffca00640 1 --2- 172.21.15.103:0/4193278622 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff810f220 0x7f0ff8111610 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:33.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.353+0000 7f0ffca00640 1 --2- 172.21.15.103:0/4193278622 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ff8075de0 0x7f0ff810ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:33.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.353+0000 7f0ffca00640 1 --2- 172.21.15.103:0/4193278622 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff80754c0 0x7f0ff80758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:33.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.353+0000 7f0ffca00640 1 -- 172.21.15.103:0/4193278622 >> 172.21.15.103:0/4193278622 conn(0x7f0ff80fe660 msgr2=0x7f0ff8100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:33.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.353+0000 7f0ffca00640 1 -- 172.21.15.103:0/4193278622 shutdown_connections 2024-09-11T01:06:33.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.353+0000 7f0ffca00640 1 -- 172.21.15.103:0/4193278622 wait complete. 2024-09-11T01:06:33.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.354+0000 7f0ffca00640 1 Processor -- start 2024-09-11T01:06:33.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.354+0000 7f0ffca00640 1 -- start start 2024-09-11T01:06:33.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ffca00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ff80754c0 0x7f0ff819b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:33.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ffca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff8075de0 0x7f0ff819b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:33.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ffca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff810f220 0x7f0ff81a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ffca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff8114e00 con 0x7f0ff8075de0 2024-09-11T01:06:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ffca00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff8114c80 con 0x7f0ff810f220 2024-09-11T01:06:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ffca00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0ff8114f80 con 0x7f0ff80754c0 2024-09-11T01:06:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ff7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff810f220 0x7f0ff81a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0fefe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff8075de0 0x7f0ff819b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ff7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff810f220 0x7f0ff81a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:59822/0 (socket says 172.21.15.103:59822) 2024-09-11T01:06:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ff7e00640 1 -- 172.21.15.103:0/1327514260 learned_addr learned my addr 172.21.15.103:0/1327514260 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:33.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ff7400640 1 --2- 172.21.15.103:0/1327514260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ff80754c0 0x7f0ff819b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ff7e00640 1 -- 172.21.15.103:0/1327514260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ff80754c0 msgr2=0x7f0ff819b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ff7e00640 1 --2- 172.21.15.103:0/1327514260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ff80754c0 0x7f0ff819b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ff7e00640 1 -- 172.21.15.103:0/1327514260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff8075de0 msgr2=0x7f0ff819b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ff7e00640 1 --2- 172.21.15.103:0/1327514260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff8075de0 0x7f0ff819b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.355+0000 7f0ff7e00640 1 -- 172.21.15.103:0/1327514260 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ff81a12c0 con 0x7f0ff810f220 2024-09-11T01:06:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.356+0000 7f0ff7e00640 1 --2- 172.21.15.103:0/1327514260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff810f220 0x7f0ff81a0af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ff002ade0 tx=0x7f0ff0031660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.356+0000 7f0ff4c00640 1 -- 172.21.15.103:0/1327514260 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0003b70 con 0x7f0ff810f220 2024-09-11T01:06:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.356+0000 7f0ffca00640 1 -- 172.21.15.103:0/1327514260 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ff81a1550 con 0x7f0ff810f220 2024-09-11T01:06:33.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.356+0000 7f0ffca00640 1 -- 172.21.15.103:0/1327514260 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ff81a7c70 con 0x7f0ff810f220 2024-09-11T01:06:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.356+0000 7f0ff4c00640 1 -- 172.21.15.103:0/1327514260 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0ff0031910 con 0x7f0ff810f220 2024-09-11T01:06:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.356+0000 7f0ff4c00640 1 -- 172.21.15.103:0/1327514260 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff002f950 con 0x7f0ff810f220 2024-09-11T01:06:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.358+0000 7f0ffca00640 1 -- 172.21.15.103:0/1327514260 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ff80758a0 con 0x7f0ff810f220 2024-09-11T01:06:33.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.360+0000 7f0ff4c00640 1 -- 172.21.15.103:0/1327514260 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f0ff0004b40 con 0x7f0ff810f220 2024-09-11T01:06:33.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.361+0000 7f0ff4c00640 1 --2- 172.21.15.103:0/1327514260 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0fdc0b5490 0x7f0fdc0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:33.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.361+0000 7f0ff4c00640 1 -- 172.21.15.103:0/1327514260 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f0ff01071c0 con 0x7f0ff810f220 2024-09-11T01:06:33.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.361+0000 7f0ff7400640 1 --2- 172.21.15.103:0/1327514260 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0fdc0b5490 0x7f0fdc0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:33.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.362+0000 7f0ff7400640 1 --2- 172.21.15.103:0/1327514260 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0fdc0b5490 0x7f0fdc0b7950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009bd0 tx=0x7f0fe8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:33.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.363+0000 7f0ff4c00640 1 -- 172.21.15.103:0/1327514260 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0ff00cdb80 con 0x7f0ff810f220 2024-09-11T01:06:33.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.613+0000 7f0ffca00640 1 -- 172.21.15.103:0/1327514260 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f0ff8100200 con 0x7f0fdc0b5490 2024-09-11T01:06:33.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.618+0000 7f0ff4c00640 1 -- 172.21.15.103:0/1327514260 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0ff8100200 con 0x7f0fdc0b5490 2024-09-11T01:06:33.619 INFO:teuthology.orchestra.run.smithi103.stdout:/volumes/qa/sv_1/e0e20cca-3ec1-4618-a976-c4d042eb9f6b 2024-09-11T01:06:33.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.620+0000 7f0ffca00640 1 -- 172.21.15.103:0/1327514260 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0fdc0b5490 msgr2=0x7f0fdc0b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:33.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.620+0000 7f0ffca00640 1 --2- 172.21.15.103:0/1327514260 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0fdc0b5490 0x7f0fdc0b7950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009bd0 tx=0x7f0fe8005f90 comp rx=0 tx=0).stop 2024-09-11T01:06:33.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.620+0000 7f0ffca00640 1 -- 172.21.15.103:0/1327514260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff810f220 msgr2=0x7f0ff81a0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:33.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.620+0000 7f0ffca00640 1 --2- 172.21.15.103:0/1327514260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff810f220 0x7f0ff81a0af0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0ff002ade0 tx=0x7f0ff0031660 comp rx=0 tx=0).stop 2024-09-11T01:06:33.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.620+0000 7f0ffca00640 1 -- 172.21.15.103:0/1327514260 shutdown_connections 2024-09-11T01:06:33.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.620+0000 7f0ffca00640 1 --2- 172.21.15.103:0/1327514260 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0fdc0b5490 0x7f0fdc0b7950 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:33.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.620+0000 7f0ffca00640 1 --2- 172.21.15.103:0/1327514260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff810f220 0x7f0ff81a0af0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:33.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.620+0000 7f0ffca00640 1 --2- 172.21.15.103:0/1327514260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0ff8075de0 0x7f0ff819b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:33.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.620+0000 7f0ffca00640 1 --2- 172.21.15.103:0/1327514260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0ff80754c0 0x7f0ff819b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:33.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.620+0000 7f0ffca00640 1 -- 172.21.15.103:0/1327514260 >> 172.21.15.103:0/1327514260 conn(0x7f0ff80fe660 msgr2=0x7f0ff80feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:33.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.620+0000 7f0ffca00640 1 -- 172.21.15.103:0/1327514260 shutdown_connections 2024-09-11T01:06:33.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:33.620+0000 7f0ffca00640 1 -- 172.21.15.103:0/1327514260 wait complete. 2024-09-11T01:06:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:33 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:06:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:33 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:06:33.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:33 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:33.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:33 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:06:33.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:33 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:06:33.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:33 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:34.057 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:33 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:06:34.057 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:33 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:06:34.058 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:33 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:06:34.515 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:06:34.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:34 smithi103 ceph-mon[30562]: pgmap v344: 129 pgs: 129 active+clean; 605 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-11T01:06:34.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:34 smithi103 ceph-mon[30562]: from='client.24860 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:34 smithi117 ceph-mon[35358]: pgmap v344: 129 pgs: 129 active+clean; 605 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-11T01:06:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:34 smithi117 ceph-mon[35358]: from='client.24860 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:34.888 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:34 smithi183 ceph-mon[34992]: pgmap v344: 129 pgs: 129 active+clean; 605 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2024-09-11T01:06:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:34 smithi183 ceph-mon[34992]: from='client.24860 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:06:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.480+0000 7f8e81000640 1 -- 172.21.15.103:0/4013556582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c10f760 msgr2=0x7f8e7c115f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.480+0000 7f8e81000640 1 --2- 172.21.15.103:0/4013556582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c10f760 0x7f8e7c115f60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8e74009ca0 tx=0x7f8e7402a8c0 comp rx=0 tx=0).stop 2024-09-11T01:06:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.480+0000 7f8e81000640 1 -- 172.21.15.103:0/4013556582 shutdown_connections 2024-09-11T01:06:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.480+0000 7f8e81000640 1 --2- 172.21.15.103:0/4013556582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c10f760 0x7f8e7c115f60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.480+0000 7f8e81000640 1 --2- 172.21.15.103:0/4013556582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7c10ede0 0x7f8e7c10f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.480+0000 7f8e81000640 1 --2- 172.21.15.103:0/4013556582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e7c1093d0 0x7f8e7c1097b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.480+0000 7f8e81000640 1 -- 172.21.15.103:0/4013556582 >> 172.21.15.103:0/4013556582 conn(0x7f8e7c078a40 msgr2=0x7f8e7c07ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.480+0000 7f8e81000640 1 -- 172.21.15.103:0/4013556582 shutdown_connections 2024-09-11T01:06:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.480+0000 7f8e81000640 1 -- 172.21.15.103:0/4013556582 wait complete. 2024-09-11T01:06:35.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.481+0000 7f8e81000640 1 Processor -- start 2024-09-11T01:06:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.481+0000 7f8e81000640 1 -- start start 2024-09-11T01:06:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e81000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7c1093d0 0x7f8e7c19f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e81000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c10ede0 0x7f8e7c19fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e81000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e7c10f760 0x7f8e7c1a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e81000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c1193e0 con 0x7f8e7c10ede0 2024-09-11T01:06:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e81000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c119260 con 0x7f8e7c10f760 2024-09-11T01:06:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e81000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c119560 con 0x7f8e7c1093d0 2024-09-11T01:06:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e79e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7c1093d0 0x7f8e7c19f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e7a800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e7c10f760 0x7f8e7c1a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e7a800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e7c10f760 0x7f8e7c1a5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:59840/0 (socket says 172.21.15.103:59840) 2024-09-11T01:06:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e79e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7c1093d0 0x7f8e7c19f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:46656/0 (socket says 172.21.15.103:46656) 2024-09-11T01:06:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e7a800640 1 -- 172.21.15.103:0/2626034124 learned_addr learned my addr 172.21.15.103:0/2626034124 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:35.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e79400640 1 --2- 172.21.15.103:0/2626034124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c10ede0 0x7f8e7c19fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:35.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e79e00640 1 -- 172.21.15.103:0/2626034124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e7c10f760 msgr2=0x7f8e7c1a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:35.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e79e00640 1 --2- 172.21.15.103:0/2626034124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e7c10f760 0x7f8e7c1a5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:35.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.482+0000 7f8e79e00640 1 -- 172.21.15.103:0/2626034124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c10ede0 msgr2=0x7f8e7c19fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:35.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.483+0000 7f8e79e00640 1 --2- 172.21.15.103:0/2626034124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c10ede0 0x7f8e7c19fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:35.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.483+0000 7f8e79e00640 1 -- 172.21.15.103:0/2626034124 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7c1a5960 con 0x7f8e7c1093d0 2024-09-11T01:06:35.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.483+0000 7f8e7a800640 1 --2- 172.21.15.103:0/2626034124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e7c10f760 0x7f8e7c1a5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:35.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.483+0000 7f8e79e00640 1 --2- 172.21.15.103:0/2626034124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7c1093d0 0x7f8e7c19f8b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00e9f0 tx=0x7f8e6c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:35.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.483+0000 7f8e72a00640 1 -- 172.21.15.103:0/2626034124 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c00ccc0 con 0x7f8e7c1093d0 2024-09-11T01:06:35.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.483+0000 7f8e81000640 1 -- 172.21.15.103:0/2626034124 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7c1a5c50 con 0x7f8e7c1093d0 2024-09-11T01:06:35.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.483+0000 7f8e72a00640 1 -- 172.21.15.103:0/2626034124 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e6c0108e0 con 0x7f8e7c1093d0 2024-09-11T01:06:35.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.483+0000 7f8e72a00640 1 -- 172.21.15.103:0/2626034124 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c018880 con 0x7f8e7c1093d0 2024-09-11T01:06:35.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.483+0000 7f8e81000640 1 -- 172.21.15.103:0/2626034124 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e7c1ac4e0 con 0x7f8e7c1093d0 2024-09-11T01:06:35.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.484+0000 7f8e81000640 1 -- 172.21.15.103:0/2626034124 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e7c1097b0 con 0x7f8e7c1093d0 2024-09-11T01:06:35.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.487+0000 7f8e72a00640 1 -- 172.21.15.103:0/2626034124 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f8e6c010430 con 0x7f8e7c1093d0 2024-09-11T01:06:35.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.488+0000 7f8e72a00640 1 --2- 172.21.15.103:0/2626034124 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8e600b53f0 0x7f8e600b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:35.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.488+0000 7f8e72a00640 1 -- 172.21.15.103:0/2626034124 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f8e6c0e6800 con 0x7f8e7c1093d0 2024-09-11T01:06:35.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.488+0000 7f8e79400640 1 --2- 172.21.15.103:0/2626034124 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8e600b53f0 0x7f8e600b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:35.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.489+0000 7f8e79400640 1 --2- 172.21.15.103:0/2626034124 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8e600b53f0 0x7f8e600b78b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c10eb30 tx=0x7f8e6800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:35.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.490+0000 7f8e72a00640 1 -- 172.21.15.103:0/2626034124 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8e6c0acb70 con 0x7f8e7c1093d0 2024-09-11T01:06:35.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.714+0000 7f8e81000640 1 -- 172.21.15.103:0/2626034124 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e7c1a09e0 con 0x7f8e7c1093d0 2024-09-11T01:06:35.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.715+0000 7f8e72a00640 1 -- 172.21.15.103:0/2626034124 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11930 (secure 0 0 0) 0x7f8e6c0b15a0 con 0x7f8e7c1093d0 2024-09-11T01:06:35.717 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:06:35.717 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-09-11T01:06:22:641923+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:06:22.629934+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24619,24629,24665]},"id":1}]} 2024-09-11T01:06:35.717 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-09-11T01:06:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.718+0000 7f8e81000640 1 -- 172.21.15.103:0/2626034124 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8e600b53f0 msgr2=0x7f8e600b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.718+0000 7f8e81000640 1 --2- 172.21.15.103:0/2626034124 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8e600b53f0 0x7f8e600b78b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c10eb30 tx=0x7f8e6800b410 comp rx=0 tx=0).stop 2024-09-11T01:06:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.718+0000 7f8e81000640 1 -- 172.21.15.103:0/2626034124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7c1093d0 msgr2=0x7f8e7c19f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.718+0000 7f8e81000640 1 --2- 172.21.15.103:0/2626034124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7c1093d0 0x7f8e7c19f8b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00e9f0 tx=0x7f8e6c00eeb0 comp rx=0 tx=0).stop 2024-09-11T01:06:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.718+0000 7f8e81000640 1 -- 172.21.15.103:0/2626034124 shutdown_connections 2024-09-11T01:06:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.718+0000 7f8e81000640 1 --2- 172.21.15.103:0/2626034124 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8e600b53f0 0x7f8e600b78b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.718+0000 7f8e81000640 1 --2- 172.21.15.103:0/2626034124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e7c10f760 0x7f8e7c1a5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.718+0000 7f8e81000640 1 --2- 172.21.15.103:0/2626034124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e7c10ede0 0x7f8e7c19fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.718+0000 7f8e81000640 1 --2- 172.21.15.103:0/2626034124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e7c1093d0 0x7f8e7c19f8b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.718+0000 7f8e81000640 1 -- 172.21.15.103:0/2626034124 >> 172.21.15.103:0/2626034124 conn(0x7f8e7c078a40 msgr2=0x7f8e7c07ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.718+0000 7f8e81000640 1 -- 172.21.15.103:0/2626034124 shutdown_connections 2024-09-11T01:06:35.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:35.718+0000 7f8e81000640 1 -- 172.21.15.103:0/2626034124 wait complete. 2024-09-11T01:06:36.517 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T01:06:36.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:36 smithi103 ceph-mon[30562]: pgmap v345: 129 pgs: 129 active+clean; 624 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.6 KiB/s wr, 10 op/s 2024-09-11T01:06:36.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:36 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2626034124' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:06:36.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:36 smithi117 ceph-mon[35358]: pgmap v345: 129 pgs: 129 active+clean; 624 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.6 KiB/s wr, 10 op/s 2024-09-11T01:06:36.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:36 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2626034124' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:06:36.889 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:36.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:36 smithi183 ceph-mon[34992]: pgmap v345: 129 pgs: 129 active+clean; 624 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 4.6 KiB/s wr, 10 op/s 2024-09-11T01:06:36.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:36 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2626034124' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:06:37.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.482+0000 7f96ae000640 1 -- 172.21.15.103:0/2050855781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96a81087d0 msgr2=0x7f96a8108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:37.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.482+0000 7f96ae000640 1 --2- 172.21.15.103:0/2050855781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96a81087d0 0x7f96a8108c10 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9694009900 tx=0x7f969402a410 comp rx=0 tx=0).stop 2024-09-11T01:06:37.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.483+0000 7f96ae000640 1 -- 172.21.15.103:0/2050855781 shutdown_connections 2024-09-11T01:06:37.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.483+0000 7f96ae000640 1 --2- 172.21.15.103:0/2050855781 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96a8109150 0x7f96a810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:37.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.483+0000 7f96ae000640 1 --2- 172.21.15.103:0/2050855781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96a81087d0 0x7f96a8108c10 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:37.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.483+0000 7f96ae000640 1 --2- 172.21.15.103:0/2050855781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a8102dc0 0x7f96a81031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:37.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.483+0000 7f96ae000640 1 -- 172.21.15.103:0/2050855781 >> 172.21.15.103:0/2050855781 conn(0x7f96a80fe830 msgr2=0x7f96a8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:37.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.483+0000 7f96ae000640 1 -- 172.21.15.103:0/2050855781 shutdown_connections 2024-09-11T01:06:37.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.483+0000 7f96ae000640 1 -- 172.21.15.103:0/2050855781 wait complete. 2024-09-11T01:06:37.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.484+0000 7f96ae000640 1 Processor -- start 2024-09-11T01:06:37.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.484+0000 7f96ae000640 1 -- start start 2024-09-11T01:06:37.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.484+0000 7f96ae000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96a8102dc0 0x7f96a819b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:37.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.484+0000 7f96ae000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a81087d0 0x7f96a819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:37.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.484+0000 7f96ae000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96a8109150 0x7f96a81a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:37.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.484+0000 7f96ae000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f96a8112e10 con 0x7f96a8109150 2024-09-11T01:06:37.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.484+0000 7f96ae000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f96a8112c90 con 0x7f96a81087d0 2024-09-11T01:06:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.484+0000 7f96ae000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f96a8112f90 con 0x7f96a8102dc0 2024-09-11T01:06:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.485+0000 7f96a7400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96a8102dc0 0x7f96a819b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.485+0000 7f96a7400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96a8102dc0 0x7f96a819b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:46676/0 (socket says 172.21.15.103:46676) 2024-09-11T01:06:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.485+0000 7f96a7400640 1 -- 172.21.15.103:0/1335731152 learned_addr learned my addr 172.21.15.103:0/1335731152 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.485+0000 7f96a7e00640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96a8109150 0x7f96a81a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.485+0000 7f96a6a00640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a81087d0 0x7f96a819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.485+0000 7f96a7e00640 1 -- 172.21.15.103:0/1335731152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96a8102dc0 msgr2=0x7f96a819b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.485+0000 7f96a7e00640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96a8102dc0 0x7f96a819b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.485+0000 7f96a7e00640 1 -- 172.21.15.103:0/1335731152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a81087d0 msgr2=0x7f96a819b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.485+0000 7f96a7e00640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a81087d0 0x7f96a819b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.485+0000 7f96a7e00640 1 -- 172.21.15.103:0/1335731152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a81a1520 con 0x7f96a8109150 2024-09-11T01:06:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.485+0000 7f96a7400640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96a8102dc0 0x7f96a819b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:37.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.485+0000 7f96a7e00640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96a8109150 0x7f96a81a0d50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009fd0 tx=0x7f96a000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:37.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.486+0000 7f969fe00640 1 -- 172.21.15.103:0/1335731152 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a000ce20 con 0x7f96a8109150 2024-09-11T01:06:37.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.486+0000 7f969fe00640 1 -- 172.21.15.103:0/1335731152 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f96a0005020 con 0x7f96a8109150 2024-09-11T01:06:37.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.486+0000 7f969fe00640 1 -- 172.21.15.103:0/1335731152 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a0010690 con 0x7f96a8109150 2024-09-11T01:06:37.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.486+0000 7f96ae000640 1 -- 172.21.15.103:0/1335731152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a81a1810 con 0x7f96a8109150 2024-09-11T01:06:37.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.486+0000 7f96ae000640 1 -- 172.21.15.103:0/1335731152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a81a7ed0 con 0x7f96a8109150 2024-09-11T01:06:37.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.487+0000 7f96ae000640 1 -- 172.21.15.103:0/1335731152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a81031a0 con 0x7f96a8109150 2024-09-11T01:06:37.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.489+0000 7f969fe00640 1 -- 172.21.15.103:0/1335731152 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f96a00054d0 con 0x7f96a8109150 2024-09-11T01:06:37.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.490+0000 7f969fe00640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f968c0b53f0 0x7f968c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:37.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.491+0000 7f969fe00640 1 -- 172.21.15.103:0/1335731152 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f96a00e6740 con 0x7f96a8109150 2024-09-11T01:06:37.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.491+0000 7f96a7400640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f968c0b53f0 0x7f968c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:37.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.492+0000 7f96a7400640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f968c0b53f0 0x7f968c0b78b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9698011550 tx=0x7f9698005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:37.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.494+0000 7f969fe00640 1 -- 172.21.15.103:0/1335731152 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f96a00ad100 con 0x7f96a8109150 2024-09-11T01:06:37.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.681+0000 7f96ae000640 1 -- 172.21.15.103:0/1335731152 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96a802e5c0 con 0x7f96a8109150 2024-09-11T01:06:37.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.683+0000 7f969fe00640 1 -- 172.21.15.103:0/1335731152 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24796 (secure 0 0 0) 0x7f96a00aca00 con 0x7f96a8109150 2024-09-11T01:06:37.685 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:06:37.685 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":87,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","created":"2024-09-11T00:56:46.242882+0000","modified":"2024-09-11T01:05:45.069528+0000","last_up_change":"2024-09-11T01:04:34.895368+0000","last_in_change":"2024-09-11T01:04:11.663436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:00:33.745338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T01:05:27.486014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T01:05:29.797513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T01:05:38.956635+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1b3e4222-43fd-4af0-bf97-3ba1000221b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6803","nonce":1867193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6805","nonce":1867193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6809","nonce":1867193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6807","nonce":1867193874}]},"public_addr":"172.21.15.103:6803/1867193874","cluster_addr":"172.21.15.103:6805/1867193874","heartbeat_back_addr":"172.21.15.103:6809/1867193874","heartbeat_front_addr":"172.21.15.103:6807/1867193874","state":["exists","up"]},{"osd":1,"uuid":"9a2b40da-7361-4c4f-a9dc-a769b427a0fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6801","nonce":2629532556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6803","nonce":2629532556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6807","nonce":2629532556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6805","nonce":2629532556}]},"public_addr":"172.21.15.117:6801/2629532556","cluster_addr":"172.21.15.117:6803/2629532556","heartbeat_back_addr":"172.21.15.117:6807/2629532556","heartbeat_front_addr":"172.21.15.117:6805/2629532556","state":["exists","up"]},{"osd":2,"uuid":"5db919c1-90a7-4ba7-acf3-89eeb77ae131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6801","nonce":3208966770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6803","nonce":3208966770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6807","nonce":3208966770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6805","nonce":3208966770}]},"public_addr":"172.21.15.183:6801/3208966770","cluster_addr":"172.21.15.183:6803/3208966770","heartbeat_back_addr":"172.21.15.183:6807/3208966770","heartbeat_front_addr":"172.21.15.183:6805/3208966770","state":["exists","up"]},{"osd":3,"uuid":"bdc465f2-06a5-4667-9651-4e168700d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6811","nonce":2238128162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6813","nonce":2238128162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6817","nonce":2238128162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6815","nonce":2238128162}]},"public_addr":"172.21.15.103:6811/2238128162","cluster_addr":"172.21.15.103:6813/2238128162","heartbeat_back_addr":"172.21.15.103:6817/2238128162","heartbeat_front_addr":"172.21.15.103:6815/2238128162","state":["exists","up"]},{"osd":4,"uuid":"be86a5d2-5e86-4bf4-8464-9dff7a801e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6809","nonce":2368878504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6811","nonce":2368878504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6815","nonce":2368878504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6813","nonce":2368878504}]},"public_addr":"172.21.15.117:6809/2368878504","cluster_addr":"172.21.15.117:6811/2368878504","heartbeat_back_addr":"172.21.15.117:6815/2368878504","heartbeat_front_addr":"172.21.15.117:6813/2368878504","state":["exists","up"]},{"osd":5,"uuid":"090b20ec-d9ff-4e10-ad9f-52ab41dbf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6809","nonce":1668069547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6811","nonce":1668069547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6815","nonce":1668069547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6813","nonce":1668069547}]},"public_addr":"172.21.15.183:6809/1668069547","cluster_addr":"172.21.15.183:6811/1668069547","heartbeat_back_addr":"172.21.15.183:6815/1668069547","heartbeat_front_addr":"172.21.15.183:6813/1668069547","state":["exists","up"]},{"osd":6,"uuid":"19abe982-3522-40f9-a628-ddaef462cdb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6819","nonce":4203476972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6821","nonce":4203476972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6825","nonce":4203476972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6823","nonce":4203476972}]},"public_addr":"172.21.15.103:6819/4203476972","cluster_addr":"172.21.15.103:6821/4203476972","heartbeat_back_addr":"172.21.15.103:6825/4203476972","heartbeat_front_addr":"172.21.15.103:6823/4203476972","state":["exists","up"]},{"osd":7,"uuid":"e875ff09-805a-40ff-9d6a-dd2607ce3432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6817","nonce":1207680713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6819","nonce":1207680713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6823","nonce":1207680713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6821","nonce":1207680713}]},"public_addr":"172.21.15.117:6817/1207680713","cluster_addr":"172.21.15.117:6819/1207680713","heartbeat_back_addr":"172.21.15.117:6823/1207680713","heartbeat_front_addr":"172.21.15.117:6821/1207680713","state":["exists","up"]},{"osd":8,"uuid":"2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6817","nonce":2935820593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6819","nonce":2935820593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6823","nonce":2935820593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6821","nonce":2935820593}]},"public_addr":"172.21.15.183:6817/2935820593","cluster_addr":"172.21.15.183:6819/2935820593","heartbeat_back_addr":"172.21.15.183:6823/2935820593","heartbeat_front_addr":"172.21.15.183:6821/2935820593","state":["exists","up"]},{"osd":9,"uuid":"c36d17d2-0bc8-4322-a998-9c8eff970e58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6827","nonce":2104855877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6829","nonce":2104855877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6833","nonce":2104855877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6831","nonce":2104855877}]},"public_addr":"172.21.15.103:6827/2104855877","cluster_addr":"172.21.15.103:6829/2104855877","heartbeat_back_addr":"172.21.15.103:6833/2104855877","heartbeat_front_addr":"172.21.15.103:6831/2104855877","state":["exists","up"]},{"osd":10,"uuid":"e71bc5f7-a829-43cf-a10b-b2444da1d773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6825","nonce":3792981873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6827","nonce":3792981873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6831","nonce":3792981873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6829","nonce":3792981873}]},"public_addr":"172.21.15.117:6825/3792981873","cluster_addr":"172.21.15.117:6827/3792981873","heartbeat_back_addr":"172.21.15.117:6831/3792981873","heartbeat_front_addr":"172.21.15.117:6829/3792981873","state":["exists","up"]},{"osd":11,"uuid":"8f36697f-4d18-4efa-bf14-d68a13464958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6825","nonce":1250387289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6827","nonce":1250387289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6831","nonce":1250387289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6829","nonce":1250387289}]},"public_addr":"172.21.15.183:6825/1250387289","cluster_addr":"172.21.15.183:6827/1250387289","heartbeat_back_addr":"172.21.15.183:6831/1250387289","heartbeat_front_addr":"172.21.15.183:6829/1250387289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:59:39.916330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:06.042858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:30.703648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:59.493376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:25.190299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:50.480326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:20.815441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:46.398318+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:11.499922+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:41.895096+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:08.411538+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:32.943466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/366890372":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6800/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2372812363":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2844264136":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/2046654364":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6801/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/211510947":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6801/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6800/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/189409602":"2024-09-12T00:57:11.412015+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:06:37.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.685+0000 7f96ae000640 1 -- 172.21.15.103:0/1335731152 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f968c0b53f0 msgr2=0x7f968c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:37.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.685+0000 7f96ae000640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f968c0b53f0 0x7f968c0b78b0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9698011550 tx=0x7f9698005f90 comp rx=0 tx=0).stop 2024-09-11T01:06:37.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.685+0000 7f96ae000640 1 -- 172.21.15.103:0/1335731152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96a8109150 msgr2=0x7f96a81a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:37.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.685+0000 7f96ae000640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96a8109150 0x7f96a81a0d50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f96a0009fd0 tx=0x7f96a000ef10 comp rx=0 tx=0).stop 2024-09-11T01:06:37.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.686+0000 7f96ae000640 1 -- 172.21.15.103:0/1335731152 shutdown_connections 2024-09-11T01:06:37.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.686+0000 7f96ae000640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f968c0b53f0 0x7f968c0b78b0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:37.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.686+0000 7f96ae000640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f96a8109150 0x7f96a81a0d50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:37.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.686+0000 7f96ae000640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a81087d0 0x7f96a819b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:37.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.686+0000 7f96ae000640 1 --2- 172.21.15.103:0/1335731152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f96a8102dc0 0x7f96a819b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:37.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.686+0000 7f96ae000640 1 -- 172.21.15.103:0/1335731152 >> 172.21.15.103:0/1335731152 conn(0x7f96a80fe830 msgr2=0x7f96a8104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:37.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.686+0000 7f96ae000640 1 -- 172.21.15.103:0/1335731152 shutdown_connections 2024-09-11T01:06:37.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:37.686+0000 7f96ae000640 1 -- 172.21.15.103:0/1335731152 wait complete. 2024-09-11T01:06:38.456 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:38 smithi103 ceph-mon[30562]: pgmap v346: 129 pgs: 129 active+clean; 624 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-11T01:06:38.456 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:38 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1335731152' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:38.498 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T01:06:38.498 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T01:06:38.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:38 smithi117 ceph-mon[35358]: pgmap v346: 129 pgs: 129 active+clean; 624 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-11T01:06:38.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:38 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1335731152' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:38.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:38 smithi183 ceph-mon[34992]: pgmap v346: 129 pgs: 129 active+clean; 624 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 4.5 KiB/s wr, 7 op/s 2024-09-11T01:06:38.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:38 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1335731152' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:38.868 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:39.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.494+0000 7f3a64600640 1 -- 172.21.15.103:0/2557702239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a5c102da0 msgr2=0x7f3a5c103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:39.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.494+0000 7f3a64600640 1 --2- 172.21.15.103:0/2557702239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a5c102da0 0x7f3a5c103180 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3a50009900 tx=0x7f3a5002a3f0 comp rx=0 tx=0).stop 2024-09-11T01:06:39.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.494+0000 7f3a64600640 1 -- 172.21.15.103:0/2557702239 shutdown_connections 2024-09-11T01:06:39.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.494+0000 7f3a64600640 1 --2- 172.21.15.103:0/2557702239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a5c109130 0x7f3a5c10f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:39.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.494+0000 7f3a64600640 1 --2- 172.21.15.103:0/2557702239 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a5c1087b0 0x7f3a5c108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:39.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.494+0000 7f3a64600640 1 --2- 172.21.15.103:0/2557702239 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a5c102da0 0x7f3a5c103180 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:39.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.494+0000 7f3a64600640 1 -- 172.21.15.103:0/2557702239 >> 172.21.15.103:0/2557702239 conn(0x7f3a5c0fe810 msgr2=0x7f3a5c100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:39.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.494+0000 7f3a64600640 1 -- 172.21.15.103:0/2557702239 shutdown_connections 2024-09-11T01:06:39.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.495+0000 7f3a64600640 1 -- 172.21.15.103:0/2557702239 wait complete. 2024-09-11T01:06:39.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.496+0000 7f3a64600640 1 Processor -- start 2024-09-11T01:06:39.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.496+0000 7f3a64600640 1 -- start start 2024-09-11T01:06:39.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.496+0000 7f3a64600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a5c102da0 0x7f3a5c1992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:39.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.496+0000 7f3a64600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a5c1087b0 0x7f3a5c1997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:39.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.496+0000 7f3a64600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a5c109130 0x7f3a5c19eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:39.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.496+0000 7f3a64600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c112df0 con 0x7f3a5c109130 2024-09-11T01:06:39.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.496+0000 7f3a64600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c112c70 con 0x7f3a5c1087b0 2024-09-11T01:06:39.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.496+0000 7f3a64600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c112f70 con 0x7f3a5c102da0 2024-09-11T01:06:39.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.496+0000 7f3a61c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a5c102da0 0x7f3a5c1992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:39.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.496+0000 7f3a62600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a5c109130 0x7f3a5c19eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:39.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.496+0000 7f3a61c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a5c102da0 0x7f3a5c1992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:46690/0 (socket says 172.21.15.103:46690) 2024-09-11T01:06:39.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.496+0000 7f3a61c00640 1 -- 172.21.15.103:0/191803849 learned_addr learned my addr 172.21.15.103:0/191803849 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:39.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.496+0000 7f3a61200640 1 --2- 172.21.15.103:0/191803849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a5c1087b0 0x7f3a5c1997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:39.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.497+0000 7f3a61c00640 1 -- 172.21.15.103:0/191803849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a5c1087b0 msgr2=0x7f3a5c1997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:39.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.497+0000 7f3a61c00640 1 --2- 172.21.15.103:0/191803849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a5c1087b0 0x7f3a5c1997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:39.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.497+0000 7f3a61c00640 1 -- 172.21.15.103:0/191803849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a5c109130 msgr2=0x7f3a5c19eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:39.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.497+0000 7f3a61c00640 1 --2- 172.21.15.103:0/191803849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a5c109130 0x7f3a5c19eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:39.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.497+0000 7f3a61c00640 1 -- 172.21.15.103:0/191803849 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c19f350 con 0x7f3a5c102da0 2024-09-11T01:06:39.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.497+0000 7f3a62600640 1 --2- 172.21.15.103:0/191803849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a5c109130 0x7f3a5c19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:39.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.497+0000 7f3a61c00640 1 --2- 172.21.15.103:0/191803849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a5c102da0 0x7f3a5c1992a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3a50005940 tx=0x7f3a50004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:39.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.498+0000 7f3a5a000640 1 -- 172.21.15.103:0/191803849 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5003f030 con 0x7f3a5c102da0 2024-09-11T01:06:39.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.498+0000 7f3a64600640 1 -- 172.21.15.103:0/191803849 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5c19f5e0 con 0x7f3a5c102da0 2024-09-11T01:06:39.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.498+0000 7f3a5a000640 1 -- 172.21.15.103:0/191803849 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a50003aa0 con 0x7f3a5c102da0 2024-09-11T01:06:39.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.498+0000 7f3a5a000640 1 -- 172.21.15.103:0/191803849 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a50035070 con 0x7f3a5c102da0 2024-09-11T01:06:39.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.498+0000 7f3a64600640 1 -- 172.21.15.103:0/191803849 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a5c1a5d00 con 0x7f3a5c102da0 2024-09-11T01:06:39.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.499+0000 7f3a64600640 1 -- 172.21.15.103:0/191803849 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5c103180 con 0x7f3a5c102da0 2024-09-11T01:06:39.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.501+0000 7f3a5a000640 1 -- 172.21.15.103:0/191803849 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f3a50003c50 con 0x7f3a5c102da0 2024-09-11T01:06:39.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.502+0000 7f3a5a000640 1 --2- 172.21.15.103:0/191803849 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3a440b5370 0x7f3a440b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:39.539 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.503+0000 7f3a5a000640 1 -- 172.21.15.103:0/191803849 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9063+0+0 (secure 0 0 0) 0x7f3a50106ca0 con 0x7f3a5c102da0 2024-09-11T01:06:39.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.503+0000 7f3a61200640 1 --2- 172.21.15.103:0/191803849 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3a440b5370 0x7f3a440b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:39.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.503+0000 7f3a61200640 1 --2- 172.21.15.103:0/191803849 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3a440b5370 0x7f3a440b7830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c108310 tx=0x7f3a4800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:39.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.505+0000 7f3a5a000640 1 -- 172.21.15.103:0/191803849 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3a500cd010 con 0x7f3a5c102da0 2024-09-11T01:06:39.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.690+0000 7f3a64600640 1 -- 172.21.15.103:0/191803849 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3a5c100790 con 0x7f3a440b5370 2024-09-11T01:06:39.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.698+0000 7f3a5a000640 1 -- 172.21.15.103:0/191803849 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340343 (secure 0 0 0) 0x7f3a5c100790 con 0x7f3a440b5370 2024-09-11T01:06:39.707 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:06:39.709 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T01:06:39.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.703+0000 7f3a64600640 1 -- 172.21.15.103:0/191803849 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3a440b5370 msgr2=0x7f3a440b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:39.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.703+0000 7f3a64600640 1 --2- 172.21.15.103:0/191803849 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3a440b5370 0x7f3a440b7830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c108310 tx=0x7f3a4800b390 comp rx=0 tx=0).stop 2024-09-11T01:06:39.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.703+0000 7f3a64600640 1 -- 172.21.15.103:0/191803849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a5c102da0 msgr2=0x7f3a5c1992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:39.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.703+0000 7f3a64600640 1 --2- 172.21.15.103:0/191803849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a5c102da0 0x7f3a5c1992a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3a50005940 tx=0x7f3a50004270 comp rx=0 tx=0).stop 2024-09-11T01:06:39.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.703+0000 7f3a64600640 1 -- 172.21.15.103:0/191803849 shutdown_connections 2024-09-11T01:06:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.703+0000 7f3a64600640 1 --2- 172.21.15.103:0/191803849 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3a440b5370 0x7f3a440b7830 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.703+0000 7f3a64600640 1 --2- 172.21.15.103:0/191803849 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a5c109130 0x7f3a5c19eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.703+0000 7f3a64600640 1 --2- 172.21.15.103:0/191803849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3a5c1087b0 0x7f3a5c1997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.703+0000 7f3a64600640 1 --2- 172.21.15.103:0/191803849 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3a5c102da0 0x7f3a5c1992a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.703+0000 7f3a64600640 1 -- 172.21.15.103:0/191803849 >> 172.21.15.103:0/191803849 conn(0x7f3a5c0fe810 msgr2=0x7f3a5c100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:39.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.703+0000 7f3a64600640 1 -- 172.21.15.103:0/191803849 shutdown_connections 2024-09-11T01:06:39.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:39.703+0000 7f3a64600640 1 -- 172.21.15.103:0/191803849 wait complete. 2024-09-11T01:06:40.478 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":347,"stamp":"2024-09-11T01:06:39.525308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":639473,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":197,"num_read_kb":176,"num_write":282,"num_write_kb":2247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2953486,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379420,"kb_used_data":13532,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124562404,"statfs":{"total":1151940427776,"available":1151551901696,"internally_reserved":0,"allocated":13856768,"data_stored":7767777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":41653,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":78,"num_write":30,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003149"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.646967+0000","last_change":"2024-09-11T01:05:28.553987+0000","last_active":"2024-09-11T01:06:19.646967+0000","last_peered":"2024-09-11T01:06:19.646967+0000","last_clean":"2024-09-11T01:06:19.646967+0000","last_became_active":"2024-09-11T01:05:28.553691+0000","last_became_peered":"2024-09-11T01:05:28.553691+0000","last_unstale":"2024-09-11T01:06:19.646967+0000","last_undegraded":"2024-09-11T01:06:19.646967+0000","last_fullsized":"2024-09-11T01:06:19.646967+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:50.407880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210592+0000","last_change":"2024-09-11T01:05:31.677005+0000","last_active":"2024-09-11T01:05:45.210592+0000","last_peered":"2024-09-11T01:05:45.210592+0000","last_clean":"2024-09-11T01:05:45.210592+0000","last_became_active":"2024-09-11T01:05:31.676597+0000","last_became_peered":"2024-09-11T01:05:31.676597+0000","last_unstale":"2024-09-11T01:05:45.210592+0000","last_undegraded":"2024-09-11T01:05:45.210592+0000","last_fullsized":"2024-09-11T01:05:45.210592+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:06.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.208866+0000","last_change":"2024-09-11T01:05:40.975009+0000","last_active":"2024-09-11T01:05:45.208866+0000","last_peered":"2024-09-11T01:05:45.208866+0000","last_clean":"2024-09-11T01:05:45.208866+0000","last_became_active":"2024-09-11T01:05:40.974546+0000","last_became_peered":"2024-09-11T01:05:40.974546+0000","last_unstale":"2024-09-11T01:05:45.208866+0000","last_undegraded":"2024-09-11T01:05:45.208866+0000","last_fullsized":"2024-09-11T01:05:45.208866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:56.420262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210860+0000","last_change":"2024-09-11T01:05:28.623367+0000","last_active":"2024-09-11T01:05:45.210860+0000","last_peered":"2024-09-11T01:05:45.210860+0000","last_clean":"2024-09-11T01:05:45.210860+0000","last_became_active":"2024-09-11T01:05:28.622990+0000","last_became_peered":"2024-09-11T01:05:28.622990+0000","last_unstale":"2024-09-11T01:05:45.210860+0000","last_undegraded":"2024-09-11T01:05:45.210860+0000","last_fullsized":"2024-09-11T01:05:45.210860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:35.022280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211219+0000","last_change":"2024-09-11T01:05:31.693910+0000","last_active":"2024-09-11T01:05:45.211219+0000","last_peered":"2024-09-11T01:05:45.211219+0000","last_clean":"2024-09-11T01:05:45.211219+0000","last_became_active":"2024-09-11T01:05:31.692906+0000","last_became_peered":"2024-09-11T01:05:31.692906+0000","last_unstale":"2024-09-11T01:05:45.211219+0000","last_undegraded":"2024-09-11T01:05:45.211219+0000","last_fullsized":"2024-09-11T01:05:45.211219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:11.906323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209596+0000","last_change":"2024-09-11T01:05:40.975768+0000","last_active":"2024-09-11T01:05:45.209596+0000","last_peered":"2024-09-11T01:05:45.209596+0000","last_clean":"2024-09-11T01:05:45.209596+0000","last_became_active":"2024-09-11T01:05:40.974721+0000","last_became_peered":"2024-09-11T01:05:40.974721+0000","last_unstale":"2024-09-11T01:05:45.209596+0000","last_undegraded":"2024-09-11T01:05:45.209596+0000","last_fullsized":"2024-09-11T01:05:45.209596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:27.475531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.644331+0000","last_change":"2024-09-11T01:05:28.558980+0000","last_active":"2024-09-11T01:06:19.644331+0000","last_peered":"2024-09-11T01:06:19.644331+0000","last_clean":"2024-09-11T01:06:19.644331+0000","last_became_active":"2024-09-11T01:05:28.558617+0000","last_became_peered":"2024-09-11T01:05:28.558617+0000","last_unstale":"2024-09-11T01:06:19.644331+0000","last_undegraded":"2024-09-11T01:06:19.644331+0000","last_fullsized":"2024-09-11T01:06:19.644331+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:13.659175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210842+0000","last_change":"2024-09-11T01:05:31.664705+0000","last_active":"2024-09-11T01:05:45.210842+0000","last_peered":"2024-09-11T01:05:45.210842+0000","last_clean":"2024-09-11T01:05:45.210842+0000","last_became_active":"2024-09-11T01:05:31.664328+0000","last_became_peered":"2024-09-11T01:05:31.664328+0000","last_unstale":"2024-09-11T01:05:45.210842+0000","last_undegraded":"2024-09-11T01:05:45.210842+0000","last_fullsized":"2024-09-11T01:05:45.210842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:20.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210141+0000","last_change":"2024-09-11T01:05:40.976636+0000","last_active":"2024-09-11T01:05:45.210141+0000","last_peered":"2024-09-11T01:05:45.210141+0000","last_clean":"2024-09-11T01:05:45.210141+0000","last_became_active":"2024-09-11T01:05:40.975437+0000","last_became_peered":"2024-09-11T01:05:40.975437+0000","last_unstale":"2024-09-11T01:05:45.210141+0000","last_undegraded":"2024-09-11T01:05:45.210141+0000","last_fullsized":"2024-09-11T01:05:45.210141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:20.255947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124635+0000","last_change":"2024-09-11T01:05:28.555081+0000","last_active":"2024-09-11T01:05:45.124635+0000","last_peered":"2024-09-11T01:05:45.124635+0000","last_clean":"2024-09-11T01:05:45.124635+0000","last_became_active":"2024-09-11T01:05:28.554562+0000","last_became_peered":"2024-09-11T01:05:28.554562+0000","last_unstale":"2024-09-11T01:05:45.124635+0000","last_undegraded":"2024-09-11T01:05:45.124635+0000","last_fullsized":"2024-09-11T01:05:45.124635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:23.922285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210657+0000","last_change":"2024-09-11T01:05:31.680442+0000","last_active":"2024-09-11T01:05:45.210657+0000","last_peered":"2024-09-11T01:05:45.210657+0000","last_clean":"2024-09-11T01:05:45.210657+0000","last_became_active":"2024-09-11T01:05:31.680107+0000","last_became_peered":"2024-09-11T01:05:31.680107+0000","last_unstale":"2024-09-11T01:05:45.210657+0000","last_undegraded":"2024-09-11T01:05:45.210657+0000","last_fullsized":"2024-09-11T01:05:45.210657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:16:02.853855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209596+0000","last_change":"2024-09-11T01:05:40.969365+0000","last_active":"2024-09-11T01:05:45.209596+0000","last_peered":"2024-09-11T01:05:45.209596+0000","last_clean":"2024-09-11T01:05:45.209596+0000","last_became_active":"2024-09-11T01:05:40.969005+0000","last_became_peered":"2024-09-11T01:05:40.969005+0000","last_unstale":"2024-09-11T01:05:45.209596+0000","last_undegraded":"2024-09-11T01:05:45.209596+0000","last_fullsized":"2024-09-11T01:05:45.209596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:42.942848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124224+0000","last_change":"2024-09-11T01:05:31.676943+0000","last_active":"2024-09-11T01:05:45.124224+0000","last_peered":"2024-09-11T01:05:45.124224+0000","last_clean":"2024-09-11T01:05:45.124224+0000","last_became_active":"2024-09-11T01:05:31.676584+0000","last_became_peered":"2024-09-11T01:05:31.676584+0000","last_unstale":"2024-09-11T01:05:45.124224+0000","last_undegraded":"2024-09-11T01:05:45.124224+0000","last_fullsized":"2024-09-11T01:05:45.124224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:08.288439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.632116+0000","last_change":"2024-09-11T01:05:28.559196+0000","last_active":"2024-09-11T01:06:18.632116+0000","last_peered":"2024-09-11T01:06:18.632116+0000","last_clean":"2024-09-11T01:06:18.632116+0000","last_became_active":"2024-09-11T01:05:28.558746+0000","last_became_peered":"2024-09-11T01:05:28.558746+0000","last_unstale":"2024-09-11T01:06:18.632116+0000","last_undegraded":"2024-09-11T01:06:18.632116+0000","last_fullsized":"2024-09-11T01:06:18.632116+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:32.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210189+0000","last_change":"2024-09-11T01:05:40.963609+0000","last_active":"2024-09-11T01:05:45.210189+0000","last_peered":"2024-09-11T01:05:45.210189+0000","last_clean":"2024-09-11T01:05:45.210189+0000","last_became_active":"2024-09-11T01:05:40.963088+0000","last_became_peered":"2024-09-11T01:05:40.963088+0000","last_unstale":"2024-09-11T01:05:45.210189+0000","last_undegraded":"2024-09-11T01:05:45.210189+0000","last_fullsized":"2024-09-11T01:05:45.210189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:27.135362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209392+0000","last_change":"2024-09-11T01:05:31.681258+0000","last_active":"2024-09-11T01:05:45.209392+0000","last_peered":"2024-09-11T01:05:45.209392+0000","last_clean":"2024-09-11T01:05:45.209392+0000","last_became_active":"2024-09-11T01:05:31.680946+0000","last_became_peered":"2024-09-11T01:05:31.680946+0000","last_unstale":"2024-09-11T01:05:45.209392+0000","last_undegraded":"2024-09-11T01:05:45.209392+0000","last_fullsized":"2024-09-11T01:05:45.209392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:42.047250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'1","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.208991+0000","last_change":"2024-09-11T01:05:28.554651+0000","last_active":"2024-09-11T01:05:45.208991+0000","last_peered":"2024-09-11T01:05:45.208991+0000","last_clean":"2024-09-11T01:05:45.208991+0000","last_became_active":"2024-09-11T01:05:28.554279+0000","last_became_peered":"2024-09-11T01:05:28.554279+0000","last_unstale":"2024-09-11T01:05:45.208991+0000","last_undegraded":"2024-09-11T01:05:45.208991+0000","last_fullsized":"2024-09-11T01:05:45.208991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:14.093403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210125+0000","last_change":"2024-09-11T01:05:40.977549+0000","last_active":"2024-09-11T01:05:45.210125+0000","last_peered":"2024-09-11T01:05:45.210125+0000","last_clean":"2024-09-11T01:05:45.210125+0000","last_became_active":"2024-09-11T01:05:40.977030+0000","last_became_peered":"2024-09-11T01:05:40.977030+0000","last_unstale":"2024-09-11T01:05:45.210125+0000","last_undegraded":"2024-09-11T01:05:45.210125+0000","last_fullsized":"2024-09-11T01:05:45.210125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:08:02.313437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210502+0000","last_change":"2024-09-11T01:05:31.681743+0000","last_active":"2024-09-11T01:05:45.210502+0000","last_peered":"2024-09-11T01:05:45.210502+0000","last_clean":"2024-09-11T01:05:45.210502+0000","last_became_active":"2024-09-11T01:05:31.681223+0000","last_became_peered":"2024-09-11T01:05:31.681223+0000","last_unstale":"2024-09-11T01:05:45.210502+0000","last_undegraded":"2024-09-11T01:05:45.210502+0000","last_fullsized":"2024-09-11T01:05:45.210502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:49.449622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.631569+0000","last_change":"2024-09-11T01:05:28.552914+0000","last_active":"2024-09-11T01:06:18.631569+0000","last_peered":"2024-09-11T01:06:18.631569+0000","last_clean":"2024-09-11T01:06:18.631569+0000","last_became_active":"2024-09-11T01:05:28.552404+0000","last_became_peered":"2024-09-11T01:05:28.552404+0000","last_unstale":"2024-09-11T01:06:18.631569+0000","last_undegraded":"2024-09-11T01:06:18.631569+0000","last_fullsized":"2024-09-11T01:06:18.631569+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:39.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.123475+0000","last_change":"2024-09-11T01:05:40.985652+0000","last_active":"2024-09-11T01:05:45.123475+0000","last_peered":"2024-09-11T01:05:45.123475+0000","last_clean":"2024-09-11T01:05:45.123475+0000","last_became_active":"2024-09-11T01:05:40.984898+0000","last_became_peered":"2024-09-11T01:05:40.984898+0000","last_unstale":"2024-09-11T01:05:45.123475+0000","last_undegraded":"2024-09-11T01:05:45.123475+0000","last_fullsized":"2024-09-11T01:05:45.123475+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:58.961342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124085+0000","last_change":"2024-09-11T01:05:31.675590+0000","last_active":"2024-09-11T01:05:45.124085+0000","last_peered":"2024-09-11T01:05:45.124085+0000","last_clean":"2024-09-11T01:05:45.124085+0000","last_became_active":"2024-09-11T01:05:31.674426+0000","last_became_peered":"2024-09-11T01:05:31.674426+0000","last_unstale":"2024-09-11T01:05:45.124085+0000","last_undegraded":"2024-09-11T01:05:45.124085+0000","last_fullsized":"2024-09-11T01:05:45.124085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:49.499195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.632055+0000","last_change":"2024-09-11T01:05:28.623677+0000","last_active":"2024-09-11T01:06:18.632055+0000","last_peered":"2024-09-11T01:06:18.632055+0000","last_clean":"2024-09-11T01:06:18.632055+0000","last_became_active":"2024-09-11T01:05:28.623357+0000","last_became_peered":"2024-09-11T01:05:28.623357+0000","last_unstale":"2024-09-11T01:06:18.632055+0000","last_undegraded":"2024-09-11T01:06:18.632055+0000","last_fullsized":"2024-09-11T01:06:18.632055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:10.875425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210503+0000","last_change":"2024-09-11T01:05:40.978136+0000","last_active":"2024-09-11T01:05:45.210503+0000","last_peered":"2024-09-11T01:05:45.210503+0000","last_clean":"2024-09-11T01:05:45.210503+0000","last_became_active":"2024-09-11T01:05:40.977583+0000","last_became_peered":"2024-09-11T01:05:40.977583+0000","last_unstale":"2024-09-11T01:05:45.210503+0000","last_undegraded":"2024-09-11T01:05:45.210503+0000","last_fullsized":"2024-09-11T01:05:45.210503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:58:20.297640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211053+0000","last_change":"2024-09-11T01:05:31.692938+0000","last_active":"2024-09-11T01:05:45.211053+0000","last_peered":"2024-09-11T01:05:45.211053+0000","last_clean":"2024-09-11T01:05:45.211053+0000","last_became_active":"2024-09-11T01:05:31.689869+0000","last_became_peered":"2024-09-11T01:05:31.689869+0000","last_unstale":"2024-09-11T01:05:45.211053+0000","last_undegraded":"2024-09-11T01:05:45.211053+0000","last_fullsized":"2024-09-11T01:05:45.211053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:24.820033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.629462+0000","last_change":"2024-09-11T01:05:28.755985+0000","last_active":"2024-09-11T01:06:18.629462+0000","last_peered":"2024-09-11T01:06:18.629462+0000","last_clean":"2024-09-11T01:06:18.629462+0000","last_became_active":"2024-09-11T01:05:28.755604+0000","last_became_peered":"2024-09-11T01:05:28.755604+0000","last_unstale":"2024-09-11T01:06:18.629462+0000","last_undegraded":"2024-09-11T01:06:18.629462+0000","last_fullsized":"2024-09-11T01:06:18.629462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:22.570473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209211+0000","last_change":"2024-09-11T01:05:40.963465+0000","last_active":"2024-09-11T01:05:45.209211+0000","last_peered":"2024-09-11T01:05:45.209211+0000","last_clean":"2024-09-11T01:05:45.209211+0000","last_became_active":"2024-09-11T01:05:40.962899+0000","last_became_peered":"2024-09-11T01:05:40.962899+0000","last_unstale":"2024-09-11T01:05:45.209211+0000","last_undegraded":"2024-09-11T01:05:45.209211+0000","last_fullsized":"2024-09-11T01:05:45.209211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:01.728640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210851+0000","last_change":"2024-09-11T01:05:31.675864+0000","last_active":"2024-09-11T01:05:45.210851+0000","last_peered":"2024-09-11T01:05:45.210851+0000","last_clean":"2024-09-11T01:05:45.210851+0000","last_became_active":"2024-09-11T01:05:31.675446+0000","last_became_peered":"2024-09-11T01:05:31.675446+0000","last_unstale":"2024-09-11T01:05:45.210851+0000","last_undegraded":"2024-09-11T01:05:45.210851+0000","last_fullsized":"2024-09-11T01:05:45.210851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:36.457881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'9","reported_seq":45,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:32.688737+0000","last_change":"2024-09-11T01:05:28.553509+0000","last_active":"2024-09-11T01:06:32.688737+0000","last_peered":"2024-09-11T01:06:32.688737+0000","last_clean":"2024-09-11T01:06:32.688737+0000","last_became_active":"2024-09-11T01:05:28.553101+0000","last_became_peered":"2024-09-11T01:05:28.553101+0000","last_unstale":"2024-09-11T01:06:32.688737+0000","last_undegraded":"2024-09-11T01:06:32.688737+0000","last_fullsized":"2024-09-11T01:06:32.688737+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:41.300518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209418+0000","last_change":"2024-09-11T01:05:40.977146+0000","last_active":"2024-09-11T01:05:45.209418+0000","last_peered":"2024-09-11T01:05:45.209418+0000","last_clean":"2024-09-11T01:05:45.209418+0000","last_became_active":"2024-09-11T01:05:40.976804+0000","last_became_peered":"2024-09-11T01:05:40.976804+0000","last_unstale":"2024-09-11T01:05:45.209418+0000","last_undegraded":"2024-09-11T01:05:45.209418+0000","last_fullsized":"2024-09-11T01:05:45.209418+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:49.753417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210515+0000","last_change":"2024-09-11T01:05:31.684219+0000","last_active":"2024-09-11T01:05:45.210515+0000","last_peered":"2024-09-11T01:05:45.210515+0000","last_clean":"2024-09-11T01:05:45.210515+0000","last_became_active":"2024-09-11T01:05:31.683937+0000","last_became_peered":"2024-09-11T01:05:31.683937+0000","last_unstale":"2024-09-11T01:05:45.210515+0000","last_undegraded":"2024-09-11T01:05:45.210515+0000","last_fullsized":"2024-09-11T01:05:45.210515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:53.813624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.632313+0000","last_change":"2024-09-11T01:05:28.623680+0000","last_active":"2024-09-11T01:06:18.632313+0000","last_peered":"2024-09-11T01:06:18.632313+0000","last_clean":"2024-09-11T01:06:18.632313+0000","last_became_active":"2024-09-11T01:05:28.623261+0000","last_became_peered":"2024-09-11T01:05:28.623261+0000","last_unstale":"2024-09-11T01:06:18.632313+0000","last_undegraded":"2024-09-11T01:06:18.632313+0000","last_fullsized":"2024-09-11T01:06:18.632313+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:17.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210983+0000","last_change":"2024-09-11T01:05:40.967165+0000","last_active":"2024-09-11T01:05:45.210983+0000","last_peered":"2024-09-11T01:05:45.210983+0000","last_clean":"2024-09-11T01:05:45.210983+0000","last_became_active":"2024-09-11T01:05:40.966723+0000","last_became_peered":"2024-09-11T01:05:40.966723+0000","last_unstale":"2024-09-11T01:05:45.210983+0000","last_undegraded":"2024-09-11T01:05:45.210983+0000","last_fullsized":"2024-09-11T01:05:45.210983+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:48.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210957+0000","last_change":"2024-09-11T01:05:31.679865+0000","last_active":"2024-09-11T01:05:45.210957+0000","last_peered":"2024-09-11T01:05:45.210957+0000","last_clean":"2024-09-11T01:05:45.210957+0000","last_became_active":"2024-09-11T01:05:31.679494+0000","last_became_peered":"2024-09-11T01:05:31.679494+0000","last_unstale":"2024-09-11T01:05:45.210957+0000","last_undegraded":"2024-09-11T01:05:45.210957+0000","last_fullsized":"2024-09-11T01:05:45.210957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:56.300799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.123409+0000","last_change":"2024-09-11T01:05:28.623746+0000","last_active":"2024-09-11T01:05:45.123409+0000","last_peered":"2024-09-11T01:05:45.123409+0000","last_clean":"2024-09-11T01:05:45.123409+0000","last_became_active":"2024-09-11T01:05:28.623358+0000","last_became_peered":"2024-09-11T01:05:28.623358+0000","last_unstale":"2024-09-11T01:05:45.123409+0000","last_undegraded":"2024-09-11T01:05:45.123409+0000","last_fullsized":"2024-09-11T01:05:45.123409+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:13.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124181+0000","last_change":"2024-09-11T01:05:40.982108+0000","last_active":"2024-09-11T01:05:45.124181+0000","last_peered":"2024-09-11T01:05:45.124181+0000","last_clean":"2024-09-11T01:05:45.124181+0000","last_became_active":"2024-09-11T01:05:40.981737+0000","last_became_peered":"2024-09-11T01:05:40.981737+0000","last_unstale":"2024-09-11T01:05:45.124181+0000","last_undegraded":"2024-09-11T01:05:45.124181+0000","last_fullsized":"2024-09-11T01:05:45.124181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:16.717933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210762+0000","last_change":"2024-09-11T01:05:31.680885+0000","last_active":"2024-09-11T01:05:45.210762+0000","last_peered":"2024-09-11T01:05:45.210762+0000","last_clean":"2024-09-11T01:05:45.210762+0000","last_became_active":"2024-09-11T01:05:31.680536+0000","last_became_peered":"2024-09-11T01:05:31.680536+0000","last_unstale":"2024-09-11T01:05:45.210762+0000","last_undegraded":"2024-09-11T01:05:45.210762+0000","last_fullsized":"2024-09-11T01:05:45.210762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:12.963321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124335+0000","last_change":"2024-09-11T01:05:28.553957+0000","last_active":"2024-09-11T01:05:45.124335+0000","last_peered":"2024-09-11T01:05:45.124335+0000","last_clean":"2024-09-11T01:05:45.124335+0000","last_became_active":"2024-09-11T01:05:28.553572+0000","last_became_peered":"2024-09-11T01:05:28.553572+0000","last_unstale":"2024-09-11T01:05:45.124335+0000","last_undegraded":"2024-09-11T01:05:45.124335+0000","last_fullsized":"2024-09-11T01:05:45.124335+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:14.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210231+0000","last_change":"2024-09-11T01:05:40.971221+0000","last_active":"2024-09-11T01:05:45.210231+0000","last_peered":"2024-09-11T01:05:45.210231+0000","last_clean":"2024-09-11T01:05:45.210231+0000","last_became_active":"2024-09-11T01:05:40.970063+0000","last_became_peered":"2024-09-11T01:05:40.970063+0000","last_unstale":"2024-09-11T01:05:45.210231+0000","last_undegraded":"2024-09-11T01:05:45.210231+0000","last_fullsized":"2024-09-11T01:05:45.210231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:46.299357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209352+0000","last_change":"2024-09-11T01:05:31.677125+0000","last_active":"2024-09-11T01:05:45.209352+0000","last_peered":"2024-09-11T01:05:45.209352+0000","last_clean":"2024-09-11T01:05:45.209352+0000","last_became_active":"2024-09-11T01:05:31.676803+0000","last_became_peered":"2024-09-11T01:05:31.676803+0000","last_unstale":"2024-09-11T01:05:45.209352+0000","last_undegraded":"2024-09-11T01:05:45.209352+0000","last_fullsized":"2024-09-11T01:05:45.209352+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:01:38.922178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'4","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:36.670845+0000","last_change":"2024-09-11T01:05:28.623895+0000","last_active":"2024-09-11T01:06:36.670845+0000","last_peered":"2024-09-11T01:06:36.670845+0000","last_clean":"2024-09-11T01:06:36.670845+0000","last_became_active":"2024-09-11T01:05:28.623520+0000","last_became_peered":"2024-09-11T01:05:28.623520+0000","last_unstale":"2024-09-11T01:06:36.670845+0000","last_undegraded":"2024-09-11T01:06:36.670845+0000","last_fullsized":"2024-09-11T01:06:36.670845+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:22.309521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211311+0000","last_change":"2024-09-11T01:05:40.974416+0000","last_active":"2024-09-11T01:05:45.211311+0000","last_peered":"2024-09-11T01:05:45.211311+0000","last_clean":"2024-09-11T01:05:45.211311+0000","last_became_active":"2024-09-11T01:05:40.973990+0000","last_became_peered":"2024-09-11T01:05:40.973990+0000","last_unstale":"2024-09-11T01:05:45.211311+0000","last_undegraded":"2024-09-11T01:05:45.211311+0000","last_fullsized":"2024-09-11T01:05:45.211311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:30.018876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209037+0000","last_change":"2024-09-11T01:05:31.688968+0000","last_active":"2024-09-11T01:05:45.209037+0000","last_peered":"2024-09-11T01:05:45.209037+0000","last_clean":"2024-09-11T01:05:45.209037+0000","last_became_active":"2024-09-11T01:05:31.688672+0000","last_became_peered":"2024-09-11T01:05:31.688672+0000","last_unstale":"2024-09-11T01:05:45.209037+0000","last_undegraded":"2024-09-11T01:05:45.209037+0000","last_fullsized":"2024-09-11T01:05:45.209037+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:39.080386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.643066+0000","last_change":"2024-09-11T01:05:28.554126+0000","last_active":"2024-09-11T01:06:19.643066+0000","last_peered":"2024-09-11T01:06:19.643066+0000","last_clean":"2024-09-11T01:06:19.643066+0000","last_became_active":"2024-09-11T01:05:28.553575+0000","last_became_peered":"2024-09-11T01:05:28.553575+0000","last_unstale":"2024-09-11T01:06:19.643066+0000","last_undegraded":"2024-09-11T01:06:19.643066+0000","last_fullsized":"2024-09-11T01:06:19.643066+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:42.203339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210957+0000","last_change":"2024-09-11T01:05:40.980415+0000","last_active":"2024-09-11T01:05:45.210957+0000","last_peered":"2024-09-11T01:05:45.210957+0000","last_clean":"2024-09-11T01:05:45.210957+0000","last_became_active":"2024-09-11T01:05:40.980062+0000","last_became_peered":"2024-09-11T01:05:40.980062+0000","last_unstale":"2024-09-11T01:05:45.210957+0000","last_undegraded":"2024-09-11T01:05:45.210957+0000","last_fullsized":"2024-09-11T01:05:45.210957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:25.889972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209592+0000","last_change":"2024-09-11T01:05:31.679622+0000","last_active":"2024-09-11T01:05:45.209592+0000","last_peered":"2024-09-11T01:05:45.209592+0000","last_clean":"2024-09-11T01:05:45.209592+0000","last_became_active":"2024-09-11T01:05:31.679239+0000","last_became_peered":"2024-09-11T01:05:31.679239+0000","last_unstale":"2024-09-11T01:05:45.209592+0000","last_undegraded":"2024-09-11T01:05:45.209592+0000","last_fullsized":"2024-09-11T01:05:45.209592+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:32.240196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:20.644341+0000","last_change":"2024-09-11T01:05:28.552203+0000","last_active":"2024-09-11T01:06:20.644341+0000","last_peered":"2024-09-11T01:06:20.644341+0000","last_clean":"2024-09-11T01:06:20.644341+0000","last_became_active":"2024-09-11T01:05:28.551658+0000","last_became_peered":"2024-09-11T01:05:28.551658+0000","last_unstale":"2024-09-11T01:06:20.644341+0000","last_undegraded":"2024-09-11T01:06:20.644341+0000","last_fullsized":"2024-09-11T01:06:20.644341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:46.102466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":112,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124120+0000","last_change":"2024-09-11T01:04:12.299017+0000","last_active":"2024-09-11T01:05:45.124120+0000","last_peered":"2024-09-11T01:05:45.124120+0000","last_clean":"2024-09-11T01:05:45.124120+0000","last_became_active":"2024-09-11T01:04:11.998504+0000","last_became_peered":"2024-09-11T01:04:11.998504+0000","last_unstale":"2024-09-11T01:05:45.124120+0000","last_undegraded":"2024-09-11T01:05:45.124120+0000","last_fullsized":"2024-09-11T01:05:45.124120+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:00:34.569322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:00:34.569322+0000","last_clean_scrub_stamp":"2024-09-11T01:00:34.569322+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:54.949789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124702+0000","last_change":"2024-09-11T01:05:40.982181+0000","last_active":"2024-09-11T01:05:45.124702+0000","last_peered":"2024-09-11T01:05:45.124702+0000","last_clean":"2024-09-11T01:05:45.124702+0000","last_became_active":"2024-09-11T01:05:40.981668+0000","last_became_peered":"2024-09-11T01:05:40.981668+0000","last_unstale":"2024-09-11T01:05:45.124702+0000","last_undegraded":"2024-09-11T01:05:45.124702+0000","last_fullsized":"2024-09-11T01:05:45.124702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:48.199189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124749+0000","last_change":"2024-09-11T01:05:31.677978+0000","last_active":"2024-09-11T01:05:45.124749+0000","last_peered":"2024-09-11T01:05:45.124749+0000","last_clean":"2024-09-11T01:05:45.124749+0000","last_became_active":"2024-09-11T01:05:31.677478+0000","last_became_peered":"2024-09-11T01:05:31.677478+0000","last_unstale":"2024-09-11T01:05:45.124749+0000","last_undegraded":"2024-09-11T01:05:45.124749+0000","last_fullsized":"2024-09-11T01:05:45.124749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:39.568921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.647354+0000","last_change":"2024-09-11T01:05:28.755866+0000","last_active":"2024-09-11T01:06:19.647354+0000","last_peered":"2024-09-11T01:06:19.647354+0000","last_clean":"2024-09-11T01:06:19.647354+0000","last_became_active":"2024-09-11T01:05:28.755475+0000","last_became_peered":"2024-09-11T01:05:28.755475+0000","last_unstale":"2024-09-11T01:06:19.647354+0000","last_undegraded":"2024-09-11T01:06:19.647354+0000","last_fullsized":"2024-09-11T01:06:19.647354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:22.324584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209644+0000","last_change":"2024-09-11T01:05:40.967181+0000","last_active":"2024-09-11T01:05:45.209644+0000","last_peered":"2024-09-11T01:05:45.209644+0000","last_clean":"2024-09-11T01:05:45.209644+0000","last_became_active":"2024-09-11T01:05:40.966748+0000","last_became_peered":"2024-09-11T01:05:40.966748+0000","last_unstale":"2024-09-11T01:05:45.209644+0000","last_undegraded":"2024-09-11T01:05:45.209644+0000","last_fullsized":"2024-09-11T01:05:45.209644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:15:28.446190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124569+0000","last_change":"2024-09-11T01:05:40.981823+0000","last_active":"2024-09-11T01:05:45.124569+0000","last_peered":"2024-09-11T01:05:45.124569+0000","last_clean":"2024-09-11T01:05:45.124569+0000","last_became_active":"2024-09-11T01:05:40.981478+0000","last_became_peered":"2024-09-11T01:05:40.981478+0000","last_unstale":"2024-09-11T01:05:45.124569+0000","last_undegraded":"2024-09-11T01:05:45.124569+0000","last_fullsized":"2024-09-11T01:05:45.124569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:55.848492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210777+0000","last_change":"2024-09-11T01:05:28.549207+0000","last_active":"2024-09-11T01:05:45.210777+0000","last_peered":"2024-09-11T01:05:45.210777+0000","last_clean":"2024-09-11T01:05:45.210777+0000","last_became_active":"2024-09-11T01:05:28.548156+0000","last_became_peered":"2024-09-11T01:05:28.548156+0000","last_unstale":"2024-09-11T01:05:45.210777+0000","last_undegraded":"2024-09-11T01:05:45.210777+0000","last_fullsized":"2024-09-11T01:05:45.210777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:58.698379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210631+0000","last_change":"2024-09-11T01:05:40.982213+0000","last_active":"2024-09-11T01:05:45.210631+0000","last_peered":"2024-09-11T01:05:45.210631+0000","last_clean":"2024-09-11T01:05:45.210631+0000","last_became_active":"2024-09-11T01:05:40.981066+0000","last_became_peered":"2024-09-11T01:05:40.981066+0000","last_unstale":"2024-09-11T01:05:45.210631+0000","last_undegraded":"2024-09-11T01:05:45.210631+0000","last_fullsized":"2024-09-11T01:05:45.210631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:09.348973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124786+0000","last_change":"2024-09-11T01:05:31.677613+0000","last_active":"2024-09-11T01:05:45.124786+0000","last_peered":"2024-09-11T01:05:45.124786+0000","last_clean":"2024-09-11T01:05:45.124786+0000","last_became_active":"2024-09-11T01:05:31.677263+0000","last_became_peered":"2024-09-11T01:05:31.677263+0000","last_unstale":"2024-09-11T01:05:45.124786+0000","last_undegraded":"2024-09-11T01:05:45.124786+0000","last_fullsized":"2024-09-11T01:05:45.124786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:32.490982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211305+0000","last_change":"2024-09-11T01:05:28.558437+0000","last_active":"2024-09-11T01:05:45.211305+0000","last_peered":"2024-09-11T01:05:45.211305+0000","last_clean":"2024-09-11T01:05:45.211305+0000","last_became_active":"2024-09-11T01:05:28.558070+0000","last_became_peered":"2024-09-11T01:05:28.558070+0000","last_unstale":"2024-09-11T01:05:45.211305+0000","last_undegraded":"2024-09-11T01:05:45.211305+0000","last_fullsized":"2024-09-11T01:05:45.211305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:26.589209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209186+0000","last_change":"2024-09-11T01:05:40.970422+0000","last_active":"2024-09-11T01:05:45.209186+0000","last_peered":"2024-09-11T01:05:45.209186+0000","last_clean":"2024-09-11T01:05:45.209186+0000","last_became_active":"2024-09-11T01:05:40.970087+0000","last_became_peered":"2024-09-11T01:05:40.970087+0000","last_unstale":"2024-09-11T01:05:45.209186+0000","last_undegraded":"2024-09-11T01:05:45.209186+0000","last_fullsized":"2024-09-11T01:05:45.209186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:05.171700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211039+0000","last_change":"2024-09-11T01:05:40.967014+0000","last_active":"2024-09-11T01:05:45.211039+0000","last_peered":"2024-09-11T01:05:45.211039+0000","last_clean":"2024-09-11T01:05:45.211039+0000","last_became_active":"2024-09-11T01:05:40.966567+0000","last_became_peered":"2024-09-11T01:05:40.966567+0000","last_unstale":"2024-09-11T01:05:45.211039+0000","last_undegraded":"2024-09-11T01:05:45.211039+0000","last_fullsized":"2024-09-11T01:05:45.211039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:50.868245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:20.640347+0000","last_change":"2024-09-11T01:05:28.553646+0000","last_active":"2024-09-11T01:06:20.640347+0000","last_peered":"2024-09-11T01:06:20.640347+0000","last_clean":"2024-09-11T01:06:20.640347+0000","last_became_active":"2024-09-11T01:05:28.553238+0000","last_became_peered":"2024-09-11T01:05:28.553238+0000","last_unstale":"2024-09-11T01:06:20.640347+0000","last_undegraded":"2024-09-11T01:06:20.640347+0000","last_fullsized":"2024-09-11T01:06:20.640347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:31.670321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209308+0000","last_change":"2024-09-11T01:05:40.973220+0000","last_active":"2024-09-11T01:05:45.209308+0000","last_peered":"2024-09-11T01:05:45.209308+0000","last_clean":"2024-09-11T01:05:45.209308+0000","last_became_active":"2024-09-11T01:05:40.972843+0000","last_became_peered":"2024-09-11T01:05:40.972843+0000","last_unstale":"2024-09-11T01:05:45.209308+0000","last_undegraded":"2024-09-11T01:05:45.209308+0000","last_fullsized":"2024-09-11T01:05:45.209308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:07.785474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209683+0000","last_change":"2024-09-11T01:05:31.682064+0000","last_active":"2024-09-11T01:05:45.209683+0000","last_peered":"2024-09-11T01:05:45.209683+0000","last_clean":"2024-09-11T01:05:45.209683+0000","last_became_active":"2024-09-11T01:05:31.681744+0000","last_became_peered":"2024-09-11T01:05:31.681744+0000","last_unstale":"2024-09-11T01:05:45.209683+0000","last_undegraded":"2024-09-11T01:05:45.209683+0000","last_fullsized":"2024-09-11T01:05:45.209683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:29.055133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.647462+0000","last_change":"2024-09-11T01:05:40.986656+0000","last_active":"2024-09-11T01:06:19.647462+0000","last_peered":"2024-09-11T01:06:19.647462+0000","last_clean":"2024-09-11T01:06:19.647462+0000","last_became_active":"2024-09-11T01:05:40.970230+0000","last_became_peered":"2024-09-11T01:05:40.970230+0000","last_unstale":"2024-09-11T01:06:19.647462+0000","last_undegraded":"2024-09-11T01:06:19.647462+0000","last_fullsized":"2024-09-11T01:06:19.647462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:25.468986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211283+0000","last_change":"2024-09-11T01:05:40.980843+0000","last_active":"2024-09-11T01:05:45.211283+0000","last_peered":"2024-09-11T01:05:45.211283+0000","last_clean":"2024-09-11T01:05:45.211283+0000","last_became_active":"2024-09-11T01:05:40.979033+0000","last_became_peered":"2024-09-11T01:05:40.979033+0000","last_unstale":"2024-09-11T01:05:45.211283+0000","last_undegraded":"2024-09-11T01:05:45.211283+0000","last_fullsized":"2024-09-11T01:05:45.211283+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:44.039548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.123902+0000","last_change":"2024-09-11T01:05:31.676046+0000","last_active":"2024-09-11T01:05:45.123902+0000","last_peered":"2024-09-11T01:05:45.123902+0000","last_clean":"2024-09-11T01:05:45.123902+0000","last_became_active":"2024-09-11T01:05:31.675704+0000","last_became_peered":"2024-09-11T01:05:31.675704+0000","last_unstale":"2024-09-11T01:05:45.123902+0000","last_undegraded":"2024-09-11T01:05:45.123902+0000","last_fullsized":"2024-09-11T01:05:45.123902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:17.907270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'4","reported_seq":62,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:36.671465+0000","last_change":"2024-09-11T01:05:28.550131+0000","last_active":"2024-09-11T01:06:36.671465+0000","last_peered":"2024-09-11T01:06:36.671465+0000","last_clean":"2024-09-11T01:06:36.671465+0000","last_became_active":"2024-09-11T01:05:28.549561+0000","last_became_peered":"2024-09-11T01:05:28.549561+0000","last_unstale":"2024-09-11T01:06:36.671465+0000","last_undegraded":"2024-09-11T01:06:36.671465+0000","last_fullsized":"2024-09-11T01:06:36.671465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:52.001757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.123717+0000","last_change":"2024-09-11T01:05:40.984877+0000","last_active":"2024-09-11T01:05:45.123717+0000","last_peered":"2024-09-11T01:05:45.123717+0000","last_clean":"2024-09-11T01:05:45.123717+0000","last_became_active":"2024-09-11T01:05:40.984500+0000","last_became_peered":"2024-09-11T01:05:40.984500+0000","last_unstale":"2024-09-11T01:05:45.123717+0000","last_undegraded":"2024-09-11T01:05:45.123717+0000","last_fullsized":"2024-09-11T01:05:45.123717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:44.309560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124317+0000","last_change":"2024-09-11T01:05:40.976014+0000","last_active":"2024-09-11T01:05:45.124317+0000","last_peered":"2024-09-11T01:05:45.124317+0000","last_clean":"2024-09-11T01:05:45.124317+0000","last_became_active":"2024-09-11T01:05:40.975610+0000","last_became_peered":"2024-09-11T01:05:40.975610+0000","last_unstale":"2024-09-11T01:05:45.124317+0000","last_undegraded":"2024-09-11T01:05:45.124317+0000","last_fullsized":"2024-09-11T01:05:45.124317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:26.920957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.632074+0000","last_change":"2024-09-11T01:05:28.553043+0000","last_active":"2024-09-11T01:06:18.632074+0000","last_peered":"2024-09-11T01:06:18.632074+0000","last_clean":"2024-09-11T01:06:18.632074+0000","last_became_active":"2024-09-11T01:05:28.552678+0000","last_became_peered":"2024-09-11T01:05:28.552678+0000","last_unstale":"2024-09-11T01:06:18.632074+0000","last_undegraded":"2024-09-11T01:06:18.632074+0000","last_fullsized":"2024-09-11T01:06:18.632074+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:23.279056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210694+0000","last_change":"2024-09-11T01:05:40.979766+0000","last_active":"2024-09-11T01:05:45.210694+0000","last_peered":"2024-09-11T01:05:45.210694+0000","last_clean":"2024-09-11T01:05:45.210694+0000","last_became_active":"2024-09-11T01:05:40.978804+0000","last_became_peered":"2024-09-11T01:05:40.978804+0000","last_unstale":"2024-09-11T01:05:45.210694+0000","last_undegraded":"2024-09-11T01:05:45.210694+0000","last_fullsized":"2024-09-11T01:05:45.210694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:39.945862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209565+0000","last_change":"2024-09-11T01:05:31.674324+0000","last_active":"2024-09-11T01:05:45.209565+0000","last_peered":"2024-09-11T01:05:45.209565+0000","last_clean":"2024-09-11T01:05:45.209565+0000","last_became_active":"2024-09-11T01:05:31.673648+0000","last_became_peered":"2024-09-11T01:05:31.673648+0000","last_unstale":"2024-09-11T01:05:45.209565+0000","last_undegraded":"2024-09-11T01:05:45.209565+0000","last_fullsized":"2024-09-11T01:05:45.209565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:02.134422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.647695+0000","last_change":"2024-09-11T01:05:40.972605+0000","last_active":"2024-09-11T01:06:19.647695+0000","last_peered":"2024-09-11T01:06:19.647695+0000","last_clean":"2024-09-11T01:06:19.647695+0000","last_became_active":"2024-09-11T01:05:40.961704+0000","last_became_peered":"2024-09-11T01:05:40.961704+0000","last_unstale":"2024-09-11T01:06:19.647695+0000","last_undegraded":"2024-09-11T01:06:19.647695+0000","last_fullsized":"2024-09-11T01:06:19.647695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:45.276739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210354+0000","last_change":"2024-09-11T01:05:40.969424+0000","last_active":"2024-09-11T01:05:45.210354+0000","last_peered":"2024-09-11T01:05:45.210354+0000","last_clean":"2024-09-11T01:05:45.210354+0000","last_became_active":"2024-09-11T01:05:40.968994+0000","last_became_peered":"2024-09-11T01:05:40.968994+0000","last_unstale":"2024-09-11T01:05:45.210354+0000","last_undegraded":"2024-09-11T01:05:45.210354+0000","last_fullsized":"2024-09-11T01:05:45.210354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:08.554953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124394+0000","last_change":"2024-09-11T01:05:31.675764+0000","last_active":"2024-09-11T01:05:45.124394+0000","last_peered":"2024-09-11T01:05:45.124394+0000","last_clean":"2024-09-11T01:05:45.124394+0000","last_became_active":"2024-09-11T01:05:31.674553+0000","last_became_peered":"2024-09-11T01:05:31.674553+0000","last_unstale":"2024-09-11T01:05:45.124394+0000","last_undegraded":"2024-09-11T01:05:45.124394+0000","last_fullsized":"2024-09-11T01:05:45.124394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:30.026758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'26","reported_seq":113,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:33.667122+0000","last_change":"2024-09-11T01:05:40.975735+0000","last_active":"2024-09-11T01:06:33.667122+0000","last_peered":"2024-09-11T01:06:33.667122+0000","last_clean":"2024-09-11T01:06:33.667122+0000","last_became_active":"2024-09-11T01:05:40.964582+0000","last_became_peered":"2024-09-11T01:05:40.964582+0000","last_unstale":"2024-09-11T01:06:33.667122+0000","last_undegraded":"2024-09-11T01:06:33.667122+0000","last_fullsized":"2024-09-11T01:06:33.667122+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:57.424468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44479,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":60,"num_write":27,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.123058+0000","last_change":"2024-09-11T01:05:40.981306+0000","last_active":"2024-09-11T01:05:45.123058+0000","last_peered":"2024-09-11T01:05:45.123058+0000","last_clean":"2024-09-11T01:05:45.123058+0000","last_became_active":"2024-09-11T01:05:40.977531+0000","last_became_peered":"2024-09-11T01:05:40.977531+0000","last_unstale":"2024-09-11T01:05:45.123058+0000","last_undegraded":"2024-09-11T01:05:45.123058+0000","last_fullsized":"2024-09-11T01:05:45.123058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:21.613080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210943+0000","last_change":"2024-09-11T01:05:31.681612+0000","last_active":"2024-09-11T01:05:45.210943+0000","last_peered":"2024-09-11T01:05:45.210943+0000","last_clean":"2024-09-11T01:05:45.210943+0000","last_became_active":"2024-09-11T01:05:31.680609+0000","last_became_peered":"2024-09-11T01:05:31.680609+0000","last_unstale":"2024-09-11T01:05:45.210943+0000","last_undegraded":"2024-09-11T01:05:45.210943+0000","last_fullsized":"2024-09-11T01:05:45.210943+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:44.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.632271+0000","last_change":"2024-09-11T01:05:28.625177+0000","last_active":"2024-09-11T01:06:18.632271+0000","last_peered":"2024-09-11T01:06:18.632271+0000","last_clean":"2024-09-11T01:06:18.632271+0000","last_became_active":"2024-09-11T01:05:28.624819+0000","last_became_peered":"2024-09-11T01:05:28.624819+0000","last_unstale":"2024-09-11T01:06:18.632271+0000","last_undegraded":"2024-09-11T01:06:18.632271+0000","last_fullsized":"2024-09-11T01:06:18.632271+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:11.709636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210780+0000","last_change":"2024-09-11T01:05:40.978481+0000","last_active":"2024-09-11T01:05:45.210780+0000","last_peered":"2024-09-11T01:05:45.210780+0000","last_clean":"2024-09-11T01:05:45.210780+0000","last_became_active":"2024-09-11T01:05:40.977501+0000","last_became_peered":"2024-09-11T01:05:40.977501+0000","last_unstale":"2024-09-11T01:05:45.210780+0000","last_undegraded":"2024-09-11T01:05:45.210780+0000","last_fullsized":"2024-09-11T01:05:45.210780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:08.427274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211243+0000","last_change":"2024-09-11T01:05:31.692675+0000","last_active":"2024-09-11T01:05:45.211243+0000","last_peered":"2024-09-11T01:05:45.211243+0000","last_clean":"2024-09-11T01:05:45.211243+0000","last_became_active":"2024-09-11T01:05:31.690308+0000","last_became_peered":"2024-09-11T01:05:31.690308+0000","last_unstale":"2024-09-11T01:05:45.211243+0000","last_undegraded":"2024-09-11T01:05:45.211243+0000","last_fullsized":"2024-09-11T01:05:45.211243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:14.823786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.631544+0000","last_change":"2024-09-11T01:05:28.557868+0000","last_active":"2024-09-11T01:06:18.631544+0000","last_peered":"2024-09-11T01:06:18.631544+0000","last_clean":"2024-09-11T01:06:18.631544+0000","last_became_active":"2024-09-11T01:05:28.557512+0000","last_became_peered":"2024-09-11T01:05:28.557512+0000","last_unstale":"2024-09-11T01:06:18.631544+0000","last_undegraded":"2024-09-11T01:06:18.631544+0000","last_fullsized":"2024-09-11T01:06:18.631544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:50.733551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.122848+0000","last_change":"2024-09-11T01:05:40.982368+0000","last_active":"2024-09-11T01:05:45.122848+0000","last_peered":"2024-09-11T01:05:45.122848+0000","last_clean":"2024-09-11T01:05:45.122848+0000","last_became_active":"2024-09-11T01:05:40.980337+0000","last_became_peered":"2024-09-11T01:05:40.980337+0000","last_unstale":"2024-09-11T01:05:45.122848+0000","last_undegraded":"2024-09-11T01:05:45.122848+0000","last_fullsized":"2024-09-11T01:05:45.122848+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:22.010496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211327+0000","last_change":"2024-09-11T01:05:31.670806+0000","last_active":"2024-09-11T01:05:45.211327+0000","last_peered":"2024-09-11T01:05:45.211327+0000","last_clean":"2024-09-11T01:05:45.211327+0000","last_became_active":"2024-09-11T01:05:31.670452+0000","last_became_peered":"2024-09-11T01:05:31.670452+0000","last_unstale":"2024-09-11T01:05:45.211327+0000","last_undegraded":"2024-09-11T01:05:45.211327+0000","last_fullsized":"2024-09-11T01:05:45.211327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:22.489650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'3","reported_seq":53,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:32.664325+0000","last_change":"2024-09-11T01:05:28.555885+0000","last_active":"2024-09-11T01:06:32.664325+0000","last_peered":"2024-09-11T01:06:32.664325+0000","last_clean":"2024-09-11T01:06:32.664325+0000","last_became_active":"2024-09-11T01:05:28.555471+0000","last_became_peered":"2024-09-11T01:05:28.555471+0000","last_unstale":"2024-09-11T01:06:32.664325+0000","last_undegraded":"2024-09-11T01:06:32.664325+0000","last_fullsized":"2024-09-11T01:06:32.664325+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:50.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209388+0000","last_change":"2024-09-11T01:05:40.971982+0000","last_active":"2024-09-11T01:05:45.209388+0000","last_peered":"2024-09-11T01:05:45.209388+0000","last_clean":"2024-09-11T01:05:45.209388+0000","last_became_active":"2024-09-11T01:05:40.971614+0000","last_became_peered":"2024-09-11T01:05:40.971614+0000","last_unstale":"2024-09-11T01:05:45.209388+0000","last_undegraded":"2024-09-11T01:05:45.209388+0000","last_fullsized":"2024-09-11T01:05:45.209388+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:11.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210899+0000","last_change":"2024-09-11T01:05:40.972734+0000","last_active":"2024-09-11T01:05:45.210899+0000","last_peered":"2024-09-11T01:05:45.210899+0000","last_clean":"2024-09-11T01:05:45.210899+0000","last_became_active":"2024-09-11T01:05:40.969428+0000","last_became_peered":"2024-09-11T01:05:40.969428+0000","last_unstale":"2024-09-11T01:05:45.210899+0000","last_undegraded":"2024-09-11T01:05:45.210899+0000","last_fullsized":"2024-09-11T01:05:45.210899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:30.199055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.122942+0000","last_change":"2024-09-11T01:05:31.684114+0000","last_active":"2024-09-11T01:05:45.122942+0000","last_peered":"2024-09-11T01:05:45.122942+0000","last_clean":"2024-09-11T01:05:45.122942+0000","last_became_active":"2024-09-11T01:05:31.683830+0000","last_became_peered":"2024-09-11T01:05:31.683830+0000","last_unstale":"2024-09-11T01:05:45.122942+0000","last_undegraded":"2024-09-11T01:05:45.122942+0000","last_fullsized":"2024-09-11T01:05:45.122942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:43.695706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209482+0000","last_change":"2024-09-11T01:05:28.554745+0000","last_active":"2024-09-11T01:05:45.209482+0000","last_peered":"2024-09-11T01:05:45.209482+0000","last_clean":"2024-09-11T01:05:45.209482+0000","last_became_active":"2024-09-11T01:05:28.554354+0000","last_became_peered":"2024-09-11T01:05:28.554354+0000","last_unstale":"2024-09-11T01:05:45.209482+0000","last_undegraded":"2024-09-11T01:05:45.209482+0000","last_fullsized":"2024-09-11T01:05:45.209482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:33.663536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211049+0000","last_change":"2024-09-11T01:05:40.974956+0000","last_active":"2024-09-11T01:05:45.211049+0000","last_peered":"2024-09-11T01:05:45.211049+0000","last_clean":"2024-09-11T01:05:45.211049+0000","last_became_active":"2024-09-11T01:05:40.974434+0000","last_became_peered":"2024-09-11T01:05:40.974434+0000","last_unstale":"2024-09-11T01:05:45.211049+0000","last_undegraded":"2024-09-11T01:05:45.211049+0000","last_fullsized":"2024-09-11T01:05:45.211049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:01.196098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209757+0000","last_change":"2024-09-11T01:05:31.679904+0000","last_active":"2024-09-11T01:05:45.209757+0000","last_peered":"2024-09-11T01:05:45.209757+0000","last_clean":"2024-09-11T01:05:45.209757+0000","last_became_active":"2024-09-11T01:05:31.679517+0000","last_became_peered":"2024-09-11T01:05:31.679517+0000","last_unstale":"2024-09-11T01:05:45.209757+0000","last_undegraded":"2024-09-11T01:05:45.209757+0000","last_fullsized":"2024-09-11T01:05:45.209757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:24.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.644923+0000","last_change":"2024-09-11T01:05:28.549752+0000","last_active":"2024-09-11T01:06:19.644923+0000","last_peered":"2024-09-11T01:06:19.644923+0000","last_clean":"2024-09-11T01:06:19.644923+0000","last_became_active":"2024-09-11T01:05:28.549253+0000","last_became_peered":"2024-09-11T01:05:28.549253+0000","last_unstale":"2024-09-11T01:06:19.644923+0000","last_undegraded":"2024-09-11T01:06:19.644923+0000","last_fullsized":"2024-09-11T01:06:19.644923+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:25.774363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.645501+0000","last_change":"2024-09-11T01:05:28.553118+0000","last_active":"2024-09-11T01:06:19.645501+0000","last_peered":"2024-09-11T01:06:19.645501+0000","last_clean":"2024-09-11T01:06:19.645501+0000","last_became_active":"2024-09-11T01:05:28.552779+0000","last_became_peered":"2024-09-11T01:05:28.552779+0000","last_unstale":"2024-09-11T01:06:19.645501+0000","last_undegraded":"2024-09-11T01:06:19.645501+0000","last_fullsized":"2024-09-11T01:06:19.645501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:58.297579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.123110+0000","last_change":"2024-09-11T01:05:40.981936+0000","last_active":"2024-09-11T01:05:45.123110+0000","last_peered":"2024-09-11T01:05:45.123110+0000","last_clean":"2024-09-11T01:05:45.123110+0000","last_became_active":"2024-09-11T01:05:40.981623+0000","last_became_peered":"2024-09-11T01:05:40.981623+0000","last_unstale":"2024-09-11T01:05:45.123110+0000","last_undegraded":"2024-09-11T01:05:45.123110+0000","last_fullsized":"2024-09-11T01:05:45.123110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:14.773406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209810+0000","last_change":"2024-09-11T01:05:40.979394+0000","last_active":"2024-09-11T01:05:45.209810+0000","last_peered":"2024-09-11T01:05:45.209810+0000","last_clean":"2024-09-11T01:05:45.209810+0000","last_became_active":"2024-09-11T01:05:40.978985+0000","last_became_peered":"2024-09-11T01:05:40.978985+0000","last_unstale":"2024-09-11T01:05:45.209810+0000","last_undegraded":"2024-09-11T01:05:45.209810+0000","last_fullsized":"2024-09-11T01:05:45.209810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:18.008402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'6","reported_seq":63,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:35.669391+0000","last_change":"2024-09-11T01:05:28.553479+0000","last_active":"2024-09-11T01:06:35.669391+0000","last_peered":"2024-09-11T01:06:35.669391+0000","last_clean":"2024-09-11T01:06:35.669391+0000","last_became_active":"2024-09-11T01:05:28.553171+0000","last_became_peered":"2024-09-11T01:05:28.553171+0000","last_unstale":"2024-09-11T01:06:35.669391+0000","last_undegraded":"2024-09-11T01:06:35.669391+0000","last_fullsized":"2024-09-11T01:06:35.669391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:04.877982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124180+0000","last_change":"2024-09-11T01:05:40.982070+0000","last_active":"2024-09-11T01:05:45.124180+0000","last_peered":"2024-09-11T01:05:45.124180+0000","last_clean":"2024-09-11T01:05:45.124180+0000","last_became_active":"2024-09-11T01:05:40.981601+0000","last_became_peered":"2024-09-11T01:05:40.981601+0000","last_unstale":"2024-09-11T01:05:45.124180+0000","last_undegraded":"2024-09-11T01:05:45.124180+0000","last_fullsized":"2024-09-11T01:05:45.124180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:31.409711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209212+0000","last_change":"2024-09-11T01:05:40.967374+0000","last_active":"2024-09-11T01:05:45.209212+0000","last_peered":"2024-09-11T01:05:45.209212+0000","last_clean":"2024-09-11T01:05:45.209212+0000","last_became_active":"2024-09-11T01:05:40.966705+0000","last_became_peered":"2024-09-11T01:05:40.966705+0000","last_unstale":"2024-09-11T01:05:45.209212+0000","last_undegraded":"2024-09-11T01:05:45.209212+0000","last_fullsized":"2024-09-11T01:05:45.209212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:17.278999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210340+0000","last_change":"2024-09-11T01:05:31.675298+0000","last_active":"2024-09-11T01:05:45.210340+0000","last_peered":"2024-09-11T01:05:45.210340+0000","last_clean":"2024-09-11T01:05:45.210340+0000","last_became_active":"2024-09-11T01:05:31.674922+0000","last_became_peered":"2024-09-11T01:05:31.674922+0000","last_unstale":"2024-09-11T01:05:45.210340+0000","last_undegraded":"2024-09-11T01:05:45.210340+0000","last_fullsized":"2024-09-11T01:05:45.210340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:54.059202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209537+0000","last_change":"2024-09-11T01:05:31.685494+0000","last_active":"2024-09-11T01:05:45.209537+0000","last_peered":"2024-09-11T01:05:45.209537+0000","last_clean":"2024-09-11T01:05:45.209537+0000","last_became_active":"2024-09-11T01:05:31.685131+0000","last_became_peered":"2024-09-11T01:05:31.685131+0000","last_unstale":"2024-09-11T01:05:45.209537+0000","last_undegraded":"2024-09-11T01:05:45.209537+0000","last_fullsized":"2024-09-11T01:05:45.209537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:41.805135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.208770+0000","last_change":"2024-09-11T01:05:31.686473+0000","last_active":"2024-09-11T01:05:45.208770+0000","last_peered":"2024-09-11T01:05:45.208770+0000","last_clean":"2024-09-11T01:05:45.208770+0000","last_became_active":"2024-09-11T01:05:31.685858+0000","last_became_peered":"2024-09-11T01:05:31.685858+0000","last_unstale":"2024-09-11T01:05:45.208770+0000","last_undegraded":"2024-09-11T01:05:45.208770+0000","last_fullsized":"2024-09-11T01:05:45.208770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:52.174889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210789+0000","last_change":"2024-09-11T01:05:31.691078+0000","last_active":"2024-09-11T01:05:45.210789+0000","last_peered":"2024-09-11T01:05:45.210789+0000","last_clean":"2024-09-11T01:05:45.210789+0000","last_became_active":"2024-09-11T01:05:31.690755+0000","last_became_peered":"2024-09-11T01:05:31.690755+0000","last_unstale":"2024-09-11T01:05:45.210789+0000","last_undegraded":"2024-09-11T01:05:45.210789+0000","last_fullsized":"2024-09-11T01:05:45.210789+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:50.643233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210424+0000","last_change":"2024-09-11T01:05:31.681933+0000","last_active":"2024-09-11T01:05:45.210424+0000","last_peered":"2024-09-11T01:05:45.210424+0000","last_clean":"2024-09-11T01:05:45.210424+0000","last_became_active":"2024-09-11T01:05:31.681642+0000","last_became_peered":"2024-09-11T01:05:31.681642+0000","last_unstale":"2024-09-11T01:05:45.210424+0000","last_undegraded":"2024-09-11T01:05:45.210424+0000","last_fullsized":"2024-09-11T01:05:45.210424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:05:10.434843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210762+0000","last_change":"2024-09-11T01:05:31.677188+0000","last_active":"2024-09-11T01:05:45.210762+0000","last_peered":"2024-09-11T01:05:45.210762+0000","last_clean":"2024-09-11T01:05:45.210762+0000","last_became_active":"2024-09-11T01:05:31.676689+0000","last_became_peered":"2024-09-11T01:05:31.676689+0000","last_unstale":"2024-09-11T01:05:45.210762+0000","last_undegraded":"2024-09-11T01:05:45.210762+0000","last_fullsized":"2024-09-11T01:05:45.210762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:51.899743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209589+0000","last_change":"2024-09-11T01:05:31.678994+0000","last_active":"2024-09-11T01:05:45.209589+0000","last_peered":"2024-09-11T01:05:45.209589+0000","last_clean":"2024-09-11T01:05:45.209589+0000","last_became_active":"2024-09-11T01:05:31.678675+0000","last_became_peered":"2024-09-11T01:05:31.678675+0000","last_unstale":"2024-09-11T01:05:45.209589+0000","last_undegraded":"2024-09-11T01:05:45.209589+0000","last_fullsized":"2024-09-11T01:05:45.209589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:35.740872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210762+0000","last_change":"2024-09-11T01:05:31.680046+0000","last_active":"2024-09-11T01:05:45.210762+0000","last_peered":"2024-09-11T01:05:45.210762+0000","last_clean":"2024-09-11T01:05:45.210762+0000","last_became_active":"2024-09-11T01:05:31.679626+0000","last_became_peered":"2024-09-11T01:05:31.679626+0000","last_unstale":"2024-09-11T01:05:45.210762+0000","last_undegraded":"2024-09-11T01:05:45.210762+0000","last_fullsized":"2024-09-11T01:05:45.210762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:15.260470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209311+0000","last_change":"2024-09-11T01:05:31.683545+0000","last_active":"2024-09-11T01:05:45.209311+0000","last_peered":"2024-09-11T01:05:45.209311+0000","last_clean":"2024-09-11T01:05:45.209311+0000","last_became_active":"2024-09-11T01:05:31.683166+0000","last_became_peered":"2024-09-11T01:05:31.683166+0000","last_unstale":"2024-09-11T01:05:45.209311+0000","last_undegraded":"2024-09-11T01:05:45.209311+0000","last_fullsized":"2024-09-11T01:05:45.209311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:57.378211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209711+0000","last_change":"2024-09-11T01:05:31.678031+0000","last_active":"2024-09-11T01:05:45.209711+0000","last_peered":"2024-09-11T01:05:45.209711+0000","last_clean":"2024-09-11T01:05:45.209711+0000","last_became_active":"2024-09-11T01:05:31.677760+0000","last_became_peered":"2024-09-11T01:05:31.677760+0000","last_unstale":"2024-09-11T01:05:45.209711+0000","last_undegraded":"2024-09-11T01:05:45.209711+0000","last_fullsized":"2024-09-11T01:05:45.209711+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:39.252655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210686+0000","last_change":"2024-09-11T01:05:31.677991+0000","last_active":"2024-09-11T01:05:45.210686+0000","last_peered":"2024-09-11T01:05:45.210686+0000","last_clean":"2024-09-11T01:05:45.210686+0000","last_became_active":"2024-09-11T01:05:31.677670+0000","last_became_peered":"2024-09-11T01:05:31.677670+0000","last_unstale":"2024-09-11T01:05:45.210686+0000","last_undegraded":"2024-09-11T01:05:45.210686+0000","last_fullsized":"2024-09-11T01:05:45.210686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:55.622757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210322+0000","last_change":"2024-09-11T01:05:31.678213+0000","last_active":"2024-09-11T01:05:45.210322+0000","last_peered":"2024-09-11T01:05:45.210322+0000","last_clean":"2024-09-11T01:05:45.210322+0000","last_became_active":"2024-09-11T01:05:31.676422+0000","last_became_peered":"2024-09-11T01:05:31.676422+0000","last_unstale":"2024-09-11T01:05:45.210322+0000","last_undegraded":"2024-09-11T01:05:45.210322+0000","last_fullsized":"2024-09-11T01:05:45.210322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:29.096123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210395+0000","last_change":"2024-09-11T01:05:31.680945+0000","last_active":"2024-09-11T01:05:45.210395+0000","last_peered":"2024-09-11T01:05:45.210395+0000","last_clean":"2024-09-11T01:05:45.210395+0000","last_became_active":"2024-09-11T01:05:31.680458+0000","last_became_peered":"2024-09-11T01:05:31.680458+0000","last_unstale":"2024-09-11T01:05:45.210395+0000","last_undegraded":"2024-09-11T01:05:45.210395+0000","last_fullsized":"2024-09-11T01:05:45.210395+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:01.382341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209449+0000","last_change":"2024-09-11T01:05:31.685792+0000","last_active":"2024-09-11T01:05:45.209449+0000","last_peered":"2024-09-11T01:05:45.209449+0000","last_clean":"2024-09-11T01:05:45.209449+0000","last_became_active":"2024-09-11T01:05:31.685467+0000","last_became_peered":"2024-09-11T01:05:31.685467+0000","last_unstale":"2024-09-11T01:05:45.209449+0000","last_undegraded":"2024-09-11T01:05:45.209449+0000","last_fullsized":"2024-09-11T01:05:45.209449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:37.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.123499+0000","last_change":"2024-09-11T01:05:31.678855+0000","last_active":"2024-09-11T01:05:45.123499+0000","last_peered":"2024-09-11T01:05:45.123499+0000","last_clean":"2024-09-11T01:05:45.123499+0000","last_became_active":"2024-09-11T01:05:31.678583+0000","last_became_peered":"2024-09-11T01:05:31.678583+0000","last_unstale":"2024-09-11T01:05:45.123499+0000","last_undegraded":"2024-09-11T01:05:45.123499+0000","last_fullsized":"2024-09-11T01:05:45.123499+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:24.112383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211042+0000","last_change":"2024-09-11T01:05:31.682261+0000","last_active":"2024-09-11T01:05:45.211042+0000","last_peered":"2024-09-11T01:05:45.211042+0000","last_clean":"2024-09-11T01:05:45.211042+0000","last_became_active":"2024-09-11T01:05:31.681924+0000","last_became_peered":"2024-09-11T01:05:31.681924+0000","last_unstale":"2024-09-11T01:05:45.211042+0000","last_undegraded":"2024-09-11T01:05:45.211042+0000","last_fullsized":"2024-09-11T01:05:45.211042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:54.556438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209929+0000","last_change":"2024-09-11T01:05:31.674687+0000","last_active":"2024-09-11T01:05:45.209929+0000","last_peered":"2024-09-11T01:05:45.209929+0000","last_clean":"2024-09-11T01:05:45.209929+0000","last_became_active":"2024-09-11T01:05:31.674348+0000","last_became_peered":"2024-09-11T01:05:31.674348+0000","last_unstale":"2024-09-11T01:05:45.209929+0000","last_undegraded":"2024-09-11T01:05:45.209929+0000","last_fullsized":"2024-09-11T01:05:45.209929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:46.086798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210030+0000","last_change":"2024-09-11T01:05:40.967775+0000","last_active":"2024-09-11T01:05:45.210030+0000","last_peered":"2024-09-11T01:05:45.210030+0000","last_clean":"2024-09-11T01:05:45.210030+0000","last_became_active":"2024-09-11T01:05:40.967355+0000","last_became_peered":"2024-09-11T01:05:40.967355+0000","last_unstale":"2024-09-11T01:05:45.210030+0000","last_undegraded":"2024-09-11T01:05:45.210030+0000","last_fullsized":"2024-09-11T01:05:45.210030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:43.224010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210128+0000","last_change":"2024-09-11T01:05:31.674655+0000","last_active":"2024-09-11T01:05:45.210128+0000","last_peered":"2024-09-11T01:05:45.210128+0000","last_clean":"2024-09-11T01:05:45.210128+0000","last_became_active":"2024-09-11T01:05:31.674342+0000","last_became_peered":"2024-09-11T01:05:31.674342+0000","last_unstale":"2024-09-11T01:05:45.210128+0000","last_undegraded":"2024-09-11T01:05:45.210128+0000","last_fullsized":"2024-09-11T01:05:45.210128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:28.593441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210236+0000","last_change":"2024-09-11T01:05:31.678521+0000","last_active":"2024-09-11T01:05:45.210236+0000","last_peered":"2024-09-11T01:05:45.210236+0000","last_clean":"2024-09-11T01:05:45.210236+0000","last_became_active":"2024-09-11T01:05:31.674828+0000","last_became_peered":"2024-09-11T01:05:31.674828+0000","last_unstale":"2024-09-11T01:05:45.210236+0000","last_undegraded":"2024-09-11T01:05:45.210236+0000","last_fullsized":"2024-09-11T01:05:45.210236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:38.797887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210369+0000","last_change":"2024-09-11T01:05:31.685075+0000","last_active":"2024-09-11T01:05:45.210369+0000","last_peered":"2024-09-11T01:05:45.210369+0000","last_clean":"2024-09-11T01:05:45.210369+0000","last_became_active":"2024-09-11T01:05:31.684742+0000","last_became_peered":"2024-09-11T01:05:31.684742+0000","last_unstale":"2024-09-11T01:05:45.210369+0000","last_undegraded":"2024-09-11T01:05:45.210369+0000","last_fullsized":"2024-09-11T01:05:45.210369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:29.381976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124625+0000","last_change":"2024-09-11T01:05:31.678921+0000","last_active":"2024-09-11T01:05:45.124625+0000","last_peered":"2024-09-11T01:05:45.124625+0000","last_clean":"2024-09-11T01:05:45.124625+0000","last_became_active":"2024-09-11T01:05:31.678547+0000","last_became_peered":"2024-09-11T01:05:31.678547+0000","last_unstale":"2024-09-11T01:05:45.124625+0000","last_undegraded":"2024-09-11T01:05:45.124625+0000","last_fullsized":"2024-09-11T01:05:45.124625+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:59.618685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211294+0000","last_change":"2024-09-11T01:05:31.685565+0000","last_active":"2024-09-11T01:05:45.211294+0000","last_peered":"2024-09-11T01:05:45.211294+0000","last_clean":"2024-09-11T01:05:45.211294+0000","last_became_active":"2024-09-11T01:05:31.685234+0000","last_became_peered":"2024-09-11T01:05:31.685234+0000","last_unstale":"2024-09-11T01:05:45.211294+0000","last_undegraded":"2024-09-11T01:05:45.211294+0000","last_fullsized":"2024-09-11T01:05:45.211294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:07.831922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211517+0000","last_change":"2024-09-11T01:05:31.677464+0000","last_active":"2024-09-11T01:05:45.211517+0000","last_peered":"2024-09-11T01:05:45.211517+0000","last_clean":"2024-09-11T01:05:45.211517+0000","last_became_active":"2024-09-11T01:05:31.677161+0000","last_became_peered":"2024-09-11T01:05:31.677161+0000","last_unstale":"2024-09-11T01:05:45.211517+0000","last_undegraded":"2024-09-11T01:05:45.211517+0000","last_fullsized":"2024-09-11T01:05:45.211517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:26.590429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209654+0000","last_change":"2024-09-11T01:05:31.679977+0000","last_active":"2024-09-11T01:05:45.209654+0000","last_peered":"2024-09-11T01:05:45.209654+0000","last_clean":"2024-09-11T01:05:45.209654+0000","last_became_active":"2024-09-11T01:05:31.679661+0000","last_became_peered":"2024-09-11T01:05:31.679661+0000","last_unstale":"2024-09-11T01:05:45.209654+0000","last_undegraded":"2024-09-11T01:05:45.209654+0000","last_fullsized":"2024-09-11T01:05:45.209654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:00.040651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124020+0000","last_change":"2024-09-11T01:05:31.685419+0000","last_active":"2024-09-11T01:05:45.124020+0000","last_peered":"2024-09-11T01:05:45.124020+0000","last_clean":"2024-09-11T01:05:45.124020+0000","last_became_active":"2024-09-11T01:05:31.684772+0000","last_became_peered":"2024-09-11T01:05:31.684772+0000","last_unstale":"2024-09-11T01:05:45.124020+0000","last_undegraded":"2024-09-11T01:05:45.124020+0000","last_fullsized":"2024-09-11T01:05:45.124020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:19.283742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210644+0000","last_change":"2024-09-11T01:05:31.681691+0000","last_active":"2024-09-11T01:05:45.210644+0000","last_peered":"2024-09-11T01:05:45.210644+0000","last_clean":"2024-09-11T01:05:45.210644+0000","last_became_active":"2024-09-11T01:05:31.680549+0000","last_became_peered":"2024-09-11T01:05:31.680549+0000","last_unstale":"2024-09-11T01:05:45.210644+0000","last_undegraded":"2024-09-11T01:05:45.210644+0000","last_fullsized":"2024-09-11T01:05:45.210644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:15.561978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124146+0000","last_change":"2024-09-11T01:05:31.687135+0000","last_active":"2024-09-11T01:05:45.124146+0000","last_peered":"2024-09-11T01:05:45.124146+0000","last_clean":"2024-09-11T01:05:45.124146+0000","last_became_active":"2024-09-11T01:05:31.686719+0000","last_became_peered":"2024-09-11T01:05:31.686719+0000","last_unstale":"2024-09-11T01:05:45.124146+0000","last_undegraded":"2024-09-11T01:05:45.124146+0000","last_fullsized":"2024-09-11T01:05:45.124146+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:42.044930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210192+0000","last_change":"2024-09-11T01:05:31.688154+0000","last_active":"2024-09-11T01:05:45.210192+0000","last_peered":"2024-09-11T01:05:45.210192+0000","last_clean":"2024-09-11T01:05:45.210192+0000","last_became_active":"2024-09-11T01:05:31.687734+0000","last_became_peered":"2024-09-11T01:05:31.687734+0000","last_unstale":"2024-09-11T01:05:45.210192+0000","last_undegraded":"2024-09-11T01:05:45.210192+0000","last_fullsized":"2024-09-11T01:05:45.210192+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:57.789086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210788+0000","last_change":"2024-09-11T01:05:31.679761+0000","last_active":"2024-09-11T01:05:45.210788+0000","last_peered":"2024-09-11T01:05:45.210788+0000","last_clean":"2024-09-11T01:05:45.210788+0000","last_became_active":"2024-09-11T01:05:31.679345+0000","last_became_peered":"2024-09-11T01:05:31.679345+0000","last_unstale":"2024-09-11T01:05:45.210788+0000","last_undegraded":"2024-09-11T01:05:45.210788+0000","last_fullsized":"2024-09-11T01:05:45.210788+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:28.480561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210976+0000","last_change":"2024-09-11T01:05:31.680782+0000","last_active":"2024-09-11T01:05:45.210976+0000","last_peered":"2024-09-11T01:05:45.210976+0000","last_clean":"2024-09-11T01:05:45.210976+0000","last_became_active":"2024-09-11T01:05:31.679984+0000","last_became_peered":"2024-09-11T01:05:31.679984+0000","last_unstale":"2024-09-11T01:05:45.210976+0000","last_undegraded":"2024-09-11T01:05:45.210976+0000","last_fullsized":"2024-09-11T01:05:45.210976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:10.306868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210891+0000","last_change":"2024-09-11T01:05:31.681462+0000","last_active":"2024-09-11T01:05:45.210891+0000","last_peered":"2024-09-11T01:05:45.210891+0000","last_clean":"2024-09-11T01:05:45.210891+0000","last_became_active":"2024-09-11T01:05:31.680799+0000","last_became_peered":"2024-09-11T01:05:31.680799+0000","last_unstale":"2024-09-11T01:05:45.210891+0000","last_undegraded":"2024-09-11T01:05:45.210891+0000","last_fullsized":"2024-09-11T01:05:45.210891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:56:44.512831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":48871,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":121,"num_read_kb":112,"num_write":157,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1646,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":171145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":135,"ondisk_log_size":135,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645338,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":487554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841567,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28636,"kb_used_data":1612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716516,"statfs":{"total":95995035648,"available":95965712384,"internally_reserved":0,"allocated":1650688,"data_stored":1119546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005091,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":491740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201322,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":487452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397552,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36896,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708256,"statfs":{"total":95995035648,"available":95957254144,"internally_reserved":0,"allocated":1589248,"data_stored":1083864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593781,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":482820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790011,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28584,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716568,"statfs":{"total":95995035648,"available":95965765632,"internally_reserved":0,"allocated":1597440,"data_stored":1079061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953536,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":544606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149765,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":987136,"data_stored":483014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":484437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":539475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":484208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":46448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:06:40.485 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T01:06:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:40 smithi103 ceph-mon[30562]: pgmap v347: 129 pgs: 129 active+clean; 624 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-09-11T01:06:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]} : dispatch 2024-09-11T01:06:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]} : dispatch 2024-09-11T01:06:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 8]} : dispatch 2024-09-11T01:06:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]} : dispatch 2024-09-11T01:06:40.862 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:40.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:40 smithi117 ceph-mon[35358]: pgmap v347: 129 pgs: 129 active+clean; 624 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-09-11T01:06:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]} : dispatch 2024-09-11T01:06:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]} : dispatch 2024-09-11T01:06:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 8]} : dispatch 2024-09-11T01:06:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]} : dispatch 2024-09-11T01:06:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:40 smithi183 ceph-mon[34992]: pgmap v347: 129 pgs: 129 active+clean; 624 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 4.5 KiB/s wr, 9 op/s 2024-09-11T01:06:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]} : dispatch 2024-09-11T01:06:40.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]} : dispatch 2024-09-11T01:06:40.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 8]} : dispatch 2024-09-11T01:06:40.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]} : dispatch 2024-09-11T01:06:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.460+0000 7f76dda00640 1 -- 172.21.15.103:0/667754827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d8104df0 msgr2=0x7f76d81051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.460+0000 7f76dda00640 1 --2- 172.21.15.103:0/667754827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d8104df0 0x7f76d81051d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009900 tx=0x7f76c802a3f0 comp rx=0 tx=0).stop 2024-09-11T01:06:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.460+0000 7f76dda00640 1 -- 172.21.15.103:0/667754827 shutdown_connections 2024-09-11T01:06:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.460+0000 7f76dda00640 1 --2- 172.21.15.103:0/667754827 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76d810b180 0x7f76d8111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.460+0000 7f76dda00640 1 --2- 172.21.15.103:0/667754827 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76d810a800 0x7f76d810ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.460+0000 7f76dda00640 1 --2- 172.21.15.103:0/667754827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d8104df0 0x7f76d81051d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.460+0000 7f76dda00640 1 -- 172.21.15.103:0/667754827 >> 172.21.15.103:0/667754827 conn(0x7f76d8100840 msgr2=0x7f76d8102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.460+0000 7f76dda00640 1 -- 172.21.15.103:0/667754827 shutdown_connections 2024-09-11T01:06:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.460+0000 7f76dda00640 1 -- 172.21.15.103:0/667754827 wait complete. 2024-09-11T01:06:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.461+0000 7f76dda00640 1 Processor -- start 2024-09-11T01:06:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.461+0000 7f76dda00640 1 -- start start 2024-09-11T01:06:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.461+0000 7f76dda00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76d8104df0 0x7f76d819b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.461+0000 7f76dda00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76d810a800 0x7f76d819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.461+0000 7f76dda00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d810b180 0x7f76d81a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.461+0000 7f76dda00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f76d8114e90 con 0x7f76d810b180 2024-09-11T01:06:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.461+0000 7f76dda00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f76d8114d10 con 0x7f76d8104df0 2024-09-11T01:06:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.461+0000 7f76dda00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f76d8115010 con 0x7f76d810a800 2024-09-11T01:06:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.462+0000 7f76dd000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d810b180 0x7f76d81a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.462+0000 7f76dd000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d810b180 0x7f76d81a0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55664/0 (socket says 172.21.15.103:55664) 2024-09-11T01:06:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.462+0000 7f76dd000640 1 -- 172.21.15.103:0/3584132471 learned_addr learned my addr 172.21.15.103:0/3584132471 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.462+0000 7f76cf400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76d810a800 0x7f76d819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.462+0000 7f76d7e00640 1 --2- 172.21.15.103:0/3584132471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76d8104df0 0x7f76d819b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.462+0000 7f76dd000640 1 -- 172.21.15.103:0/3584132471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76d810a800 msgr2=0x7f76d819b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.462+0000 7f76dd000640 1 --2- 172.21.15.103:0/3584132471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76d810a800 0x7f76d819b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.462+0000 7f76dd000640 1 -- 172.21.15.103:0/3584132471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76d8104df0 msgr2=0x7f76d819b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.462+0000 7f76dd000640 1 --2- 172.21.15.103:0/3584132471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76d8104df0 0x7f76d819b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.462+0000 7f76dd000640 1 -- 172.21.15.103:0/3584132471 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d81a12b0 con 0x7f76d810b180 2024-09-11T01:06:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.462+0000 7f76dd000640 1 --2- 172.21.15.103:0/3584132471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d810b180 0x7f76d81a0ae0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f76d000eaa0 tx=0x7f76d000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.463+0000 7f76d5600640 1 -- 172.21.15.103:0/3584132471 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d000cdb0 con 0x7f76d810b180 2024-09-11T01:06:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.463+0000 7f76dda00640 1 -- 172.21.15.103:0/3584132471 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d81a15a0 con 0x7f76d810b180 2024-09-11T01:06:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.463+0000 7f76d5600640 1 -- 172.21.15.103:0/3584132471 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76d0005020 con 0x7f76d810b180 2024-09-11T01:06:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.463+0000 7f76d5600640 1 -- 172.21.15.103:0/3584132471 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d00116d0 con 0x7f76d810b180 2024-09-11T01:06:41.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.463+0000 7f76dda00640 1 -- 172.21.15.103:0/3584132471 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d81a7c60 con 0x7f76d810b180 2024-09-11T01:06:41.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.464+0000 7f76dda00640 1 -- 172.21.15.103:0/3584132471 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d81051d0 con 0x7f76d810b180 2024-09-11T01:06:41.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.466+0000 7f76d5600640 1 -- 172.21.15.103:0/3584132471 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f76d000f040 con 0x7f76d810b180 2024-09-11T01:06:41.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.467+0000 7f76d5600640 1 --2- 172.21.15.103:0/3584132471 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f76bc0b5410 0x7f76bc0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:41.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.468+0000 7f76d5600640 1 -- 172.21.15.103:0/3584132471 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9179+0+0 (secure 0 0 0) 0x7f76d00e5f30 con 0x7f76d810b180 2024-09-11T01:06:41.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.468+0000 7f76d7e00640 1 --2- 172.21.15.103:0/3584132471 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f76bc0b5410 0x7f76bc0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:41.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.468+0000 7f76d7e00640 1 --2- 172.21.15.103:0/3584132471 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f76bc0b5410 0x7f76bc0b78d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f76c8005ab0 tx=0x7f76c8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:41.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.471+0000 7f76d5600640 1 -- 172.21.15.103:0/3584132471 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f76d0016030 con 0x7f76d810b180 2024-09-11T01:06:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.662+0000 7f76dda00640 1 -- 172.21.15.103:0/3584132471 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76d8102580 con 0x7f76bc0b5410 2024-09-11T01:06:41.664 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:41 smithi103 ceph-mon[30562]: from='client.24856 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:06:41.664 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-09-11T01:06:41.664 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-09-11T01:06:41.664 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 8]}]': finished 2024-09-11T01:06:41.664 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-11T01:06:41.664 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:41 smithi103 ceph-mon[30562]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T01:06:41.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.668+0000 7f76d5600640 1 -- 172.21.15.103:0/3584132471 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340347 (secure 0 0 0) 0x7f76d8102580 con 0x7f76bc0b5410 2024-09-11T01:06:41.674 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:06:41.675 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T01:06:41.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.673+0000 7f76dda00640 1 -- 172.21.15.103:0/3584132471 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f76bc0b5410 msgr2=0x7f76bc0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:41.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.673+0000 7f76dda00640 1 --2- 172.21.15.103:0/3584132471 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f76bc0b5410 0x7f76bc0b78d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f76c8005ab0 tx=0x7f76c8005a20 comp rx=0 tx=0).stop 2024-09-11T01:06:41.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.673+0000 7f76dda00640 1 -- 172.21.15.103:0/3584132471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d810b180 msgr2=0x7f76d81a0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:41.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.673+0000 7f76dda00640 1 --2- 172.21.15.103:0/3584132471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d810b180 0x7f76d81a0ae0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f76d000eaa0 tx=0x7f76d000ef60 comp rx=0 tx=0).stop 2024-09-11T01:06:41.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.673+0000 7f76dda00640 1 -- 172.21.15.103:0/3584132471 shutdown_connections 2024-09-11T01:06:41.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.673+0000 7f76dda00640 1 --2- 172.21.15.103:0/3584132471 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f76bc0b5410 0x7f76bc0b78d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:41.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.673+0000 7f76dda00640 1 --2- 172.21.15.103:0/3584132471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76d810b180 0x7f76d81a0ae0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:41.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.673+0000 7f76dda00640 1 --2- 172.21.15.103:0/3584132471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f76d810a800 0x7f76d819b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:41.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.673+0000 7f76dda00640 1 --2- 172.21.15.103:0/3584132471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f76d8104df0 0x7f76d819b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:41.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.673+0000 7f76dda00640 1 -- 172.21.15.103:0/3584132471 >> 172.21.15.103:0/3584132471 conn(0x7f76d8100840 msgr2=0x7f76d8101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:41.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.674+0000 7f76dda00640 1 -- 172.21.15.103:0/3584132471 shutdown_connections 2024-09-11T01:06:41.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:41.674+0000 7f76dda00640 1 -- 172.21.15.103:0/3584132471 wait complete. 2024-09-11T01:06:41.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:41 smithi117 ceph-mon[35358]: from='client.24856 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:06:41.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-09-11T01:06:41.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-09-11T01:06:41.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 8]}]': finished 2024-09-11T01:06:41.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-11T01:06:41.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:41 smithi117 ceph-mon[35358]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T01:06:41.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:41 smithi183 ceph-mon[34992]: from='client.24856 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:06:41.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.c", "id": [9, 10]}]': finished 2024-09-11T01:06:41.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [9, 8]}]': finished 2024-09-11T01:06:41.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [5, 8]}]': finished 2024-09-11T01:06:41.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-09-11T01:06:41.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:41 smithi183 ceph-mon[34992]: osdmap e88: 12 total, 12 up, 12 in 2024-09-11T01:06:42.517 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2024-09-11T01:06:41.593052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651739,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":213,"num_read_kb":198,"num_write":291,"num_write_kb":2261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":2953486,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379452,"kb_used_data":13560,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124562372,"statfs":{"total":1151940427776,"available":1151551868928,"internally_reserved":0,"allocated":13885440,"data_stored":7789538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":32169,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":57,"num_write":23,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.069402"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":46,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.646967+0000","last_change":"2024-09-11T01:05:28.553987+0000","last_active":"2024-09-11T01:06:19.646967+0000","last_peered":"2024-09-11T01:06:19.646967+0000","last_clean":"2024-09-11T01:06:19.646967+0000","last_became_active":"2024-09-11T01:05:28.553691+0000","last_became_peered":"2024-09-11T01:05:28.553691+0000","last_unstale":"2024-09-11T01:06:19.646967+0000","last_undegraded":"2024-09-11T01:06:19.646967+0000","last_fullsized":"2024-09-11T01:06:19.646967+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:50.407880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T01:06:40.586055+0000","last_change":"2024-09-11T01:05:31.677005+0000","last_active":"2024-09-11T01:06:40.586055+0000","last_peered":"2024-09-11T01:06:40.586055+0000","last_clean":"2024-09-11T01:06:40.586055+0000","last_became_active":"2024-09-11T01:05:31.676597+0000","last_became_peered":"2024-09-11T01:05:31.676597+0000","last_unstale":"2024-09-11T01:06:40.586055+0000","last_undegraded":"2024-09-11T01:06:40.586055+0000","last_fullsized":"2024-09-11T01:06:40.586055+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:06.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.208866+0000","last_change":"2024-09-11T01:05:40.975009+0000","last_active":"2024-09-11T01:05:45.208866+0000","last_peered":"2024-09-11T01:05:45.208866+0000","last_clean":"2024-09-11T01:05:45.208866+0000","last_became_active":"2024-09-11T01:05:40.974546+0000","last_became_peered":"2024-09-11T01:05:40.974546+0000","last_unstale":"2024-09-11T01:05:45.208866+0000","last_undegraded":"2024-09-11T01:05:45.208866+0000","last_fullsized":"2024-09-11T01:05:45.208866+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:56.420262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":40,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T01:06:40.586318+0000","last_change":"2024-09-11T01:05:28.623367+0000","last_active":"2024-09-11T01:06:40.586318+0000","last_peered":"2024-09-11T01:06:40.586318+0000","last_clean":"2024-09-11T01:06:40.586318+0000","last_became_active":"2024-09-11T01:05:28.622990+0000","last_became_peered":"2024-09-11T01:05:28.622990+0000","last_unstale":"2024-09-11T01:06:40.586318+0000","last_undegraded":"2024-09-11T01:06:40.586318+0000","last_fullsized":"2024-09-11T01:06:40.586318+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:35.022280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211219+0000","last_change":"2024-09-11T01:05:31.693910+0000","last_active":"2024-09-11T01:05:45.211219+0000","last_peered":"2024-09-11T01:05:45.211219+0000","last_clean":"2024-09-11T01:05:45.211219+0000","last_became_active":"2024-09-11T01:05:31.692906+0000","last_became_peered":"2024-09-11T01:05:31.692906+0000","last_unstale":"2024-09-11T01:05:45.211219+0000","last_undegraded":"2024-09-11T01:05:45.211219+0000","last_fullsized":"2024-09-11T01:05:45.211219+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:11.906323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209596+0000","last_change":"2024-09-11T01:05:40.975768+0000","last_active":"2024-09-11T01:05:45.209596+0000","last_peered":"2024-09-11T01:05:45.209596+0000","last_clean":"2024-09-11T01:05:45.209596+0000","last_became_active":"2024-09-11T01:05:40.974721+0000","last_became_peered":"2024-09-11T01:05:40.974721+0000","last_unstale":"2024-09-11T01:05:45.209596+0000","last_undegraded":"2024-09-11T01:05:45.209596+0000","last_fullsized":"2024-09-11T01:05:45.209596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:27.475531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.644331+0000","last_change":"2024-09-11T01:05:28.558980+0000","last_active":"2024-09-11T01:06:19.644331+0000","last_peered":"2024-09-11T01:06:19.644331+0000","last_clean":"2024-09-11T01:06:19.644331+0000","last_became_active":"2024-09-11T01:05:28.558617+0000","last_became_peered":"2024-09-11T01:05:28.558617+0000","last_unstale":"2024-09-11T01:06:19.644331+0000","last_undegraded":"2024-09-11T01:06:19.644331+0000","last_fullsized":"2024-09-11T01:06:19.644331+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:13.659175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210842+0000","last_change":"2024-09-11T01:05:31.664705+0000","last_active":"2024-09-11T01:05:45.210842+0000","last_peered":"2024-09-11T01:05:45.210842+0000","last_clean":"2024-09-11T01:05:45.210842+0000","last_became_active":"2024-09-11T01:05:31.664328+0000","last_became_peered":"2024-09-11T01:05:31.664328+0000","last_unstale":"2024-09-11T01:05:45.210842+0000","last_undegraded":"2024-09-11T01:05:45.210842+0000","last_fullsized":"2024-09-11T01:05:45.210842+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:20.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210141+0000","last_change":"2024-09-11T01:05:40.976636+0000","last_active":"2024-09-11T01:05:45.210141+0000","last_peered":"2024-09-11T01:05:45.210141+0000","last_clean":"2024-09-11T01:05:45.210141+0000","last_became_active":"2024-09-11T01:05:40.975437+0000","last_became_peered":"2024-09-11T01:05:40.975437+0000","last_unstale":"2024-09-11T01:05:45.210141+0000","last_undegraded":"2024-09-11T01:05:45.210141+0000","last_fullsized":"2024-09-11T01:05:45.210141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:20.255947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124635+0000","last_change":"2024-09-11T01:05:28.555081+0000","last_active":"2024-09-11T01:05:45.124635+0000","last_peered":"2024-09-11T01:05:45.124635+0000","last_clean":"2024-09-11T01:05:45.124635+0000","last_became_active":"2024-09-11T01:05:28.554562+0000","last_became_peered":"2024-09-11T01:05:28.554562+0000","last_unstale":"2024-09-11T01:05:45.124635+0000","last_undegraded":"2024-09-11T01:05:45.124635+0000","last_fullsized":"2024-09-11T01:05:45.124635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:23.922285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210657+0000","last_change":"2024-09-11T01:05:31.680442+0000","last_active":"2024-09-11T01:05:45.210657+0000","last_peered":"2024-09-11T01:05:45.210657+0000","last_clean":"2024-09-11T01:05:45.210657+0000","last_became_active":"2024-09-11T01:05:31.680107+0000","last_became_peered":"2024-09-11T01:05:31.680107+0000","last_unstale":"2024-09-11T01:05:45.210657+0000","last_undegraded":"2024-09-11T01:05:45.210657+0000","last_fullsized":"2024-09-11T01:05:45.210657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:16:02.853855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209596+0000","last_change":"2024-09-11T01:05:40.969365+0000","last_active":"2024-09-11T01:05:45.209596+0000","last_peered":"2024-09-11T01:05:45.209596+0000","last_clean":"2024-09-11T01:05:45.209596+0000","last_became_active":"2024-09-11T01:05:40.969005+0000","last_became_peered":"2024-09-11T01:05:40.969005+0000","last_unstale":"2024-09-11T01:05:45.209596+0000","last_undegraded":"2024-09-11T01:05:45.209596+0000","last_fullsized":"2024-09-11T01:05:45.209596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:42.942848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124224+0000","last_change":"2024-09-11T01:05:31.676943+0000","last_active":"2024-09-11T01:05:45.124224+0000","last_peered":"2024-09-11T01:05:45.124224+0000","last_clean":"2024-09-11T01:05:45.124224+0000","last_became_active":"2024-09-11T01:05:31.676584+0000","last_became_peered":"2024-09-11T01:05:31.676584+0000","last_unstale":"2024-09-11T01:05:45.124224+0000","last_undegraded":"2024-09-11T01:05:45.124224+0000","last_fullsized":"2024-09-11T01:05:45.124224+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:08.288439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.632116+0000","last_change":"2024-09-11T01:05:28.559196+0000","last_active":"2024-09-11T01:06:18.632116+0000","last_peered":"2024-09-11T01:06:18.632116+0000","last_clean":"2024-09-11T01:06:18.632116+0000","last_became_active":"2024-09-11T01:05:28.558746+0000","last_became_peered":"2024-09-11T01:05:28.558746+0000","last_unstale":"2024-09-11T01:06:18.632116+0000","last_undegraded":"2024-09-11T01:06:18.632116+0000","last_fullsized":"2024-09-11T01:06:18.632116+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:32.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210189+0000","last_change":"2024-09-11T01:05:40.963609+0000","last_active":"2024-09-11T01:05:45.210189+0000","last_peered":"2024-09-11T01:05:45.210189+0000","last_clean":"2024-09-11T01:05:45.210189+0000","last_became_active":"2024-09-11T01:05:40.963088+0000","last_became_peered":"2024-09-11T01:05:40.963088+0000","last_unstale":"2024-09-11T01:05:45.210189+0000","last_undegraded":"2024-09-11T01:05:45.210189+0000","last_fullsized":"2024-09-11T01:05:45.210189+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:27.135362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T01:06:40.585999+0000","last_change":"2024-09-11T01:05:31.681258+0000","last_active":"2024-09-11T01:06:40.585999+0000","last_peered":"2024-09-11T01:06:40.585999+0000","last_clean":"2024-09-11T01:06:40.585999+0000","last_became_active":"2024-09-11T01:05:31.680946+0000","last_became_peered":"2024-09-11T01:05:31.680946+0000","last_unstale":"2024-09-11T01:06:40.585999+0000","last_undegraded":"2024-09-11T01:06:40.585999+0000","last_fullsized":"2024-09-11T01:06:40.585999+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:42.047250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'1","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.208991+0000","last_change":"2024-09-11T01:05:28.554651+0000","last_active":"2024-09-11T01:05:45.208991+0000","last_peered":"2024-09-11T01:05:45.208991+0000","last_clean":"2024-09-11T01:05:45.208991+0000","last_became_active":"2024-09-11T01:05:28.554279+0000","last_became_peered":"2024-09-11T01:05:28.554279+0000","last_unstale":"2024-09-11T01:05:45.208991+0000","last_undegraded":"2024-09-11T01:05:45.208991+0000","last_fullsized":"2024-09-11T01:05:45.208991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:14.093403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210125+0000","last_change":"2024-09-11T01:05:40.977549+0000","last_active":"2024-09-11T01:05:45.210125+0000","last_peered":"2024-09-11T01:05:45.210125+0000","last_clean":"2024-09-11T01:05:45.210125+0000","last_became_active":"2024-09-11T01:05:40.977030+0000","last_became_peered":"2024-09-11T01:05:40.977030+0000","last_unstale":"2024-09-11T01:05:45.210125+0000","last_undegraded":"2024-09-11T01:05:45.210125+0000","last_fullsized":"2024-09-11T01:05:45.210125+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:08:02.313437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210502+0000","last_change":"2024-09-11T01:05:31.681743+0000","last_active":"2024-09-11T01:05:45.210502+0000","last_peered":"2024-09-11T01:05:45.210502+0000","last_clean":"2024-09-11T01:05:45.210502+0000","last_became_active":"2024-09-11T01:05:31.681223+0000","last_became_peered":"2024-09-11T01:05:31.681223+0000","last_unstale":"2024-09-11T01:05:45.210502+0000","last_undegraded":"2024-09-11T01:05:45.210502+0000","last_fullsized":"2024-09-11T01:05:45.210502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:49.449622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":41,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T01:06:40.585853+0000","last_change":"2024-09-11T01:05:28.552914+0000","last_active":"2024-09-11T01:06:40.585853+0000","last_peered":"2024-09-11T01:06:40.585853+0000","last_clean":"2024-09-11T01:06:40.585853+0000","last_became_active":"2024-09-11T01:05:28.552404+0000","last_became_peered":"2024-09-11T01:05:28.552404+0000","last_unstale":"2024-09-11T01:06:40.585853+0000","last_undegraded":"2024-09-11T01:06:40.585853+0000","last_fullsized":"2024-09-11T01:06:40.585853+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:39.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.123475+0000","last_change":"2024-09-11T01:05:40.985652+0000","last_active":"2024-09-11T01:05:45.123475+0000","last_peered":"2024-09-11T01:05:45.123475+0000","last_clean":"2024-09-11T01:05:45.123475+0000","last_became_active":"2024-09-11T01:05:40.984898+0000","last_became_peered":"2024-09-11T01:05:40.984898+0000","last_unstale":"2024-09-11T01:05:45.123475+0000","last_undegraded":"2024-09-11T01:05:45.123475+0000","last_fullsized":"2024-09-11T01:05:45.123475+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:58.961342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124085+0000","last_change":"2024-09-11T01:05:31.675590+0000","last_active":"2024-09-11T01:05:45.124085+0000","last_peered":"2024-09-11T01:05:45.124085+0000","last_clean":"2024-09-11T01:05:45.124085+0000","last_became_active":"2024-09-11T01:05:31.674426+0000","last_became_peered":"2024-09-11T01:05:31.674426+0000","last_unstale":"2024-09-11T01:05:45.124085+0000","last_undegraded":"2024-09-11T01:05:45.124085+0000","last_fullsized":"2024-09-11T01:05:45.124085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:49.499195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.632055+0000","last_change":"2024-09-11T01:05:28.623677+0000","last_active":"2024-09-11T01:06:18.632055+0000","last_peered":"2024-09-11T01:06:18.632055+0000","last_clean":"2024-09-11T01:06:18.632055+0000","last_became_active":"2024-09-11T01:05:28.623357+0000","last_became_peered":"2024-09-11T01:05:28.623357+0000","last_unstale":"2024-09-11T01:06:18.632055+0000","last_undegraded":"2024-09-11T01:06:18.632055+0000","last_fullsized":"2024-09-11T01:06:18.632055+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:10.875425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210503+0000","last_change":"2024-09-11T01:05:40.978136+0000","last_active":"2024-09-11T01:05:45.210503+0000","last_peered":"2024-09-11T01:05:45.210503+0000","last_clean":"2024-09-11T01:05:45.210503+0000","last_became_active":"2024-09-11T01:05:40.977583+0000","last_became_peered":"2024-09-11T01:05:40.977583+0000","last_unstale":"2024-09-11T01:05:45.210503+0000","last_undegraded":"2024-09-11T01:05:45.210503+0000","last_fullsized":"2024-09-11T01:05:45.210503+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:58:20.297640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211053+0000","last_change":"2024-09-11T01:05:31.692938+0000","last_active":"2024-09-11T01:05:45.211053+0000","last_peered":"2024-09-11T01:05:45.211053+0000","last_clean":"2024-09-11T01:05:45.211053+0000","last_became_active":"2024-09-11T01:05:31.689869+0000","last_became_peered":"2024-09-11T01:05:31.689869+0000","last_unstale":"2024-09-11T01:05:45.211053+0000","last_undegraded":"2024-09-11T01:05:45.211053+0000","last_fullsized":"2024-09-11T01:05:45.211053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:24.820033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":41,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.629462+0000","last_change":"2024-09-11T01:05:28.755985+0000","last_active":"2024-09-11T01:06:18.629462+0000","last_peered":"2024-09-11T01:06:18.629462+0000","last_clean":"2024-09-11T01:06:18.629462+0000","last_became_active":"2024-09-11T01:05:28.755604+0000","last_became_peered":"2024-09-11T01:05:28.755604+0000","last_unstale":"2024-09-11T01:06:18.629462+0000","last_undegraded":"2024-09-11T01:06:18.629462+0000","last_fullsized":"2024-09-11T01:06:18.629462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:22.570473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209211+0000","last_change":"2024-09-11T01:05:40.963465+0000","last_active":"2024-09-11T01:05:45.209211+0000","last_peered":"2024-09-11T01:05:45.209211+0000","last_clean":"2024-09-11T01:05:45.209211+0000","last_became_active":"2024-09-11T01:05:40.962899+0000","last_became_peered":"2024-09-11T01:05:40.962899+0000","last_unstale":"2024-09-11T01:05:45.209211+0000","last_undegraded":"2024-09-11T01:05:45.209211+0000","last_fullsized":"2024-09-11T01:05:45.209211+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:01.728640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T01:06:40.586269+0000","last_change":"2024-09-11T01:05:31.675864+0000","last_active":"2024-09-11T01:06:40.586269+0000","last_peered":"2024-09-11T01:06:40.586269+0000","last_clean":"2024-09-11T01:06:40.586269+0000","last_became_active":"2024-09-11T01:05:31.675446+0000","last_became_peered":"2024-09-11T01:05:31.675446+0000","last_unstale":"2024-09-11T01:06:40.586269+0000","last_undegraded":"2024-09-11T01:06:40.586269+0000","last_fullsized":"2024-09-11T01:06:40.586269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:36.457881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'12","reported_seq":48,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:36.689455+0000","last_change":"2024-09-11T01:05:28.553509+0000","last_active":"2024-09-11T01:06:36.689455+0000","last_peered":"2024-09-11T01:06:36.689455+0000","last_clean":"2024-09-11T01:06:36.689455+0000","last_became_active":"2024-09-11T01:05:28.553101+0000","last_became_peered":"2024-09-11T01:05:28.553101+0000","last_unstale":"2024-09-11T01:06:36.689455+0000","last_undegraded":"2024-09-11T01:06:36.689455+0000","last_fullsized":"2024-09-11T01:06:36.689455+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:41.300518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T01:06:40.584257+0000","last_change":"2024-09-11T01:05:40.977146+0000","last_active":"2024-09-11T01:06:40.584257+0000","last_peered":"2024-09-11T01:06:40.584257+0000","last_clean":"2024-09-11T01:06:40.584257+0000","last_became_active":"2024-09-11T01:05:40.976804+0000","last_became_peered":"2024-09-11T01:05:40.976804+0000","last_unstale":"2024-09-11T01:06:40.584257+0000","last_undegraded":"2024-09-11T01:06:40.584257+0000","last_fullsized":"2024-09-11T01:06:40.584257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:49.753417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210515+0000","last_change":"2024-09-11T01:05:31.684219+0000","last_active":"2024-09-11T01:05:45.210515+0000","last_peered":"2024-09-11T01:05:45.210515+0000","last_clean":"2024-09-11T01:05:45.210515+0000","last_became_active":"2024-09-11T01:05:31.683937+0000","last_became_peered":"2024-09-11T01:05:31.683937+0000","last_unstale":"2024-09-11T01:05:45.210515+0000","last_undegraded":"2024-09-11T01:05:45.210515+0000","last_fullsized":"2024-09-11T01:05:45.210515+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:53.813624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.632313+0000","last_change":"2024-09-11T01:05:28.623680+0000","last_active":"2024-09-11T01:06:18.632313+0000","last_peered":"2024-09-11T01:06:18.632313+0000","last_clean":"2024-09-11T01:06:18.632313+0000","last_became_active":"2024-09-11T01:05:28.623261+0000","last_became_peered":"2024-09-11T01:05:28.623261+0000","last_unstale":"2024-09-11T01:06:18.632313+0000","last_undegraded":"2024-09-11T01:06:18.632313+0000","last_fullsized":"2024-09-11T01:06:18.632313+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:17.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210983+0000","last_change":"2024-09-11T01:05:40.967165+0000","last_active":"2024-09-11T01:05:45.210983+0000","last_peered":"2024-09-11T01:05:45.210983+0000","last_clean":"2024-09-11T01:05:45.210983+0000","last_became_active":"2024-09-11T01:05:40.966723+0000","last_became_peered":"2024-09-11T01:05:40.966723+0000","last_unstale":"2024-09-11T01:05:45.210983+0000","last_undegraded":"2024-09-11T01:05:45.210983+0000","last_fullsized":"2024-09-11T01:05:45.210983+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:48.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210957+0000","last_change":"2024-09-11T01:05:31.679865+0000","last_active":"2024-09-11T01:05:45.210957+0000","last_peered":"2024-09-11T01:05:45.210957+0000","last_clean":"2024-09-11T01:05:45.210957+0000","last_became_active":"2024-09-11T01:05:31.679494+0000","last_became_peered":"2024-09-11T01:05:31.679494+0000","last_unstale":"2024-09-11T01:05:45.210957+0000","last_undegraded":"2024-09-11T01:05:45.210957+0000","last_fullsized":"2024-09-11T01:05:45.210957+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:56.300799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.123409+0000","last_change":"2024-09-11T01:05:28.623746+0000","last_active":"2024-09-11T01:05:45.123409+0000","last_peered":"2024-09-11T01:05:45.123409+0000","last_clean":"2024-09-11T01:05:45.123409+0000","last_became_active":"2024-09-11T01:05:28.623358+0000","last_became_peered":"2024-09-11T01:05:28.623358+0000","last_unstale":"2024-09-11T01:05:45.123409+0000","last_undegraded":"2024-09-11T01:05:45.123409+0000","last_fullsized":"2024-09-11T01:05:45.123409+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:13.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124181+0000","last_change":"2024-09-11T01:05:40.982108+0000","last_active":"2024-09-11T01:05:45.124181+0000","last_peered":"2024-09-11T01:05:45.124181+0000","last_clean":"2024-09-11T01:05:45.124181+0000","last_became_active":"2024-09-11T01:05:40.981737+0000","last_became_peered":"2024-09-11T01:05:40.981737+0000","last_unstale":"2024-09-11T01:05:45.124181+0000","last_undegraded":"2024-09-11T01:05:45.124181+0000","last_fullsized":"2024-09-11T01:05:45.124181+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:16.717933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210762+0000","last_change":"2024-09-11T01:05:31.680885+0000","last_active":"2024-09-11T01:05:45.210762+0000","last_peered":"2024-09-11T01:05:45.210762+0000","last_clean":"2024-09-11T01:05:45.210762+0000","last_became_active":"2024-09-11T01:05:31.680536+0000","last_became_peered":"2024-09-11T01:05:31.680536+0000","last_unstale":"2024-09-11T01:05:45.210762+0000","last_undegraded":"2024-09-11T01:05:45.210762+0000","last_fullsized":"2024-09-11T01:05:45.210762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:12.963321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124335+0000","last_change":"2024-09-11T01:05:28.553957+0000","last_active":"2024-09-11T01:05:45.124335+0000","last_peered":"2024-09-11T01:05:45.124335+0000","last_clean":"2024-09-11T01:05:45.124335+0000","last_became_active":"2024-09-11T01:05:28.553572+0000","last_became_peered":"2024-09-11T01:05:28.553572+0000","last_unstale":"2024-09-11T01:05:45.124335+0000","last_undegraded":"2024-09-11T01:05:45.124335+0000","last_fullsized":"2024-09-11T01:05:45.124335+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:14.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210231+0000","last_change":"2024-09-11T01:05:40.971221+0000","last_active":"2024-09-11T01:05:45.210231+0000","last_peered":"2024-09-11T01:05:45.210231+0000","last_clean":"2024-09-11T01:05:45.210231+0000","last_became_active":"2024-09-11T01:05:40.970063+0000","last_became_peered":"2024-09-11T01:05:40.970063+0000","last_unstale":"2024-09-11T01:05:45.210231+0000","last_undegraded":"2024-09-11T01:05:45.210231+0000","last_fullsized":"2024-09-11T01:05:45.210231+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:46.299357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209352+0000","last_change":"2024-09-11T01:05:31.677125+0000","last_active":"2024-09-11T01:05:45.209352+0000","last_peered":"2024-09-11T01:05:45.209352+0000","last_clean":"2024-09-11T01:05:45.209352+0000","last_became_active":"2024-09-11T01:05:31.676803+0000","last_became_peered":"2024-09-11T01:05:31.676803+0000","last_unstale":"2024-09-11T01:05:45.209352+0000","last_undegraded":"2024-09-11T01:05:45.209352+0000","last_fullsized":"2024-09-11T01:05:45.209352+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:01:38.922178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'4","reported_seq":59,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:36.670845+0000","last_change":"2024-09-11T01:05:28.623895+0000","last_active":"2024-09-11T01:06:36.670845+0000","last_peered":"2024-09-11T01:06:36.670845+0000","last_clean":"2024-09-11T01:06:36.670845+0000","last_became_active":"2024-09-11T01:05:28.623520+0000","last_became_peered":"2024-09-11T01:05:28.623520+0000","last_unstale":"2024-09-11T01:06:36.670845+0000","last_undegraded":"2024-09-11T01:06:36.670845+0000","last_fullsized":"2024-09-11T01:06:36.670845+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:22.309521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211311+0000","last_change":"2024-09-11T01:05:40.974416+0000","last_active":"2024-09-11T01:05:45.211311+0000","last_peered":"2024-09-11T01:05:45.211311+0000","last_clean":"2024-09-11T01:05:45.211311+0000","last_became_active":"2024-09-11T01:05:40.973990+0000","last_became_peered":"2024-09-11T01:05:40.973990+0000","last_unstale":"2024-09-11T01:05:45.211311+0000","last_undegraded":"2024-09-11T01:05:45.211311+0000","last_fullsized":"2024-09-11T01:05:45.211311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:30.018876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209037+0000","last_change":"2024-09-11T01:05:31.688968+0000","last_active":"2024-09-11T01:05:45.209037+0000","last_peered":"2024-09-11T01:05:45.209037+0000","last_clean":"2024-09-11T01:05:45.209037+0000","last_became_active":"2024-09-11T01:05:31.688672+0000","last_became_peered":"2024-09-11T01:05:31.688672+0000","last_unstale":"2024-09-11T01:05:45.209037+0000","last_undegraded":"2024-09-11T01:05:45.209037+0000","last_fullsized":"2024-09-11T01:05:45.209037+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:39.080386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.643066+0000","last_change":"2024-09-11T01:05:28.554126+0000","last_active":"2024-09-11T01:06:19.643066+0000","last_peered":"2024-09-11T01:06:19.643066+0000","last_clean":"2024-09-11T01:06:19.643066+0000","last_became_active":"2024-09-11T01:05:28.553575+0000","last_became_peered":"2024-09-11T01:05:28.553575+0000","last_unstale":"2024-09-11T01:06:19.643066+0000","last_undegraded":"2024-09-11T01:06:19.643066+0000","last_fullsized":"2024-09-11T01:06:19.643066+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:42.203339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210957+0000","last_change":"2024-09-11T01:05:40.980415+0000","last_active":"2024-09-11T01:05:45.210957+0000","last_peered":"2024-09-11T01:05:45.210957+0000","last_clean":"2024-09-11T01:05:45.210957+0000","last_became_active":"2024-09-11T01:05:40.980062+0000","last_became_peered":"2024-09-11T01:05:40.980062+0000","last_unstale":"2024-09-11T01:05:45.210957+0000","last_undegraded":"2024-09-11T01:05:45.210957+0000","last_fullsized":"2024-09-11T01:05:45.210957+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:25.889972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T01:06:40.585827+0000","last_change":"2024-09-11T01:05:31.679622+0000","last_active":"2024-09-11T01:06:40.585827+0000","last_peered":"2024-09-11T01:06:40.585827+0000","last_clean":"2024-09-11T01:06:40.585827+0000","last_became_active":"2024-09-11T01:05:31.679239+0000","last_became_peered":"2024-09-11T01:05:31.679239+0000","last_unstale":"2024-09-11T01:06:40.585827+0000","last_undegraded":"2024-09-11T01:06:40.585827+0000","last_fullsized":"2024-09-11T01:06:40.585827+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:32.240196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:20.644341+0000","last_change":"2024-09-11T01:05:28.552203+0000","last_active":"2024-09-11T01:06:20.644341+0000","last_peered":"2024-09-11T01:06:20.644341+0000","last_clean":"2024-09-11T01:06:20.644341+0000","last_became_active":"2024-09-11T01:05:28.551658+0000","last_became_peered":"2024-09-11T01:05:28.551658+0000","last_unstale":"2024-09-11T01:06:20.644341+0000","last_undegraded":"2024-09-11T01:06:20.644341+0000","last_fullsized":"2024-09-11T01:06:20.644341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:46.102466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":112,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124120+0000","last_change":"2024-09-11T01:04:12.299017+0000","last_active":"2024-09-11T01:05:45.124120+0000","last_peered":"2024-09-11T01:05:45.124120+0000","last_clean":"2024-09-11T01:05:45.124120+0000","last_became_active":"2024-09-11T01:04:11.998504+0000","last_became_peered":"2024-09-11T01:04:11.998504+0000","last_unstale":"2024-09-11T01:05:45.124120+0000","last_undegraded":"2024-09-11T01:05:45.124120+0000","last_fullsized":"2024-09-11T01:05:45.124120+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:00:34.569322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:00:34.569322+0000","last_clean_scrub_stamp":"2024-09-11T01:00:34.569322+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:54.949789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124702+0000","last_change":"2024-09-11T01:05:40.982181+0000","last_active":"2024-09-11T01:05:45.124702+0000","last_peered":"2024-09-11T01:05:45.124702+0000","last_clean":"2024-09-11T01:05:45.124702+0000","last_became_active":"2024-09-11T01:05:40.981668+0000","last_became_peered":"2024-09-11T01:05:40.981668+0000","last_unstale":"2024-09-11T01:05:45.124702+0000","last_undegraded":"2024-09-11T01:05:45.124702+0000","last_fullsized":"2024-09-11T01:05:45.124702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:48.199189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124749+0000","last_change":"2024-09-11T01:05:31.677978+0000","last_active":"2024-09-11T01:05:45.124749+0000","last_peered":"2024-09-11T01:05:45.124749+0000","last_clean":"2024-09-11T01:05:45.124749+0000","last_became_active":"2024-09-11T01:05:31.677478+0000","last_became_peered":"2024-09-11T01:05:31.677478+0000","last_unstale":"2024-09-11T01:05:45.124749+0000","last_undegraded":"2024-09-11T01:05:45.124749+0000","last_fullsized":"2024-09-11T01:05:45.124749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:39.568921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.647354+0000","last_change":"2024-09-11T01:05:28.755866+0000","last_active":"2024-09-11T01:06:19.647354+0000","last_peered":"2024-09-11T01:06:19.647354+0000","last_clean":"2024-09-11T01:06:19.647354+0000","last_became_active":"2024-09-11T01:05:28.755475+0000","last_became_peered":"2024-09-11T01:05:28.755475+0000","last_unstale":"2024-09-11T01:06:19.647354+0000","last_undegraded":"2024-09-11T01:06:19.647354+0000","last_fullsized":"2024-09-11T01:06:19.647354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:22.324584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209644+0000","last_change":"2024-09-11T01:05:40.967181+0000","last_active":"2024-09-11T01:05:45.209644+0000","last_peered":"2024-09-11T01:05:45.209644+0000","last_clean":"2024-09-11T01:05:45.209644+0000","last_became_active":"2024-09-11T01:05:40.966748+0000","last_became_peered":"2024-09-11T01:05:40.966748+0000","last_unstale":"2024-09-11T01:05:45.209644+0000","last_undegraded":"2024-09-11T01:05:45.209644+0000","last_fullsized":"2024-09-11T01:05:45.209644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:15:28.446190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124569+0000","last_change":"2024-09-11T01:05:40.981823+0000","last_active":"2024-09-11T01:05:45.124569+0000","last_peered":"2024-09-11T01:05:45.124569+0000","last_clean":"2024-09-11T01:05:45.124569+0000","last_became_active":"2024-09-11T01:05:40.981478+0000","last_became_peered":"2024-09-11T01:05:40.981478+0000","last_unstale":"2024-09-11T01:05:45.124569+0000","last_undegraded":"2024-09-11T01:05:45.124569+0000","last_fullsized":"2024-09-11T01:05:45.124569+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:55.848492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210777+0000","last_change":"2024-09-11T01:05:28.549207+0000","last_active":"2024-09-11T01:05:45.210777+0000","last_peered":"2024-09-11T01:05:45.210777+0000","last_clean":"2024-09-11T01:05:45.210777+0000","last_became_active":"2024-09-11T01:05:28.548156+0000","last_became_peered":"2024-09-11T01:05:28.548156+0000","last_unstale":"2024-09-11T01:05:45.210777+0000","last_undegraded":"2024-09-11T01:05:45.210777+0000","last_fullsized":"2024-09-11T01:05:45.210777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:58.698379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210631+0000","last_change":"2024-09-11T01:05:40.982213+0000","last_active":"2024-09-11T01:05:45.210631+0000","last_peered":"2024-09-11T01:05:45.210631+0000","last_clean":"2024-09-11T01:05:45.210631+0000","last_became_active":"2024-09-11T01:05:40.981066+0000","last_became_peered":"2024-09-11T01:05:40.981066+0000","last_unstale":"2024-09-11T01:05:45.210631+0000","last_undegraded":"2024-09-11T01:05:45.210631+0000","last_fullsized":"2024-09-11T01:05:45.210631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:09.348973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124786+0000","last_change":"2024-09-11T01:05:31.677613+0000","last_active":"2024-09-11T01:05:45.124786+0000","last_peered":"2024-09-11T01:05:45.124786+0000","last_clean":"2024-09-11T01:05:45.124786+0000","last_became_active":"2024-09-11T01:05:31.677263+0000","last_became_peered":"2024-09-11T01:05:31.677263+0000","last_unstale":"2024-09-11T01:05:45.124786+0000","last_undegraded":"2024-09-11T01:05:45.124786+0000","last_fullsized":"2024-09-11T01:05:45.124786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:32.490982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211305+0000","last_change":"2024-09-11T01:05:28.558437+0000","last_active":"2024-09-11T01:05:45.211305+0000","last_peered":"2024-09-11T01:05:45.211305+0000","last_clean":"2024-09-11T01:05:45.211305+0000","last_became_active":"2024-09-11T01:05:28.558070+0000","last_became_peered":"2024-09-11T01:05:28.558070+0000","last_unstale":"2024-09-11T01:05:45.211305+0000","last_undegraded":"2024-09-11T01:05:45.211305+0000","last_fullsized":"2024-09-11T01:05:45.211305+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:26.589209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209186+0000","last_change":"2024-09-11T01:05:40.970422+0000","last_active":"2024-09-11T01:05:45.209186+0000","last_peered":"2024-09-11T01:05:45.209186+0000","last_clean":"2024-09-11T01:05:45.209186+0000","last_became_active":"2024-09-11T01:05:40.970087+0000","last_became_peered":"2024-09-11T01:05:40.970087+0000","last_unstale":"2024-09-11T01:05:45.209186+0000","last_undegraded":"2024-09-11T01:05:45.209186+0000","last_fullsized":"2024-09-11T01:05:45.209186+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:05.171700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211039+0000","last_change":"2024-09-11T01:05:40.967014+0000","last_active":"2024-09-11T01:05:45.211039+0000","last_peered":"2024-09-11T01:05:45.211039+0000","last_clean":"2024-09-11T01:05:45.211039+0000","last_became_active":"2024-09-11T01:05:40.966567+0000","last_became_peered":"2024-09-11T01:05:40.966567+0000","last_unstale":"2024-09-11T01:05:45.211039+0000","last_undegraded":"2024-09-11T01:05:45.211039+0000","last_fullsized":"2024-09-11T01:05:45.211039+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:50.868245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:20.640347+0000","last_change":"2024-09-11T01:05:28.553646+0000","last_active":"2024-09-11T01:06:20.640347+0000","last_peered":"2024-09-11T01:06:20.640347+0000","last_clean":"2024-09-11T01:06:20.640347+0000","last_became_active":"2024-09-11T01:05:28.553238+0000","last_became_peered":"2024-09-11T01:05:28.553238+0000","last_unstale":"2024-09-11T01:06:20.640347+0000","last_undegraded":"2024-09-11T01:06:20.640347+0000","last_fullsized":"2024-09-11T01:06:20.640347+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:31.670321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209308+0000","last_change":"2024-09-11T01:05:40.973220+0000","last_active":"2024-09-11T01:05:45.209308+0000","last_peered":"2024-09-11T01:05:45.209308+0000","last_clean":"2024-09-11T01:05:45.209308+0000","last_became_active":"2024-09-11T01:05:40.972843+0000","last_became_peered":"2024-09-11T01:05:40.972843+0000","last_unstale":"2024-09-11T01:05:45.209308+0000","last_undegraded":"2024-09-11T01:05:45.209308+0000","last_fullsized":"2024-09-11T01:05:45.209308+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:07.785474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209683+0000","last_change":"2024-09-11T01:05:31.682064+0000","last_active":"2024-09-11T01:05:45.209683+0000","last_peered":"2024-09-11T01:05:45.209683+0000","last_clean":"2024-09-11T01:05:45.209683+0000","last_became_active":"2024-09-11T01:05:31.681744+0000","last_became_peered":"2024-09-11T01:05:31.681744+0000","last_unstale":"2024-09-11T01:05:45.209683+0000","last_undegraded":"2024-09-11T01:05:45.209683+0000","last_fullsized":"2024-09-11T01:05:45.209683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:29.055133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":35,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.647462+0000","last_change":"2024-09-11T01:05:40.986656+0000","last_active":"2024-09-11T01:06:19.647462+0000","last_peered":"2024-09-11T01:06:19.647462+0000","last_clean":"2024-09-11T01:06:19.647462+0000","last_became_active":"2024-09-11T01:05:40.970230+0000","last_became_peered":"2024-09-11T01:05:40.970230+0000","last_unstale":"2024-09-11T01:06:19.647462+0000","last_undegraded":"2024-09-11T01:06:19.647462+0000","last_fullsized":"2024-09-11T01:06:19.647462+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:25.468986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211283+0000","last_change":"2024-09-11T01:05:40.980843+0000","last_active":"2024-09-11T01:05:45.211283+0000","last_peered":"2024-09-11T01:05:45.211283+0000","last_clean":"2024-09-11T01:05:45.211283+0000","last_became_active":"2024-09-11T01:05:40.979033+0000","last_became_peered":"2024-09-11T01:05:40.979033+0000","last_unstale":"2024-09-11T01:05:45.211283+0000","last_undegraded":"2024-09-11T01:05:45.211283+0000","last_fullsized":"2024-09-11T01:05:45.211283+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:44.039548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.123902+0000","last_change":"2024-09-11T01:05:31.676046+0000","last_active":"2024-09-11T01:05:45.123902+0000","last_peered":"2024-09-11T01:05:45.123902+0000","last_clean":"2024-09-11T01:05:45.123902+0000","last_became_active":"2024-09-11T01:05:31.675704+0000","last_became_peered":"2024-09-11T01:05:31.675704+0000","last_unstale":"2024-09-11T01:05:45.123902+0000","last_undegraded":"2024-09-11T01:05:45.123902+0000","last_fullsized":"2024-09-11T01:05:45.123902+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:17.907270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'4","reported_seq":62,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:36.671465+0000","last_change":"2024-09-11T01:05:28.550131+0000","last_active":"2024-09-11T01:06:36.671465+0000","last_peered":"2024-09-11T01:06:36.671465+0000","last_clean":"2024-09-11T01:06:36.671465+0000","last_became_active":"2024-09-11T01:05:28.549561+0000","last_became_peered":"2024-09-11T01:05:28.549561+0000","last_unstale":"2024-09-11T01:06:36.671465+0000","last_undegraded":"2024-09-11T01:06:36.671465+0000","last_fullsized":"2024-09-11T01:06:36.671465+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:52.001757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.123717+0000","last_change":"2024-09-11T01:05:40.984877+0000","last_active":"2024-09-11T01:05:45.123717+0000","last_peered":"2024-09-11T01:05:45.123717+0000","last_clean":"2024-09-11T01:05:45.123717+0000","last_became_active":"2024-09-11T01:05:40.984500+0000","last_became_peered":"2024-09-11T01:05:40.984500+0000","last_unstale":"2024-09-11T01:05:45.123717+0000","last_undegraded":"2024-09-11T01:05:45.123717+0000","last_fullsized":"2024-09-11T01:05:45.123717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:44.309560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124317+0000","last_change":"2024-09-11T01:05:40.976014+0000","last_active":"2024-09-11T01:05:45.124317+0000","last_peered":"2024-09-11T01:05:45.124317+0000","last_clean":"2024-09-11T01:05:45.124317+0000","last_became_active":"2024-09-11T01:05:40.975610+0000","last_became_peered":"2024-09-11T01:05:40.975610+0000","last_unstale":"2024-09-11T01:05:45.124317+0000","last_undegraded":"2024-09-11T01:05:45.124317+0000","last_fullsized":"2024-09-11T01:05:45.124317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:26.920957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":40,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.632074+0000","last_change":"2024-09-11T01:05:28.553043+0000","last_active":"2024-09-11T01:06:18.632074+0000","last_peered":"2024-09-11T01:06:18.632074+0000","last_clean":"2024-09-11T01:06:18.632074+0000","last_became_active":"2024-09-11T01:05:28.552678+0000","last_became_peered":"2024-09-11T01:05:28.552678+0000","last_unstale":"2024-09-11T01:06:18.632074+0000","last_undegraded":"2024-09-11T01:06:18.632074+0000","last_fullsized":"2024-09-11T01:06:18.632074+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:23.279056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210694+0000","last_change":"2024-09-11T01:05:40.979766+0000","last_active":"2024-09-11T01:05:45.210694+0000","last_peered":"2024-09-11T01:05:45.210694+0000","last_clean":"2024-09-11T01:05:45.210694+0000","last_became_active":"2024-09-11T01:05:40.978804+0000","last_became_peered":"2024-09-11T01:05:40.978804+0000","last_unstale":"2024-09-11T01:05:45.210694+0000","last_undegraded":"2024-09-11T01:05:45.210694+0000","last_fullsized":"2024-09-11T01:05:45.210694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:39.945862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209565+0000","last_change":"2024-09-11T01:05:31.674324+0000","last_active":"2024-09-11T01:05:45.209565+0000","last_peered":"2024-09-11T01:05:45.209565+0000","last_clean":"2024-09-11T01:05:45.209565+0000","last_became_active":"2024-09-11T01:05:31.673648+0000","last_became_peered":"2024-09-11T01:05:31.673648+0000","last_unstale":"2024-09-11T01:05:45.209565+0000","last_undegraded":"2024-09-11T01:05:45.209565+0000","last_fullsized":"2024-09-11T01:05:45.209565+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:02.134422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.647695+0000","last_change":"2024-09-11T01:05:40.972605+0000","last_active":"2024-09-11T01:06:19.647695+0000","last_peered":"2024-09-11T01:06:19.647695+0000","last_clean":"2024-09-11T01:06:19.647695+0000","last_became_active":"2024-09-11T01:05:40.961704+0000","last_became_peered":"2024-09-11T01:05:40.961704+0000","last_unstale":"2024-09-11T01:06:19.647695+0000","last_undegraded":"2024-09-11T01:06:19.647695+0000","last_fullsized":"2024-09-11T01:06:19.647695+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:45.276739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210354+0000","last_change":"2024-09-11T01:05:40.969424+0000","last_active":"2024-09-11T01:05:45.210354+0000","last_peered":"2024-09-11T01:05:45.210354+0000","last_clean":"2024-09-11T01:05:45.210354+0000","last_became_active":"2024-09-11T01:05:40.968994+0000","last_became_peered":"2024-09-11T01:05:40.968994+0000","last_unstale":"2024-09-11T01:05:45.210354+0000","last_undegraded":"2024-09-11T01:05:45.210354+0000","last_fullsized":"2024-09-11T01:05:45.210354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:08.554953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124394+0000","last_change":"2024-09-11T01:05:31.675764+0000","last_active":"2024-09-11T01:05:45.124394+0000","last_peered":"2024-09-11T01:05:45.124394+0000","last_clean":"2024-09-11T01:05:45.124394+0000","last_became_active":"2024-09-11T01:05:31.674553+0000","last_became_peered":"2024-09-11T01:05:31.674553+0000","last_unstale":"2024-09-11T01:05:45.124394+0000","last_undegraded":"2024-09-11T01:05:45.124394+0000","last_fullsized":"2024-09-11T01:05:45.124394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:30.026758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"87'29","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:38.673873+0000","last_change":"2024-09-11T01:05:40.975735+0000","last_active":"2024-09-11T01:06:38.673873+0000","last_peered":"2024-09-11T01:06:38.673873+0000","last_clean":"2024-09-11T01:06:38.673873+0000","last_became_active":"2024-09-11T01:05:40.964582+0000","last_became_peered":"2024-09-11T01:05:40.964582+0000","last_unstale":"2024-09-11T01:06:38.673873+0000","last_undegraded":"2024-09-11T01:06:38.673873+0000","last_fullsized":"2024-09-11T01:06:38.673873+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:57.424468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56745,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":45,"num_read_kb":77,"num_write":30,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.123058+0000","last_change":"2024-09-11T01:05:40.981306+0000","last_active":"2024-09-11T01:05:45.123058+0000","last_peered":"2024-09-11T01:05:45.123058+0000","last_clean":"2024-09-11T01:05:45.123058+0000","last_became_active":"2024-09-11T01:05:40.977531+0000","last_became_peered":"2024-09-11T01:05:40.977531+0000","last_unstale":"2024-09-11T01:05:45.123058+0000","last_undegraded":"2024-09-11T01:05:45.123058+0000","last_fullsized":"2024-09-11T01:05:45.123058+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:21.613080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210943+0000","last_change":"2024-09-11T01:05:31.681612+0000","last_active":"2024-09-11T01:05:45.210943+0000","last_peered":"2024-09-11T01:05:45.210943+0000","last_clean":"2024-09-11T01:05:45.210943+0000","last_became_active":"2024-09-11T01:05:31.680609+0000","last_became_peered":"2024-09-11T01:05:31.680609+0000","last_unstale":"2024-09-11T01:05:45.210943+0000","last_undegraded":"2024-09-11T01:05:45.210943+0000","last_fullsized":"2024-09-11T01:05:45.210943+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:44.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":42,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.632271+0000","last_change":"2024-09-11T01:05:28.625177+0000","last_active":"2024-09-11T01:06:18.632271+0000","last_peered":"2024-09-11T01:06:18.632271+0000","last_clean":"2024-09-11T01:06:18.632271+0000","last_became_active":"2024-09-11T01:05:28.624819+0000","last_became_peered":"2024-09-11T01:05:28.624819+0000","last_unstale":"2024-09-11T01:06:18.632271+0000","last_undegraded":"2024-09-11T01:06:18.632271+0000","last_fullsized":"2024-09-11T01:06:18.632271+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:11.709636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210780+0000","last_change":"2024-09-11T01:05:40.978481+0000","last_active":"2024-09-11T01:05:45.210780+0000","last_peered":"2024-09-11T01:05:45.210780+0000","last_clean":"2024-09-11T01:05:45.210780+0000","last_became_active":"2024-09-11T01:05:40.977501+0000","last_became_peered":"2024-09-11T01:05:40.977501+0000","last_unstale":"2024-09-11T01:05:45.210780+0000","last_undegraded":"2024-09-11T01:05:45.210780+0000","last_fullsized":"2024-09-11T01:05:45.210780+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:08.427274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211243+0000","last_change":"2024-09-11T01:05:31.692675+0000","last_active":"2024-09-11T01:05:45.211243+0000","last_peered":"2024-09-11T01:05:45.211243+0000","last_clean":"2024-09-11T01:05:45.211243+0000","last_became_active":"2024-09-11T01:05:31.690308+0000","last_became_peered":"2024-09-11T01:05:31.690308+0000","last_unstale":"2024-09-11T01:05:45.211243+0000","last_undegraded":"2024-09-11T01:05:45.211243+0000","last_fullsized":"2024-09-11T01:05:45.211243+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:14.823786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:18.631544+0000","last_change":"2024-09-11T01:05:28.557868+0000","last_active":"2024-09-11T01:06:18.631544+0000","last_peered":"2024-09-11T01:06:18.631544+0000","last_clean":"2024-09-11T01:06:18.631544+0000","last_became_active":"2024-09-11T01:05:28.557512+0000","last_became_peered":"2024-09-11T01:05:28.557512+0000","last_unstale":"2024-09-11T01:06:18.631544+0000","last_undegraded":"2024-09-11T01:06:18.631544+0000","last_fullsized":"2024-09-11T01:06:18.631544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:50.733551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.122848+0000","last_change":"2024-09-11T01:05:40.982368+0000","last_active":"2024-09-11T01:05:45.122848+0000","last_peered":"2024-09-11T01:05:45.122848+0000","last_clean":"2024-09-11T01:05:45.122848+0000","last_became_active":"2024-09-11T01:05:40.980337+0000","last_became_peered":"2024-09-11T01:05:40.980337+0000","last_unstale":"2024-09-11T01:05:45.122848+0000","last_undegraded":"2024-09-11T01:05:45.122848+0000","last_fullsized":"2024-09-11T01:05:45.122848+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:22.010496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211327+0000","last_change":"2024-09-11T01:05:31.670806+0000","last_active":"2024-09-11T01:05:45.211327+0000","last_peered":"2024-09-11T01:05:45.211327+0000","last_clean":"2024-09-11T01:05:45.211327+0000","last_became_active":"2024-09-11T01:05:31.670452+0000","last_became_peered":"2024-09-11T01:05:31.670452+0000","last_unstale":"2024-09-11T01:05:45.211327+0000","last_undegraded":"2024-09-11T01:05:45.211327+0000","last_fullsized":"2024-09-11T01:05:45.211327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:22.489650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'3","reported_seq":58,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:37.671825+0000","last_change":"2024-09-11T01:05:28.555885+0000","last_active":"2024-09-11T01:06:37.671825+0000","last_peered":"2024-09-11T01:06:37.671825+0000","last_clean":"2024-09-11T01:06:37.671825+0000","last_became_active":"2024-09-11T01:05:28.555471+0000","last_became_peered":"2024-09-11T01:05:28.555471+0000","last_unstale":"2024-09-11T01:06:37.671825+0000","last_undegraded":"2024-09-11T01:06:37.671825+0000","last_fullsized":"2024-09-11T01:06:37.671825+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:50.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":19,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T01:06:40.585558+0000","last_change":"2024-09-11T01:05:40.971982+0000","last_active":"2024-09-11T01:06:40.585558+0000","last_peered":"2024-09-11T01:06:40.585558+0000","last_clean":"2024-09-11T01:06:40.585558+0000","last_became_active":"2024-09-11T01:05:40.971614+0000","last_became_peered":"2024-09-11T01:05:40.971614+0000","last_unstale":"2024-09-11T01:06:40.585558+0000","last_undegraded":"2024-09-11T01:06:40.585558+0000","last_fullsized":"2024-09-11T01:06:40.585558+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:11.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210899+0000","last_change":"2024-09-11T01:05:40.972734+0000","last_active":"2024-09-11T01:05:45.210899+0000","last_peered":"2024-09-11T01:05:45.210899+0000","last_clean":"2024-09-11T01:05:45.210899+0000","last_became_active":"2024-09-11T01:05:40.969428+0000","last_became_peered":"2024-09-11T01:05:40.969428+0000","last_unstale":"2024-09-11T01:05:45.210899+0000","last_undegraded":"2024-09-11T01:05:45.210899+0000","last_fullsized":"2024-09-11T01:05:45.210899+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:30.199055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.122942+0000","last_change":"2024-09-11T01:05:31.684114+0000","last_active":"2024-09-11T01:05:45.122942+0000","last_peered":"2024-09-11T01:05:45.122942+0000","last_clean":"2024-09-11T01:05:45.122942+0000","last_became_active":"2024-09-11T01:05:31.683830+0000","last_became_peered":"2024-09-11T01:05:31.683830+0000","last_unstale":"2024-09-11T01:05:45.122942+0000","last_undegraded":"2024-09-11T01:05:45.122942+0000","last_fullsized":"2024-09-11T01:05:45.122942+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:43.695706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":38,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209482+0000","last_change":"2024-09-11T01:05:28.554745+0000","last_active":"2024-09-11T01:05:45.209482+0000","last_peered":"2024-09-11T01:05:45.209482+0000","last_clean":"2024-09-11T01:05:45.209482+0000","last_became_active":"2024-09-11T01:05:28.554354+0000","last_became_peered":"2024-09-11T01:05:28.554354+0000","last_unstale":"2024-09-11T01:05:45.209482+0000","last_undegraded":"2024-09-11T01:05:45.209482+0000","last_fullsized":"2024-09-11T01:05:45.209482+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:33.663536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211049+0000","last_change":"2024-09-11T01:05:40.974956+0000","last_active":"2024-09-11T01:05:45.211049+0000","last_peered":"2024-09-11T01:05:45.211049+0000","last_clean":"2024-09-11T01:05:45.211049+0000","last_became_active":"2024-09-11T01:05:40.974434+0000","last_became_peered":"2024-09-11T01:05:40.974434+0000","last_unstale":"2024-09-11T01:05:45.211049+0000","last_undegraded":"2024-09-11T01:05:45.211049+0000","last_fullsized":"2024-09-11T01:05:45.211049+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:01.196098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T01:06:40.584838+0000","last_change":"2024-09-11T01:05:31.679904+0000","last_active":"2024-09-11T01:06:40.584838+0000","last_peered":"2024-09-11T01:06:40.584838+0000","last_clean":"2024-09-11T01:06:40.584838+0000","last_became_active":"2024-09-11T01:05:31.679517+0000","last_became_peered":"2024-09-11T01:05:31.679517+0000","last_unstale":"2024-09-11T01:06:40.584838+0000","last_undegraded":"2024-09-11T01:06:40.584838+0000","last_fullsized":"2024-09-11T01:06:40.584838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:24.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.644923+0000","last_change":"2024-09-11T01:05:28.549752+0000","last_active":"2024-09-11T01:06:19.644923+0000","last_peered":"2024-09-11T01:06:19.644923+0000","last_clean":"2024-09-11T01:06:19.644923+0000","last_became_active":"2024-09-11T01:05:28.549253+0000","last_became_peered":"2024-09-11T01:05:28.549253+0000","last_unstale":"2024-09-11T01:06:19.644923+0000","last_undegraded":"2024-09-11T01:06:19.644923+0000","last_fullsized":"2024-09-11T01:06:19.644923+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:25.774363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":39,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:19.645501+0000","last_change":"2024-09-11T01:05:28.553118+0000","last_active":"2024-09-11T01:06:19.645501+0000","last_peered":"2024-09-11T01:06:19.645501+0000","last_clean":"2024-09-11T01:06:19.645501+0000","last_became_active":"2024-09-11T01:05:28.552779+0000","last_became_peered":"2024-09-11T01:05:28.552779+0000","last_unstale":"2024-09-11T01:06:19.645501+0000","last_undegraded":"2024-09-11T01:06:19.645501+0000","last_fullsized":"2024-09-11T01:06:19.645501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:58.297579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.123110+0000","last_change":"2024-09-11T01:05:40.981936+0000","last_active":"2024-09-11T01:05:45.123110+0000","last_peered":"2024-09-11T01:05:45.123110+0000","last_clean":"2024-09-11T01:05:45.123110+0000","last_became_active":"2024-09-11T01:05:40.981623+0000","last_became_peered":"2024-09-11T01:05:40.981623+0000","last_unstale":"2024-09-11T01:05:45.123110+0000","last_undegraded":"2024-09-11T01:05:45.123110+0000","last_fullsized":"2024-09-11T01:05:45.123110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:14.773406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209810+0000","last_change":"2024-09-11T01:05:40.979394+0000","last_active":"2024-09-11T01:05:45.209810+0000","last_peered":"2024-09-11T01:05:45.209810+0000","last_clean":"2024-09-11T01:05:45.209810+0000","last_became_active":"2024-09-11T01:05:40.978985+0000","last_became_peered":"2024-09-11T01:05:40.978985+0000","last_unstale":"2024-09-11T01:05:45.209810+0000","last_undegraded":"2024-09-11T01:05:45.209810+0000","last_fullsized":"2024-09-11T01:05:45.209810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:18.008402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'6","reported_seq":63,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:06:35.669391+0000","last_change":"2024-09-11T01:05:28.553479+0000","last_active":"2024-09-11T01:06:35.669391+0000","last_peered":"2024-09-11T01:06:35.669391+0000","last_clean":"2024-09-11T01:06:35.669391+0000","last_became_active":"2024-09-11T01:05:28.553171+0000","last_became_peered":"2024-09-11T01:05:28.553171+0000","last_unstale":"2024-09-11T01:06:35.669391+0000","last_undegraded":"2024-09-11T01:06:35.669391+0000","last_fullsized":"2024-09-11T01:06:35.669391+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:04.877982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124180+0000","last_change":"2024-09-11T01:05:40.982070+0000","last_active":"2024-09-11T01:05:45.124180+0000","last_peered":"2024-09-11T01:05:45.124180+0000","last_clean":"2024-09-11T01:05:45.124180+0000","last_became_active":"2024-09-11T01:05:40.981601+0000","last_became_peered":"2024-09-11T01:05:40.981601+0000","last_unstale":"2024-09-11T01:05:45.124180+0000","last_undegraded":"2024-09-11T01:05:45.124180+0000","last_fullsized":"2024-09-11T01:05:45.124180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:31.409711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209212+0000","last_change":"2024-09-11T01:05:40.967374+0000","last_active":"2024-09-11T01:05:45.209212+0000","last_peered":"2024-09-11T01:05:45.209212+0000","last_clean":"2024-09-11T01:05:45.209212+0000","last_became_active":"2024-09-11T01:05:40.966705+0000","last_became_peered":"2024-09-11T01:05:40.966705+0000","last_unstale":"2024-09-11T01:05:45.209212+0000","last_undegraded":"2024-09-11T01:05:45.209212+0000","last_fullsized":"2024-09-11T01:05:45.209212+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:17.278999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210340+0000","last_change":"2024-09-11T01:05:31.675298+0000","last_active":"2024-09-11T01:05:45.210340+0000","last_peered":"2024-09-11T01:05:45.210340+0000","last_clean":"2024-09-11T01:05:45.210340+0000","last_became_active":"2024-09-11T01:05:31.674922+0000","last_became_peered":"2024-09-11T01:05:31.674922+0000","last_unstale":"2024-09-11T01:05:45.210340+0000","last_undegraded":"2024-09-11T01:05:45.210340+0000","last_fullsized":"2024-09-11T01:05:45.210340+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:54.059202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209537+0000","last_change":"2024-09-11T01:05:31.685494+0000","last_active":"2024-09-11T01:05:45.209537+0000","last_peered":"2024-09-11T01:05:45.209537+0000","last_clean":"2024-09-11T01:05:45.209537+0000","last_became_active":"2024-09-11T01:05:31.685131+0000","last_became_peered":"2024-09-11T01:05:31.685131+0000","last_unstale":"2024-09-11T01:05:45.209537+0000","last_undegraded":"2024-09-11T01:05:45.209537+0000","last_fullsized":"2024-09-11T01:05:45.209537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:41.805135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.208770+0000","last_change":"2024-09-11T01:05:31.686473+0000","last_active":"2024-09-11T01:05:45.208770+0000","last_peered":"2024-09-11T01:05:45.208770+0000","last_clean":"2024-09-11T01:05:45.208770+0000","last_became_active":"2024-09-11T01:05:31.685858+0000","last_became_peered":"2024-09-11T01:05:31.685858+0000","last_unstale":"2024-09-11T01:05:45.208770+0000","last_undegraded":"2024-09-11T01:05:45.208770+0000","last_fullsized":"2024-09-11T01:05:45.208770+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:52.174889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210789+0000","last_change":"2024-09-11T01:05:31.691078+0000","last_active":"2024-09-11T01:05:45.210789+0000","last_peered":"2024-09-11T01:05:45.210789+0000","last_clean":"2024-09-11T01:05:45.210789+0000","last_became_active":"2024-09-11T01:05:31.690755+0000","last_became_peered":"2024-09-11T01:05:31.690755+0000","last_unstale":"2024-09-11T01:05:45.210789+0000","last_undegraded":"2024-09-11T01:05:45.210789+0000","last_fullsized":"2024-09-11T01:05:45.210789+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:50.643233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210424+0000","last_change":"2024-09-11T01:05:31.681933+0000","last_active":"2024-09-11T01:05:45.210424+0000","last_peered":"2024-09-11T01:05:45.210424+0000","last_clean":"2024-09-11T01:05:45.210424+0000","last_became_active":"2024-09-11T01:05:31.681642+0000","last_became_peered":"2024-09-11T01:05:31.681642+0000","last_unstale":"2024-09-11T01:05:45.210424+0000","last_undegraded":"2024-09-11T01:05:45.210424+0000","last_fullsized":"2024-09-11T01:05:45.210424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:05:10.434843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210762+0000","last_change":"2024-09-11T01:05:31.677188+0000","last_active":"2024-09-11T01:05:45.210762+0000","last_peered":"2024-09-11T01:05:45.210762+0000","last_clean":"2024-09-11T01:05:45.210762+0000","last_became_active":"2024-09-11T01:05:31.676689+0000","last_became_peered":"2024-09-11T01:05:31.676689+0000","last_unstale":"2024-09-11T01:05:45.210762+0000","last_undegraded":"2024-09-11T01:05:45.210762+0000","last_fullsized":"2024-09-11T01:05:45.210762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:51.899743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209589+0000","last_change":"2024-09-11T01:05:31.678994+0000","last_active":"2024-09-11T01:05:45.209589+0000","last_peered":"2024-09-11T01:05:45.209589+0000","last_clean":"2024-09-11T01:05:45.209589+0000","last_became_active":"2024-09-11T01:05:31.678675+0000","last_became_peered":"2024-09-11T01:05:31.678675+0000","last_unstale":"2024-09-11T01:05:45.209589+0000","last_undegraded":"2024-09-11T01:05:45.209589+0000","last_fullsized":"2024-09-11T01:05:45.209589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:35.740872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T01:06:40.586188+0000","last_change":"2024-09-11T01:05:31.680046+0000","last_active":"2024-09-11T01:06:40.586188+0000","last_peered":"2024-09-11T01:06:40.586188+0000","last_clean":"2024-09-11T01:06:40.586188+0000","last_became_active":"2024-09-11T01:05:31.679626+0000","last_became_peered":"2024-09-11T01:05:31.679626+0000","last_unstale":"2024-09-11T01:06:40.586188+0000","last_undegraded":"2024-09-11T01:06:40.586188+0000","last_fullsized":"2024-09-11T01:06:40.586188+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:15.260470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209311+0000","last_change":"2024-09-11T01:05:31.683545+0000","last_active":"2024-09-11T01:05:45.209311+0000","last_peered":"2024-09-11T01:05:45.209311+0000","last_clean":"2024-09-11T01:05:45.209311+0000","last_became_active":"2024-09-11T01:05:31.683166+0000","last_became_peered":"2024-09-11T01:05:31.683166+0000","last_unstale":"2024-09-11T01:05:45.209311+0000","last_undegraded":"2024-09-11T01:05:45.209311+0000","last_fullsized":"2024-09-11T01:05:45.209311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:57.378211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T01:06:40.585723+0000","last_change":"2024-09-11T01:05:31.678031+0000","last_active":"2024-09-11T01:06:40.585723+0000","last_peered":"2024-09-11T01:06:40.585723+0000","last_clean":"2024-09-11T01:06:40.585723+0000","last_became_active":"2024-09-11T01:05:31.677760+0000","last_became_peered":"2024-09-11T01:05:31.677760+0000","last_unstale":"2024-09-11T01:06:40.585723+0000","last_undegraded":"2024-09-11T01:06:40.585723+0000","last_fullsized":"2024-09-11T01:06:40.585723+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:39.252655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210686+0000","last_change":"2024-09-11T01:05:31.677991+0000","last_active":"2024-09-11T01:05:45.210686+0000","last_peered":"2024-09-11T01:05:45.210686+0000","last_clean":"2024-09-11T01:05:45.210686+0000","last_became_active":"2024-09-11T01:05:31.677670+0000","last_became_peered":"2024-09-11T01:05:31.677670+0000","last_unstale":"2024-09-11T01:05:45.210686+0000","last_undegraded":"2024-09-11T01:05:45.210686+0000","last_fullsized":"2024-09-11T01:05:45.210686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:55.622757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210322+0000","last_change":"2024-09-11T01:05:31.678213+0000","last_active":"2024-09-11T01:05:45.210322+0000","last_peered":"2024-09-11T01:05:45.210322+0000","last_clean":"2024-09-11T01:05:45.210322+0000","last_became_active":"2024-09-11T01:05:31.676422+0000","last_became_peered":"2024-09-11T01:05:31.676422+0000","last_unstale":"2024-09-11T01:05:45.210322+0000","last_undegraded":"2024-09-11T01:05:45.210322+0000","last_fullsized":"2024-09-11T01:05:45.210322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:29.096123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210395+0000","last_change":"2024-09-11T01:05:31.680945+0000","last_active":"2024-09-11T01:05:45.210395+0000","last_peered":"2024-09-11T01:05:45.210395+0000","last_clean":"2024-09-11T01:05:45.210395+0000","last_became_active":"2024-09-11T01:05:31.680458+0000","last_became_peered":"2024-09-11T01:05:31.680458+0000","last_unstale":"2024-09-11T01:05:45.210395+0000","last_undegraded":"2024-09-11T01:05:45.210395+0000","last_fullsized":"2024-09-11T01:05:45.210395+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:01.382341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209449+0000","last_change":"2024-09-11T01:05:31.685792+0000","last_active":"2024-09-11T01:05:45.209449+0000","last_peered":"2024-09-11T01:05:45.209449+0000","last_clean":"2024-09-11T01:05:45.209449+0000","last_became_active":"2024-09-11T01:05:31.685467+0000","last_became_peered":"2024-09-11T01:05:31.685467+0000","last_unstale":"2024-09-11T01:05:45.209449+0000","last_undegraded":"2024-09-11T01:05:45.209449+0000","last_fullsized":"2024-09-11T01:05:45.209449+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:37.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.123499+0000","last_change":"2024-09-11T01:05:31.678855+0000","last_active":"2024-09-11T01:05:45.123499+0000","last_peered":"2024-09-11T01:05:45.123499+0000","last_clean":"2024-09-11T01:05:45.123499+0000","last_became_active":"2024-09-11T01:05:31.678583+0000","last_became_peered":"2024-09-11T01:05:31.678583+0000","last_unstale":"2024-09-11T01:05:45.123499+0000","last_undegraded":"2024-09-11T01:05:45.123499+0000","last_fullsized":"2024-09-11T01:05:45.123499+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:24.112383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211042+0000","last_change":"2024-09-11T01:05:31.682261+0000","last_active":"2024-09-11T01:05:45.211042+0000","last_peered":"2024-09-11T01:05:45.211042+0000","last_clean":"2024-09-11T01:05:45.211042+0000","last_became_active":"2024-09-11T01:05:31.681924+0000","last_became_peered":"2024-09-11T01:05:31.681924+0000","last_unstale":"2024-09-11T01:05:45.211042+0000","last_undegraded":"2024-09-11T01:05:45.211042+0000","last_fullsized":"2024-09-11T01:05:45.211042+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:54.556438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.209929+0000","last_change":"2024-09-11T01:05:31.674687+0000","last_active":"2024-09-11T01:05:45.209929+0000","last_peered":"2024-09-11T01:05:45.209929+0000","last_clean":"2024-09-11T01:05:45.209929+0000","last_became_active":"2024-09-11T01:05:31.674348+0000","last_became_peered":"2024-09-11T01:05:31.674348+0000","last_unstale":"2024-09-11T01:05:45.209929+0000","last_undegraded":"2024-09-11T01:05:45.209929+0000","last_fullsized":"2024-09-11T01:05:45.209929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:46.086798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210030+0000","last_change":"2024-09-11T01:05:40.967775+0000","last_active":"2024-09-11T01:05:45.210030+0000","last_peered":"2024-09-11T01:05:45.210030+0000","last_clean":"2024-09-11T01:05:45.210030+0000","last_became_active":"2024-09-11T01:05:40.967355+0000","last_became_peered":"2024-09-11T01:05:40.967355+0000","last_unstale":"2024-09-11T01:05:45.210030+0000","last_undegraded":"2024-09-11T01:05:45.210030+0000","last_fullsized":"2024-09-11T01:05:45.210030+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:43.224010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210128+0000","last_change":"2024-09-11T01:05:31.674655+0000","last_active":"2024-09-11T01:05:45.210128+0000","last_peered":"2024-09-11T01:05:45.210128+0000","last_clean":"2024-09-11T01:05:45.210128+0000","last_became_active":"2024-09-11T01:05:31.674342+0000","last_became_peered":"2024-09-11T01:05:31.674342+0000","last_unstale":"2024-09-11T01:05:45.210128+0000","last_undegraded":"2024-09-11T01:05:45.210128+0000","last_fullsized":"2024-09-11T01:05:45.210128+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:28.593441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210236+0000","last_change":"2024-09-11T01:05:31.678521+0000","last_active":"2024-09-11T01:05:45.210236+0000","last_peered":"2024-09-11T01:05:45.210236+0000","last_clean":"2024-09-11T01:05:45.210236+0000","last_became_active":"2024-09-11T01:05:31.674828+0000","last_became_peered":"2024-09-11T01:05:31.674828+0000","last_unstale":"2024-09-11T01:05:45.210236+0000","last_undegraded":"2024-09-11T01:05:45.210236+0000","last_fullsized":"2024-09-11T01:05:45.210236+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:38.797887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210369+0000","last_change":"2024-09-11T01:05:31.685075+0000","last_active":"2024-09-11T01:05:45.210369+0000","last_peered":"2024-09-11T01:05:45.210369+0000","last_clean":"2024-09-11T01:05:45.210369+0000","last_became_active":"2024-09-11T01:05:31.684742+0000","last_became_peered":"2024-09-11T01:05:31.684742+0000","last_unstale":"2024-09-11T01:05:45.210369+0000","last_undegraded":"2024-09-11T01:05:45.210369+0000","last_fullsized":"2024-09-11T01:05:45.210369+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:29.381976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124625+0000","last_change":"2024-09-11T01:05:31.678921+0000","last_active":"2024-09-11T01:05:45.124625+0000","last_peered":"2024-09-11T01:05:45.124625+0000","last_clean":"2024-09-11T01:05:45.124625+0000","last_became_active":"2024-09-11T01:05:31.678547+0000","last_became_peered":"2024-09-11T01:05:31.678547+0000","last_unstale":"2024-09-11T01:05:45.124625+0000","last_undegraded":"2024-09-11T01:05:45.124625+0000","last_fullsized":"2024-09-11T01:05:45.124625+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:59.618685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211294+0000","last_change":"2024-09-11T01:05:31.685565+0000","last_active":"2024-09-11T01:05:45.211294+0000","last_peered":"2024-09-11T01:05:45.211294+0000","last_clean":"2024-09-11T01:05:45.211294+0000","last_became_active":"2024-09-11T01:05:31.685234+0000","last_became_peered":"2024-09-11T01:05:31.685234+0000","last_unstale":"2024-09-11T01:05:45.211294+0000","last_undegraded":"2024-09-11T01:05:45.211294+0000","last_fullsized":"2024-09-11T01:05:45.211294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:07.831922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.211517+0000","last_change":"2024-09-11T01:05:31.677464+0000","last_active":"2024-09-11T01:05:45.211517+0000","last_peered":"2024-09-11T01:05:45.211517+0000","last_clean":"2024-09-11T01:05:45.211517+0000","last_became_active":"2024-09-11T01:05:31.677161+0000","last_became_peered":"2024-09-11T01:05:31.677161+0000","last_unstale":"2024-09-11T01:05:45.211517+0000","last_undegraded":"2024-09-11T01:05:45.211517+0000","last_fullsized":"2024-09-11T01:05:45.211517+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:26.590429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-09-11T01:06:40.584746+0000","last_change":"2024-09-11T01:05:31.679977+0000","last_active":"2024-09-11T01:06:40.584746+0000","last_peered":"2024-09-11T01:06:40.584746+0000","last_clean":"2024-09-11T01:06:40.584746+0000","last_became_active":"2024-09-11T01:05:31.679661+0000","last_became_peered":"2024-09-11T01:05:31.679661+0000","last_unstale":"2024-09-11T01:06:40.584746+0000","last_undegraded":"2024-09-11T01:06:40.584746+0000","last_fullsized":"2024-09-11T01:06:40.584746+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:00.040651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124020+0000","last_change":"2024-09-11T01:05:31.685419+0000","last_active":"2024-09-11T01:05:45.124020+0000","last_peered":"2024-09-11T01:05:45.124020+0000","last_clean":"2024-09-11T01:05:45.124020+0000","last_became_active":"2024-09-11T01:05:31.684772+0000","last_became_peered":"2024-09-11T01:05:31.684772+0000","last_unstale":"2024-09-11T01:05:45.124020+0000","last_undegraded":"2024-09-11T01:05:45.124020+0000","last_fullsized":"2024-09-11T01:05:45.124020+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:19.283742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210644+0000","last_change":"2024-09-11T01:05:31.681691+0000","last_active":"2024-09-11T01:05:45.210644+0000","last_peered":"2024-09-11T01:05:45.210644+0000","last_clean":"2024-09-11T01:05:45.210644+0000","last_became_active":"2024-09-11T01:05:31.680549+0000","last_became_peered":"2024-09-11T01:05:31.680549+0000","last_unstale":"2024-09-11T01:05:45.210644+0000","last_undegraded":"2024-09-11T01:05:45.210644+0000","last_fullsized":"2024-09-11T01:05:45.210644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:15.561978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.124146+0000","last_change":"2024-09-11T01:05:31.687135+0000","last_active":"2024-09-11T01:05:45.124146+0000","last_peered":"2024-09-11T01:05:45.124146+0000","last_clean":"2024-09-11T01:05:45.124146+0000","last_became_active":"2024-09-11T01:05:31.686719+0000","last_became_peered":"2024-09-11T01:05:31.686719+0000","last_unstale":"2024-09-11T01:05:45.124146+0000","last_undegraded":"2024-09-11T01:05:45.124146+0000","last_fullsized":"2024-09-11T01:05:45.124146+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:42.044930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210192+0000","last_change":"2024-09-11T01:05:31.688154+0000","last_active":"2024-09-11T01:05:45.210192+0000","last_peered":"2024-09-11T01:05:45.210192+0000","last_clean":"2024-09-11T01:05:45.210192+0000","last_became_active":"2024-09-11T01:05:31.687734+0000","last_became_peered":"2024-09-11T01:05:31.687734+0000","last_unstale":"2024-09-11T01:05:45.210192+0000","last_undegraded":"2024-09-11T01:05:45.210192+0000","last_fullsized":"2024-09-11T01:05:45.210192+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:57.789086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210788+0000","last_change":"2024-09-11T01:05:31.679761+0000","last_active":"2024-09-11T01:05:45.210788+0000","last_peered":"2024-09-11T01:05:45.210788+0000","last_clean":"2024-09-11T01:05:45.210788+0000","last_became_active":"2024-09-11T01:05:31.679345+0000","last_became_peered":"2024-09-11T01:05:31.679345+0000","last_unstale":"2024-09-11T01:05:45.210788+0000","last_undegraded":"2024-09-11T01:05:45.210788+0000","last_fullsized":"2024-09-11T01:05:45.210788+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:28.480561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":30,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210976+0000","last_change":"2024-09-11T01:05:31.680782+0000","last_active":"2024-09-11T01:05:45.210976+0000","last_peered":"2024-09-11T01:05:45.210976+0000","last_clean":"2024-09-11T01:05:45.210976+0000","last_became_active":"2024-09-11T01:05:31.679984+0000","last_became_peered":"2024-09-11T01:05:31.679984+0000","last_unstale":"2024-09-11T01:05:45.210976+0000","last_undegraded":"2024-09-11T01:05:45.210976+0000","last_fullsized":"2024-09-11T01:05:45.210976+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:10.306868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-11T01:05:45.210891+0000","last_change":"2024-09-11T01:05:31.681462+0000","last_active":"2024-09-11T01:05:45.210891+0000","last_peered":"2024-09-11T01:05:45.210891+0000","last_clean":"2024-09-11T01:05:45.210891+0000","last_became_active":"2024-09-11T01:05:31.680799+0000","last_became_peered":"2024-09-11T01:05:31.680799+0000","last_unstale":"2024-09-11T01:05:45.210891+0000","last_undegraded":"2024-09-11T01:05:45.210891+0000","last_fullsized":"2024-09-11T01:05:45.210891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:56:44.512831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61137,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":137,"num_read_kb":134,"num_write":166,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1646,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":183411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645339,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36312,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708840,"statfs":{"total":95995035648,"available":95957852160,"internally_reserved":0,"allocated":991232,"data_stored":487554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841568,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28648,"kb_used_data":1624,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716504,"statfs":{"total":95995035648,"available":95965700096,"internally_reserved":0,"allocated":1662976,"data_stored":1131812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005092,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":491740,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201322,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":487452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397552,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36896,"kb_used_data":1552,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708256,"statfs":{"total":95995035648,"available":95957254144,"internally_reserved":0,"allocated":1589248,"data_stored":1083864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593781,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":482820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790011,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28584,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716568,"statfs":{"total":95995035648,"available":95965765632,"internally_reserved":0,"allocated":1597440,"data_stored":1079061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953536,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":544606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149766,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1003520,"data_stored":492509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":484437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":539475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":484208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:06:42.522 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T01:06:42.522 INFO:tasks.cephadm:Setting up client nodes... 2024-09-11T01:06:42.523 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-11T01:06:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:42 smithi103 ceph-mon[30562]: pgmap v349: 129 pgs: 129 active+clean; 636 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-11T01:06:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:42 smithi103 ceph-mon[30562]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T01:06:42.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:42 smithi117 ceph-mon[35358]: pgmap v349: 129 pgs: 129 active+clean; 636 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-11T01:06:42.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:42 smithi117 ceph-mon[35358]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T01:06:42.895 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:42.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:42 smithi183 ceph-mon[34992]: pgmap v349: 129 pgs: 129 active+clean; 636 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 KiB/s wr, 8 op/s 2024-09-11T01:06:42.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:42 smithi183 ceph-mon[34992]: osdmap e89: 12 total, 12 up, 12 in 2024-09-11T01:06:43.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.482+0000 7fa072000640 1 -- 172.21.15.103:0/1837208160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c104aa0 msgr2=0x7fa06c104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:43.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.482+0000 7fa072000640 1 --2- 172.21.15.103:0/1837208160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c104aa0 0x7fa06c104ea0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa060009930 tx=0x7fa06002a420 comp rx=0 tx=0).stop 2024-09-11T01:06:43.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.482+0000 7fa072000640 1 -- 172.21.15.103:0/1837208160 shutdown_connections 2024-09-11T01:06:43.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.482+0000 7fa072000640 1 --2- 172.21.15.103:0/1837208160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa06c1065c0 0x7fa06c10cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:43.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.482+0000 7fa072000640 1 --2- 172.21.15.103:0/1837208160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c105c00 0x7fa06c106080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:43.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.482+0000 7fa072000640 1 --2- 172.21.15.103:0/1837208160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c104aa0 0x7fa06c104ea0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:43.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.482+0000 7fa072000640 1 -- 172.21.15.103:0/1837208160 >> 172.21.15.103:0/1837208160 conn(0x7fa06c100370 msgr2=0x7fa06c1027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:43.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.482+0000 7fa072000640 1 -- 172.21.15.103:0/1837208160 shutdown_connections 2024-09-11T01:06:43.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.482+0000 7fa072000640 1 -- 172.21.15.103:0/1837208160 wait complete. 2024-09-11T01:06:43.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.483+0000 7fa072000640 1 Processor -- start 2024-09-11T01:06:43.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.483+0000 7fa072000640 1 -- start start 2024-09-11T01:06:43.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.483+0000 7fa072000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa06c104aa0 0x7fa06c19adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:43.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.483+0000 7fa072000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c105c00 0x7fa06c19b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:43.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.483+0000 7fa072000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c1065c0 0x7fa06c19c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:43.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.483+0000 7fa072000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c110750 con 0x7fa06c1065c0 2024-09-11T01:06:43.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.483+0000 7fa072000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1105d0 con 0x7fa06c105c00 2024-09-11T01:06:43.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.483+0000 7fa072000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa06c1108d0 con 0x7fa06c104aa0 2024-09-11T01:06:43.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.484+0000 7fa071600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c1065c0 0x7fa06c19c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:43.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.484+0000 7fa071600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c1065c0 0x7fa06c19c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55686/0 (socket says 172.21.15.103:55686) 2024-09-11T01:06:43.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.484+0000 7fa071600640 1 -- 172.21.15.103:0/257893324 learned_addr learned my addr 172.21.15.103:0/257893324 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:43.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.484+0000 7fa070c00640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa06c104aa0 0x7fa06c19adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:43.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.484+0000 7fa06be00640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c105c00 0x7fa06c19b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:43.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.484+0000 7fa071600640 1 -- 172.21.15.103:0/257893324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa06c104aa0 msgr2=0x7fa06c19adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:43.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.484+0000 7fa071600640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa06c104aa0 0x7fa06c19adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:43.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.484+0000 7fa071600640 1 -- 172.21.15.103:0/257893324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c105c00 msgr2=0x7fa06c19b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:43.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.484+0000 7fa071600640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c105c00 0x7fa06c19b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:43.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.484+0000 7fa071600640 1 -- 172.21.15.103:0/257893324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa06c19c920 con 0x7fa06c1065c0 2024-09-11T01:06:43.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.484+0000 7fa06be00640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c105c00 0x7fa06c19b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:06:43.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.484+0000 7fa071600640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c1065c0 0x7fa06c19c080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa064009fd0 tx=0x7fa06400b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:43.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.485+0000 7fa069600640 1 -- 172.21.15.103:0/257893324 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064017070 con 0x7fa06c1065c0 2024-09-11T01:06:43.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.485+0000 7fa069600640 1 -- 172.21.15.103:0/257893324 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa064003e20 con 0x7fa06c1065c0 2024-09-11T01:06:43.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.485+0000 7fa069600640 1 -- 172.21.15.103:0/257893324 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa064010460 con 0x7fa06c1065c0 2024-09-11T01:06:43.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.485+0000 7fa072000640 1 -- 172.21.15.103:0/257893324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa06c19cc10 con 0x7fa06c1065c0 2024-09-11T01:06:43.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.485+0000 7fa072000640 1 -- 172.21.15.103:0/257893324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa06c1a32f0 con 0x7fa06c1065c0 2024-09-11T01:06:43.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.486+0000 7fa072000640 1 -- 172.21.15.103:0/257893324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa06c10bdc0 con 0x7fa06c1065c0 2024-09-11T01:06:43.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.488+0000 7fa069600640 1 -- 172.21.15.103:0/257893324 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7fa064003970 con 0x7fa06c1065c0 2024-09-11T01:06:43.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.490+0000 7fa069600640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0540b5490 0x7fa0540b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:43.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.490+0000 7fa069600640 1 -- 172.21.15.103:0/257893324 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fa0640e5e00 con 0x7fa06c1065c0 2024-09-11T01:06:43.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.490+0000 7fa070c00640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0540b5490 0x7fa0540b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:43.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.491+0000 7fa070c00640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0540b5490 0x7fa0540b7950 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa060009900 tx=0x7fa060031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:43.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.492+0000 7fa069600640 1 -- 172.21.15.103:0/257893324 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa0640ac7d0 con 0x7fa06c1065c0 2024-09-11T01:06:43.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.750+0000 7fa072000640 1 -- 172.21.15.103:0/257893324 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fa06c02e5c0 con 0x7fa06c1065c0 2024-09-11T01:06:43.752 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:43 smithi103 ceph-mon[30562]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:06:43.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.753+0000 7fa069600640 1 -- 172.21.15.103:0/257893324 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7fa0640ac0d0 con 0x7fa06c1065c0 2024-09-11T01:06:43.755 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-11T01:06:43.755 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQAj7eBmmPbRLBAAUqzv9f1M1iSCa5kl5blK3A== 2024-09-11T01:06:43.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.756+0000 7fa072000640 1 -- 172.21.15.103:0/257893324 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0540b5490 msgr2=0x7fa0540b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:43.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.756+0000 7fa072000640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0540b5490 0x7fa0540b7950 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa060009900 tx=0x7fa060031450 comp rx=0 tx=0).stop 2024-09-11T01:06:43.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.756+0000 7fa072000640 1 -- 172.21.15.103:0/257893324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c1065c0 msgr2=0x7fa06c19c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:43.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.756+0000 7fa072000640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c1065c0 0x7fa06c19c080 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa064009fd0 tx=0x7fa06400b260 comp rx=0 tx=0).stop 2024-09-11T01:06:43.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.756+0000 7fa072000640 1 -- 172.21.15.103:0/257893324 shutdown_connections 2024-09-11T01:06:43.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.756+0000 7fa072000640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0540b5490 0x7fa0540b7950 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:43.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.756+0000 7fa072000640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa06c1065c0 0x7fa06c19c080 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:43.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.756+0000 7fa072000640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa06c105c00 0x7fa06c19b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:43.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.756+0000 7fa072000640 1 --2- 172.21.15.103:0/257893324 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa06c104aa0 0x7fa06c19adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:43.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.756+0000 7fa072000640 1 -- 172.21.15.103:0/257893324 >> 172.21.15.103:0/257893324 conn(0x7fa06c100370 msgr2=0x7fa06c108f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:43.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.757+0000 7fa072000640 1 -- 172.21.15.103:0/257893324 shutdown_connections 2024-09-11T01:06:43.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:43.757+0000 7fa072000640 1 -- 172.21.15.103:0/257893324 wait complete. 2024-09-11T01:06:43.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:43 smithi117 ceph-mon[35358]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:06:43.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:43 smithi183 ceph-mon[34992]: from='client.14871 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:06:44.610 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T01:06:44.610 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-11T01:06:44.610 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T01:06:44.690 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph config log 1 --format=json 2024-09-11T01:06:44.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:44 smithi103 ceph-mon[30562]: pgmap v351: 129 pgs: 129 active+clean; 636 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 14 B/s, 0 objects/s recovering 2024-09-11T01:06:44.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:44 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/257893324' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-11T01:06:44.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:44 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/257893324' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T01:06:44.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:44 smithi117 ceph-mon[35358]: pgmap v351: 129 pgs: 129 active+clean; 636 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 14 B/s, 0 objects/s recovering 2024-09-11T01:06:44.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:44 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/257893324' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-11T01:06:44.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:44 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/257893324' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T01:06:44.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:44 smithi183 ceph-mon[34992]: pgmap v351: 129 pgs: 129 active+clean; 636 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 14 B/s, 0 objects/s recovering 2024-09-11T01:06:44.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:44 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/257893324' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-11T01:06:44.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:44 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/257893324' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-11T01:06:45.102 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:45.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.676+0000 7f9f07e00640 1 -- 172.21.15.103:0/2970844014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f08104df0 msgr2=0x7f9f081051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:45.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.676+0000 7f9f07e00640 1 --2- 172.21.15.103:0/2970844014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f08104df0 0x7f9f081051d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8009900 tx=0x7f9ef802a3f0 comp rx=0 tx=0).stop 2024-09-11T01:06:45.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.676+0000 7f9f07e00640 1 -- 172.21.15.103:0/2970844014 shutdown_connections 2024-09-11T01:06:45.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.676+0000 7f9f07e00640 1 --2- 172.21.15.103:0/2970844014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f0810b180 0x7f9f08111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:45.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.676+0000 7f9f07e00640 1 --2- 172.21.15.103:0/2970844014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f0810a800 0x7f9f0810ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:45.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.676+0000 7f9f07e00640 1 --2- 172.21.15.103:0/2970844014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f08104df0 0x7f9f081051d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:45.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.676+0000 7f9f07e00640 1 -- 172.21.15.103:0/2970844014 >> 172.21.15.103:0/2970844014 conn(0x7f9f08100840 msgr2=0x7f9f08102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:45.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.676+0000 7f9f07e00640 1 -- 172.21.15.103:0/2970844014 shutdown_connections 2024-09-11T01:06:45.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.676+0000 7f9f07e00640 1 -- 172.21.15.103:0/2970844014 wait complete. 2024-09-11T01:06:45.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.677+0000 7f9f07e00640 1 Processor -- start 2024-09-11T01:06:45.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.677+0000 7f9f07e00640 1 -- start start 2024-09-11T01:06:45.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.678+0000 7f9f07e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f08104df0 0x7f9f0819b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:45.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.678+0000 7f9f07e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f0810a800 0x7f9f0819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:45.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.678+0000 7f9f07e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f0810b180 0x7f9f081a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:45.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.678+0000 7f9f07e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9f08114e90 con 0x7f9f08104df0 2024-09-11T01:06:45.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.678+0000 7f9f07e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9f08114d10 con 0x7f9f0810a800 2024-09-11T01:06:45.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.678+0000 7f9f07e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9f08115010 con 0x7f9f0810b180 2024-09-11T01:06:45.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.678+0000 7f9f06a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f08104df0 0x7f9f0819b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:45.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.678+0000 7f9f06a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f08104df0 0x7f9f0819b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55706/0 (socket says 172.21.15.103:55706) 2024-09-11T01:06:45.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.678+0000 7f9f06a00640 1 -- 172.21.15.103:0/3889482212 learned_addr learned my addr 172.21.15.103:0/3889482212 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.678+0000 7f9f06000640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f0810a800 0x7f9f0819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.678+0000 7f9f07400640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f0810b180 0x7f9f081a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.679+0000 7f9f06a00640 1 -- 172.21.15.103:0/3889482212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f0810b180 msgr2=0x7f9f081a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.679+0000 7f9f06a00640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f0810b180 0x7f9f081a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.679+0000 7f9f06a00640 1 -- 172.21.15.103:0/3889482212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f0810a800 msgr2=0x7f9f0819b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.679+0000 7f9f06a00640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f0810a800 0x7f9f0819b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.679+0000 7f9f06a00640 1 -- 172.21.15.103:0/3889482212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f081a12b0 con 0x7f9f08104df0 2024-09-11T01:06:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.679+0000 7f9f06000640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f0810a800 0x7f9f0819b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:06:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.679+0000 7f9f06a00640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f08104df0 0x7f9f0819b200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8005ab0 tx=0x7f9ef8003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.679+0000 7f9f0ca00640 1 -- 172.21.15.103:0/3889482212 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef803f070 con 0x7f9f08104df0 2024-09-11T01:06:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.679+0000 7f9f0ca00640 1 -- 172.21.15.103:0/3889482212 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9ef8031d60 con 0x7f9f08104df0 2024-09-11T01:06:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.679+0000 7f9f0ca00640 1 -- 172.21.15.103:0/3889482212 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8035030 con 0x7f9f08104df0 2024-09-11T01:06:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.679+0000 7f9f07e00640 1 -- 172.21.15.103:0/3889482212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f081a1540 con 0x7f9f08104df0 2024-09-11T01:06:45.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.679+0000 7f9f07e00640 1 -- 172.21.15.103:0/3889482212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f081a7c60 con 0x7f9f08104df0 2024-09-11T01:06:45.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.680+0000 7f9f07e00640 1 -- 172.21.15.103:0/3889482212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f081051d0 con 0x7f9f08104df0 2024-09-11T01:06:45.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.682+0000 7f9f0ca00640 1 -- 172.21.15.103:0/3889482212 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f9ef803b460 con 0x7f9f08104df0 2024-09-11T01:06:45.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.684+0000 7f9f0ca00640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9eec0b5410 0x7f9eec0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:45.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.684+0000 7f9f0ca00640 1 -- 172.21.15.103:0/3889482212 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f9ef8106cf0 con 0x7f9f08104df0 2024-09-11T01:06:45.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.684+0000 7f9f06000640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9eec0b5410 0x7f9eec0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:45.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.685+0000 7f9f06000640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9eec0b5410 0x7f9eec0b78d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4005d00 tx=0x7f9ef4005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:45.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.688+0000 7f9f0ca00640 1 -- 172.21.15.103:0/3889482212 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9ef80cd640 con 0x7f9f08104df0 2024-09-11T01:06:45.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.875+0000 7f9f07e00640 1 -- 172.21.15.103:0/3889482212 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f9f081a7f00 con 0x7f9f08104df0 2024-09-11T01:06:45.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.876+0000 7f9f0ca00640 1 -- 172.21.15.103:0/3889482212 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v51) ==== 86+0+133 (secure 0 0 0) 0x7f9ef80ccf40 con 0x7f9f08104df0 2024-09-11T01:06:45.877 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:06:45.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.878+0000 7f9f07e00640 1 -- 172.21.15.103:0/3889482212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9eec0b5410 msgr2=0x7f9eec0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.878+0000 7f9f07e00640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9eec0b5410 0x7f9eec0b78d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4005d00 tx=0x7f9ef4005c70 comp rx=0 tx=0).stop 2024-09-11T01:06:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.878+0000 7f9f07e00640 1 -- 172.21.15.103:0/3889482212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f08104df0 msgr2=0x7f9f0819b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.878+0000 7f9f07e00640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f08104df0 0x7f9f0819b200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8005ab0 tx=0x7f9ef8003c80 comp rx=0 tx=0).stop 2024-09-11T01:06:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.878+0000 7f9f07e00640 1 -- 172.21.15.103:0/3889482212 shutdown_connections 2024-09-11T01:06:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.878+0000 7f9f07e00640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9eec0b5410 0x7f9eec0b78d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.878+0000 7f9f07e00640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9f0810b180 0x7f9f081a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.878+0000 7f9f07e00640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9f0810a800 0x7f9f0819b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.878+0000 7f9f07e00640 1 --2- 172.21.15.103:0/3889482212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f08104df0 0x7f9f0819b200 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.878+0000 7f9f07e00640 1 -- 172.21.15.103:0/3889482212 >> 172.21.15.103:0/3889482212 conn(0x7f9f08100840 msgr2=0x7f9f08101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.878+0000 7f9f07e00640 1 -- 172.21.15.103:0/3889482212 shutdown_connections 2024-09-11T01:06:45.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:45.878+0000 7f9f07e00640 1 -- 172.21.15.103:0/3889482212 wait complete. 2024-09-11T01:06:46.742 INFO:teuthology.orchestra.run.smithi103.stdout:[{"version":51,"timestamp":"2024-09-11T01:05:19.971596+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-11T01:06:46.743 INFO:tasks.ceph_manager:config epoch is 51 2024-09-11T01:06:46.743 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T01:06:46.743 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-11T01:06:46.743 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph mgr dump --format=json 2024-09-11T01:06:46.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:46 smithi117 ceph-mon[35358]: pgmap v352: 129 pgs: 129 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.7 KiB/s wr, 9 op/s; 14 B/s, 0 objects/s recovering 2024-09-11T01:06:46.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:46 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3889482212' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-11T01:06:46.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:46 smithi183 ceph-mon[34992]: pgmap v352: 129 pgs: 129 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.7 KiB/s wr, 9 op/s; 14 B/s, 0 objects/s recovering 2024-09-11T01:06:46.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:46 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3889482212' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-11T01:06:47.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:46 smithi103 ceph-mon[30562]: pgmap v352: 129 pgs: 129 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.7 KiB/s wr, 9 op/s; 14 B/s, 0 objects/s recovering 2024-09-11T01:06:47.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:46 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3889482212' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-11T01:06:47.114 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:47.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.712+0000 7f17daa00640 1 -- 172.21.15.103:0/1340946908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17d410b180 msgr2=0x7f17d4111980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:47.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.712+0000 7f17daa00640 1 --2- 172.21.15.103:0/1340946908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17d410b180 0x7f17d4111980 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009900 tx=0x7f17cc02a3f0 comp rx=0 tx=0).stop 2024-09-11T01:06:47.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.712+0000 7f17daa00640 1 -- 172.21.15.103:0/1340946908 shutdown_connections 2024-09-11T01:06:47.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.712+0000 7f17daa00640 1 --2- 172.21.15.103:0/1340946908 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17d410b180 0x7f17d4111980 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:47.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.712+0000 7f17daa00640 1 --2- 172.21.15.103:0/1340946908 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17d410a800 0x7f17d410ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:47.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.712+0000 7f17daa00640 1 --2- 172.21.15.103:0/1340946908 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17d4104df0 0x7f17d41051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:47.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.712+0000 7f17daa00640 1 -- 172.21.15.103:0/1340946908 >> 172.21.15.103:0/1340946908 conn(0x7f17d4100840 msgr2=0x7f17d4102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:47.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.712+0000 7f17daa00640 1 -- 172.21.15.103:0/1340946908 shutdown_connections 2024-09-11T01:06:47.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.712+0000 7f17daa00640 1 -- 172.21.15.103:0/1340946908 wait complete. 2024-09-11T01:06:47.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.713+0000 7f17daa00640 1 Processor -- start 2024-09-11T01:06:47.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.713+0000 7f17daa00640 1 -- start start 2024-09-11T01:06:47.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17daa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17d4104df0 0x7f17d419b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:47.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17daa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17d410a800 0x7f17d419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:47.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17daa00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17d410b180 0x7f17d41a0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:47.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17daa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17d4114e00 con 0x7f17d4104df0 2024-09-11T01:06:47.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17daa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f17d4114c80 con 0x7f17d410a800 2024-09-11T01:06:47.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17daa00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f17d4114f80 con 0x7f17d410b180 2024-09-11T01:06:47.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17d8c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17d410a800 0x7f17d419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:47.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17d9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17d4104df0 0x7f17d419b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:47.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17d8c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17d410a800 0x7f17d419b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:42040/0 (socket says 172.21.15.103:42040) 2024-09-11T01:06:47.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17d8c00640 1 -- 172.21.15.103:0/2001758947 learned_addr learned my addr 172.21.15.103:0/2001758947 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:47.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17da000640 1 --2- 172.21.15.103:0/2001758947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17d410b180 0x7f17d41a0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:47.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17d8c00640 1 -- 172.21.15.103:0/2001758947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17d410b180 msgr2=0x7f17d41a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:47.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17d8c00640 1 --2- 172.21.15.103:0/2001758947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17d410b180 0x7f17d41a0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:47.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17d8c00640 1 -- 172.21.15.103:0/2001758947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17d4104df0 msgr2=0x7f17d419b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:47.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17d8c00640 1 --2- 172.21.15.103:0/2001758947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17d4104df0 0x7f17d419b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:47.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.714+0000 7f17d8c00640 1 -- 172.21.15.103:0/2001758947 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17d41a1320 con 0x7f17d410a800 2024-09-11T01:06:47.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.715+0000 7f17d8c00640 1 --2- 172.21.15.103:0/2001758947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17d410a800 0x7f17d419b7b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17c000d950 tx=0x7f17c000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:47.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.715+0000 7f17d2000640 1 -- 172.21.15.103:0/2001758947 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c0017030 con 0x7f17d410a800 2024-09-11T01:06:47.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.715+0000 7f17daa00640 1 -- 172.21.15.103:0/2001758947 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17d41a1610 con 0x7f17d410a800 2024-09-11T01:06:47.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.715+0000 7f17d2000640 1 -- 172.21.15.103:0/2001758947 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17c0004020 con 0x7f17d410a800 2024-09-11T01:06:47.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.715+0000 7f17d2000640 1 -- 172.21.15.103:0/2001758947 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17c00047a0 con 0x7f17d410a800 2024-09-11T01:06:47.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.715+0000 7f17daa00640 1 -- 172.21.15.103:0/2001758947 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17d41a7cd0 con 0x7f17d410a800 2024-09-11T01:06:47.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.716+0000 7f17daa00640 1 -- 172.21.15.103:0/2001758947 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17d41051d0 con 0x7f17d410a800 2024-09-11T01:06:47.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.719+0000 7f17d2000640 1 -- 172.21.15.103:0/2001758947 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f17c0009a30 con 0x7f17d410a800 2024-09-11T01:06:47.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.721+0000 7f17d2000640 1 --2- 172.21.15.103:0/2001758947 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f17bc0b5410 0x7f17bc0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:47.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.721+0000 7f17d2000640 1 -- 172.21.15.103:0/2001758947 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f17c00e5a40 con 0x7f17d410a800 2024-09-11T01:06:47.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.721+0000 7f17d9600640 1 --2- 172.21.15.103:0/2001758947 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f17bc0b5410 0x7f17bc0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:47.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.722+0000 7f17d9600640 1 --2- 172.21.15.103:0/2001758947 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f17bc0b5410 0x7f17bc0b78d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f17c8005fd0 tx=0x7f17c8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:47.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.722+0000 7f17d2000640 1 -- 172.21.15.103:0/2001758947 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f17c00ac390 con 0x7f17d410a800 2024-09-11T01:06:47.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.954+0000 7f17daa00640 1 -- 172.21.15.103:0/2001758947 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f17d419c3a0 con 0x7f17d410a800 2024-09-11T01:06:47.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.959+0000 7f17d2000640 1 -- 172.21.15.103:0/2001758947 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+294225 (secure 0 0 0) 0x7f17d419c3a0 con 0x7f17d410a800 2024-09-11T01:06:47.965 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:06:47.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.963+0000 7f17daa00640 1 -- 172.21.15.103:0/2001758947 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f17bc0b5410 msgr2=0x7f17bc0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:47.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.963+0000 7f17daa00640 1 --2- 172.21.15.103:0/2001758947 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f17bc0b5410 0x7f17bc0b78d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f17c8005fd0 tx=0x7f17c8009680 comp rx=0 tx=0).stop 2024-09-11T01:06:47.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.963+0000 7f17daa00640 1 -- 172.21.15.103:0/2001758947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17d410a800 msgr2=0x7f17d419b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:47.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.963+0000 7f17daa00640 1 --2- 172.21.15.103:0/2001758947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17d410a800 0x7f17d419b7b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17c000d950 tx=0x7f17c000de10 comp rx=0 tx=0).stop 2024-09-11T01:06:47.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.963+0000 7f17daa00640 1 -- 172.21.15.103:0/2001758947 shutdown_connections 2024-09-11T01:06:47.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.963+0000 7f17daa00640 1 --2- 172.21.15.103:0/2001758947 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f17bc0b5410 0x7f17bc0b78d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:47.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.963+0000 7f17daa00640 1 --2- 172.21.15.103:0/2001758947 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17d410b180 0x7f17d41a0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:47.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.963+0000 7f17daa00640 1 --2- 172.21.15.103:0/2001758947 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17d410a800 0x7f17d419b7b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:47.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.963+0000 7f17daa00640 1 --2- 172.21.15.103:0/2001758947 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17d4104df0 0x7f17d419b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:47.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.963+0000 7f17daa00640 1 -- 172.21.15.103:0/2001758947 >> 172.21.15.103:0/2001758947 conn(0x7f17d4100840 msgr2=0x7f17d4101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:47.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.963+0000 7f17daa00640 1 -- 172.21.15.103:0/2001758947 shutdown_connections 2024-09-11T01:06:47.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:47.963+0000 7f17daa00640 1 -- 172.21.15.103:0/2001758947 wait complete. 2024-09-11T01:06:48.836 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3230239737},{"type":"v1","addr":"172.21.15.103:6801","nonce":3230239737}]},"active_addr":"172.21.15.103:6801/3230239737","active_change":"2024-09-11T00:57:39.411554+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24142,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24170,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.103:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":1474968635}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":2990920642}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":3930871094}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":4067976787}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":1559225640}]}]} 2024-09-11T01:06:48.842 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-11T01:06:48.842 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-11T01:06:48.842 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T01:06:48.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:48 smithi117 ceph-mon[35358]: pgmap v353: 129 pgs: 129 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.7 KiB/s wr, 7 op/s; 14 B/s, 0 objects/s recovering 2024-09-11T01:06:48.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:48 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2001758947' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-11T01:06:48.891 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:48 smithi103 ceph-mon[30562]: pgmap v353: 129 pgs: 129 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.7 KiB/s wr, 7 op/s; 14 B/s, 0 objects/s recovering 2024-09-11T01:06:48.891 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:48 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2001758947' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-11T01:06:48.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:48 smithi183 ceph-mon[34992]: pgmap v353: 129 pgs: 129 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 2.7 KiB/s wr, 7 op/s; 14 B/s, 0 objects/s recovering 2024-09-11T01:06:48.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:48 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2001758947' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-11T01:06:49.214 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:49.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.778+0000 7f26df400640 1 -- 172.21.15.103:0/2955575526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d8109130 msgr2=0x7f26d810f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:49.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.778+0000 7f26df400640 1 --2- 172.21.15.103:0/2955575526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d8109130 0x7f26d810f930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f26d0009ca0 tx=0x7f26d002a8c0 comp rx=0 tx=0).stop 2024-09-11T01:06:49.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.779+0000 7f26df400640 1 -- 172.21.15.103:0/2955575526 shutdown_connections 2024-09-11T01:06:49.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.779+0000 7f26df400640 1 --2- 172.21.15.103:0/2955575526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d8109130 0x7f26d810f930 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:49.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.779+0000 7f26df400640 1 --2- 172.21.15.103:0/2955575526 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26d81087b0 0x7f26d8108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:49.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.779+0000 7f26df400640 1 --2- 172.21.15.103:0/2955575526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26d8102da0 0x7f26d8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:49.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.779+0000 7f26df400640 1 -- 172.21.15.103:0/2955575526 >> 172.21.15.103:0/2955575526 conn(0x7f26d80fe810 msgr2=0x7f26d8100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:49.781 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.779+0000 7f26df400640 1 -- 172.21.15.103:0/2955575526 shutdown_connections 2024-09-11T01:06:49.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.779+0000 7f26df400640 1 -- 172.21.15.103:0/2955575526 wait complete. 2024-09-11T01:06:49.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.780+0000 7f26df400640 1 Processor -- start 2024-09-11T01:06:49.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.780+0000 7f26df400640 1 -- start start 2024-09-11T01:06:49.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.780+0000 7f26df400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26d8102da0 0x7f26d8109920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:49.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.780+0000 7f26df400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26d81087b0 0x7f26d8109e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:49.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.780+0000 7f26df400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d8109130 0x7f26d810a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:49.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.780+0000 7f26df400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f26d8112df0 con 0x7f26d8109130 2024-09-11T01:06:49.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.780+0000 7f26df400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f26d8112c70 con 0x7f26d81087b0 2024-09-11T01:06:49.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.780+0000 7f26df400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f26d8112f70 con 0x7f26d8102da0 2024-09-11T01:06:49.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.780+0000 7f26dd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d8109130 0x7f26d810a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:49.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.780+0000 7f26dca00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26d8102da0 0x7f26d8109920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:49.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.781+0000 7f26dca00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26d8102da0 0x7f26d8109920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:57338/0 (socket says 172.21.15.103:57338) 2024-09-11T01:06:49.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.781+0000 7f26dca00640 1 -- 172.21.15.103:0/2231088587 learned_addr learned my addr 172.21.15.103:0/2231088587 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.781+0000 7f26d7e00640 1 --2- 172.21.15.103:0/2231088587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26d81087b0 0x7f26d8109e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.781+0000 7f26dca00640 1 -- 172.21.15.103:0/2231088587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26d81087b0 msgr2=0x7f26d8109e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.781+0000 7f26dca00640 1 --2- 172.21.15.103:0/2231088587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26d81087b0 0x7f26d8109e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.781+0000 7f26dca00640 1 -- 172.21.15.103:0/2231088587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d8109130 msgr2=0x7f26d810a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.781+0000 7f26dca00640 1 --2- 172.21.15.103:0/2231088587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d8109130 0x7f26d810a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.781+0000 7f26dca00640 1 -- 172.21.15.103:0/2231088587 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26d81aba20 con 0x7f26d8102da0 2024-09-11T01:06:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.781+0000 7f26dca00640 1 --2- 172.21.15.103:0/2231088587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26d8102da0 0x7f26d8109920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00e9f0 tx=0x7f26cc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.781+0000 7f26d5600640 1 -- 172.21.15.103:0/2231088587 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc00cd80 con 0x7f26d8102da0 2024-09-11T01:06:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.782+0000 7f26df400640 1 -- 172.21.15.103:0/2231088587 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26d81abd10 con 0x7f26d8102da0 2024-09-11T01:06:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.782+0000 7f26d5600640 1 -- 172.21.15.103:0/2231088587 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f26cc0108e0 con 0x7f26d8102da0 2024-09-11T01:06:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.782+0000 7f26d5600640 1 -- 172.21.15.103:0/2231088587 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26cc018980 con 0x7f26d8102da0 2024-09-11T01:06:49.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.782+0000 7f26df400640 1 -- 172.21.15.103:0/2231088587 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26d81ac1f0 con 0x7f26d8102da0 2024-09-11T01:06:49.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.783+0000 7f26df400640 1 -- 172.21.15.103:0/2231088587 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26d8103180 con 0x7f26d8102da0 2024-09-11T01:06:49.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.785+0000 7f26d5600640 1 -- 172.21.15.103:0/2231088587 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f26cc010430 con 0x7f26d8102da0 2024-09-11T01:06:49.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.786+0000 7f26d5600640 1 --2- 172.21.15.103:0/2231088587 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f26c00b5370 0x7f26c00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:49.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.787+0000 7f26d5600640 1 -- 172.21.15.103:0/2231088587 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f26cc0e66e0 con 0x7f26d8102da0 2024-09-11T01:06:49.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.787+0000 7f26d7e00640 1 --2- 172.21.15.103:0/2231088587 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f26c00b5370 0x7f26c00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:49.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.787+0000 7f26d7e00640 1 --2- 172.21.15.103:0/2231088587 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f26c00b5370 0x7f26c00b7830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f26c40095f0 tx=0x7f26c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:49.789 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.788+0000 7f26d5600640 1 -- 172.21.15.103:0/2231088587 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f26cc0ac9e0 con 0x7f26d8102da0 2024-09-11T01:06:49.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.974+0000 7f26df400640 1 -- 172.21.15.103:0/2231088587 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26d802e690 con 0x7f26d8102da0 2024-09-11T01:06:49.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.976+0000 7f26d5600640 1 -- 172.21.15.103:0/2231088587 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24984 (secure 0 0 0) 0x7f26cc0b1410 con 0x7f26d8102da0 2024-09-11T01:06:49.978 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:06:49.978 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","created":"2024-09-11T00:56:46.242882+0000","modified":"2024-09-11T01:06:41.586918+0000","last_up_change":"2024-09-11T01:04:34.895368+0000","last_in_change":"2024-09-11T01:04:11.663436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:00:33.745338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T01:05:27.486014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T01:05:29.797513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T01:05:38.956635+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1b3e4222-43fd-4af0-bf97-3ba1000221b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6803","nonce":1867193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6805","nonce":1867193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6809","nonce":1867193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6807","nonce":1867193874}]},"public_addr":"172.21.15.103:6803/1867193874","cluster_addr":"172.21.15.103:6805/1867193874","heartbeat_back_addr":"172.21.15.103:6809/1867193874","heartbeat_front_addr":"172.21.15.103:6807/1867193874","state":["exists","up"]},{"osd":1,"uuid":"9a2b40da-7361-4c4f-a9dc-a769b427a0fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6801","nonce":2629532556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6803","nonce":2629532556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6807","nonce":2629532556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6805","nonce":2629532556}]},"public_addr":"172.21.15.117:6801/2629532556","cluster_addr":"172.21.15.117:6803/2629532556","heartbeat_back_addr":"172.21.15.117:6807/2629532556","heartbeat_front_addr":"172.21.15.117:6805/2629532556","state":["exists","up"]},{"osd":2,"uuid":"5db919c1-90a7-4ba7-acf3-89eeb77ae131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6801","nonce":3208966770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6803","nonce":3208966770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6807","nonce":3208966770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6805","nonce":3208966770}]},"public_addr":"172.21.15.183:6801/3208966770","cluster_addr":"172.21.15.183:6803/3208966770","heartbeat_back_addr":"172.21.15.183:6807/3208966770","heartbeat_front_addr":"172.21.15.183:6805/3208966770","state":["exists","up"]},{"osd":3,"uuid":"bdc465f2-06a5-4667-9651-4e168700d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6811","nonce":2238128162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6813","nonce":2238128162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6817","nonce":2238128162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6815","nonce":2238128162}]},"public_addr":"172.21.15.103:6811/2238128162","cluster_addr":"172.21.15.103:6813/2238128162","heartbeat_back_addr":"172.21.15.103:6817/2238128162","heartbeat_front_addr":"172.21.15.103:6815/2238128162","state":["exists","up"]},{"osd":4,"uuid":"be86a5d2-5e86-4bf4-8464-9dff7a801e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6809","nonce":2368878504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6811","nonce":2368878504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6815","nonce":2368878504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6813","nonce":2368878504}]},"public_addr":"172.21.15.117:6809/2368878504","cluster_addr":"172.21.15.117:6811/2368878504","heartbeat_back_addr":"172.21.15.117:6815/2368878504","heartbeat_front_addr":"172.21.15.117:6813/2368878504","state":["exists","up"]},{"osd":5,"uuid":"090b20ec-d9ff-4e10-ad9f-52ab41dbf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6809","nonce":1668069547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6811","nonce":1668069547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6815","nonce":1668069547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6813","nonce":1668069547}]},"public_addr":"172.21.15.183:6809/1668069547","cluster_addr":"172.21.15.183:6811/1668069547","heartbeat_back_addr":"172.21.15.183:6815/1668069547","heartbeat_front_addr":"172.21.15.183:6813/1668069547","state":["exists","up"]},{"osd":6,"uuid":"19abe982-3522-40f9-a628-ddaef462cdb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6819","nonce":4203476972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6821","nonce":4203476972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6825","nonce":4203476972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6823","nonce":4203476972}]},"public_addr":"172.21.15.103:6819/4203476972","cluster_addr":"172.21.15.103:6821/4203476972","heartbeat_back_addr":"172.21.15.103:6825/4203476972","heartbeat_front_addr":"172.21.15.103:6823/4203476972","state":["exists","up"]},{"osd":7,"uuid":"e875ff09-805a-40ff-9d6a-dd2607ce3432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6817","nonce":1207680713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6819","nonce":1207680713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6823","nonce":1207680713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6821","nonce":1207680713}]},"public_addr":"172.21.15.117:6817/1207680713","cluster_addr":"172.21.15.117:6819/1207680713","heartbeat_back_addr":"172.21.15.117:6823/1207680713","heartbeat_front_addr":"172.21.15.117:6821/1207680713","state":["exists","up"]},{"osd":8,"uuid":"2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6817","nonce":2935820593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6819","nonce":2935820593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6823","nonce":2935820593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6821","nonce":2935820593}]},"public_addr":"172.21.15.183:6817/2935820593","cluster_addr":"172.21.15.183:6819/2935820593","heartbeat_back_addr":"172.21.15.183:6823/2935820593","heartbeat_front_addr":"172.21.15.183:6821/2935820593","state":["exists","up"]},{"osd":9,"uuid":"c36d17d2-0bc8-4322-a998-9c8eff970e58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6827","nonce":2104855877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6829","nonce":2104855877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6833","nonce":2104855877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6831","nonce":2104855877}]},"public_addr":"172.21.15.103:6827/2104855877","cluster_addr":"172.21.15.103:6829/2104855877","heartbeat_back_addr":"172.21.15.103:6833/2104855877","heartbeat_front_addr":"172.21.15.103:6831/2104855877","state":["exists","up"]},{"osd":10,"uuid":"e71bc5f7-a829-43cf-a10b-b2444da1d773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6825","nonce":3792981873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6827","nonce":3792981873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6831","nonce":3792981873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6829","nonce":3792981873}]},"public_addr":"172.21.15.117:6825/3792981873","cluster_addr":"172.21.15.117:6827/3792981873","heartbeat_back_addr":"172.21.15.117:6831/3792981873","heartbeat_front_addr":"172.21.15.117:6829/3792981873","state":["exists","up"]},{"osd":11,"uuid":"8f36697f-4d18-4efa-bf14-d68a13464958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6825","nonce":1250387289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6827","nonce":1250387289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6831","nonce":1250387289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6829","nonce":1250387289}]},"public_addr":"172.21.15.183:6825/1250387289","cluster_addr":"172.21.15.183:6827/1250387289","heartbeat_back_addr":"172.21.15.183:6831/1250387289","heartbeat_front_addr":"172.21.15.183:6829/1250387289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:59:39.916330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:06.042858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:30.703648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:59.493376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:25.190299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:50.480326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:20.815441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:46.398318+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:11.499922+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:41.895096+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:08.411538+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:32.943466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/366890372":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6800/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2372812363":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2844264136":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/2046654364":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6801/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/211510947":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6801/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6800/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/189409602":"2024-09-12T00:57:11.412015+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:06:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.978+0000 7f26df400640 1 -- 172.21.15.103:0/2231088587 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f26c00b5370 msgr2=0x7f26c00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.978+0000 7f26df400640 1 --2- 172.21.15.103:0/2231088587 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f26c00b5370 0x7f26c00b7830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f26c40095f0 tx=0x7f26c4005f90 comp rx=0 tx=0).stop 2024-09-11T01:06:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.978+0000 7f26df400640 1 -- 172.21.15.103:0/2231088587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26d8102da0 msgr2=0x7f26d8109920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.978+0000 7f26df400640 1 --2- 172.21.15.103:0/2231088587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26d8102da0 0x7f26d8109920 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00e9f0 tx=0x7f26cc00eeb0 comp rx=0 tx=0).stop 2024-09-11T01:06:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.978+0000 7f26df400640 1 -- 172.21.15.103:0/2231088587 shutdown_connections 2024-09-11T01:06:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.978+0000 7f26df400640 1 --2- 172.21.15.103:0/2231088587 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f26c00b5370 0x7f26c00b7830 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.978+0000 7f26df400640 1 --2- 172.21.15.103:0/2231088587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26d8109130 0x7f26d810a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.978+0000 7f26df400640 1 --2- 172.21.15.103:0/2231088587 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f26d81087b0 0x7f26d8109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.978+0000 7f26df400640 1 --2- 172.21.15.103:0/2231088587 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f26d8102da0 0x7f26d8109920 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.978+0000 7f26df400640 1 -- 172.21.15.103:0/2231088587 >> 172.21.15.103:0/2231088587 conn(0x7f26d80fe810 msgr2=0x7f26d8104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:49.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.978+0000 7f26df400640 1 -- 172.21.15.103:0/2231088587 shutdown_connections 2024-09-11T01:06:49.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:49.978+0000 7f26df400640 1 -- 172.21.15.103:0/2231088587 wait complete. 2024-09-11T01:06:50.856 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-11T01:06:50.857 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T01:06:50.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:50 smithi117 ceph-mon[35358]: pgmap v354: 129 pgs: 129 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 915 B/s wr, 5 op/s; 13 B/s, 0 objects/s recovering 2024-09-11T01:06:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:50 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2231088587' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:50.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:50 smithi103 ceph-mon[30562]: pgmap v354: 129 pgs: 129 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 915 B/s wr, 5 op/s; 13 B/s, 0 objects/s recovering 2024-09-11T01:06:50.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:50 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2231088587' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:50.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:50 smithi183 ceph-mon[34992]: pgmap v354: 129 pgs: 129 active+clean; 642 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 915 B/s wr, 5 op/s; 13 B/s, 0 objects/s recovering 2024-09-11T01:06:50.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:50 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2231088587' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:51.228 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:51.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.821+0000 7fccee800640 1 -- 172.21.15.103:0/36672621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce8102dc0 msgr2=0x7fcce81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:51.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.821+0000 7fccee800640 1 --2- 172.21.15.103:0/36672621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce8102dc0 0x7fcce81031a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fccd8009900 tx=0x7fccd802a410 comp rx=0 tx=0).stop 2024-09-11T01:06:51.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.821+0000 7fccee800640 1 -- 172.21.15.103:0/36672621 shutdown_connections 2024-09-11T01:06:51.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.821+0000 7fccee800640 1 --2- 172.21.15.103:0/36672621 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce8109150 0x7fcce810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:51.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.821+0000 7fccee800640 1 --2- 172.21.15.103:0/36672621 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcce81087d0 0x7fcce8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:51.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.821+0000 7fccee800640 1 --2- 172.21.15.103:0/36672621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce8102dc0 0x7fcce81031a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:51.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.821+0000 7fccee800640 1 -- 172.21.15.103:0/36672621 >> 172.21.15.103:0/36672621 conn(0x7fcce80fe830 msgr2=0x7fcce8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:51.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.822+0000 7fccee800640 1 -- 172.21.15.103:0/36672621 shutdown_connections 2024-09-11T01:06:51.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.822+0000 7fccee800640 1 -- 172.21.15.103:0/36672621 wait complete. 2024-09-11T01:06:51.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.822+0000 7fccee800640 1 Processor -- start 2024-09-11T01:06:51.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.823+0000 7fccee800640 1 -- start start 2024-09-11T01:06:51.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.823+0000 7fccee800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce8102dc0 0x7fcce819b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:51.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.823+0000 7fccee800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcce81087d0 0x7fcce819ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:51.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.823+0000 7fccee800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce8109150 0x7fcce81a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:51.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.823+0000 7fccee800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcce8112e60 con 0x7fcce8109150 2024-09-11T01:06:51.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.823+0000 7fccee800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcce8112ce0 con 0x7fcce81087d0 2024-09-11T01:06:51.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.823+0000 7fccee800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcce8112fe0 con 0x7fcce8102dc0 2024-09-11T01:06:51.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.823+0000 7fcce7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce8109150 0x7fcce81a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:51.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.823+0000 7fcce7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce8109150 0x7fcce81a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37486/0 (socket says 172.21.15.103:37486) 2024-09-11T01:06:51.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.823+0000 7fcce7e00640 1 -- 172.21.15.103:0/3878341391 learned_addr learned my addr 172.21.15.103:0/3878341391 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:51.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.823+0000 7fcce7400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce8102dc0 0x7fcce819b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:51.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.823+0000 7fccdfe00640 1 --2- 172.21.15.103:0/3878341391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcce81087d0 0x7fcce819ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:51.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.824+0000 7fcce7e00640 1 -- 172.21.15.103:0/3878341391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce8102dc0 msgr2=0x7fcce819b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:51.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.824+0000 7fcce7e00640 1 --2- 172.21.15.103:0/3878341391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce8102dc0 0x7fcce819b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:51.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.824+0000 7fcce7e00640 1 -- 172.21.15.103:0/3878341391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcce81087d0 msgr2=0x7fcce819ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:51.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.824+0000 7fcce7e00640 1 --2- 172.21.15.103:0/3878341391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcce81087d0 0x7fcce819ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:51.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.824+0000 7fcce7e00640 1 -- 172.21.15.103:0/3878341391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce81a15a0 con 0x7fcce8109150 2024-09-11T01:06:51.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.824+0000 7fcce7e00640 1 --2- 172.21.15.103:0/3878341391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce8109150 0x7fcce81a0dd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcce000eb10 tx=0x7fcce000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:51.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.824+0000 7fcce4c00640 1 -- 172.21.15.103:0/3878341391 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0004b20 con 0x7fcce8109150 2024-09-11T01:06:51.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.824+0000 7fcce4c00640 1 -- 172.21.15.103:0/3878341391 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcce0004cc0 con 0x7fcce8109150 2024-09-11T01:06:51.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.824+0000 7fccee800640 1 -- 172.21.15.103:0/3878341391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce81a1890 con 0x7fcce8109150 2024-09-11T01:06:51.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.824+0000 7fcce4c00640 1 -- 172.21.15.103:0/3878341391 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0010670 con 0x7fcce8109150 2024-09-11T01:06:51.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.824+0000 7fccee800640 1 -- 172.21.15.103:0/3878341391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce81a7f50 con 0x7fcce8109150 2024-09-11T01:06:51.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.825+0000 7fccee800640 1 -- 172.21.15.103:0/3878341391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce81031a0 con 0x7fcce8109150 2024-09-11T01:06:51.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.827+0000 7fcce4c00640 1 -- 172.21.15.103:0/3878341391 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7fcce0005020 con 0x7fcce8109150 2024-09-11T01:06:51.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.830+0000 7fcce4c00640 1 --2- 172.21.15.103:0/3878341391 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcccc0b53f0 0x7fcccc0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:51.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.830+0000 7fcce4c00640 1 -- 172.21.15.103:0/3878341391 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fcce00e6650 con 0x7fcce8109150 2024-09-11T01:06:51.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.830+0000 7fcce7400640 1 --2- 172.21.15.103:0/3878341391 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcccc0b53f0 0x7fcccc0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:51.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.831+0000 7fcce7400640 1 --2- 172.21.15.103:0/3878341391 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcccc0b53f0 0x7fcccc0b78b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fccd8005ab0 tx=0x7fccd8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:51.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:51.834+0000 7fcce4c00640 1 -- 172.21.15.103:0/3878341391 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcce00acfa0 con 0x7fcce8109150 2024-09-11T01:06:52.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:52.019+0000 7fccee800640 1 -- 172.21.15.103:0/3878341391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcce81a8410 con 0x7fcce8109150 2024-09-11T01:06:52.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:52.021+0000 7fcce4c00640 1 -- 172.21.15.103:0/3878341391 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24984 (secure 0 0 0) 0x7fcce00ac8a0 con 0x7fcce8109150 2024-09-11T01:06:52.023 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:06:52.023 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","created":"2024-09-11T00:56:46.242882+0000","modified":"2024-09-11T01:06:41.586918+0000","last_up_change":"2024-09-11T01:04:34.895368+0000","last_in_change":"2024-09-11T01:04:11.663436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:00:33.745338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T01:05:27.486014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T01:05:29.797513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T01:05:38.956635+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1b3e4222-43fd-4af0-bf97-3ba1000221b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6803","nonce":1867193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6805","nonce":1867193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6809","nonce":1867193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6807","nonce":1867193874}]},"public_addr":"172.21.15.103:6803/1867193874","cluster_addr":"172.21.15.103:6805/1867193874","heartbeat_back_addr":"172.21.15.103:6809/1867193874","heartbeat_front_addr":"172.21.15.103:6807/1867193874","state":["exists","up"]},{"osd":1,"uuid":"9a2b40da-7361-4c4f-a9dc-a769b427a0fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6801","nonce":2629532556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6803","nonce":2629532556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6807","nonce":2629532556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6805","nonce":2629532556}]},"public_addr":"172.21.15.117:6801/2629532556","cluster_addr":"172.21.15.117:6803/2629532556","heartbeat_back_addr":"172.21.15.117:6807/2629532556","heartbeat_front_addr":"172.21.15.117:6805/2629532556","state":["exists","up"]},{"osd":2,"uuid":"5db919c1-90a7-4ba7-acf3-89eeb77ae131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6801","nonce":3208966770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6803","nonce":3208966770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6807","nonce":3208966770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6805","nonce":3208966770}]},"public_addr":"172.21.15.183:6801/3208966770","cluster_addr":"172.21.15.183:6803/3208966770","heartbeat_back_addr":"172.21.15.183:6807/3208966770","heartbeat_front_addr":"172.21.15.183:6805/3208966770","state":["exists","up"]},{"osd":3,"uuid":"bdc465f2-06a5-4667-9651-4e168700d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6811","nonce":2238128162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6813","nonce":2238128162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6817","nonce":2238128162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6815","nonce":2238128162}]},"public_addr":"172.21.15.103:6811/2238128162","cluster_addr":"172.21.15.103:6813/2238128162","heartbeat_back_addr":"172.21.15.103:6817/2238128162","heartbeat_front_addr":"172.21.15.103:6815/2238128162","state":["exists","up"]},{"osd":4,"uuid":"be86a5d2-5e86-4bf4-8464-9dff7a801e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6809","nonce":2368878504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6811","nonce":2368878504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6815","nonce":2368878504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6813","nonce":2368878504}]},"public_addr":"172.21.15.117:6809/2368878504","cluster_addr":"172.21.15.117:6811/2368878504","heartbeat_back_addr":"172.21.15.117:6815/2368878504","heartbeat_front_addr":"172.21.15.117:6813/2368878504","state":["exists","up"]},{"osd":5,"uuid":"090b20ec-d9ff-4e10-ad9f-52ab41dbf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6809","nonce":1668069547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6811","nonce":1668069547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6815","nonce":1668069547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6813","nonce":1668069547}]},"public_addr":"172.21.15.183:6809/1668069547","cluster_addr":"172.21.15.183:6811/1668069547","heartbeat_back_addr":"172.21.15.183:6815/1668069547","heartbeat_front_addr":"172.21.15.183:6813/1668069547","state":["exists","up"]},{"osd":6,"uuid":"19abe982-3522-40f9-a628-ddaef462cdb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6819","nonce":4203476972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6821","nonce":4203476972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6825","nonce":4203476972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6823","nonce":4203476972}]},"public_addr":"172.21.15.103:6819/4203476972","cluster_addr":"172.21.15.103:6821/4203476972","heartbeat_back_addr":"172.21.15.103:6825/4203476972","heartbeat_front_addr":"172.21.15.103:6823/4203476972","state":["exists","up"]},{"osd":7,"uuid":"e875ff09-805a-40ff-9d6a-dd2607ce3432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6817","nonce":1207680713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6819","nonce":1207680713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6823","nonce":1207680713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6821","nonce":1207680713}]},"public_addr":"172.21.15.117:6817/1207680713","cluster_addr":"172.21.15.117:6819/1207680713","heartbeat_back_addr":"172.21.15.117:6823/1207680713","heartbeat_front_addr":"172.21.15.117:6821/1207680713","state":["exists","up"]},{"osd":8,"uuid":"2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6817","nonce":2935820593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6819","nonce":2935820593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6823","nonce":2935820593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6821","nonce":2935820593}]},"public_addr":"172.21.15.183:6817/2935820593","cluster_addr":"172.21.15.183:6819/2935820593","heartbeat_back_addr":"172.21.15.183:6823/2935820593","heartbeat_front_addr":"172.21.15.183:6821/2935820593","state":["exists","up"]},{"osd":9,"uuid":"c36d17d2-0bc8-4322-a998-9c8eff970e58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6827","nonce":2104855877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6829","nonce":2104855877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6833","nonce":2104855877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6831","nonce":2104855877}]},"public_addr":"172.21.15.103:6827/2104855877","cluster_addr":"172.21.15.103:6829/2104855877","heartbeat_back_addr":"172.21.15.103:6833/2104855877","heartbeat_front_addr":"172.21.15.103:6831/2104855877","state":["exists","up"]},{"osd":10,"uuid":"e71bc5f7-a829-43cf-a10b-b2444da1d773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6825","nonce":3792981873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6827","nonce":3792981873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6831","nonce":3792981873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6829","nonce":3792981873}]},"public_addr":"172.21.15.117:6825/3792981873","cluster_addr":"172.21.15.117:6827/3792981873","heartbeat_back_addr":"172.21.15.117:6831/3792981873","heartbeat_front_addr":"172.21.15.117:6829/3792981873","state":["exists","up"]},{"osd":11,"uuid":"8f36697f-4d18-4efa-bf14-d68a13464958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6825","nonce":1250387289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6827","nonce":1250387289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6831","nonce":1250387289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6829","nonce":1250387289}]},"public_addr":"172.21.15.183:6825/1250387289","cluster_addr":"172.21.15.183:6827/1250387289","heartbeat_back_addr":"172.21.15.183:6831/1250387289","heartbeat_front_addr":"172.21.15.183:6829/1250387289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:59:39.916330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:06.042858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:30.703648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:59.493376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:25.190299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:50.480326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:20.815441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:46.398318+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:11.499922+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:41.895096+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:08.411538+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:32.943466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/366890372":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6800/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2372812363":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2844264136":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/2046654364":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6801/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/211510947":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6801/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6800/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/189409602":"2024-09-12T00:57:11.412015+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:06:52.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:52.023+0000 7fccee800640 1 -- 172.21.15.103:0/3878341391 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcccc0b53f0 msgr2=0x7fcccc0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:52.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:52.023+0000 7fccee800640 1 --2- 172.21.15.103:0/3878341391 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcccc0b53f0 0x7fcccc0b78b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fccd8005ab0 tx=0x7fccd8005a20 comp rx=0 tx=0).stop 2024-09-11T01:06:52.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:52.023+0000 7fccee800640 1 -- 172.21.15.103:0/3878341391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce8109150 msgr2=0x7fcce81a0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:52.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:52.023+0000 7fccee800640 1 --2- 172.21.15.103:0/3878341391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce8109150 0x7fcce81a0dd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcce000eb10 tx=0x7fcce000c2d0 comp rx=0 tx=0).stop 2024-09-11T01:06:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:52.024+0000 7fccee800640 1 -- 172.21.15.103:0/3878341391 shutdown_connections 2024-09-11T01:06:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:52.024+0000 7fccee800640 1 --2- 172.21.15.103:0/3878341391 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcccc0b53f0 0x7fcccc0b78b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:52.024+0000 7fccee800640 1 --2- 172.21.15.103:0/3878341391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcce8109150 0x7fcce81a0dd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:52.024+0000 7fccee800640 1 --2- 172.21.15.103:0/3878341391 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcce81087d0 0x7fcce819ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:52.024+0000 7fccee800640 1 --2- 172.21.15.103:0/3878341391 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcce8102dc0 0x7fcce819b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:52.024+0000 7fccee800640 1 -- 172.21.15.103:0/3878341391 >> 172.21.15.103:0/3878341391 conn(0x7fcce80fe830 msgr2=0x7fcce80ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:52.024+0000 7fccee800640 1 -- 172.21.15.103:0/3878341391 shutdown_connections 2024-09-11T01:06:52.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:52.024+0000 7fccee800640 1 -- 172.21.15.103:0/3878341391 wait complete. 2024-09-11T01:06:52.795 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:52 smithi103 ceph-mon[30562]: pgmap v355: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 6 op/s; 11 B/s, 0 objects/s recovering 2024-09-11T01:06:52.795 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:52 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3878341391' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:52.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-11T01:06:52.833 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-11T01:06:52.833 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-11T01:06:52.833 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-11T01:06:52.834 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-11T01:06:52.834 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-11T01:06:52.834 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-11T01:06:52.835 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-11T01:06:52.836 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-11T01:06:52.836 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-11T01:06:52.837 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-11T01:06:52.837 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-11T01:06:52.928 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:52 smithi183 ceph-mon[34992]: pgmap v355: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 6 op/s; 11 B/s, 0 objects/s recovering 2024-09-11T01:06:52.928 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:52 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3878341391' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:52.928 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:52 smithi117 ceph-mon[35358]: pgmap v355: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1023 B/s wr, 6 op/s; 11 B/s, 0 objects/s recovering 2024-09-11T01:06:52.929 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:52 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3878341391' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:06:53.852 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:53.958 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:53.967 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:53.968 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:53.974 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:53.976 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:53.976 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:53.977 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:53.979 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:53.982 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:53.982 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:54.112 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:06:54.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:54 smithi103 ceph-mon[30562]: pgmap v356: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 857 B/s wr, 6 op/s; 9 B/s, 0 objects/s recovering 2024-09-11T01:06:54.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:54 smithi117 ceph-mon[35358]: pgmap v356: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 857 B/s wr, 6 op/s; 9 B/s, 0 objects/s recovering 2024-09-11T01:06:54.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:54 smithi183 ceph-mon[34992]: pgmap v356: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 857 B/s wr, 6 op/s; 9 B/s, 0 objects/s recovering 2024-09-11T01:06:55.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.456+0000 7f330da00640 1 -- 172.21.15.103:0/759575077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33080776d0 msgr2=0x7f3308077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:55.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.456+0000 7f330da00640 1 --2- 172.21.15.103:0/759575077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33080776d0 0x7f3308077ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009900 tx=0x7f32f802a3f0 comp rx=0 tx=0).stop 2024-09-11T01:06:55.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.457+0000 7f330da00640 1 -- 172.21.15.103:0/759575077 shutdown_connections 2024-09-11T01:06:55.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.457+0000 7f330da00640 1 --2- 172.21.15.103:0/759575077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3308113990 0x7f3308115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:55.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.457+0000 7f330da00640 1 --2- 172.21.15.103:0/759575077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3308077ff0 0x7f3308113450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:55.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.457+0000 7f330da00640 1 --2- 172.21.15.103:0/759575077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33080776d0 0x7f3308077ab0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:55.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.457+0000 7f330da00640 1 -- 172.21.15.103:0/759575077 >> 172.21.15.103:0/759575077 conn(0x7f3308100a50 msgr2=0x7f3308102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:55.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.457+0000 7f330da00640 1 -- 172.21.15.103:0/759575077 shutdown_connections 2024-09-11T01:06:55.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.457+0000 7f330da00640 1 -- 172.21.15.103:0/759575077 wait complete. 2024-09-11T01:06:55.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.457+0000 7f330da00640 1 Processor -- start 2024-09-11T01:06:55.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.458+0000 7f330da00640 1 -- start start 2024-09-11T01:06:55.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.458+0000 7f330da00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33080776d0 0x7f330819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:55.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.458+0000 7f330da00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3308077ff0 0x7f330819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:55.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.458+0000 7f330da00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3308113990 0x7f33081a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:55.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.458+0000 7f330da00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3308119380 con 0x7f33080776d0 2024-09-11T01:06:55.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.458+0000 7f330da00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3308119200 con 0x7f3308077ff0 2024-09-11T01:06:55.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.458+0000 7f330da00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3308119500 con 0x7f3308113990 2024-09-11T01:06:55.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.458+0000 7f3306a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33080776d0 0x7f330819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:55.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.458+0000 7f32fe000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3308077ff0 0x7f330819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:55.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.458+0000 7f32fe000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3308077ff0 0x7f330819fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:40824/0 (socket says 172.21.15.103:40824) 2024-09-11T01:06:55.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.458+0000 7f3307400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3308113990 0x7f33081a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:55.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.458+0000 7f32fe000640 1 -- 172.21.15.103:0/2597226133 learned_addr learned my addr 172.21.15.103:0/2597226133 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:55.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.459+0000 7f32fe000640 1 -- 172.21.15.103:0/2597226133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3308113990 msgr2=0x7f33081a5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:55.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.459+0000 7f32fe000640 1 --2- 172.21.15.103:0/2597226133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3308113990 0x7f33081a5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:55.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.459+0000 7f32fe000640 1 -- 172.21.15.103:0/2597226133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33080776d0 msgr2=0x7f330819f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:55.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.459+0000 7f32fe000640 1 --2- 172.21.15.103:0/2597226133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33080776d0 0x7f330819f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:55.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.459+0000 7f32fe000640 1 -- 172.21.15.103:0/2597226133 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33081a5940 con 0x7f3308077ff0 2024-09-11T01:06:55.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.459+0000 7f32fe000640 1 --2- 172.21.15.103:0/2597226133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3308077ff0 0x7f330819fdd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f32f000e9f0 tx=0x7f32f000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:55.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.459+0000 7f32ffe00640 1 -- 172.21.15.103:0/2597226133 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f000cd80 con 0x7f3308077ff0 2024-09-11T01:06:55.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.459+0000 7f330da00640 1 -- 172.21.15.103:0/2597226133 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33081a5c30 con 0x7f3308077ff0 2024-09-11T01:06:55.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.459+0000 7f32ffe00640 1 -- 172.21.15.103:0/2597226133 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32f00108e0 con 0x7f3308077ff0 2024-09-11T01:06:55.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.459+0000 7f32ffe00640 1 -- 172.21.15.103:0/2597226133 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0018980 con 0x7f3308077ff0 2024-09-11T01:06:55.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.459+0000 7f330da00640 1 -- 172.21.15.103:0/2597226133 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33081ac4c0 con 0x7f3308077ff0 2024-09-11T01:06:55.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.460+0000 7f330da00640 1 -- 172.21.15.103:0/2597226133 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f33081158f0 con 0x7f3308077ff0 2024-09-11T01:06:55.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.463+0000 7f32ffe00640 1 -- 172.21.15.103:0/2597226133 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f32f0010430 con 0x7f3308077ff0 2024-09-11T01:06:55.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.465+0000 7f32ffe00640 1 --2- 172.21.15.103:0/2597226133 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f32ec0b53f0 0x7f32ec0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:55.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.465+0000 7f32ffe00640 1 -- 172.21.15.103:0/2597226133 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f32f00e6b80 con 0x7f3308077ff0 2024-09-11T01:06:55.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.465+0000 7f3306a00640 1 --2- 172.21.15.103:0/2597226133 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f32ec0b53f0 0x7f32ec0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:55.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.466+0000 7f32ffe00640 1 --2- 172.21.15.103:0/2597226133 >> [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556] conn(0x7f32ec0c0630 0x7f32ec0c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:55.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.466+0000 7f32ffe00640 1 -- 172.21.15.103:0/2597226133 --> [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32ec0c31a0 con 0x7f32ec0c0630 2024-09-11T01:06:55.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.466+0000 7f32ffe00640 1 -- 172.21.15.103:0/2597226133 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f32f00e6f30 con 0x7f3308077ff0 2024-09-11T01:06:55.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.466+0000 7f3306a00640 1 --2- 172.21.15.103:0/2597226133 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f32ec0b53f0 0x7f32ec0b78b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f32f8031440 tx=0x7f32f8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:55.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.466+0000 7f3307400640 1 --2- 172.21.15.103:0/2597226133 >> [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556] conn(0x7f32ec0c0630 0x7f32ec0c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:55.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.467+0000 7f3307400640 1 --2- 172.21.15.103:0/2597226133 >> [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556] conn(0x7f32ec0c0630 0x7f32ec0c2ad0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:55.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.467+0000 7f32ffe00640 1 -- 172.21.15.103:0/2597226133 <== osd.1 v2:172.21.15.117:6800/2629532556 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f32ec0c31a0 con 0x7f32ec0c0630 2024-09-11T01:06:55.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.482+0000 7f330da00640 1 -- 172.21.15.103:0/2597226133 --> [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3308078be0 con 0x7f32ec0c0630 2024-09-11T01:06:55.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.482+0000 7f32ffe00640 1 -- 172.21.15.103:0/2597226133 <== osd.1 v2:172.21.15.117:6800/2629532556 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3308078be0 con 0x7f32ec0c0630 2024-09-11T01:06:55.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.483+0000 7f330da00640 1 -- 172.21.15.103:0/2597226133 >> [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556] conn(0x7f32ec0c0630 msgr2=0x7f32ec0c2ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:55.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.483+0000 7f330da00640 1 --2- 172.21.15.103:0/2597226133 >> [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556] conn(0x7f32ec0c0630 0x7f32ec0c2ad0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:55.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.483+0000 7f330da00640 1 -- 172.21.15.103:0/2597226133 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f32ec0b53f0 msgr2=0x7f32ec0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:55.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.483+0000 7f330da00640 1 --2- 172.21.15.103:0/2597226133 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f32ec0b53f0 0x7f32ec0b78b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f32f8031440 tx=0x7f32f8005b50 comp rx=0 tx=0).stop 2024-09-11T01:06:55.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.483+0000 7f330da00640 1 -- 172.21.15.103:0/2597226133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3308077ff0 msgr2=0x7f330819fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:55.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.483+0000 7f330da00640 1 --2- 172.21.15.103:0/2597226133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3308077ff0 0x7f330819fdd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f32f000e9f0 tx=0x7f32f000eeb0 comp rx=0 tx=0).stop 2024-09-11T01:06:55.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.483+0000 7f3307400640 1 -- 172.21.15.103:0/2597226133 reap_dead start 2024-09-11T01:06:55.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.483+0000 7f330da00640 1 -- 172.21.15.103:0/2597226133 shutdown_connections 2024-09-11T01:06:55.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.483+0000 7f330da00640 1 -- 172.21.15.103:0/2597226133 >> 172.21.15.103:0/2597226133 conn(0x7f3308100a50 msgr2=0x7f3308102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:55.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.483+0000 7f330da00640 1 -- 172.21.15.103:0/2597226133 shutdown_connections 2024-09-11T01:06:55.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.483+0000 7f330da00640 1 -- 172.21.15.103:0/2597226133 wait complete. 2024-09-11T01:06:56.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.671+0000 7f805b200640 1 -- 172.21.15.103:0/3660816077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f805c10a800 msgr2=0x7f805c10ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:56.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.671+0000 7f805b200640 1 --2- 172.21.15.103:0/3660816077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f805c10a800 0x7f805c10ac40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8048009900 tx=0x7f804802a410 comp rx=0 tx=0).stop 2024-09-11T01:06:56.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.671+0000 7f805b200640 1 -- 172.21.15.103:0/3660816077 shutdown_connections 2024-09-11T01:06:56.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.671+0000 7f805b200640 1 --2- 172.21.15.103:0/3660816077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f805c10b180 0x7f805c111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:56.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.671+0000 7f805b200640 1 --2- 172.21.15.103:0/3660816077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f805c10a800 0x7f805c10ac40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:56.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.671+0000 7f805b200640 1 --2- 172.21.15.103:0/3660816077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f805c104df0 0x7f805c1051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:56.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.671+0000 7f805b200640 1 -- 172.21.15.103:0/3660816077 >> 172.21.15.103:0/3660816077 conn(0x7f805c100840 msgr2=0x7f805c102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:56.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.671+0000 7f805b200640 1 -- 172.21.15.103:0/3660816077 shutdown_connections 2024-09-11T01:06:56.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.671+0000 7f805b200640 1 -- 172.21.15.103:0/3660816077 wait complete. 2024-09-11T01:06:56.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.672+0000 7f805b200640 1 Processor -- start 2024-09-11T01:06:56.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.672+0000 7f805b200640 1 -- start start 2024-09-11T01:06:56.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f805b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f805c104df0 0x7f805c19b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:56.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f805b200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f805c10a800 0x7f805c19b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:56.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f805b200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f805c10b180 0x7f805c1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:56.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f805b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f805c114e00 con 0x7f805c104df0 2024-09-11T01:06:56.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f805b200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f805c114c80 con 0x7f805c10a800 2024-09-11T01:06:56.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f805b200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f805c114f80 con 0x7f805c10b180 2024-09-11T01:06:56.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f8059e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f805c104df0 0x7f805c19b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:56.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f8059e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f805c104df0 0x7f805c19b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37524/0 (socket says 172.21.15.103:37524) 2024-09-11T01:06:56.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f8059e00640 1 -- 172.21.15.103:0/3918536263 learned_addr learned my addr 172.21.15.103:0/3918536263 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:56.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f805a800640 1 --2- 172.21.15.103:0/3918536263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f805c10b180 0x7f805c1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:56.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f8059400640 1 --2- 172.21.15.103:0/3918536263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f805c10a800 0x7f805c19b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:56.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f8059e00640 1 -- 172.21.15.103:0/3918536263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f805c10b180 msgr2=0x7f805c1a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:56.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f8059e00640 1 --2- 172.21.15.103:0/3918536263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f805c10b180 0x7f805c1a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:56.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f8059e00640 1 -- 172.21.15.103:0/3918536263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f805c10a800 msgr2=0x7f805c19b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:56.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f8059e00640 1 --2- 172.21.15.103:0/3918536263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f805c10a800 0x7f805c19b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.673+0000 7f8059e00640 1 -- 172.21.15.103:0/3918536263 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f805c1a12c0 con 0x7f805c104df0 2024-09-11T01:06:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.674+0000 7f8059e00640 1 --2- 172.21.15.103:0/3918536263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f805c104df0 0x7f805c19b210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f804c00e9f0 tx=0x7f804c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.674+0000 7f8052a00640 1 -- 172.21.15.103:0/3918536263 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c00cd80 con 0x7f805c104df0 2024-09-11T01:06:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.674+0000 7f8052a00640 1 -- 172.21.15.103:0/3918536263 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f804c0054d0 con 0x7f805c104df0 2024-09-11T01:06:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.674+0000 7f805b200640 1 -- 172.21.15.103:0/3918536263 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f805c1a15b0 con 0x7f805c104df0 2024-09-11T01:06:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.674+0000 7f8052a00640 1 -- 172.21.15.103:0/3918536263 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f804c010690 con 0x7f805c104df0 2024-09-11T01:06:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.674+0000 7f805b200640 1 -- 172.21.15.103:0/3918536263 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f805c1a7c70 con 0x7f805c104df0 2024-09-11T01:06:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.675+0000 7f805b200640 1 -- 172.21.15.103:0/3918536263 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f805c108130 con 0x7f805c104df0 2024-09-11T01:06:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.677+0000 7f8052a00640 1 -- 172.21.15.103:0/3918536263 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f804c004e30 con 0x7f805c104df0 2024-09-11T01:06:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.679+0000 7f8052a00640 1 --2- 172.21.15.103:0/3918536263 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f80400b5410 0x7f80400b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.679+0000 7f8052a00640 1 -- 172.21.15.103:0/3918536263 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f804c0e6990 con 0x7f805c104df0 2024-09-11T01:06:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.679+0000 7f8059400640 1 --2- 172.21.15.103:0/3918536263 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f80400b5410 0x7f80400b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:56.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.679+0000 7f8052a00640 1 --2- 172.21.15.103:0/3918536263 >> [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593] conn(0x7f80400c0650 0x7f80400c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:56.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.679+0000 7f8052a00640 1 -- 172.21.15.103:0/3918536263 --> [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f804c01ee50 con 0x7f80400c0650 2024-09-11T01:06:56.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.679+0000 7f8052a00640 1 -- 172.21.15.103:0/3918536263 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f804c0e6d40 con 0x7f805c104df0 2024-09-11T01:06:56.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.680+0000 7f8059400640 1 --2- 172.21.15.103:0/3918536263 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f80400b5410 0x7f80400b78d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8048031440 tx=0x7f8048005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:56.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.680+0000 7f805a800640 1 --2- 172.21.15.103:0/3918536263 >> [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593] conn(0x7f80400c0650 0x7f80400c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:56.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.680+0000 7f805a800640 1 --2- 172.21.15.103:0/3918536263 >> [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593] conn(0x7f80400c0650 0x7f80400c2af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:56.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.681+0000 7f8052a00640 1 -- 172.21.15.103:0/3918536263 <== osd.8 v2:172.21.15.183:6816/2935820593 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f804c01ee50 con 0x7f80400c0650 2024-09-11T01:06:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.696+0000 7f805b200640 1 -- 172.21.15.103:0/3918536263 --> [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f805c1060a0 con 0x7f80400c0650 2024-09-11T01:06:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.697+0000 7f8052a00640 1 -- 172.21.15.103:0/3918536263 <== osd.8 v2:172.21.15.183:6816/2935820593 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f805c1060a0 con 0x7f80400c0650 2024-09-11T01:06:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.698+0000 7f805b200640 1 -- 172.21.15.103:0/3918536263 >> [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593] conn(0x7f80400c0650 msgr2=0x7f80400c2af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.698+0000 7f805b200640 1 --2- 172.21.15.103:0/3918536263 >> [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593] conn(0x7f80400c0650 0x7f80400c2af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.698+0000 7f805b200640 1 -- 172.21.15.103:0/3918536263 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f80400b5410 msgr2=0x7f80400b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.698+0000 7f805b200640 1 --2- 172.21.15.103:0/3918536263 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f80400b5410 0x7f80400b78d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8048031440 tx=0x7f8048005b50 comp rx=0 tx=0).stop 2024-09-11T01:06:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.698+0000 7f805b200640 1 -- 172.21.15.103:0/3918536263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f805c104df0 msgr2=0x7f805c19b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.698+0000 7f805b200640 1 --2- 172.21.15.103:0/3918536263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f805c104df0 0x7f805c19b210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f804c00e9f0 tx=0x7f804c00edf0 comp rx=0 tx=0).stop 2024-09-11T01:06:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.698+0000 7f805a800640 1 -- 172.21.15.103:0/3918536263 reap_dead start 2024-09-11T01:06:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.698+0000 7f805b200640 1 -- 172.21.15.103:0/3918536263 shutdown_connections 2024-09-11T01:06:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.698+0000 7f805b200640 1 -- 172.21.15.103:0/3918536263 >> 172.21.15.103:0/3918536263 conn(0x7f805c100840 msgr2=0x7f805c102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.698+0000 7f805b200640 1 -- 172.21.15.103:0/3918536263 shutdown_connections 2024-09-11T01:06:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.698+0000 7f805b200640 1 -- 172.21.15.103:0/3918536263 wait complete. 2024-09-11T01:06:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.949+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3364324470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3a0109150 msgr2=0x7fa3a010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.949+0000 7fa3a6a00640 1 --2- 172.21.15.103:0/3364324470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3a0109150 0x7fa3a010f950 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa398009ca0 tx=0x7fa39802a8c0 comp rx=0 tx=0).stop 2024-09-11T01:06:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.949+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3364324470 shutdown_connections 2024-09-11T01:06:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.949+0000 7fa3a6a00640 1 --2- 172.21.15.103:0/3364324470 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3a0109150 0x7fa3a010f950 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.949+0000 7fa3a6a00640 1 --2- 172.21.15.103:0/3364324470 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a01087d0 0x7fa3a0108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.949+0000 7fa3a6a00640 1 --2- 172.21.15.103:0/3364324470 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3a0102dc0 0x7fa3a01031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.949+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3364324470 >> 172.21.15.103:0/3364324470 conn(0x7fa3a00fe830 msgr2=0x7fa3a0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.949+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3364324470 shutdown_connections 2024-09-11T01:06:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.949+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3364324470 wait complete. 2024-09-11T01:06:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.950+0000 7fa3a6a00640 1 Processor -- start 2024-09-11T01:06:56.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.950+0000 7fa3a6a00640 1 -- start start 2024-09-11T01:06:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa3a6a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3a0102dc0 0x7fa3a00754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa3a6a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3a01087d0 0x7fa3a00759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa3a6a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a0109150 0x7fa3a0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa3a6a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0112e20 con 0x7fa3a0102dc0 2024-09-11T01:06:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa3a6a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0112ca0 con 0x7fa3a01087d0 2024-09-11T01:06:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa3a6a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a0112fa0 con 0x7fa3a0109150 2024-09-11T01:06:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa39fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3a0102dc0 0x7fa3a00754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa39fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3a0102dc0 0x7fa3a00754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37548/0 (socket says 172.21.15.103:37548) 2024-09-11T01:06:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa39fe00640 1 -- 172.21.15.103:0/3540238085 learned_addr learned my addr 172.21.15.103:0/3540238085 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa397e00640 1 --2- 172.21.15.103:0/3540238085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3a01087d0 0x7fa3a00759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa3a4a00640 1 --2- 172.21.15.103:0/3540238085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a0109150 0x7fa3a0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa39fe00640 1 -- 172.21.15.103:0/3540238085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a0109150 msgr2=0x7fa3a0075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa39fe00640 1 --2- 172.21.15.103:0/3540238085 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa3a0109150 0x7fa3a0075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa39fe00640 1 -- 172.21.15.103:0/3540238085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3a01087d0 msgr2=0x7fa3a00759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa39fe00640 1 --2- 172.21.15.103:0/3540238085 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3a01087d0 0x7fa3a00759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.951+0000 7fa39fe00640 1 -- 172.21.15.103:0/3540238085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a01a7670 con 0x7fa3a0102dc0 2024-09-11T01:06:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.952+0000 7fa39fe00640 1 --2- 172.21.15.103:0/3540238085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3a0102dc0 0x7fa3a00754a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa39000ea60 tx=0x7fa39000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.952+0000 7fa39d600640 1 -- 172.21.15.103:0/3540238085 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39000cde0 con 0x7fa3a0102dc0 2024-09-11T01:06:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.952+0000 7fa39d600640 1 -- 172.21.15.103:0/3540238085 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa3900035f0 con 0x7fa3a0102dc0 2024-09-11T01:06:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.952+0000 7fa39d600640 1 -- 172.21.15.103:0/3540238085 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390010690 con 0x7fa3a0102dc0 2024-09-11T01:06:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.952+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3540238085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a01a7960 con 0x7fa3a0102dc0 2024-09-11T01:06:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.952+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3540238085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a01a7e50 con 0x7fa3a0102dc0 2024-09-11T01:06:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.953+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3540238085 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa3a00638e0 con 0x7fa3a0102dc0 2024-09-11T01:06:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.955+0000 7fa39d600640 1 -- 172.21.15.103:0/3540238085 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7fa390004000 con 0x7fa3a0102dc0 2024-09-11T01:06:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.957+0000 7fa39d600640 1 --2- 172.21.15.103:0/3540238085 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3840b5370 0x7fa3840b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.957+0000 7fa39d600640 1 -- 172.21.15.103:0/3540238085 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fa3900e6860 con 0x7fa3a0102dc0 2024-09-11T01:06:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.957+0000 7fa397e00640 1 --2- 172.21.15.103:0/3540238085 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3840b5370 0x7fa3840b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:56.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.957+0000 7fa39d600640 1 --2- 172.21.15.103:0/3540238085 >> [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504] conn(0x7fa3840c05b0 0x7fa3840c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:56.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.957+0000 7fa39d600640 1 -- 172.21.15.103:0/3540238085 --> [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa390022e50 con 0x7fa3840c05b0 2024-09-11T01:06:56.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.957+0000 7fa39d600640 1 -- 172.21.15.103:0/3540238085 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fa3900e6c10 con 0x7fa3a0102dc0 2024-09-11T01:06:56.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.957+0000 7fa3a4a00640 1 --2- 172.21.15.103:0/3540238085 >> [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504] conn(0x7fa3840c05b0 0x7fa3840c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:56.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.958+0000 7fa397e00640 1 --2- 172.21.15.103:0/3540238085 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3840b5370 0x7fa3840b7830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0076f90 tx=0x7fa388005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:56.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.958+0000 7fa3a4a00640 1 --2- 172.21.15.103:0/3540238085 >> [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504] conn(0x7fa3840c05b0 0x7fa3840c2a50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:56.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.959+0000 7fa39d600640 1 -- 172.21.15.103:0/3540238085 <== osd.4 v2:172.21.15.117:6808/2368878504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa390022e50 con 0x7fa3840c05b0 2024-09-11T01:06:56.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.973+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3540238085 --> [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa3a0063d60 con 0x7fa3840c05b0 2024-09-11T01:06:56.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.973+0000 7fa39d600640 1 -- 172.21.15.103:0/3540238085 <== osd.4 v2:172.21.15.117:6808/2368878504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa3a0063d60 con 0x7fa3840c05b0 2024-09-11T01:06:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.974+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3540238085 >> [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504] conn(0x7fa3840c05b0 msgr2=0x7fa3840c2a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.974+0000 7fa3a6a00640 1 --2- 172.21.15.103:0/3540238085 >> [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504] conn(0x7fa3840c05b0 0x7fa3840c2a50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.974+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3540238085 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3840b5370 msgr2=0x7fa3840b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.974+0000 7fa3a6a00640 1 --2- 172.21.15.103:0/3540238085 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa3840b5370 0x7fa3840b7830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0076f90 tx=0x7fa388005f90 comp rx=0 tx=0).stop 2024-09-11T01:06:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.974+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3540238085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3a0102dc0 msgr2=0x7fa3a00754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.974+0000 7fa3a6a00640 1 --2- 172.21.15.103:0/3540238085 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa3a0102dc0 0x7fa3a00754a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa39000ea60 tx=0x7fa39000ef20 comp rx=0 tx=0).stop 2024-09-11T01:06:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.974+0000 7fa3a4a00640 1 -- 172.21.15.103:0/3540238085 reap_dead start 2024-09-11T01:06:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.974+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3540238085 shutdown_connections 2024-09-11T01:06:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.974+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3540238085 >> 172.21.15.103:0/3540238085 conn(0x7fa3a00fe830 msgr2=0x7fa3a00ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.974+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3540238085 shutdown_connections 2024-09-11T01:06:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:55.974+0000 7fa3a6a00640 1 -- 172.21.15.103:0/3540238085 wait complete. 2024-09-11T01:06:56.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:56 smithi103 ceph-mon[30562]: pgmap v357: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-11T01:06:56.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:56 smithi117 ceph-mon[35358]: pgmap v357: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-11T01:06:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:56 smithi183 ceph-mon[34992]: pgmap v357: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-11T01:06:57.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.313+0000 7ffbf9600640 1 -- 172.21.15.103:0/3698550909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbf4104fc0 msgr2=0x7ffbf41053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:57.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.313+0000 7ffbf9600640 1 --2- 172.21.15.103:0/3698550909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbf4104fc0 0x7ffbf41053a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffbe4009900 tx=0x7ffbe402a410 comp rx=0 tx=0).stop 2024-09-11T01:06:57.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.313+0000 7ffbf9600640 1 -- 172.21.15.103:0/3698550909 shutdown_connections 2024-09-11T01:06:57.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.313+0000 7ffbf9600640 1 --2- 172.21.15.103:0/3698550909 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbf410b350 0x7ffbf4111b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:57.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.313+0000 7ffbf9600640 1 --2- 172.21.15.103:0/3698550909 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf410a9d0 0x7ffbf410ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:57.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.313+0000 7ffbf9600640 1 --2- 172.21.15.103:0/3698550909 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbf4104fc0 0x7ffbf41053a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:57.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.313+0000 7ffbf9600640 1 -- 172.21.15.103:0/3698550909 >> 172.21.15.103:0/3698550909 conn(0x7ffbf41009f0 msgr2=0x7ffbf4102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:57.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.313+0000 7ffbf9600640 1 -- 172.21.15.103:0/3698550909 shutdown_connections 2024-09-11T01:06:57.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.313+0000 7ffbf9600640 1 -- 172.21.15.103:0/3698550909 wait complete. 2024-09-11T01:06:57.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.314+0000 7ffbf9600640 1 Processor -- start 2024-09-11T01:06:57.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.314+0000 7ffbf9600640 1 -- start start 2024-09-11T01:06:57.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.314+0000 7ffbf9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbf4104fc0 0x7ffbf419b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:57.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbf9600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf410a9d0 0x7ffbf419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:57.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbf9600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbf410b350 0x7ffbf41a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:57.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbf9600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf4114fb0 con 0x7ffbf4104fc0 2024-09-11T01:06:57.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbf9600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf4114e30 con 0x7ffbf410a9d0 2024-09-11T01:06:57.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbf9600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf4115130 con 0x7ffbf410b350 2024-09-11T01:06:57.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbf2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbf4104fc0 0x7ffbf419b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:57.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbf3400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbf410b350 0x7ffbf41a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:57.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbf2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbf4104fc0 0x7ffbf419b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37584/0 (socket says 172.21.15.103:37584) 2024-09-11T01:06:57.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbf2a00640 1 -- 172.21.15.103:0/482515353 learned_addr learned my addr 172.21.15.103:0/482515353 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:57.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbebe00640 1 --2- 172.21.15.103:0/482515353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf410a9d0 0x7ffbf419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:57.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbf3400640 1 -- 172.21.15.103:0/482515353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf410a9d0 msgr2=0x7ffbf419b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:57.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbf3400640 1 --2- 172.21.15.103:0/482515353 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbf410a9d0 0x7ffbf419b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:57.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbf3400640 1 -- 172.21.15.103:0/482515353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbf4104fc0 msgr2=0x7ffbf419b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:57.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbf3400640 1 --2- 172.21.15.103:0/482515353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbf4104fc0 0x7ffbf419b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:57.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.315+0000 7ffbf3400640 1 -- 172.21.15.103:0/482515353 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf41a1530 con 0x7ffbf410b350 2024-09-11T01:06:57.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.316+0000 7ffbf3400640 1 --2- 172.21.15.103:0/482515353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbf410b350 0x7ffbf41a0d60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffbec009fd0 tx=0x7ffbec00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:57.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.316+0000 7ffbeb400640 1 -- 172.21.15.103:0/482515353 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbec00ce20 con 0x7ffbf410b350 2024-09-11T01:06:57.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.316+0000 7ffbeb400640 1 -- 172.21.15.103:0/482515353 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbec005020 con 0x7ffbf410b350 2024-09-11T01:06:57.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.316+0000 7ffbeb400640 1 -- 172.21.15.103:0/482515353 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbec010690 con 0x7ffbf410b350 2024-09-11T01:06:57.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.316+0000 7ffbf9600640 1 -- 172.21.15.103:0/482515353 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf41a1820 con 0x7ffbf410b350 2024-09-11T01:06:57.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.316+0000 7ffbf9600640 1 -- 172.21.15.103:0/482515353 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf41a7ee0 con 0x7ffbf410b350 2024-09-11T01:06:57.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.317+0000 7ffbf9600640 1 -- 172.21.15.103:0/482515353 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffbf40638a0 con 0x7ffbf410b350 2024-09-11T01:06:57.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.319+0000 7ffbeb400640 1 -- 172.21.15.103:0/482515353 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7ffbec0054d0 con 0x7ffbf410b350 2024-09-11T01:06:57.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.321+0000 7ffbeb400640 1 --2- 172.21.15.103:0/482515353 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffbd80b53f0 0x7ffbd80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:57.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.321+0000 7ffbeb400640 1 -- 172.21.15.103:0/482515353 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7ffbec0e6960 con 0x7ffbf410b350 2024-09-11T01:06:57.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.321+0000 7ffbf2a00640 1 --2- 172.21.15.103:0/482515353 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffbd80b53f0 0x7ffbd80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:57.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.321+0000 7ffbeb400640 1 --2- 172.21.15.103:0/482515353 >> [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972] conn(0x7ffbd80c0630 0x7ffbd80c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:57.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.321+0000 7ffbeb400640 1 -- 172.21.15.103:0/482515353 --> [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffbec00be50 con 0x7ffbd80c0630 2024-09-11T01:06:57.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.321+0000 7ffbeb400640 1 -- 172.21.15.103:0/482515353 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7ffbec0e6d10 con 0x7ffbf410b350 2024-09-11T01:06:57.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.321+0000 7ffbebe00640 1 --2- 172.21.15.103:0/482515353 >> [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972] conn(0x7ffbd80c0630 0x7ffbd80c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:57.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.322+0000 7ffbf2a00640 1 --2- 172.21.15.103:0/482515353 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffbd80b53f0 0x7ffbd80b78b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40096c0 tx=0x7ffbe4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:57.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.322+0000 7ffbebe00640 1 --2- 172.21.15.103:0/482515353 >> [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972] conn(0x7ffbd80c0630 0x7ffbd80c2ad0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:57.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.323+0000 7ffbeb400640 1 -- 172.21.15.103:0/482515353 <== osd.6 v2:172.21.15.103:6818/4203476972 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffbec00be50 con 0x7ffbd80c0630 2024-09-11T01:06:57.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.337+0000 7ffbf9600640 1 -- 172.21.15.103:0/482515353 --> [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ffbf4063d20 con 0x7ffbd80c0630 2024-09-11T01:06:57.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.338+0000 7ffbeb400640 1 -- 172.21.15.103:0/482515353 <== osd.6 v2:172.21.15.103:6818/4203476972 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ffbf4063d20 con 0x7ffbd80c0630 2024-09-11T01:06:57.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.338+0000 7ffbf9600640 1 -- 172.21.15.103:0/482515353 >> [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972] conn(0x7ffbd80c0630 msgr2=0x7ffbd80c2ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:57.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.338+0000 7ffbf9600640 1 --2- 172.21.15.103:0/482515353 >> [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972] conn(0x7ffbd80c0630 0x7ffbd80c2ad0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:57.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.338+0000 7ffbf9600640 1 -- 172.21.15.103:0/482515353 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffbd80b53f0 msgr2=0x7ffbd80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:57.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.338+0000 7ffbf9600640 1 --2- 172.21.15.103:0/482515353 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffbd80b53f0 0x7ffbd80b78b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffbe40096c0 tx=0x7ffbe4005a20 comp rx=0 tx=0).stop 2024-09-11T01:06:57.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.338+0000 7ffbf9600640 1 -- 172.21.15.103:0/482515353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbf410b350 msgr2=0x7ffbf41a0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:57.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.338+0000 7ffbf9600640 1 --2- 172.21.15.103:0/482515353 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbf410b350 0x7ffbf41a0d60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffbec009fd0 tx=0x7ffbec00ef10 comp rx=0 tx=0).stop 2024-09-11T01:06:57.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.338+0000 7ffbf3400640 1 -- 172.21.15.103:0/482515353 reap_dead start 2024-09-11T01:06:57.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.338+0000 7ffbf9600640 1 -- 172.21.15.103:0/482515353 shutdown_connections 2024-09-11T01:06:57.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.338+0000 7ffbf9600640 1 -- 172.21.15.103:0/482515353 >> 172.21.15.103:0/482515353 conn(0x7ffbf41009f0 msgr2=0x7ffbf4101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:57.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.339+0000 7ffbf9600640 1 -- 172.21.15.103:0/482515353 shutdown_connections 2024-09-11T01:06:57.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:57.339+0000 7ffbf9600640 1 -- 172.21.15.103:0/482515353 wait complete. 2024-09-11T01:06:57.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:06:57 smithi103 ceph-mon[30562]: pgmap v358: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-11T01:06:57.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:06:57 smithi183 ceph-mon[34992]: pgmap v358: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-11T01:06:58.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:06:57 smithi117 ceph-mon[35358]: pgmap v358: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-11T01:06:58.390 INFO:teuthology.orchestra.run.smithi103.stdout:236223201326 2024-09-11T01:06:58.391 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-11T01:06:59.096 INFO:teuthology.orchestra.run.smithi103.stdout:55834574932 2024-09-11T01:06:59.096 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-11T01:06:59.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.116+0000 7f12c2200640 1 -- 172.21.15.103:0/78474444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12bc109150 msgr2=0x7f12bc10f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:59.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.116+0000 7f12c2200640 1 --2- 172.21.15.103:0/78474444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12bc109150 0x7f12bc10f950 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009be0 tx=0x7f12b402a6c0 comp rx=0 tx=0).stop 2024-09-11T01:06:59.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.116+0000 7f12c2200640 1 -- 172.21.15.103:0/78474444 shutdown_connections 2024-09-11T01:06:59.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.116+0000 7f12c2200640 1 --2- 172.21.15.103:0/78474444 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12bc109150 0x7f12bc10f950 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:59.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.116+0000 7f12c2200640 1 --2- 172.21.15.103:0/78474444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12bc1087d0 0x7f12bc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:59.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.116+0000 7f12c2200640 1 --2- 172.21.15.103:0/78474444 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12bc102dc0 0x7f12bc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:59.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.116+0000 7f12c2200640 1 -- 172.21.15.103:0/78474444 >> 172.21.15.103:0/78474444 conn(0x7f12bc0fe830 msgr2=0x7f12bc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:59.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.116+0000 7f12c2200640 1 -- 172.21.15.103:0/78474444 shutdown_connections 2024-09-11T01:06:59.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.116+0000 7f12c2200640 1 -- 172.21.15.103:0/78474444 wait complete. 2024-09-11T01:06:59.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.117+0000 7f12c2200640 1 Processor -- start 2024-09-11T01:06:59.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.117+0000 7f12c2200640 1 -- start start 2024-09-11T01:06:59.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.117+0000 7f12c2200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12bc102dc0 0x7f12bc19b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:59.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.117+0000 7f12c2200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12bc1087d0 0x7f12bc19b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:59.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.117+0000 7f12c2200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12bc109150 0x7f12bc1a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:59.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.117+0000 7f12c2200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc112e10 con 0x7f12bc109150 2024-09-11T01:06:59.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.117+0000 7f12c2200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc112c90 con 0x7f12bc102dc0 2024-09-11T01:06:59.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.117+0000 7f12c2200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc112f90 con 0x7f12bc1087d0 2024-09-11T01:06:59.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.118+0000 7f12bbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12bc109150 0x7f12bc1a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:59.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.118+0000 7f12baa00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12bc1087d0 0x7f12bc19b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:59.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.118+0000 7f12bbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12bc109150 0x7f12bc1a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37566/0 (socket says 172.21.15.103:37566) 2024-09-11T01:06:59.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.118+0000 7f12bbe00640 1 -- 172.21.15.103:0/1642115220 learned_addr learned my addr 172.21.15.103:0/1642115220 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:06:59.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.118+0000 7f12bb400640 1 --2- 172.21.15.103:0/1642115220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12bc102dc0 0x7f12bc19b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:59.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.118+0000 7f12baa00640 1 -- 172.21.15.103:0/1642115220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12bc102dc0 msgr2=0x7f12bc19b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:59.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.118+0000 7f12baa00640 1 --2- 172.21.15.103:0/1642115220 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12bc102dc0 0x7f12bc19b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:59.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.118+0000 7f12baa00640 1 -- 172.21.15.103:0/1642115220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12bc109150 msgr2=0x7f12bc1a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:59.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.118+0000 7f12baa00640 1 --2- 172.21.15.103:0/1642115220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12bc109150 0x7f12bc1a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:59.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.118+0000 7f12baa00640 1 -- 172.21.15.103:0/1642115220 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12bc1a1520 con 0x7f12bc1087d0 2024-09-11T01:06:59.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.118+0000 7f12bbe00640 1 --2- 172.21.15.103:0/1642115220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12bc109150 0x7f12bc1a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:06:59.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.118+0000 7f12baa00640 1 --2- 172.21.15.103:0/1642115220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12bc1087d0 0x7f12bc19b9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f12a8005fd0 tx=0x7f12a800ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:59.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.119+0000 7f12b3e00640 1 -- 172.21.15.103:0/1642115220 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a800cd00 con 0x7f12bc1087d0 2024-09-11T01:06:59.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.119+0000 7f12c2200640 1 -- 172.21.15.103:0/1642115220 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12bc1a1810 con 0x7f12bc1087d0 2024-09-11T01:06:59.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.119+0000 7f12b3e00640 1 -- 172.21.15.103:0/1642115220 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12a80035f0 con 0x7f12bc1087d0 2024-09-11T01:06:59.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.119+0000 7f12b3e00640 1 -- 172.21.15.103:0/1642115220 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8010670 con 0x7f12bc1087d0 2024-09-11T01:06:59.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.119+0000 7f12c2200640 1 -- 172.21.15.103:0/1642115220 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12bc1a7ed0 con 0x7f12bc1087d0 2024-09-11T01:06:59.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.120+0000 7f12c2200640 1 -- 172.21.15.103:0/1642115220 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f12bc0638a0 con 0x7f12bc1087d0 2024-09-11T01:06:59.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.123+0000 7f12b3e00640 1 -- 172.21.15.103:0/1642115220 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f12a80037a0 con 0x7f12bc1087d0 2024-09-11T01:06:59.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.125+0000 7f12b3e00640 1 --2- 172.21.15.103:0/1642115220 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f12a00b5370 0x7f12a00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:59.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.125+0000 7f12b3e00640 1 -- 172.21.15.103:0/1642115220 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f12a80e65e0 con 0x7f12bc1087d0 2024-09-11T01:06:59.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.125+0000 7f12bb400640 1 --2- 172.21.15.103:0/1642115220 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f12a00b5370 0x7f12a00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:59.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.125+0000 7f12b3e00640 1 --2- 172.21.15.103:0/1642115220 >> [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162] conn(0x7f12a00c05b0 0x7f12a00c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:06:59.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.125+0000 7f12b3e00640 1 -- 172.21.15.103:0/1642115220 --> [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12a8013ec0 con 0x7f12a00c05b0 2024-09-11T01:06:59.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.125+0000 7f12b3e00640 1 -- 172.21.15.103:0/1642115220 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f12a80e6990 con 0x7f12bc1087d0 2024-09-11T01:06:59.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.126+0000 7f12bbe00640 1 --2- 172.21.15.103:0/1642115220 >> [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162] conn(0x7f12a00c05b0 0x7f12a00c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:06:59.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.126+0000 7f12bb400640 1 --2- 172.21.15.103:0/1642115220 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f12a00b5370 0x7f12a00b7830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009bd0 tx=0x7f12ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:59.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.126+0000 7f12bbe00640 1 --2- 172.21.15.103:0/1642115220 >> [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162] conn(0x7f12a00c05b0 0x7f12a00c2a50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:06:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.127+0000 7f12b3e00640 1 -- 172.21.15.103:0/1642115220 <== osd.3 v2:172.21.15.103:6810/2238128162 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f12a8013ec0 con 0x7f12a00c05b0 2024-09-11T01:06:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.142+0000 7f12c2200640 1 -- 172.21.15.103:0/1642115220 --> [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f12bc063ca0 con 0x7f12a00c05b0 2024-09-11T01:06:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.143+0000 7f12b3e00640 1 -- 172.21.15.103:0/1642115220 <== osd.3 v2:172.21.15.103:6810/2238128162 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f12bc063ca0 con 0x7f12a00c05b0 2024-09-11T01:06:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.143+0000 7f12c2200640 1 -- 172.21.15.103:0/1642115220 >> [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162] conn(0x7f12a00c05b0 msgr2=0x7f12a00c2a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.143+0000 7f12c2200640 1 --2- 172.21.15.103:0/1642115220 >> [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162] conn(0x7f12a00c05b0 0x7f12a00c2a50 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:06:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.143+0000 7f12c2200640 1 -- 172.21.15.103:0/1642115220 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f12a00b5370 msgr2=0x7f12a00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.143+0000 7f12c2200640 1 --2- 172.21.15.103:0/1642115220 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f12a00b5370 0x7f12a00b7830 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009bd0 tx=0x7f12ac005f90 comp rx=0 tx=0).stop 2024-09-11T01:06:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.143+0000 7f12c2200640 1 -- 172.21.15.103:0/1642115220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12bc1087d0 msgr2=0x7f12bc19b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:06:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.143+0000 7f12c2200640 1 --2- 172.21.15.103:0/1642115220 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f12bc1087d0 0x7f12bc19b9b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f12a8005fd0 tx=0x7f12a800ee50 comp rx=0 tx=0).stop 2024-09-11T01:06:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.143+0000 7f12bbe00640 1 -- 172.21.15.103:0/1642115220 reap_dead start 2024-09-11T01:06:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.143+0000 7f12c2200640 1 -- 172.21.15.103:0/1642115220 shutdown_connections 2024-09-11T01:06:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.143+0000 7f12c2200640 1 -- 172.21.15.103:0/1642115220 >> 172.21.15.103:0/1642115220 conn(0x7f12bc0fe830 msgr2=0x7f12bc104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:06:59.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.143+0000 7f12c2200640 1 -- 172.21.15.103:0/1642115220 shutdown_connections 2024-09-11T01:06:59.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:06:56.144+0000 7f12c2200640 1 -- 172.21.15.103:0/1642115220 wait complete. 2024-09-11T01:07:00.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.070+0000 7f0aae800640 1 -- 172.21.15.103:0/3552861820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0aa810f390 msgr2=0x7f0aa8111780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:00.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.070+0000 7f0aae800640 1 --2- 172.21.15.103:0/3552861820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0aa810f390 0x7f0aa8111780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009ca0 tx=0x7f0aa002a8c0 comp rx=0 tx=0).stop 2024-09-11T01:07:00.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.070+0000 7f0aae800640 1 -- 172.21.15.103:0/3552861820 shutdown_connections 2024-09-11T01:07:00.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.070+0000 7f0aae800640 1 --2- 172.21.15.103:0/3552861820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0aa810f390 0x7f0aa8111780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:00.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.070+0000 7f0aae800640 1 --2- 172.21.15.103:0/3552861820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aa8075e00 0x7f0aa810ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:00.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.070+0000 7f0aae800640 1 --2- 172.21.15.103:0/3552861820 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0aa80754e0 0x7f0aa80758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:00.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.070+0000 7f0aae800640 1 -- 172.21.15.103:0/3552861820 >> 172.21.15.103:0/3552861820 conn(0x7f0aa80fe810 msgr2=0x7f0aa8100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.070+0000 7f0aae800640 1 -- 172.21.15.103:0/3552861820 shutdown_connections 2024-09-11T01:07:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.070+0000 7f0aae800640 1 -- 172.21.15.103:0/3552861820 wait complete. 2024-09-11T01:07:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.071+0000 7f0aae800640 1 Processor -- start 2024-09-11T01:07:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.071+0000 7f0aae800640 1 -- start start 2024-09-11T01:07:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.071+0000 7f0aae800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aa80754e0 0x7f0aa819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.071+0000 7f0aae800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0aa8075e00 0x7f0aa819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.071+0000 7f0aae800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0aa810f390 0x7f0aa81a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.071+0000 7f0aae800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa8114f90 con 0x7f0aa810f390 2024-09-11T01:07:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.071+0000 7f0aae800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa8114e10 con 0x7f0aa80754e0 2024-09-11T01:07:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.071+0000 7f0aae800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa8115110 con 0x7f0aa8075e00 2024-09-11T01:07:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.072+0000 7f0aa7400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aa80754e0 0x7f0aa819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.072+0000 7f0aa7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0aa810f390 0x7f0aa81a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.072+0000 7f0aa7400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aa80754e0 0x7f0aa819b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38050/0 (socket says 172.21.15.103:38050) 2024-09-11T01:07:00.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.072+0000 7f0aa7400640 1 -- 172.21.15.103:0/2417738013 learned_addr learned my addr 172.21.15.103:0/2417738013 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:00.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.072+0000 7f0a9ea00640 1 --2- 172.21.15.103:0/2417738013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0aa8075e00 0x7f0aa819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:00.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.072+0000 7f0aa7400640 1 -- 172.21.15.103:0/2417738013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0aa8075e00 msgr2=0x7f0aa819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:00.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.072+0000 7f0aa7400640 1 --2- 172.21.15.103:0/2417738013 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0aa8075e00 0x7f0aa819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:00.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.072+0000 7f0aa7400640 1 -- 172.21.15.103:0/2417738013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0aa810f390 msgr2=0x7f0aa81a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:00.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.072+0000 7f0aa7400640 1 --2- 172.21.15.103:0/2417738013 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0aa810f390 0x7f0aa81a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:00.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.072+0000 7f0aa7400640 1 -- 172.21.15.103:0/2417738013 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa81a1510 con 0x7f0aa80754e0 2024-09-11T01:07:00.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.072+0000 7f0aa7400640 1 --2- 172.21.15.103:0/2417738013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aa80754e0 0x7f0aa819b460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800e9f0 tx=0x7f0a9800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:00.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.073+0000 7f0aa4c00640 1 -- 172.21.15.103:0/2417738013 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800cd80 con 0x7f0aa80754e0 2024-09-11T01:07:00.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.073+0000 7f0aa4c00640 1 -- 172.21.15.103:0/2417738013 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a980108e0 con 0x7f0aa80754e0 2024-09-11T01:07:00.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.073+0000 7f0aae800640 1 -- 172.21.15.103:0/2417738013 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa81a1800 con 0x7f0aa80754e0 2024-09-11T01:07:00.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.073+0000 7f0aa4c00640 1 -- 172.21.15.103:0/2417738013 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a98018980 con 0x7f0aa80754e0 2024-09-11T01:07:00.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.073+0000 7f0aae800640 1 -- 172.21.15.103:0/2417738013 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa81a8090 con 0x7f0aa80754e0 2024-09-11T01:07:00.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.074+0000 7f0aae800640 1 -- 172.21.15.103:0/2417738013 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0aa81006f0 con 0x7f0aa80754e0 2024-09-11T01:07:00.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.076+0000 7f0aa4c00640 1 -- 172.21.15.103:0/2417738013 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f0a98010430 con 0x7f0aa80754e0 2024-09-11T01:07:00.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.078+0000 7f0aa4c00640 1 --2- 172.21.15.103:0/2417738013 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0a8c0b53f0 0x7f0a8c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:00.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.078+0000 7f0aa4c00640 1 -- 172.21.15.103:0/2417738013 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f0a980e6b90 con 0x7f0aa80754e0 2024-09-11T01:07:00.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.078+0000 7f0a9ea00640 1 --2- 172.21.15.103:0/2417738013 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0a8c0b53f0 0x7f0a8c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:00.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.078+0000 7f0aa4c00640 1 --2- 172.21.15.103:0/2417738013 >> [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289] conn(0x7f0a8c0c0630 0x7f0a8c0c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:00.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.078+0000 7f0aa4c00640 1 -- 172.21.15.103:0/2417738013 --> [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a9801bec0 con 0x7f0a8c0c0630 2024-09-11T01:07:00.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.078+0000 7f0aa4c00640 1 -- 172.21.15.103:0/2417738013 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f0a980e6f40 con 0x7f0aa80754e0 2024-09-11T01:07:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.079+0000 7f0aa7e00640 1 --2- 172.21.15.103:0/2417738013 >> [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289] conn(0x7f0a8c0c0630 0x7f0a8c0c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.079+0000 7f0a9ea00640 1 --2- 172.21.15.103:0/2417738013 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0a8c0b53f0 0x7f0a8c0b78b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8102140 tx=0x7f0a9000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.079+0000 7f0aa7e00640 1 --2- 172.21.15.103:0/2417738013 >> [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289] conn(0x7f0a8c0c0630 0x7f0a8c0c2ad0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.080+0000 7f0aa4c00640 1 -- 172.21.15.103:0/2417738013 <== osd.11 v2:172.21.15.183:6824/1250387289 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a9801bec0 con 0x7f0a8c0c0630 2024-09-11T01:07:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.094+0000 7f0aae800640 1 -- 172.21.15.103:0/2417738013 --> [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0aa80769f0 con 0x7f0a8c0c0630 2024-09-11T01:07:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.095+0000 7f0aa4c00640 1 -- 172.21.15.103:0/2417738013 <== osd.11 v2:172.21.15.183:6824/1250387289 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0aa80769f0 con 0x7f0a8c0c0630 2024-09-11T01:07:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.095+0000 7f0aae800640 1 -- 172.21.15.103:0/2417738013 >> [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289] conn(0x7f0a8c0c0630 msgr2=0x7f0a8c0c2ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.095+0000 7f0aae800640 1 --2- 172.21.15.103:0/2417738013 >> [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289] conn(0x7f0a8c0c0630 0x7f0a8c0c2ad0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.096+0000 7f0aae800640 1 -- 172.21.15.103:0/2417738013 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0a8c0b53f0 msgr2=0x7f0a8c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.096+0000 7f0aae800640 1 --2- 172.21.15.103:0/2417738013 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0a8c0b53f0 0x7f0a8c0b78b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8102140 tx=0x7f0a9000b390 comp rx=0 tx=0).stop 2024-09-11T01:07:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.096+0000 7f0aae800640 1 -- 172.21.15.103:0/2417738013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aa80754e0 msgr2=0x7f0aa819b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.096+0000 7f0aae800640 1 --2- 172.21.15.103:0/2417738013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0aa80754e0 0x7f0aa819b460 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0a9800e9f0 tx=0x7f0a9800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:07:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.096+0000 7f0aa7e00640 1 -- 172.21.15.103:0/2417738013 reap_dead start 2024-09-11T01:07:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.096+0000 7f0aae800640 1 -- 172.21.15.103:0/2417738013 shutdown_connections 2024-09-11T01:07:00.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.096+0000 7f0aae800640 1 -- 172.21.15.103:0/2417738013 >> 172.21.15.103:0/2417738013 conn(0x7f0aa80fe810 msgr2=0x7f0aa81114f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:00.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.096+0000 7f0aae800640 1 -- 172.21.15.103:0/2417738013 shutdown_connections 2024-09-11T01:07:00.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.096+0000 7f0aae800640 1 -- 172.21.15.103:0/2417738013 wait complete. 2024-09-11T01:07:00.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:00 smithi117 ceph-mon[35358]: pgmap v359: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-11T01:07:00.897 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:00 smithi103 ceph-mon[30562]: pgmap v359: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-11T01:07:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:00 smithi183 ceph-mon[34992]: pgmap v359: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-11T01:07:01.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.047+0000 7f5768600640 1 -- 172.21.15.103:0/3736024340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5760102dc0 msgr2=0x7f57601031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:01.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.047+0000 7f5768600640 1 --2- 172.21.15.103:0/3736024340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5760102dc0 0x7f57601031a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5750009ca0 tx=0x7f575002a8c0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.047+0000 7f5768600640 1 -- 172.21.15.103:0/3736024340 shutdown_connections 2024-09-11T01:07:01.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.047+0000 7f5768600640 1 --2- 172.21.15.103:0/3736024340 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5760109150 0x7f576010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.047+0000 7f5768600640 1 --2- 172.21.15.103:0/3736024340 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f57601087d0 0x7f5760108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.047+0000 7f5768600640 1 --2- 172.21.15.103:0/3736024340 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5760102dc0 0x7f57601031a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.047+0000 7f5768600640 1 -- 172.21.15.103:0/3736024340 >> 172.21.15.103:0/3736024340 conn(0x7f57600fe830 msgr2=0x7f5760100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:01.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.047+0000 7f5768600640 1 -- 172.21.15.103:0/3736024340 shutdown_connections 2024-09-11T01:07:01.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.047+0000 7f5768600640 1 -- 172.21.15.103:0/3736024340 wait complete. 2024-09-11T01:07:01.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.048+0000 7f5768600640 1 Processor -- start 2024-09-11T01:07:01.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.048+0000 7f5768600640 1 -- start start 2024-09-11T01:07:01.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.048+0000 7f5768600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5760102dc0 0x7f576019b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:01.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.048+0000 7f5768600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57601087d0 0x7f576019ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:01.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.048+0000 7f5768600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5760109150 0x7f57601a0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:01.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.048+0000 7f5768600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5760112e60 con 0x7f57601087d0 2024-09-11T01:07:01.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.048+0000 7f5768600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5760112ce0 con 0x7f5760102dc0 2024-09-11T01:07:01.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.048+0000 7f5768600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5760112fe0 con 0x7f5760109150 2024-09-11T01:07:01.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.049+0000 7f5765200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57601087d0 0x7f576019ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:01.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.049+0000 7f5765200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57601087d0 0x7f576019ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52230/0 (socket says 172.21.15.103:52230) 2024-09-11T01:07:01.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.049+0000 7f5765200640 1 -- 172.21.15.103:0/1332630495 learned_addr learned my addr 172.21.15.103:0/1332630495 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:01.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.049+0000 7f5765c00640 1 --2- 172.21.15.103:0/1332630495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5760102dc0 0x7f576019b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:01.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.049+0000 7f5766600640 1 --2- 172.21.15.103:0/1332630495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5760109150 0x7f57601a0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:01.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.049+0000 7f5765200640 1 -- 172.21.15.103:0/1332630495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5760109150 msgr2=0x7f57601a0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:01.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.049+0000 7f5765200640 1 --2- 172.21.15.103:0/1332630495 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5760109150 0x7f57601a0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.049+0000 7f5765200640 1 -- 172.21.15.103:0/1332630495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5760102dc0 msgr2=0x7f576019b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:01.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.049+0000 7f5765200640 1 --2- 172.21.15.103:0/1332630495 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5760102dc0 0x7f576019b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.049+0000 7f5765200640 1 -- 172.21.15.103:0/1332630495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57601a1580 con 0x7f57601087d0 2024-09-11T01:07:01.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.050+0000 7f5765200640 1 --2- 172.21.15.103:0/1332630495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57601087d0 0x7f576019ba10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f574c00e9f0 tx=0x7f574c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:01.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.050+0000 7f575e000640 1 -- 172.21.15.103:0/1332630495 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c00ccc0 con 0x7f57601087d0 2024-09-11T01:07:01.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.050+0000 7f575e000640 1 -- 172.21.15.103:0/1332630495 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f574c0108e0 con 0x7f57601087d0 2024-09-11T01:07:01.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.050+0000 7f575e000640 1 -- 172.21.15.103:0/1332630495 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f574c018880 con 0x7f57601087d0 2024-09-11T01:07:01.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.050+0000 7f5768600640 1 -- 172.21.15.103:0/1332630495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57601a1870 con 0x7f57601087d0 2024-09-11T01:07:01.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.050+0000 7f5768600640 1 -- 172.21.15.103:0/1332630495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57601a7f30 con 0x7f57601087d0 2024-09-11T01:07:01.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.051+0000 7f5768600640 1 -- 172.21.15.103:0/1332630495 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5760100920 con 0x7f57601087d0 2024-09-11T01:07:01.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.054+0000 7f575e000640 1 -- 172.21.15.103:0/1332630495 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f574c029050 con 0x7f57601087d0 2024-09-11T01:07:01.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.055+0000 7f575e000640 1 --2- 172.21.15.103:0/1332630495 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f57440b53f0 0x7f57440b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:01.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.055+0000 7f575e000640 1 -- 172.21.15.103:0/1332630495 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f574c0e6a30 con 0x7f57601087d0 2024-09-11T01:07:01.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.056+0000 7f5765c00640 1 --2- 172.21.15.103:0/1332630495 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f57440b53f0 0x7f57440b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:01.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.056+0000 7f575e000640 1 --2- 172.21.15.103:0/1332630495 >> [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713] conn(0x7f57440c0630 0x7f57440c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:01.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.056+0000 7f575e000640 1 -- 172.21.15.103:0/1332630495 --> [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f574c024e70 con 0x7f57440c0630 2024-09-11T01:07:01.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.056+0000 7f575e000640 1 -- 172.21.15.103:0/1332630495 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f574c0e6de0 con 0x7f57601087d0 2024-09-11T01:07:01.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.056+0000 7f5766600640 1 --2- 172.21.15.103:0/1332630495 >> [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713] conn(0x7f57440c0630 0x7f57440c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:01.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.056+0000 7f5765c00640 1 --2- 172.21.15.103:0/1332630495 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f57440b53f0 0x7f57440b78b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5750006010 tx=0x7f5750009820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:01.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.057+0000 7f5766600640 1 --2- 172.21.15.103:0/1332630495 >> [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713] conn(0x7f57440c0630 0x7f57440c2ad0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:01.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.058+0000 7f575e000640 1 -- 172.21.15.103:0/1332630495 <== osd.7 v2:172.21.15.117:6816/1207680713 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f574c024e70 con 0x7f57440c0630 2024-09-11T01:07:01.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.072+0000 7f5768600640 1 -- 172.21.15.103:0/1332630495 --> [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5760104070 con 0x7f57440c0630 2024-09-11T01:07:01.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.072+0000 7f575e000640 1 -- 172.21.15.103:0/1332630495 <== osd.7 v2:172.21.15.117:6816/1207680713 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5760104070 con 0x7f57440c0630 2024-09-11T01:07:01.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.073+0000 7f5768600640 1 -- 172.21.15.103:0/1332630495 >> [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713] conn(0x7f57440c0630 msgr2=0x7f57440c2ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:01.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.073+0000 7f5768600640 1 --2- 172.21.15.103:0/1332630495 >> [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713] conn(0x7f57440c0630 0x7f57440c2ad0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.073+0000 7f5768600640 1 -- 172.21.15.103:0/1332630495 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f57440b53f0 msgr2=0x7f57440b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.073+0000 7f5768600640 1 --2- 172.21.15.103:0/1332630495 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f57440b53f0 0x7f57440b78b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5750006010 tx=0x7f5750009820 comp rx=0 tx=0).stop 2024-09-11T01:07:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.073+0000 7f5768600640 1 -- 172.21.15.103:0/1332630495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57601087d0 msgr2=0x7f576019ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.073+0000 7f5768600640 1 --2- 172.21.15.103:0/1332630495 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57601087d0 0x7f576019ba10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f574c00e9f0 tx=0x7f574c00edf0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.073+0000 7f5766600640 1 -- 172.21.15.103:0/1332630495 reap_dead start 2024-09-11T01:07:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.073+0000 7f5768600640 1 -- 172.21.15.103:0/1332630495 shutdown_connections 2024-09-11T01:07:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.073+0000 7f5768600640 1 -- 172.21.15.103:0/1332630495 >> 172.21.15.103:0/1332630495 conn(0x7f57600fe830 msgr2=0x7f57600fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.073+0000 7f5768600640 1 -- 172.21.15.103:0/1332630495 shutdown_connections 2024-09-11T01:07:01.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.073+0000 7f5768600640 1 -- 172.21.15.103:0/1332630495 wait complete. 2024-09-11T01:07:01.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.281+0000 7f7b5ca00640 1 -- 172.21.15.103:0/560950469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b58108620 msgr2=0x7f7b58108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:01.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.281+0000 7f7b5ca00640 1 --2- 172.21.15.103:0/560950469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b58108620 0x7f7b58108a60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009900 tx=0x7f7b4402a3f0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.281+0000 7f7b5ca00640 1 -- 172.21.15.103:0/560950469 shutdown_connections 2024-09-11T01:07:01.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.281+0000 7f7b5ca00640 1 --2- 172.21.15.103:0/560950469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b58108fa0 0x7f7b5810f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.281+0000 7f7b5ca00640 1 --2- 172.21.15.103:0/560950469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b58108620 0x7f7b58108a60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.281+0000 7f7b5ca00640 1 --2- 172.21.15.103:0/560950469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b58102c10 0x7f7b58102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.281+0000 7f7b5ca00640 1 -- 172.21.15.103:0/560950469 >> 172.21.15.103:0/560950469 conn(0x7f7b580fe660 msgr2=0x7f7b58100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:01.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.281+0000 7f7b5ca00640 1 -- 172.21.15.103:0/560950469 shutdown_connections 2024-09-11T01:07:01.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.281+0000 7f7b5ca00640 1 -- 172.21.15.103:0/560950469 wait complete. 2024-09-11T01:07:01.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.282+0000 7f7b5ca00640 1 Processor -- start 2024-09-11T01:07:01.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.282+0000 7f7b5ca00640 1 -- start start 2024-09-11T01:07:01.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b5ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b58102c10 0x7f7b58199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:01.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b5ca00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b58108620 0x7f7b581995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:01.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b5ca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b58108fa0 0x7f7b5819e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:01.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b5ca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7b58112c30 con 0x7f7b58102c10 2024-09-11T01:07:01.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b5ca00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7b58112ab0 con 0x7f7b58108fa0 2024-09-11T01:07:01.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b5ca00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7b58112db0 con 0x7f7b58108620 2024-09-11T01:07:01.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b57400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b58102c10 0x7f7b58199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:01.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b57400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b58102c10 0x7f7b58199080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52246/0 (socket says 172.21.15.103:52246) 2024-09-11T01:07:01.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b57400640 1 -- 172.21.15.103:0/2761074466 learned_addr learned my addr 172.21.15.103:0/2761074466 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:01.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b57e00640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b58108fa0 0x7f7b5819e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:01.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b56a00640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b58108620 0x7f7b581995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:01.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b57400640 1 -- 172.21.15.103:0/2761074466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b58108620 msgr2=0x7f7b581995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:01.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b57400640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b58108620 0x7f7b581995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b57400640 1 -- 172.21.15.103:0/2761074466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b58108fa0 msgr2=0x7f7b5819e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:01.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b57400640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b58108fa0 0x7f7b5819e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b57400640 1 -- 172.21.15.103:0/2761074466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5819f130 con 0x7f7b58102c10 2024-09-11T01:07:01.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.283+0000 7f7b56a00640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7b58108620 0x7f7b581995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:07:01.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.284+0000 7f7b57400640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b58102c10 0x7f7b58199080 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800e9f0 tx=0x7f7b4800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:01.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.284+0000 7f7b4fe00640 1 -- 172.21.15.103:0/2761074466 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4800cd80 con 0x7f7b58102c10 2024-09-11T01:07:01.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.284+0000 7f7b4fe00640 1 -- 172.21.15.103:0/2761074466 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b480108e0 con 0x7f7b58102c10 2024-09-11T01:07:01.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.284+0000 7f7b4fe00640 1 -- 172.21.15.103:0/2761074466 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b48018980 con 0x7f7b58102c10 2024-09-11T01:07:01.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.284+0000 7f7b5ca00640 1 -- 172.21.15.103:0/2761074466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b5819f420 con 0x7f7b58102c10 2024-09-11T01:07:01.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.284+0000 7f7b5ca00640 1 -- 172.21.15.103:0/2761074466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b581a5ae0 con 0x7f7b58102c10 2024-09-11T01:07:01.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.285+0000 7f7b5ca00640 1 -- 172.21.15.103:0/2761074466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b580638a0 con 0x7f7b58102c10 2024-09-11T01:07:01.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.287+0000 7f7b4fe00640 1 -- 172.21.15.103:0/2761074466 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f7b48010430 con 0x7f7b58102c10 2024-09-11T01:07:01.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.289+0000 7f7b4fe00640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7b3c0b5410 0x7f7b3c0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:01.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.289+0000 7f7b4fe00640 1 -- 172.21.15.103:0/2761074466 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f7b480e6c60 con 0x7f7b58102c10 2024-09-11T01:07:01.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.289+0000 7f7b56a00640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7b3c0b5410 0x7f7b3c0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:01.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.289+0000 7f7b4fe00640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547] conn(0x7f7b3c0c0650 0x7f7b3c0c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:01.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.289+0000 7f7b4fe00640 1 -- 172.21.15.103:0/2761074466 --> [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b4801bec0 con 0x7f7b3c0c0650 2024-09-11T01:07:01.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.289+0000 7f7b4fe00640 1 -- 172.21.15.103:0/2761074466 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f7b480e7010 con 0x7f7b58102c10 2024-09-11T01:07:01.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.290+0000 7f7b56a00640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7b3c0b5410 0x7f7b3c0b78d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b44031440 tx=0x7f7b44005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:01.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.290+0000 7f7b57e00640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547] conn(0x7f7b3c0c0650 0x7f7b3c0c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:01.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.290+0000 7f7b57e00640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547] conn(0x7f7b3c0c0650 0x7f7b3c0c2af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:01.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.291+0000 7f7b4fe00640 1 -- 172.21.15.103:0/2761074466 <== osd.5 v2:172.21.15.183:6808/1668069547 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b4801bec0 con 0x7f7b3c0c0650 2024-09-11T01:07:01.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.305+0000 7f7b5ca00640 1 -- 172.21.15.103:0/2761074466 --> [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7b58063d50 con 0x7f7b3c0c0650 2024-09-11T01:07:01.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.306+0000 7f7b4fe00640 1 -- 172.21.15.103:0/2761074466 <== osd.5 v2:172.21.15.183:6808/1668069547 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7b58063d50 con 0x7f7b3c0c0650 2024-09-11T01:07:01.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.307+0000 7f7b5ca00640 1 -- 172.21.15.103:0/2761074466 >> [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547] conn(0x7f7b3c0c0650 msgr2=0x7f7b3c0c2af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:01.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.307+0000 7f7b5ca00640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547] conn(0x7f7b3c0c0650 0x7f7b3c0c2af0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.307+0000 7f7b5ca00640 1 -- 172.21.15.103:0/2761074466 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7b3c0b5410 msgr2=0x7f7b3c0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:01.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.307+0000 7f7b5ca00640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7b3c0b5410 0x7f7b3c0b78d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b44031440 tx=0x7f7b44005a20 comp rx=0 tx=0).stop 2024-09-11T01:07:01.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.307+0000 7f7b5ca00640 1 -- 172.21.15.103:0/2761074466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b58102c10 msgr2=0x7f7b58199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:01.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.307+0000 7f7b5ca00640 1 --2- 172.21.15.103:0/2761074466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b58102c10 0x7f7b58199080 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7b4800e9f0 tx=0x7f7b4800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:07:01.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.307+0000 7f7b57e00640 1 -- 172.21.15.103:0/2761074466 reap_dead start 2024-09-11T01:07:01.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.307+0000 7f7b5ca00640 1 -- 172.21.15.103:0/2761074466 shutdown_connections 2024-09-11T01:07:01.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.307+0000 7f7b5ca00640 1 -- 172.21.15.103:0/2761074466 >> 172.21.15.103:0/2761074466 conn(0x7f7b580fe660 msgr2=0x7f7b58100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:01.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.307+0000 7f7b5ca00640 1 -- 172.21.15.103:0/2761074466 shutdown_connections 2024-09-11T01:07:01.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:01.307+0000 7f7b5ca00640 1 -- 172.21.15.103:0/2761074466 wait complete. 2024-09-11T01:07:02.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.894+0000 7fa118800640 1 -- 172.21.15.103:0/3217622541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa110104f90 msgr2=0x7fa110105370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:02.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.894+0000 7fa118800640 1 --2- 172.21.15.103:0/3217622541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa110104f90 0x7fa110105370 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa104009900 tx=0x7fa10402a410 comp rx=0 tx=0).stop 2024-09-11T01:07:02.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.894+0000 7fa118800640 1 -- 172.21.15.103:0/3217622541 shutdown_connections 2024-09-11T01:07:02.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.894+0000 7fa118800640 1 --2- 172.21.15.103:0/3217622541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa11010b320 0x7fa110111b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:02.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.894+0000 7fa118800640 1 --2- 172.21.15.103:0/3217622541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa11010a9a0 0x7fa11010ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:02.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.894+0000 7fa118800640 1 --2- 172.21.15.103:0/3217622541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa110104f90 0x7fa110105370 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:02.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.894+0000 7fa118800640 1 -- 172.21.15.103:0/3217622541 >> 172.21.15.103:0/3217622541 conn(0x7fa110100a00 msgr2=0x7fa110102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:02.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.894+0000 7fa118800640 1 -- 172.21.15.103:0/3217622541 shutdown_connections 2024-09-11T01:07:02.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.894+0000 7fa118800640 1 -- 172.21.15.103:0/3217622541 wait complete. 2024-09-11T01:07:02.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.895+0000 7fa118800640 1 Processor -- start 2024-09-11T01:07:02.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.896+0000 7fa118800640 1 -- start start 2024-09-11T01:07:02.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.896+0000 7fa118800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa110104f90 0x7fa11019b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:02.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.896+0000 7fa118800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa11010a9a0 0x7fa11019b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:02.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.896+0000 7fa118800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa11010b320 0x7fa1101a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:02.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.896+0000 7fa118800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa110114fa0 con 0x7fa11010b320 2024-09-11T01:07:02.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.896+0000 7fa118800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa110114e20 con 0x7fa11010a9a0 2024-09-11T01:07:02.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.896+0000 7fa118800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa110115120 con 0x7fa110104f90 2024-09-11T01:07:02.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.896+0000 7fa115e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa110104f90 0x7fa11019b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:02.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.896+0000 7fa115e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa110104f90 0x7fa11019b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:37650/0 (socket says 172.21.15.103:37650) 2024-09-11T01:07:02.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.896+0000 7fa115e00640 1 -- 172.21.15.103:0/296695743 learned_addr learned my addr 172.21.15.103:0/296695743 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:02.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.896+0000 7fa116800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa11010b320 0x7fa1101a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:02.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.896+0000 7fa115400640 1 --2- 172.21.15.103:0/296695743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa11010a9a0 0x7fa11019b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:02.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.897+0000 7fa115e00640 1 -- 172.21.15.103:0/296695743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa11010a9a0 msgr2=0x7fa11019b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:02.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.897+0000 7fa115e00640 1 --2- 172.21.15.103:0/296695743 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa11010a9a0 0x7fa11019b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:02.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.897+0000 7fa115e00640 1 -- 172.21.15.103:0/296695743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa11010b320 msgr2=0x7fa1101a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:02.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.897+0000 7fa115e00640 1 --2- 172.21.15.103:0/296695743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa11010b320 0x7fa1101a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:02.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.897+0000 7fa115e00640 1 -- 172.21.15.103:0/296695743 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1101a1510 con 0x7fa110104f90 2024-09-11T01:07:02.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.897+0000 7fa115e00640 1 --2- 172.21.15.103:0/296695743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa110104f90 0x7fa11019b460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa104005ab0 tx=0x7fa104003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:02.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.897+0000 7fa10aa00640 1 -- 172.21.15.103:0/296695743 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10403f070 con 0x7fa110104f90 2024-09-11T01:07:02.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.897+0000 7fa118800640 1 -- 172.21.15.103:0/296695743 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1101a17a0 con 0x7fa110104f90 2024-09-11T01:07:02.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.897+0000 7fa10aa00640 1 -- 172.21.15.103:0/296695743 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa104031b60 con 0x7fa110104f90 2024-09-11T01:07:02.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.897+0000 7fa10aa00640 1 -- 172.21.15.103:0/296695743 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa104035030 con 0x7fa110104f90 2024-09-11T01:07:02.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.898+0000 7fa118800640 1 -- 172.21.15.103:0/296695743 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1101a7ec0 con 0x7fa110104f90 2024-09-11T01:07:02.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.898+0000 7fa118800640 1 -- 172.21.15.103:0/296695743 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1100638e0 con 0x7fa110104f90 2024-09-11T01:07:02.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.901+0000 7fa10aa00640 1 -- 172.21.15.103:0/296695743 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7fa10403b460 con 0x7fa110104f90 2024-09-11T01:07:02.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.902+0000 7fa10aa00640 1 --2- 172.21.15.103:0/296695743 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0f80b5370 0x7fa0f80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:02.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.902+0000 7fa10aa00640 1 -- 172.21.15.103:0/296695743 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fa1041071a0 con 0x7fa110104f90 2024-09-11T01:07:02.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.903+0000 7fa115400640 1 --2- 172.21.15.103:0/296695743 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0f80b5370 0x7fa0f80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:02.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.903+0000 7fa10aa00640 1 --2- 172.21.15.103:0/296695743 >> [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873] conn(0x7fa0f80c05b0 0x7fa0f80c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:02.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.903+0000 7fa10aa00640 1 -- 172.21.15.103:0/296695743 --> [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa104046e50 con 0x7fa0f80c05b0 2024-09-11T01:07:02.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.903+0000 7fa10aa00640 1 -- 172.21.15.103:0/296695743 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fa104107550 con 0x7fa110104f90 2024-09-11T01:07:02.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.903+0000 7fa115400640 1 --2- 172.21.15.103:0/296695743 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0f80b5370 0x7fa0f80b7830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa11010a0e0 tx=0x7fa100005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:02.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.903+0000 7fa116800640 1 --2- 172.21.15.103:0/296695743 >> [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873] conn(0x7fa0f80c05b0 0x7fa0f80c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:02.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.904+0000 7fa116800640 1 --2- 172.21.15.103:0/296695743 >> [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873] conn(0x7fa0f80c05b0 0x7fa0f80c2a50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:02.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.905+0000 7fa10aa00640 1 -- 172.21.15.103:0/296695743 <== osd.10 v2:172.21.15.117:6824/3792981873 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa104046e50 con 0x7fa0f80c05b0 2024-09-11T01:07:02.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.919+0000 7fa118800640 1 -- 172.21.15.103:0/296695743 --> [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa110063ce0 con 0x7fa0f80c05b0 2024-09-11T01:07:02.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.920+0000 7fa10aa00640 1 -- 172.21.15.103:0/296695743 <== osd.10 v2:172.21.15.117:6824/3792981873 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa110063ce0 con 0x7fa0f80c05b0 2024-09-11T01:07:02.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.920+0000 7fa118800640 1 -- 172.21.15.103:0/296695743 >> [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873] conn(0x7fa0f80c05b0 msgr2=0x7fa0f80c2a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:02.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.920+0000 7fa118800640 1 --2- 172.21.15.103:0/296695743 >> [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873] conn(0x7fa0f80c05b0 0x7fa0f80c2a50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:02.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.920+0000 7fa118800640 1 -- 172.21.15.103:0/296695743 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0f80b5370 msgr2=0x7fa0f80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:02.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.920+0000 7fa118800640 1 --2- 172.21.15.103:0/296695743 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0f80b5370 0x7fa0f80b7830 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa11010a0e0 tx=0x7fa100005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:02.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.920+0000 7fa118800640 1 -- 172.21.15.103:0/296695743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa110104f90 msgr2=0x7fa11019b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:02.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.920+0000 7fa118800640 1 --2- 172.21.15.103:0/296695743 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa110104f90 0x7fa11019b460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa104005ab0 tx=0x7fa104003c10 comp rx=0 tx=0).stop 2024-09-11T01:07:02.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.920+0000 7fa116800640 1 -- 172.21.15.103:0/296695743 reap_dead start 2024-09-11T01:07:02.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.920+0000 7fa118800640 1 -- 172.21.15.103:0/296695743 shutdown_connections 2024-09-11T01:07:02.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.920+0000 7fa118800640 1 -- 172.21.15.103:0/296695743 >> 172.21.15.103:0/296695743 conn(0x7fa110100a00 msgr2=0x7fa110101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:02.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.921+0000 7fa118800640 1 -- 172.21.15.103:0/296695743 shutdown_connections 2024-09-11T01:07:02.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:00.921+0000 7fa118800640 1 -- 172.21.15.103:0/296695743 wait complete. 2024-09-11T01:07:02.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:02 smithi117 ceph-mon[35358]: pgmap v360: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-11T01:07:02.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:02 smithi183 ceph-mon[34992]: pgmap v360: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-11T01:07:02.958 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:02 smithi103 ceph-mon[30562]: pgmap v360: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-11T01:07:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.067+0000 7f6c3a400640 1 -- 172.21.15.103:0/1656633965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c34108fa0 msgr2=0x7f6c3410f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.067+0000 7f6c3a400640 1 --2- 172.21.15.103:0/1656633965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c34108fa0 0x7f6c3410f7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009ca0 tx=0x7f6c2c02a8c0 comp rx=0 tx=0).stop 2024-09-11T01:07:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.067+0000 7f6c3a400640 1 -- 172.21.15.103:0/1656633965 shutdown_connections 2024-09-11T01:07:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.067+0000 7f6c3a400640 1 --2- 172.21.15.103:0/1656633965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c34108fa0 0x7f6c3410f7a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.067+0000 7f6c3a400640 1 --2- 172.21.15.103:0/1656633965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c34108620 0x7f6c34108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.067+0000 7f6c3a400640 1 --2- 172.21.15.103:0/1656633965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c34102c10 0x7f6c34102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.067+0000 7f6c3a400640 1 -- 172.21.15.103:0/1656633965 >> 172.21.15.103:0/1656633965 conn(0x7f6c340fe660 msgr2=0x7f6c34100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.067+0000 7f6c3a400640 1 -- 172.21.15.103:0/1656633965 shutdown_connections 2024-09-11T01:07:03.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.067+0000 7f6c3a400640 1 -- 172.21.15.103:0/1656633965 wait complete. 2024-09-11T01:07:03.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.068+0000 7f6c3a400640 1 Processor -- start 2024-09-11T01:07:03.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.068+0000 7f6c3a400640 1 -- start start 2024-09-11T01:07:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.069+0000 7f6c3a400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c34102c10 0x7f6c34198f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.069+0000 7f6c3a400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c34108620 0x7f6c341994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.069+0000 7f6c3a400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c34108fa0 0x7f6c3419e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.069+0000 7f6c3a400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6c34112cb0 con 0x7f6c34108fa0 2024-09-11T01:07:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.069+0000 7f6c3a400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6c34112b30 con 0x7f6c34102c10 2024-09-11T01:07:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.069+0000 7f6c3a400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6c34112e30 con 0x7f6c34108620 2024-09-11T01:07:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.069+0000 7f6c39000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c34102c10 0x7f6c34198f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.069+0000 7f6c39000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c34102c10 0x7f6c34198f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38110/0 (socket says 172.21.15.103:38110) 2024-09-11T01:07:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.069+0000 7f6c39000640 1 -- 172.21.15.103:0/3422709147 learned_addr learned my addr 172.21.15.103:0/3422709147 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.069+0000 7f6c33e00640 1 --2- 172.21.15.103:0/3422709147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c34108620 0x7f6c341994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.069+0000 7f6c39a00640 1 --2- 172.21.15.103:0/3422709147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c34108fa0 0x7f6c3419e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:03.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.069+0000 7f6c39000640 1 -- 172.21.15.103:0/3422709147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c34108620 msgr2=0x7f6c341994c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.069+0000 7f6c39000640 1 --2- 172.21.15.103:0/3422709147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6c34108620 0x7f6c341994c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.070+0000 7f6c39000640 1 -- 172.21.15.103:0/3422709147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c34108fa0 msgr2=0x7f6c3419e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.070+0000 7f6c39000640 1 --2- 172.21.15.103:0/3422709147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6c34108fa0 0x7f6c3419e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.070+0000 7f6c39000640 1 -- 172.21.15.103:0/3422709147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3419f030 con 0x7f6c34102c10 2024-09-11T01:07:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.070+0000 7f6c39000640 1 --2- 172.21.15.103:0/3422709147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c34102c10 0x7f6c34198f80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400e9f0 tx=0x7f6c2400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.070+0000 7f6c31600640 1 -- 172.21.15.103:0/3422709147 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400ccc0 con 0x7f6c34102c10 2024-09-11T01:07:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.070+0000 7f6c31600640 1 -- 172.21.15.103:0/3422709147 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6c2400ce60 con 0x7f6c34102c10 2024-09-11T01:07:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.070+0000 7f6c3a400640 1 -- 172.21.15.103:0/3422709147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3419f320 con 0x7f6c34102c10 2024-09-11T01:07:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.070+0000 7f6c31600640 1 -- 172.21.15.103:0/3422709147 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c24010430 con 0x7f6c34102c10 2024-09-11T01:07:03.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.070+0000 7f6c3a400640 1 -- 172.21.15.103:0/3422709147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c34075380 con 0x7f6c34102c10 2024-09-11T01:07:03.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.071+0000 7f6c3a400640 1 -- 172.21.15.103:0/3422709147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6c341004b0 con 0x7f6c34102c10 2024-09-11T01:07:03.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.074+0000 7f6c31600640 1 -- 172.21.15.103:0/3422709147 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f6c240046c0 con 0x7f6c34102c10 2024-09-11T01:07:03.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.076+0000 7f6c31600640 1 --2- 172.21.15.103:0/3422709147 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6c180b5490 0x7f6c180b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:03.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.076+0000 7f6c31600640 1 -- 172.21.15.103:0/3422709147 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f6c240e68f0 con 0x7f6c34102c10 2024-09-11T01:07:03.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.076+0000 7f6c33e00640 1 --2- 172.21.15.103:0/3422709147 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6c180b5490 0x7f6c180b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:03.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.076+0000 7f6c31600640 1 --2- 172.21.15.103:0/3422709147 >> [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877] conn(0x7f6c180c06d0 0x7f6c180c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:03.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.076+0000 7f6c31600640 1 -- 172.21.15.103:0/3422709147 --> [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c24025ea0 con 0x7f6c180c06d0 2024-09-11T01:07:03.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.076+0000 7f6c31600640 1 -- 172.21.15.103:0/3422709147 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f6c240e6ca0 con 0x7f6c34102c10 2024-09-11T01:07:03.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.076+0000 7f6c39a00640 1 --2- 172.21.15.103:0/3422709147 >> [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877] conn(0x7f6c180c06d0 0x7f6c180c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:03.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.077+0000 7f6c33e00640 1 --2- 172.21.15.103:0/3422709147 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6c180b5490 0x7f6c180b7950 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6c34100e90 tx=0x7f6c2000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:03.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.077+0000 7f6c39a00640 1 --2- 172.21.15.103:0/3422709147 >> [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877] conn(0x7f6c180c06d0 0x7f6c180c2b70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:03.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.078+0000 7f6c31600640 1 -- 172.21.15.103:0/3422709147 <== osd.9 v2:172.21.15.103:6826/2104855877 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6c24025ea0 con 0x7f6c180c06d0 2024-09-11T01:07:03.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.097+0000 7f6c3a400640 1 -- 172.21.15.103:0/3422709147 --> [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6c34103ec0 con 0x7f6c180c06d0 2024-09-11T01:07:03.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.098+0000 7f6c31600640 1 -- 172.21.15.103:0/3422709147 <== osd.9 v2:172.21.15.103:6826/2104855877 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6c34103ec0 con 0x7f6c180c06d0 2024-09-11T01:07:03.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.098+0000 7f6c3a400640 1 -- 172.21.15.103:0/3422709147 >> [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877] conn(0x7f6c180c06d0 msgr2=0x7f6c180c2b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:03.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.098+0000 7f6c3a400640 1 --2- 172.21.15.103:0/3422709147 >> [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877] conn(0x7f6c180c06d0 0x7f6c180c2b70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:03.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.099+0000 7f6c3a400640 1 -- 172.21.15.103:0/3422709147 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6c180b5490 msgr2=0x7f6c180b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:03.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.099+0000 7f6c3a400640 1 --2- 172.21.15.103:0/3422709147 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6c180b5490 0x7f6c180b7950 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6c34100e90 tx=0x7f6c2000a2d0 comp rx=0 tx=0).stop 2024-09-11T01:07:03.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.099+0000 7f6c3a400640 1 -- 172.21.15.103:0/3422709147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c34102c10 msgr2=0x7f6c34198f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:03.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.099+0000 7f6c3a400640 1 --2- 172.21.15.103:0/3422709147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c34102c10 0x7f6c34198f80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400e9f0 tx=0x7f6c2400edf0 comp rx=0 tx=0).stop 2024-09-11T01:07:03.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.099+0000 7f6c39a00640 1 -- 172.21.15.103:0/3422709147 reap_dead start 2024-09-11T01:07:03.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.099+0000 7f6c3a400640 1 -- 172.21.15.103:0/3422709147 shutdown_connections 2024-09-11T01:07:03.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.099+0000 7f6c3a400640 1 -- 172.21.15.103:0/3422709147 >> 172.21.15.103:0/3422709147 conn(0x7f6c340fe660 msgr2=0x7f6c340fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:03.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.099+0000 7f6c3a400640 1 -- 172.21.15.103:0/3422709147 shutdown_connections 2024-09-11T01:07:03.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:03.099+0000 7f6c3a400640 1 -- 172.21.15.103:0/3422709147 wait complete. 2024-09-11T01:07:04.038 INFO:teuthology.orchestra.run.smithi103.stdout:210453397557 2024-09-11T01:07:04.039 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-11T01:07:04.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.204+0000 7f5e04e00640 1 -- 172.21.15.103:0/2368844700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e000776d0 msgr2=0x7f5e00077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:04.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.204+0000 7f5e04e00640 1 --2- 172.21.15.103:0/2368844700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e000776d0 0x7f5e00077ab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5df0009900 tx=0x7f5df002a3f0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.205+0000 7f5e04e00640 1 -- 172.21.15.103:0/2368844700 shutdown_connections 2024-09-11T01:07:04.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.205+0000 7f5e04e00640 1 --2- 172.21.15.103:0/2368844700 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e001137d0 0x7f5e00115bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.205+0000 7f5e04e00640 1 --2- 172.21.15.103:0/2368844700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e00077ff0 0x7f5e00113290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.205+0000 7f5e04e00640 1 --2- 172.21.15.103:0/2368844700 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e000776d0 0x7f5e00077ab0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.205+0000 7f5e04e00640 1 -- 172.21.15.103:0/2368844700 >> 172.21.15.103:0/2368844700 conn(0x7f5e00100830 msgr2=0x7f5e00102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:04.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.205+0000 7f5e04e00640 1 -- 172.21.15.103:0/2368844700 shutdown_connections 2024-09-11T01:07:04.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.205+0000 7f5e04e00640 1 -- 172.21.15.103:0/2368844700 wait complete. 2024-09-11T01:07:04.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.206+0000 7f5e04e00640 1 Processor -- start 2024-09-11T01:07:04.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.206+0000 7f5e04e00640 1 -- start start 2024-09-11T01:07:04.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.206+0000 7f5e04e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e000776d0 0x7f5e0019f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:04.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.206+0000 7f5e04e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e00077ff0 0x7f5e0019fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:04.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.206+0000 7f5e04e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e001137d0 0x7f5e001a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:04.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.206+0000 7f5e04e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5e001191e0 con 0x7f5e001137d0 2024-09-11T01:07:04.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.206+0000 7f5e04e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5e00119060 con 0x7f5e00077ff0 2024-09-11T01:07:04.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.206+0000 7f5e04e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5e00119360 con 0x7f5e000776d0 2024-09-11T01:07:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.207+0000 7f5dff400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e000776d0 0x7f5e0019f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.207+0000 7f5dff400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e000776d0 0x7f5e0019f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:37728/0 (socket says 172.21.15.103:37728) 2024-09-11T01:07:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.207+0000 7f5dff400640 1 -- 172.21.15.103:0/1564773094 learned_addr learned my addr 172.21.15.103:0/1564773094 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.207+0000 7f5df7e00640 1 --2- 172.21.15.103:0/1564773094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e00077ff0 0x7f5e0019fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.207+0000 7f5dffe00640 1 --2- 172.21.15.103:0/1564773094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e001137d0 0x7f5e001a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.207+0000 7f5dff400640 1 -- 172.21.15.103:0/1564773094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e00077ff0 msgr2=0x7f5e0019fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.207+0000 7f5dff400640 1 --2- 172.21.15.103:0/1564773094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e00077ff0 0x7f5e0019fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.207+0000 7f5dff400640 1 -- 172.21.15.103:0/1564773094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e001137d0 msgr2=0x7f5e001a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.207+0000 7f5dff400640 1 --2- 172.21.15.103:0/1564773094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e001137d0 0x7f5e001a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.207+0000 7f5dff400640 1 -- 172.21.15.103:0/1564773094 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e001a57a0 con 0x7f5e000776d0 2024-09-11T01:07:04.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.208+0000 7f5dff400640 1 --2- 172.21.15.103:0/1564773094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e000776d0 0x7f5e0019f6f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5df0005940 tx=0x7f5df00040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:04.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.208+0000 7f5dfcc00640 1 -- 172.21.15.103:0/1564773094 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df003f030 con 0x7f5e000776d0 2024-09-11T01:07:04.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.208+0000 7f5dfcc00640 1 -- 172.21.15.103:0/1564773094 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5df00044c0 con 0x7f5e000776d0 2024-09-11T01:07:04.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.208+0000 7f5dfcc00640 1 -- 172.21.15.103:0/1564773094 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0035070 con 0x7f5e000776d0 2024-09-11T01:07:04.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.208+0000 7f5e04e00640 1 -- 172.21.15.103:0/1564773094 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e001a5a30 con 0x7f5e000776d0 2024-09-11T01:07:04.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.208+0000 7f5e04e00640 1 -- 172.21.15.103:0/1564773094 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e001ac150 con 0x7f5e000776d0 2024-09-11T01:07:04.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.209+0000 7f5e04e00640 1 -- 172.21.15.103:0/1564773094 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5e00115c70 con 0x7f5e000776d0 2024-09-11T01:07:04.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.212+0000 7f5dfcc00640 1 -- 172.21.15.103:0/1564773094 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f5df003b960 con 0x7f5e000776d0 2024-09-11T01:07:04.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.213+0000 7f5dfcc00640 1 --2- 172.21.15.103:0/1564773094 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5de40b5410 0x7f5de40b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:04.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.213+0000 7f5dfcc00640 1 -- 172.21.15.103:0/1564773094 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5df0106dd0 con 0x7f5e000776d0 2024-09-11T01:07:04.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.214+0000 7f5df7e00640 1 --2- 172.21.15.103:0/1564773094 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5de40b5410 0x7f5de40b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:04.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.214+0000 7f5dfcc00640 1 --2- 172.21.15.103:0/1564773094 >> [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770] conn(0x7f5de40c0650 0x7f5de40c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:04.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.214+0000 7f5dfcc00640 1 -- 172.21.15.103:0/1564773094 --> [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5de40c31c0 con 0x7f5de40c0650 2024-09-11T01:07:04.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.214+0000 7f5dfcc00640 1 -- 172.21.15.103:0/1564773094 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f5df0107180 con 0x7f5e000776d0 2024-09-11T01:07:04.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.214+0000 7f5dffe00640 1 --2- 172.21.15.103:0/1564773094 >> [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770] conn(0x7f5de40c0650 0x7f5de40c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:04.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.215+0000 7f5df7e00640 1 --2- 172.21.15.103:0/1564773094 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5de40b5410 0x7f5de40b78d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5e0007a150 tx=0x7f5de8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:04.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.215+0000 7f5dffe00640 1 --2- 172.21.15.103:0/1564773094 >> [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770] conn(0x7f5de40c0650 0x7f5de40c2af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:04.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.216+0000 7f5dfcc00640 1 -- 172.21.15.103:0/1564773094 <== osd.2 v2:172.21.15.183:6800/3208966770 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5de40c31c0 con 0x7f5de40c0650 2024-09-11T01:07:04.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.230+0000 7f5e04e00640 1 -- 172.21.15.103:0/1564773094 --> [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5e00078be0 con 0x7f5de40c0650 2024-09-11T01:07:04.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.231+0000 7f5dfcc00640 1 -- 172.21.15.103:0/1564773094 <== osd.2 v2:172.21.15.183:6800/3208966770 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5e00078be0 con 0x7f5de40c0650 2024-09-11T01:07:04.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.231+0000 7f5e04e00640 1 -- 172.21.15.103:0/1564773094 >> [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770] conn(0x7f5de40c0650 msgr2=0x7f5de40c2af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:04.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.231+0000 7f5e04e00640 1 --2- 172.21.15.103:0/1564773094 >> [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770] conn(0x7f5de40c0650 0x7f5de40c2af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.231+0000 7f5e04e00640 1 -- 172.21.15.103:0/1564773094 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5de40b5410 msgr2=0x7f5de40b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:04.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.231+0000 7f5e04e00640 1 --2- 172.21.15.103:0/1564773094 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5de40b5410 0x7f5de40b78d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5e0007a150 tx=0x7f5de8005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:04.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.231+0000 7f5e04e00640 1 -- 172.21.15.103:0/1564773094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e000776d0 msgr2=0x7f5e0019f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:04.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.231+0000 7f5e04e00640 1 --2- 172.21.15.103:0/1564773094 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e000776d0 0x7f5e0019f6f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5df0005940 tx=0x7f5df00040c0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.231+0000 7f5dffe00640 1 -- 172.21.15.103:0/1564773094 reap_dead start 2024-09-11T01:07:04.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.232+0000 7f5e04e00640 1 -- 172.21.15.103:0/1564773094 shutdown_connections 2024-09-11T01:07:04.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.232+0000 7f5e04e00640 1 -- 172.21.15.103:0/1564773094 >> 172.21.15.103:0/1564773094 conn(0x7f5e00100830 msgr2=0x7f5e00102c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:04.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.232+0000 7f5e04e00640 1 -- 172.21.15.103:0/1564773094 shutdown_connections 2024-09-11T01:07:04.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.232+0000 7f5e04e00640 1 -- 172.21.15.103:0/1564773094 wait complete. 2024-09-11T01:07:04.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.808+0000 7faa1a800640 1 -- 172.21.15.103:0/1296322241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa14101720 msgr2=0x7faa14101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:04.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.808+0000 7faa1a800640 1 --2- 172.21.15.103:0/1296322241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa14101720 0x7faa14101b00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7faa08009900 tx=0x7faa0802a480 comp rx=0 tx=0).stop 2024-09-11T01:07:04.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.808+0000 7faa1a800640 1 -- 172.21.15.103:0/1296322241 shutdown_connections 2024-09-11T01:07:04.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.808+0000 7faa1a800640 1 --2- 172.21.15.103:0/1296322241 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa1410f2d0 0x7faa141116c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.808+0000 7faa1a800640 1 --2- 172.21.15.103:0/1296322241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa14102040 0x7faa1410ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.808+0000 7faa1a800640 1 --2- 172.21.15.103:0/1296322241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa14101720 0x7faa14101b00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.808+0000 7faa1a800640 1 -- 172.21.15.103:0/1296322241 >> 172.21.15.103:0/1296322241 conn(0x7faa140fd5b0 msgr2=0x7faa140ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:04.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.808+0000 7faa1a800640 1 -- 172.21.15.103:0/1296322241 shutdown_connections 2024-09-11T01:07:04.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.808+0000 7faa1a800640 1 -- 172.21.15.103:0/1296322241 wait complete. 2024-09-11T01:07:04.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.809+0000 7faa1a800640 1 Processor -- start 2024-09-11T01:07:04.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.809+0000 7faa1a800640 1 -- start start 2024-09-11T01:07:04.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa1a800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa14101720 0x7faa1419b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:04.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa1a800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa14102040 0x7faa1419b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:04.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa1a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa1410f2d0 0x7faa141a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:04.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa1a800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faa14114de0 con 0x7faa1410f2d0 2024-09-11T01:07:04.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa1a800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faa14114c60 con 0x7faa14102040 2024-09-11T01:07:04.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa1a800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faa14114f60 con 0x7faa14101720 2024-09-11T01:07:04.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa19e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa1410f2d0 0x7faa141a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:04.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa19e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa1410f2d0 0x7faa141a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52292/0 (socket says 172.21.15.103:52292) 2024-09-11T01:07:04.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa19e00640 1 -- 172.21.15.103:0/98270104 learned_addr learned my addr 172.21.15.103:0/98270104 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:04.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa18a00640 1 --2- 172.21.15.103:0/98270104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa14102040 0x7faa1419b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:04.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa19400640 1 --2- 172.21.15.103:0/98270104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa14101720 0x7faa1419b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:04.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa19e00640 1 -- 172.21.15.103:0/98270104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa14101720 msgr2=0x7faa1419b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:04.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa19e00640 1 --2- 172.21.15.103:0/98270104 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa14101720 0x7faa1419b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa19e00640 1 -- 172.21.15.103:0/98270104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa14102040 msgr2=0x7faa1419b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:04.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa19e00640 1 --2- 172.21.15.103:0/98270104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa14102040 0x7faa1419b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.810+0000 7faa19e00640 1 -- 172.21.15.103:0/98270104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa141a12e0 con 0x7faa1410f2d0 2024-09-11T01:07:04.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.811+0000 7faa19e00640 1 --2- 172.21.15.103:0/98270104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa1410f2d0 0x7faa141a0b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00efd0 tx=0x7faa0c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:04.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.811+0000 7faa12000640 1 -- 172.21.15.103:0/98270104 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c003b70 con 0x7faa1410f2d0 2024-09-11T01:07:04.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.811+0000 7faa12000640 1 -- 172.21.15.103:0/98270104 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa0c003d10 con 0x7faa1410f2d0 2024-09-11T01:07:04.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.811+0000 7faa1a800640 1 -- 172.21.15.103:0/98270104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa141a15d0 con 0x7faa1410f2d0 2024-09-11T01:07:04.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.811+0000 7faa12000640 1 -- 172.21.15.103:0/98270104 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0108a0 con 0x7faa1410f2d0 2024-09-11T01:07:04.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.811+0000 7faa1a800640 1 -- 172.21.15.103:0/98270104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa141a7c90 con 0x7faa1410f2d0 2024-09-11T01:07:04.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.812+0000 7faa1a800640 1 -- 172.21.15.103:0/98270104 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa14110a10 con 0x7faa1410f2d0 2024-09-11T01:07:04.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.815+0000 7faa12000640 1 -- 172.21.15.103:0/98270104 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7faa0c01f020 con 0x7faa1410f2d0 2024-09-11T01:07:04.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.817+0000 7faa12000640 1 --2- 172.21.15.103:0/98270104 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa9fc0b5490 0x7fa9fc0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:04.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.818+0000 7faa12000640 1 -- 172.21.15.103:0/98270104 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7faa0c0e6610 con 0x7faa1410f2d0 2024-09-11T01:07:04.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.818+0000 7faa19400640 1 --2- 172.21.15.103:0/98270104 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa9fc0b5490 0x7fa9fc0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:04.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.818+0000 7faa12000640 1 --2- 172.21.15.103:0/98270104 >> [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874] conn(0x7fa9fc0c06d0 0x7fa9fc0c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:04.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.818+0000 7faa12000640 1 -- 172.21.15.103:0/98270104 --> [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa0c011ea0 con 0x7fa9fc0c06d0 2024-09-11T01:07:04.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.818+0000 7faa12000640 1 -- 172.21.15.103:0/98270104 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7faa0c0e69c0 con 0x7faa1410f2d0 2024-09-11T01:07:04.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.818+0000 7faa18a00640 1 --2- 172.21.15.103:0/98270104 >> [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874] conn(0x7fa9fc0c06d0 0x7fa9fc0c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:04.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.819+0000 7faa19400640 1 --2- 172.21.15.103:0/98270104 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa9fc0b5490 0x7fa9fc0b7950 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faa08031440 tx=0x7faa08005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:04.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.819+0000 7faa18a00640 1 --2- 172.21.15.103:0/98270104 >> [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874] conn(0x7fa9fc0c06d0 0x7fa9fc0c2b70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:04.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.820+0000 7faa12000640 1 -- 172.21.15.103:0/98270104 <== osd.0 v2:172.21.15.103:6802/1867193874 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa0c011ea0 con 0x7fa9fc0c06d0 2024-09-11T01:07:04.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.834+0000 7faa1a800640 1 -- 172.21.15.103:0/98270104 --> [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa1406b130 con 0x7fa9fc0c06d0 2024-09-11T01:07:04.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.834+0000 7faa12000640 1 -- 172.21.15.103:0/98270104 <== osd.0 v2:172.21.15.103:6802/1867193874 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faa1406b130 con 0x7fa9fc0c06d0 2024-09-11T01:07:04.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.834+0000 7faa1a800640 1 -- 172.21.15.103:0/98270104 >> [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874] conn(0x7fa9fc0c06d0 msgr2=0x7fa9fc0c2b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:04.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.834+0000 7faa1a800640 1 --2- 172.21.15.103:0/98270104 >> [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874] conn(0x7fa9fc0c06d0 0x7fa9fc0c2b70 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.835+0000 7faa1a800640 1 -- 172.21.15.103:0/98270104 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa9fc0b5490 msgr2=0x7fa9fc0b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.835+0000 7faa1a800640 1 --2- 172.21.15.103:0/98270104 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa9fc0b5490 0x7fa9fc0b7950 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7faa08031440 tx=0x7faa08005b50 comp rx=0 tx=0).stop 2024-09-11T01:07:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.835+0000 7faa1a800640 1 -- 172.21.15.103:0/98270104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa1410f2d0 msgr2=0x7faa141a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.835+0000 7faa1a800640 1 --2- 172.21.15.103:0/98270104 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa1410f2d0 0x7faa141a0b10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00efd0 tx=0x7faa0c00c6a0 comp rx=0 tx=0).stop 2024-09-11T01:07:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.835+0000 7faa19e00640 1 -- 172.21.15.103:0/98270104 reap_dead start 2024-09-11T01:07:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.835+0000 7faa1a800640 1 -- 172.21.15.103:0/98270104 shutdown_connections 2024-09-11T01:07:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.835+0000 7faa1a800640 1 -- 172.21.15.103:0/98270104 >> 172.21.15.103:0/98270104 conn(0x7faa140fd5b0 msgr2=0x7faa14111560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.835+0000 7faa1a800640 1 -- 172.21.15.103:0/98270104 shutdown_connections 2024-09-11T01:07:04.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:04.835+0000 7faa1a800640 1 -- 172.21.15.103:0/98270104 wait complete. 2024-09-11T01:07:04.850 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:04 smithi103 ceph-mon[30562]: pgmap v361: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-11T01:07:04.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:04 smithi117 ceph-mon[35358]: pgmap v361: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-11T01:07:04.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:04 smithi183 ceph-mon[34992]: pgmap v361: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-11T01:07:05.471 INFO:teuthology.orchestra.run.smithi103.stdout:137438953540 2024-09-11T01:07:05.472 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-11T01:07:05.593 INFO:teuthology.orchestra.run.smithi103.stdout:111669149769 2024-09-11T01:07:05.593 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-11T01:07:05.693 INFO:teuthology.orchestra.run.smithi103.stdout:184683593785 2024-09-11T01:07:05.693 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-11T01:07:06.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:06 smithi117 ceph-mon[35358]: pgmap v362: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:06.877 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:06 smithi103 ceph-mon[30562]: pgmap v362: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:06.913 INFO:teuthology.orchestra.run.smithi103.stdout:283467841573 2024-09-11T01:07:06.914 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-11T01:07:06.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:06 smithi183 ceph-mon[34992]: pgmap v362: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:07.647 INFO:teuthology.orchestra.run.smithi103.stdout:309237645343 2024-09-11T01:07:07.648 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-11T01:07:08.233 INFO:teuthology.orchestra.run.smithi103.stdout:34359738458 2024-09-11T01:07:08.234 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-11T01:07:08.673 INFO:teuthology.orchestra.run.smithi103.stdout:158913790016 2024-09-11T01:07:08.673 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-11T01:07:08.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:08 smithi117 ceph-mon[35358]: pgmap v363: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:08.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:08 smithi183 ceph-mon[34992]: pgmap v363: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:09.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:08 smithi103 ceph-mon[30562]: pgmap v363: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:09.196 INFO:teuthology.orchestra.run.smithi103.stdout:261993005097 2024-09-11T01:07:09.197 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-11T01:07:10.032 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:10.094 INFO:teuthology.orchestra.run.smithi103.stdout:77309411410 2024-09-11T01:07:10.094 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-11T01:07:10.193 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:10.211 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:10.216 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:10.217 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:10.226 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:10.853 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:10 smithi103 ceph-mon[30562]: pgmap v364: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-11T01:07:10.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:10 smithi117 ceph-mon[35358]: pgmap v364: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-11T01:07:10.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:10 smithi183 ceph-mon[34992]: pgmap v364: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-11T01:07:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.507+0000 7fa538400640 1 -- 172.21.15.103:0/540766981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa530109150 msgr2=0x7fa53010f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.507+0000 7fa538400640 1 --2- 172.21.15.103:0/540766981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa530109150 0x7fa53010f950 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa528009ca0 tx=0x7fa52802a8c0 comp rx=0 tx=0).stop 2024-09-11T01:07:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.507+0000 7fa538400640 1 -- 172.21.15.103:0/540766981 shutdown_connections 2024-09-11T01:07:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.507+0000 7fa538400640 1 --2- 172.21.15.103:0/540766981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa530109150 0x7fa53010f950 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.507+0000 7fa538400640 1 --2- 172.21.15.103:0/540766981 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5301087d0 0x7fa530108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.507+0000 7fa538400640 1 --2- 172.21.15.103:0/540766981 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa530102dc0 0x7fa5301031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.507+0000 7fa538400640 1 -- 172.21.15.103:0/540766981 >> 172.21.15.103:0/540766981 conn(0x7fa5300fe830 msgr2=0x7fa530100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.507+0000 7fa538400640 1 -- 172.21.15.103:0/540766981 shutdown_connections 2024-09-11T01:07:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.507+0000 7fa538400640 1 -- 172.21.15.103:0/540766981 wait complete. 2024-09-11T01:07:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.508+0000 7fa538400640 1 Processor -- start 2024-09-11T01:07:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.508+0000 7fa538400640 1 -- start start 2024-09-11T01:07:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.509+0000 7fa538400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa530102dc0 0x7fa53019b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.509+0000 7fa538400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5301087d0 0x7fa53019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.509+0000 7fa538400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa530109150 0x7fa5301a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.509+0000 7fa538400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa530112e10 con 0x7fa530109150 2024-09-11T01:07:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.509+0000 7fa538400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa530112c90 con 0x7fa530102dc0 2024-09-11T01:07:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.509+0000 7fa538400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa530112f90 con 0x7fa5301087d0 2024-09-11T01:07:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.509+0000 7fa536400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa530109150 0x7fa5301a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.509+0000 7fa535000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5301087d0 0x7fa53019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.509+0000 7fa536400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa530109150 0x7fa5301a0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53566/0 (socket says 172.21.15.103:53566) 2024-09-11T01:07:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.509+0000 7fa535a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa530102dc0 0x7fa53019b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.509+0000 7fa536400640 1 -- 172.21.15.103:0/1905360922 learned_addr learned my addr 172.21.15.103:0/1905360922 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.510+0000 7fa535a00640 1 -- 172.21.15.103:0/1905360922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5301087d0 msgr2=0x7fa53019b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.510+0000 7fa535a00640 1 --2- 172.21.15.103:0/1905360922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5301087d0 0x7fa53019b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.510+0000 7fa535a00640 1 -- 172.21.15.103:0/1905360922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa530109150 msgr2=0x7fa5301a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.510+0000 7fa535a00640 1 --2- 172.21.15.103:0/1905360922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa530109150 0x7fa5301a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.510+0000 7fa535a00640 1 -- 172.21.15.103:0/1905360922 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5301a1530 con 0x7fa530102dc0 2024-09-11T01:07:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.510+0000 7fa536400640 1 --2- 172.21.15.103:0/1905360922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa530109150 0x7fa5301a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.510+0000 7fa535a00640 1 --2- 172.21.15.103:0/1905360922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa530102dc0 0x7fa53019b480 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa52400e9f0 tx=0x7fa52400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.510+0000 7fa52e000640 1 -- 172.21.15.103:0/1905360922 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52400ccc0 con 0x7fa530102dc0 2024-09-11T01:07:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.510+0000 7fa538400640 1 -- 172.21.15.103:0/1905360922 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5301a1820 con 0x7fa530102dc0 2024-09-11T01:07:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.510+0000 7fa52e000640 1 -- 172.21.15.103:0/1905360922 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa5240108e0 con 0x7fa530102dc0 2024-09-11T01:07:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.510+0000 7fa52e000640 1 -- 172.21.15.103:0/1905360922 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa524018880 con 0x7fa530102dc0 2024-09-11T01:07:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.510+0000 7fa538400640 1 -- 172.21.15.103:0/1905360922 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5301a80b0 con 0x7fa530102dc0 2024-09-11T01:07:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.511+0000 7fa538400640 1 -- 172.21.15.103:0/1905360922 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa530104070 con 0x7fa530102dc0 2024-09-11T01:07:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.514+0000 7fa52e000640 1 -- 172.21.15.103:0/1905360922 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7fa524010430 con 0x7fa530102dc0 2024-09-11T01:07:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.515+0000 7fa52e000640 1 --2- 172.21.15.103:0/1905360922 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa5180b5370 0x7fa5180b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.515+0000 7fa52e000640 1 -- 172.21.15.103:0/1905360922 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fa5240e6940 con 0x7fa530102dc0 2024-09-11T01:07:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.516+0000 7fa535000640 1 --2- 172.21.15.103:0/1905360922 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa5180b5370 0x7fa5180b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.516+0000 7fa535000640 1 --2- 172.21.15.103:0/1905360922 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa5180b5370 0x7fa5180b7830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa530108500 tx=0x7fa51c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:12.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.517+0000 7fa52e000640 1 -- 172.21.15.103:0/1905360922 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa5240acc40 con 0x7fa530102dc0 2024-09-11T01:07:12.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.716+0000 7fa538400640 1 -- 172.21.15.103:0/1905360922 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa53010edb0 con 0x7fa530102dc0 2024-09-11T01:07:12.719 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:12 smithi103 ceph-mon[30562]: pgmap v365: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:12.719 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:12 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2331665904' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-11T01:07:12.719 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:12 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3931866559' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-11T01:07:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.716+0000 7fa52e000640 1 -- 172.21.15.103:0/1905360922 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa5240b1670 con 0x7fa530102dc0 2024-09-11T01:07:12.719 INFO:teuthology.orchestra.run.smithi103.stdout:184683593788 2024-09-11T01:07:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.719+0000 7fa538400640 1 -- 172.21.15.103:0/1905360922 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa5180b5370 msgr2=0x7fa5180b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.719+0000 7fa538400640 1 --2- 172.21.15.103:0/1905360922 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa5180b5370 0x7fa5180b7830 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa530108500 tx=0x7fa51c005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.719+0000 7fa538400640 1 -- 172.21.15.103:0/1905360922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa530102dc0 msgr2=0x7fa53019b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.719+0000 7fa538400640 1 --2- 172.21.15.103:0/1905360922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa530102dc0 0x7fa53019b480 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa52400e9f0 tx=0x7fa52400eeb0 comp rx=0 tx=0).stop 2024-09-11T01:07:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.719+0000 7fa538400640 1 -- 172.21.15.103:0/1905360922 shutdown_connections 2024-09-11T01:07:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.719+0000 7fa538400640 1 --2- 172.21.15.103:0/1905360922 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa5180b5370 0x7fa5180b7830 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.719+0000 7fa538400640 1 --2- 172.21.15.103:0/1905360922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa530109150 0x7fa5301a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.719+0000 7fa538400640 1 --2- 172.21.15.103:0/1905360922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa5301087d0 0x7fa53019b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.719+0000 7fa538400640 1 --2- 172.21.15.103:0/1905360922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa530102dc0 0x7fa53019b480 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.719+0000 7fa538400640 1 -- 172.21.15.103:0/1905360922 >> 172.21.15.103:0/1905360922 conn(0x7fa5300fe830 msgr2=0x7fa530104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.719+0000 7fa538400640 1 -- 172.21.15.103:0/1905360922 shutdown_connections 2024-09-11T01:07:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.719+0000 7fa538400640 1 -- 172.21.15.103:0/1905360922 wait complete. 2024-09-11T01:07:12.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:12 smithi117 ceph-mon[35358]: pgmap v365: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:12 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2331665904' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-11T01:07:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:12 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3931866559' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-11T01:07:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:12 smithi183 ceph-mon[34992]: pgmap v365: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:12 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2331665904' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-11T01:07:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:12 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3931866559' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-11T01:07:13.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:13 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1905360922' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-11T01:07:13.648 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:13 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3113428261' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-11T01:07:13.759 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:13.759 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:13.760 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:13.760 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.767+0000 7f7416c00640 1 -- 172.21.15.103:0/2817665111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7410102de0 msgr2=0x7f74101031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:13.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.767+0000 7f7416c00640 1 --2- 172.21.15.103:0/2817665111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7410102de0 0x7f74101031c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7400009900 tx=0x7f740002a410 comp rx=0 tx=0).stop 2024-09-11T01:07:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.768+0000 7f7416c00640 1 -- 172.21.15.103:0/2817665111 shutdown_connections 2024-09-11T01:07:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.768+0000 7f7416c00640 1 --2- 172.21.15.103:0/2817665111 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7410109170 0x7f741010f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.768+0000 7f7416c00640 1 --2- 172.21.15.103:0/2817665111 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f74101087f0 0x7f7410108c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.768+0000 7f7416c00640 1 --2- 172.21.15.103:0/2817665111 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7410102de0 0x7f74101031c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.768+0000 7f7416c00640 1 -- 172.21.15.103:0/2817665111 >> 172.21.15.103:0/2817665111 conn(0x7f74100fe830 msgr2=0x7f7410100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.768+0000 7f7416c00640 1 -- 172.21.15.103:0/2817665111 shutdown_connections 2024-09-11T01:07:13.771 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.768+0000 7f7416c00640 1 -- 172.21.15.103:0/2817665111 wait complete. 2024-09-11T01:07:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.769+0000 7f7416c00640 1 Processor -- start 2024-09-11T01:07:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.770+0000 7f7416c00640 1 -- start start 2024-09-11T01:07:13.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.770+0000 7f7416c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7410102de0 0x7f7410197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.770+0000 7f7416c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74101087f0 0x7f74101975b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.770+0000 7f7416c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7410109170 0x7f741019c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.770+0000 7f7416c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7410110c40 con 0x7f7410109170 2024-09-11T01:07:13.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.770+0000 7f7416c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7410110ac0 con 0x7f7410102de0 2024-09-11T01:07:13.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.770+0000 7f7416c00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7410110dc0 con 0x7f74101087f0 2024-09-11T01:07:13.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.770+0000 7f740fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7410102de0 0x7f7410197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:13.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.771+0000 7f740fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7410102de0 0x7f7410197070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:35196/0 (socket says 172.21.15.103:35196) 2024-09-11T01:07:13.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.771+0000 7f740fe00640 1 -- 172.21.15.103:0/4177229171 learned_addr learned my addr 172.21.15.103:0/4177229171 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:13.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.771+0000 7f7414c00640 1 --2- 172.21.15.103:0/4177229171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7410109170 0x7f741019c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:13.774 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.771+0000 7f740f400640 1 --2- 172.21.15.103:0/4177229171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74101087f0 0x7f74101975b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.771+0000 7f7414c00640 1 -- 172.21.15.103:0/4177229171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74101087f0 msgr2=0x7f74101975b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.771+0000 7f7414c00640 1 --2- 172.21.15.103:0/4177229171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74101087f0 0x7f74101975b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.771+0000 7f7414c00640 1 -- 172.21.15.103:0/4177229171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7410102de0 msgr2=0x7f7410197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.771+0000 7f7414c00640 1 --2- 172.21.15.103:0/4177229171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7410102de0 0x7f7410197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.771+0000 7f7414c00640 1 -- 172.21.15.103:0/4177229171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f741019d120 con 0x7f7410109170 2024-09-11T01:07:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.772+0000 7f7414c00640 1 --2- 172.21.15.103:0/4177229171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7410109170 0x7f741019c950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f740800bfb0 tx=0x7f74080114a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:13.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.773+0000 7f740cc00640 1 -- 172.21.15.103:0/4177229171 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7408004b20 con 0x7f7410109170 2024-09-11T01:07:13.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.773+0000 7f740cc00640 1 -- 172.21.15.103:0/4177229171 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7408004cc0 con 0x7f7410109170 2024-09-11T01:07:13.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.773+0000 7f7416c00640 1 -- 172.21.15.103:0/4177229171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f741019d410 con 0x7f7410109170 2024-09-11T01:07:13.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.773+0000 7f740cc00640 1 -- 172.21.15.103:0/4177229171 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7408019660 con 0x7f7410109170 2024-09-11T01:07:13.776 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.773+0000 7f7416c00640 1 -- 172.21.15.103:0/4177229171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74101a3ad0 con 0x7f7410109170 2024-09-11T01:07:13.778 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.774+0000 7f7416c00640 1 -- 172.21.15.103:0/4177229171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74101031c0 con 0x7f7410109170 2024-09-11T01:07:13.782 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.779+0000 7f740cc00640 1 -- 172.21.15.103:0/4177229171 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f740802a080 con 0x7f7410109170 2024-09-11T01:07:13.783 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.781+0000 7f740cc00640 1 --2- 172.21.15.103:0/4177229171 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f73f40b53f0 0x7f73f40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:13.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.781+0000 7f740cc00640 1 -- 172.21.15.103:0/4177229171 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f74080ea160 con 0x7f7410109170 2024-09-11T01:07:13.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.784+0000 7f740fe00640 1 --2- 172.21.15.103:0/4177229171 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f73f40b53f0 0x7f73f40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:13.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.785+0000 7f740cc00640 1 -- 172.21.15.103:0/4177229171 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7408014070 con 0x7f7410109170 2024-09-11T01:07:13.788 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.786+0000 7f740fe00640 1 --2- 172.21.15.103:0/4177229171 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f73f40b53f0 0x7f73f40b78b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7400005ab0 tx=0x7f7400005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:13.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:13 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1905360922' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-11T01:07:13.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:13 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3113428261' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-11T01:07:13.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:13 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1905360922' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-11T01:07:13.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:13 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3113428261' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-11T01:07:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.986+0000 7f7416c00640 1 -- 172.21.15.103:0/4177229171 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f74101981a0 con 0x7f7410109170 2024-09-11T01:07:13.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.987+0000 7f740cc00640 1 -- 172.21.15.103:0/4177229171 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f74080b0b10 con 0x7f7410109170 2024-09-11T01:07:13.989 INFO:teuthology.orchestra.run.smithi103.stdout:55834574936 2024-09-11T01:07:13.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.990+0000 7f7416c00640 1 -- 172.21.15.103:0/4177229171 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f73f40b53f0 msgr2=0x7f73f40b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:13.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.990+0000 7f7416c00640 1 --2- 172.21.15.103:0/4177229171 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f73f40b53f0 0x7f73f40b78b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7400005ab0 tx=0x7f7400005a20 comp rx=0 tx=0).stop 2024-09-11T01:07:13.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.990+0000 7f7416c00640 1 -- 172.21.15.103:0/4177229171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7410109170 msgr2=0x7f741019c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:13.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.990+0000 7f7416c00640 1 --2- 172.21.15.103:0/4177229171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7410109170 0x7f741019c950 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f740800bfb0 tx=0x7f74080114a0 comp rx=0 tx=0).stop 2024-09-11T01:07:13.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.990+0000 7f7416c00640 1 -- 172.21.15.103:0/4177229171 shutdown_connections 2024-09-11T01:07:13.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.990+0000 7f7416c00640 1 --2- 172.21.15.103:0/4177229171 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f73f40b53f0 0x7f73f40b78b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:13.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.990+0000 7f7416c00640 1 --2- 172.21.15.103:0/4177229171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7410109170 0x7f741019c950 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:13.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.990+0000 7f7416c00640 1 --2- 172.21.15.103:0/4177229171 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f74101087f0 0x7f74101975b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:13.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.990+0000 7f7416c00640 1 --2- 172.21.15.103:0/4177229171 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7410102de0 0x7f7410197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:13.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.990+0000 7f7416c00640 1 -- 172.21.15.103:0/4177229171 >> 172.21.15.103:0/4177229171 conn(0x7f74100fe830 msgr2=0x7f7410100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:13.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.990+0000 7f7416c00640 1 -- 172.21.15.103:0/4177229171 shutdown_connections 2024-09-11T01:07:13.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.990+0000 7f7416c00640 1 -- 172.21.15.103:0/4177229171 wait complete. 2024-09-11T01:07:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.756+0000 7f225e200640 1 -- 172.21.15.103:0/4011584629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f225810b1a0 msgr2=0x7f22581119a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.756+0000 7f225e200640 1 --2- 172.21.15.103:0/4011584629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f225810b1a0 0x7f22581119a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2250009ca0 tx=0x7f225002a8c0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.756+0000 7f225e200640 1 -- 172.21.15.103:0/4011584629 shutdown_connections 2024-09-11T01:07:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.756+0000 7f225e200640 1 --2- 172.21.15.103:0/4011584629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f225810b1a0 0x7f22581119a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.756+0000 7f225e200640 1 --2- 172.21.15.103:0/4011584629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f225810a820 0x7f225810ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.756+0000 7f225e200640 1 --2- 172.21.15.103:0/4011584629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2258104e10 0x7f22581051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.756+0000 7f225e200640 1 -- 172.21.15.103:0/4011584629 >> 172.21.15.103:0/4011584629 conn(0x7f2258100840 msgr2=0x7f2258102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.756+0000 7f225e200640 1 -- 172.21.15.103:0/4011584629 shutdown_connections 2024-09-11T01:07:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.756+0000 7f225e200640 1 -- 172.21.15.103:0/4011584629 wait complete. 2024-09-11T01:07:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.757+0000 7f225e200640 1 Processor -- start 2024-09-11T01:07:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.757+0000 7f225e200640 1 -- start start 2024-09-11T01:07:14.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.757+0000 7f225e200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2258104e10 0x7f225819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.757+0000 7f225e200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f225810a820 0x7f225819b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.757+0000 7f225e200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f225810b1a0 0x7f22581a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.758+0000 7f225e200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2258114eb0 con 0x7f225810b1a0 2024-09-11T01:07:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.758+0000 7f225e200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2258114d30 con 0x7f2258104e10 2024-09-11T01:07:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.758+0000 7f225e200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2258115030 con 0x7f225810a820 2024-09-11T01:07:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.758+0000 7f225d800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f225810b1a0 0x7f22581a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.758+0000 7f225d800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f225810b1a0 0x7f22581a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53528/0 (socket says 172.21.15.103:53528) 2024-09-11T01:07:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.758+0000 7f225d800640 1 -- 172.21.15.103:0/2331665904 learned_addr learned my addr 172.21.15.103:0/2331665904 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.758+0000 7f224fe00640 1 --2- 172.21.15.103:0/2331665904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f225810a820 0x7f225819b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.758+0000 7f225ce00640 1 --2- 172.21.15.103:0/2331665904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2258104e10 0x7f225819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.758+0000 7f225d800640 1 -- 172.21.15.103:0/2331665904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f225810a820 msgr2=0x7f225819b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.758+0000 7f225d800640 1 --2- 172.21.15.103:0/2331665904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f225810a820 0x7f225819b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.758+0000 7f225d800640 1 -- 172.21.15.103:0/2331665904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2258104e10 msgr2=0x7f225819b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.758+0000 7f225d800640 1 --2- 172.21.15.103:0/2331665904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2258104e10 0x7f225819b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.758+0000 7f225d800640 1 -- 172.21.15.103:0/2331665904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22581a1270 con 0x7f225810b1a0 2024-09-11T01:07:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.759+0000 7f225d800640 1 --2- 172.21.15.103:0/2331665904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f225810b1a0 0x7f22581a0aa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f225002f540 tx=0x7f22500316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.759+0000 7f2256000640 1 -- 172.21.15.103:0/2331665904 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2250003b70 con 0x7f225810b1a0 2024-09-11T01:07:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.759+0000 7f2256000640 1 -- 172.21.15.103:0/2331665904 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2250003d10 con 0x7f225810b1a0 2024-09-11T01:07:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.759+0000 7f225e200640 1 -- 172.21.15.103:0/2331665904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22581a1500 con 0x7f225810b1a0 2024-09-11T01:07:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.759+0000 7f2256000640 1 -- 172.21.15.103:0/2331665904 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f225002f990 con 0x7f225810b1a0 2024-09-11T01:07:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.759+0000 7f225e200640 1 -- 172.21.15.103:0/2331665904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22581a7c20 con 0x7f225810b1a0 2024-09-11T01:07:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.760+0000 7f225e200640 1 -- 172.21.15.103:0/2331665904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22581051f0 con 0x7f225810b1a0 2024-09-11T01:07:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.762+0000 7f2256000640 1 -- 172.21.15.103:0/2331665904 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f225002fb30 con 0x7f225810b1a0 2024-09-11T01:07:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.764+0000 7f2256000640 1 --2- 172.21.15.103:0/2331665904 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f223c0b5490 0x7f223c0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.764+0000 7f2256000640 1 -- 172.21.15.103:0/2331665904 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f22501072d0 con 0x7f225810b1a0 2024-09-11T01:07:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.764+0000 7f225ce00640 1 --2- 172.21.15.103:0/2331665904 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f223c0b5490 0x7f223c0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:14.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.764+0000 7f225ce00640 1 --2- 172.21.15.103:0/2331665904 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f223c0b5490 0x7f223c0b7950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f22480095f0 tx=0x7f2248005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:14.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.767+0000 7f2256000640 1 -- 172.21.15.103:0/2331665904 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f22500cdc20 con 0x7f225810b1a0 2024-09-11T01:07:14.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.966+0000 7f225e200640 1 -- 172.21.15.103:0/2331665904 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f22581a7f90 con 0x7f225810b1a0 2024-09-11T01:07:14.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.967+0000 7f2256000640 1 -- 172.21.15.103:0/2331665904 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f22500cd520 con 0x7f225810b1a0 2024-09-11T01:07:14.023 INFO:teuthology.orchestra.run.smithi103.stdout:137438953543 2024-09-11T01:07:14.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.969+0000 7f225e200640 1 -- 172.21.15.103:0/2331665904 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f223c0b5490 msgr2=0x7f223c0b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:14.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.969+0000 7f225e200640 1 --2- 172.21.15.103:0/2331665904 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f223c0b5490 0x7f223c0b7950 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f22480095f0 tx=0x7f2248005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:14.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.969+0000 7f225e200640 1 -- 172.21.15.103:0/2331665904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f225810b1a0 msgr2=0x7f22581a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:14.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.969+0000 7f225e200640 1 --2- 172.21.15.103:0/2331665904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f225810b1a0 0x7f22581a0aa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f225002f540 tx=0x7f22500316f0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.969+0000 7f225e200640 1 -- 172.21.15.103:0/2331665904 shutdown_connections 2024-09-11T01:07:14.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.969+0000 7f225e200640 1 --2- 172.21.15.103:0/2331665904 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f223c0b5490 0x7f223c0b7950 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.969+0000 7f225e200640 1 --2- 172.21.15.103:0/2331665904 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f225810b1a0 0x7f22581a0aa0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.969+0000 7f225e200640 1 --2- 172.21.15.103:0/2331665904 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f225810a820 0x7f225819b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.969+0000 7f225e200640 1 --2- 172.21.15.103:0/2331665904 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2258104e10 0x7f225819b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.969+0000 7f225e200640 1 -- 172.21.15.103:0/2331665904 >> 172.21.15.103:0/2331665904 conn(0x7f2258100840 msgr2=0x7f2258103d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:14.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.969+0000 7f225e200640 1 -- 172.21.15.103:0/2331665904 shutdown_connections 2024-09-11T01:07:14.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.969+0000 7f225e200640 1 -- 172.21.15.103:0/2331665904 wait complete. 2024-09-11T01:07:14.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.857+0000 7f614fe00640 1 -- 172.21.15.103:0/813546967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6150104df0 msgr2=0x7f61501051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:14.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.857+0000 7f614fe00640 1 --2- 172.21.15.103:0/813546967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6150104df0 0x7f61501051d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6140009ca0 tx=0x7f614002a8c0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.857+0000 7f614fe00640 1 -- 172.21.15.103:0/813546967 shutdown_connections 2024-09-11T01:07:14.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.857+0000 7f614fe00640 1 --2- 172.21.15.103:0/813546967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f615010b180 0x7f6150111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.857+0000 7f614fe00640 1 --2- 172.21.15.103:0/813546967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f615010a800 0x7f615010ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.857+0000 7f614fe00640 1 --2- 172.21.15.103:0/813546967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6150104df0 0x7f61501051d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.857+0000 7f614fe00640 1 -- 172.21.15.103:0/813546967 >> 172.21.15.103:0/813546967 conn(0x7f6150100840 msgr2=0x7f6150102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:14.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.857+0000 7f614fe00640 1 -- 172.21.15.103:0/813546967 shutdown_connections 2024-09-11T01:07:14.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.857+0000 7f614fe00640 1 -- 172.21.15.103:0/813546967 wait complete. 2024-09-11T01:07:14.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.858+0000 7f614fe00640 1 Processor -- start 2024-09-11T01:07:14.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.858+0000 7f614fe00640 1 -- start start 2024-09-11T01:07:14.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.858+0000 7f614fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6150104df0 0x7f615019b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:14.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.858+0000 7f614fe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f615010a800 0x7f615019b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:14.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.858+0000 7f614fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f615010b180 0x7f61501a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:14.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.858+0000 7f614fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6150114e90 con 0x7f615010b180 2024-09-11T01:07:14.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.858+0000 7f614fe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6150114d10 con 0x7f6150104df0 2024-09-11T01:07:14.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.858+0000 7f614fe00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6150115010 con 0x7f615010a800 2024-09-11T01:07:14.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.859+0000 7f614f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f615010b180 0x7f61501a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:14.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.859+0000 7f614ea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6150104df0 0x7f615019b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:14.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.859+0000 7f614f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f615010b180 0x7f61501a0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53598/0 (socket says 172.21.15.103:53598) 2024-09-11T01:07:14.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.859+0000 7f614f400640 1 -- 172.21.15.103:0/3113428261 learned_addr learned my addr 172.21.15.103:0/3113428261 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:14.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.859+0000 7f614e000640 1 --2- 172.21.15.103:0/3113428261 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f615010a800 0x7f615019b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.859+0000 7f614f400640 1 -- 172.21.15.103:0/3113428261 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f615010a800 msgr2=0x7f615019b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.859+0000 7f614f400640 1 --2- 172.21.15.103:0/3113428261 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f615010a800 0x7f615019b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.859+0000 7f614f400640 1 -- 172.21.15.103:0/3113428261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6150104df0 msgr2=0x7f615019b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.859+0000 7f614f400640 1 --2- 172.21.15.103:0/3113428261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6150104df0 0x7f615019b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.859+0000 7f614f400640 1 -- 172.21.15.103:0/3113428261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61501a1290 con 0x7f615010b180 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.859+0000 7f614f400640 1 --2- 172.21.15.103:0/3113428261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f615010b180 0x7f61501a0ac0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f614800e970 tx=0x7f614800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.860+0000 7f6147400640 1 -- 172.21.15.103:0/3113428261 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f614800ccc0 con 0x7f615010b180 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.860+0000 7f6147400640 1 -- 172.21.15.103:0/3113428261 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f614800ce60 con 0x7f615010b180 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.860+0000 7f614fe00640 1 -- 172.21.15.103:0/3113428261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61501a1580 con 0x7f615010b180 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.860+0000 7f6147400640 1 -- 172.21.15.103:0/3113428261 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148010430 con 0x7f615010b180 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.860+0000 7f614fe00640 1 -- 172.21.15.103:0/3113428261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61501a7c40 con 0x7f615010b180 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.861+0000 7f614fe00640 1 -- 172.21.15.103:0/3113428261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61501051d0 con 0x7f615010b180 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.865+0000 7f6147400640 1 -- 172.21.15.103:0/3113428261 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f6148004fb0 con 0x7f615010b180 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.866+0000 7f6147400640 1 --2- 172.21.15.103:0/3113428261 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f61340b5410 0x7f61340b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:14.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.866+0000 7f6147400640 1 -- 172.21.15.103:0/3113428261 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f61480e6730 con 0x7f615010b180 2024-09-11T01:07:14.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.866+0000 7f614ea00640 1 --2- 172.21.15.103:0/3113428261 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f61340b5410 0x7f61340b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:14.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.867+0000 7f614ea00640 1 --2- 172.21.15.103:0/3113428261 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f61340b5410 0x7f61340b78d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6140006010 tx=0x7f6140009820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:14.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.868+0000 7f6147400640 1 -- 172.21.15.103:0/3113428261 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6148056220 con 0x7f615010b180 2024-09-11T01:07:14.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.060+0000 7f614fe00640 1 -- 172.21.15.103:0/3113428261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f61501a7fa0 con 0x7f615010b180 2024-09-11T01:07:14.579 INFO:teuthology.orchestra.run.smithi103.stdout:283467841575 2024-09-11T01:07:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.061+0000 7f6147400640 1 -- 172.21.15.103:0/3113428261 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f61480ad080 con 0x7f615010b180 2024-09-11T01:07:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.063+0000 7f614fe00640 1 -- 172.21.15.103:0/3113428261 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f61340b5410 msgr2=0x7f61340b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.063+0000 7f614fe00640 1 --2- 172.21.15.103:0/3113428261 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f61340b5410 0x7f61340b78d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6140006010 tx=0x7f6140009820 comp rx=0 tx=0).stop 2024-09-11T01:07:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.063+0000 7f614fe00640 1 -- 172.21.15.103:0/3113428261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f615010b180 msgr2=0x7f61501a0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.063+0000 7f614fe00640 1 --2- 172.21.15.103:0/3113428261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f615010b180 0x7f61501a0ac0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f614800e970 tx=0x7f614800ed70 comp rx=0 tx=0).stop 2024-09-11T01:07:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.063+0000 7f614fe00640 1 -- 172.21.15.103:0/3113428261 shutdown_connections 2024-09-11T01:07:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.063+0000 7f614fe00640 1 --2- 172.21.15.103:0/3113428261 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f61340b5410 0x7f61340b78d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.063+0000 7f614fe00640 1 --2- 172.21.15.103:0/3113428261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f615010b180 0x7f61501a0ac0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.063+0000 7f614fe00640 1 --2- 172.21.15.103:0/3113428261 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f615010a800 0x7f615019b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.063+0000 7f614fe00640 1 --2- 172.21.15.103:0/3113428261 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6150104df0 0x7f615019b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.063+0000 7f614fe00640 1 -- 172.21.15.103:0/3113428261 >> 172.21.15.103:0/3113428261 conn(0x7f6150100840 msgr2=0x7f6150103cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.064+0000 7f614fe00640 1 -- 172.21.15.103:0/3113428261 shutdown_connections 2024-09-11T01:07:14.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.064+0000 7f614fe00640 1 -- 172.21.15.103:0/3113428261 wait complete. 2024-09-11T01:07:14.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:14 smithi117 ceph-mon[35358]: pgmap v366: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-11T01:07:14.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:14 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/4177229171' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-11T01:07:14.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:14 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3487764782' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-11T01:07:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:14 smithi183 ceph-mon[34992]: pgmap v366: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-11T01:07:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:14 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/4177229171' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-11T01:07:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:14 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3487764782' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-11T01:07:14.944 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:14 smithi103 ceph-mon[30562]: pgmap v366: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-11T01:07:14.944 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:14 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/4177229171' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-11T01:07:14.945 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:14 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3487764782' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-11T01:07:14.983 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593785 got 184683593788 for osd.6 2024-09-11T01:07:14.983 DEBUG:teuthology.parallel:result is None 2024-09-11T01:07:15.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.989+0000 7fad6fe00640 1 -- 172.21.15.103:0/1713836667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70108620 msgr2=0x7fad70108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:15.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.989+0000 7fad6fe00640 1 --2- 172.21.15.103:0/1713836667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70108620 0x7fad70108a60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fad5c009900 tx=0x7fad5c02a3f0 comp rx=0 tx=0).stop 2024-09-11T01:07:15.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.989+0000 7fad6fe00640 1 -- 172.21.15.103:0/1713836667 shutdown_connections 2024-09-11T01:07:15.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.989+0000 7fad6fe00640 1 --2- 172.21.15.103:0/1713836667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad70108fa0 0x7fad7010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:15.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.989+0000 7fad6fe00640 1 --2- 172.21.15.103:0/1713836667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70108620 0x7fad70108a60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:15.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.989+0000 7fad6fe00640 1 --2- 172.21.15.103:0/1713836667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad70102c10 0x7fad70102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:15.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.989+0000 7fad6fe00640 1 -- 172.21.15.103:0/1713836667 >> 172.21.15.103:0/1713836667 conn(0x7fad700fe660 msgr2=0x7fad70100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:15.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.989+0000 7fad6fe00640 1 -- 172.21.15.103:0/1713836667 shutdown_connections 2024-09-11T01:07:15.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.989+0000 7fad6fe00640 1 -- 172.21.15.103:0/1713836667 wait complete. 2024-09-11T01:07:15.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.990+0000 7fad6fe00640 1 Processor -- start 2024-09-11T01:07:15.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.991+0000 7fad6fe00640 1 -- start start 2024-09-11T01:07:15.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.991+0000 7fad6fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70102c10 0x7fad700754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:15.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.991+0000 7fad6fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad70108620 0x7fad700759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:15.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.991+0000 7fad6fe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad70108fa0 0x7fad70075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:15.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.991+0000 7fad6fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fad70112c40 con 0x7fad70102c10 2024-09-11T01:07:15.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.991+0000 7fad6fe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fad70112ac0 con 0x7fad70108620 2024-09-11T01:07:15.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.991+0000 7fad6fe00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fad70112dc0 con 0x7fad70108fa0 2024-09-11T01:07:15.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.991+0000 7fad6ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70102c10 0x7fad700754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:15.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.991+0000 7fad6f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad70108fa0 0x7fad70075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:15.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.991+0000 7fad6f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad70108fa0 0x7fad70075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:46112/0 (socket says 172.21.15.103:46112) 2024-09-11T01:07:15.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.991+0000 7fad6f400640 1 -- 172.21.15.103:0/3487764782 learned_addr learned my addr 172.21.15.103:0/3487764782 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:15.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.992+0000 7fad6e000640 1 --2- 172.21.15.103:0/3487764782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad70108620 0x7fad700759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:15.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.992+0000 7fad6f400640 1 -- 172.21.15.103:0/3487764782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad70108620 msgr2=0x7fad700759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:15.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.992+0000 7fad6f400640 1 --2- 172.21.15.103:0/3487764782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad70108620 0x7fad700759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:15.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.992+0000 7fad6f400640 1 -- 172.21.15.103:0/3487764782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70102c10 msgr2=0x7fad700754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:15.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.992+0000 7fad6f400640 1 --2- 172.21.15.103:0/3487764782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70102c10 0x7fad700754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:15.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.992+0000 7fad6f400640 1 -- 172.21.15.103:0/3487764782 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad701a7430 con 0x7fad70108fa0 2024-09-11T01:07:15.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.992+0000 7fad6f400640 1 --2- 172.21.15.103:0/3487764782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad70108fa0 0x7fad70075f20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad6800eb10 tx=0x7fad6800c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:15.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.992+0000 7fad67400640 1 -- 172.21.15.103:0/3487764782 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68004b20 con 0x7fad70108fa0 2024-09-11T01:07:15.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.993+0000 7fad6fe00640 1 -- 172.21.15.103:0/3487764782 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad701a7720 con 0x7fad70108fa0 2024-09-11T01:07:15.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.993+0000 7fad67400640 1 -- 172.21.15.103:0/3487764782 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fad68004cc0 con 0x7fad70108fa0 2024-09-11T01:07:15.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.993+0000 7fad67400640 1 -- 172.21.15.103:0/3487764782 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad68010670 con 0x7fad70108fa0 2024-09-11T01:07:15.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.993+0000 7fad6fe00640 1 -- 172.21.15.103:0/3487764782 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad701a7c30 con 0x7fad70108fa0 2024-09-11T01:07:15.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.994+0000 7fad6fe00640 1 -- 172.21.15.103:0/3487764782 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad70102ff0 con 0x7fad70108fa0 2024-09-11T01:07:15.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.996+0000 7fad67400640 1 -- 172.21.15.103:0/3487764782 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7fad68005020 con 0x7fad70108fa0 2024-09-11T01:07:15.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.997+0000 7fad67400640 1 --2- 172.21.15.103:0/3487764782 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fad540b5410 0x7fad540b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:15.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.998+0000 7fad67400640 1 -- 172.21.15.103:0/3487764782 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fad680e66f0 con 0x7fad70108fa0 2024-09-11T01:07:15.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.998+0000 7fad6ea00640 1 --2- 172.21.15.103:0/3487764782 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fad540b5410 0x7fad540b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:15.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:13.998+0000 7fad6ea00640 1 --2- 172.21.15.103:0/3487764782 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fad540b5410 0x7fad540b78d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fad600095f0 tx=0x7fad60005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:15.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.000+0000 7fad67400640 1 -- 172.21.15.103:0/3487764782 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fad680ad040 con 0x7fad70108fa0 2024-09-11T01:07:15.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.197+0000 7fad6fe00640 1 -- 172.21.15.103:0/3487764782 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fad701a8090 con 0x7fad70108fa0 2024-09-11T01:07:15.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.198+0000 7fad67400640 1 -- 172.21.15.103:0/3487764782 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fad680ac940 con 0x7fad70108fa0 2024-09-11T01:07:15.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.200+0000 7fad6fe00640 1 -- 172.21.15.103:0/3487764782 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fad540b5410 msgr2=0x7fad540b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:15.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.200+0000 7fad6fe00640 1 --2- 172.21.15.103:0/3487764782 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fad540b5410 0x7fad540b78d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fad600095f0 tx=0x7fad60005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:15.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.200+0000 7fad6fe00640 1 -- 172.21.15.103:0/3487764782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad70108fa0 msgr2=0x7fad70075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:15.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.200+0000 7fad6fe00640 1 --2- 172.21.15.103:0/3487764782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad70108fa0 0x7fad70075f20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fad6800eb10 tx=0x7fad6800c2d0 comp rx=0 tx=0).stop 2024-09-11T01:07:15.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.200+0000 7fad6fe00640 1 -- 172.21.15.103:0/3487764782 shutdown_connections 2024-09-11T01:07:15.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.200+0000 7fad6fe00640 1 --2- 172.21.15.103:0/3487764782 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fad540b5410 0x7fad540b78d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:15.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.200+0000 7fad6fe00640 1 --2- 172.21.15.103:0/3487764782 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fad70108fa0 0x7fad70075f20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:15.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.200+0000 7fad6fe00640 1 --2- 172.21.15.103:0/3487764782 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fad70108620 0x7fad700759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:15.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.200+0000 7fad6fe00640 1 --2- 172.21.15.103:0/3487764782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70102c10 0x7fad700754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:15.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.200+0000 7fad6fe00640 1 -- 172.21.15.103:0/3487764782 >> 172.21.15.103:0/3487764782 conn(0x7fad700fe660 msgr2=0x7fad70100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:15.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.200+0000 7fad6fe00640 1 -- 172.21.15.103:0/3487764782 shutdown_connections 2024-09-11T01:07:15.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:14.200+0000 7fad6fe00640 1 -- 172.21.15.103:0/3487764782 wait complete. 2024-09-11T01:07:15.217 INFO:teuthology.orchestra.run.smithi103.stdout:236223201330 2024-09-11T01:07:16.047 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841573 got 283467841575 for osd.10 2024-09-11T01:07:16.047 DEBUG:teuthology.parallel:result is None 2024-09-11T01:07:16.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.890+0000 7fc27f400640 1 -- 172.21.15.103:0/3435282256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27810d120 msgr2=0x7fc27810f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:16.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.890+0000 7fc27f400640 1 --2- 172.21.15.103:0/3435282256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27810d120 0x7fc27810f580 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc270009ca0 tx=0x7fc27002a8c0 comp rx=0 tx=0).stop 2024-09-11T01:07:16.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.890+0000 7fc27f400640 1 -- 172.21.15.103:0/3435282256 shutdown_connections 2024-09-11T01:07:16.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.890+0000 7fc27f400640 1 --2- 172.21.15.103:0/3435282256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27810d120 0x7fc27810f580 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:16.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.890+0000 7fc27f400640 1 --2- 172.21.15.103:0/3435282256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2781045e0 0x7fc27810cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:16.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.890+0000 7fc27f400640 1 --2- 172.21.15.103:0/3435282256 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc278103cc0 0x7fc2781040a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:16.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.890+0000 7fc27f400640 1 -- 172.21.15.103:0/3435282256 >> 172.21.15.103:0/3435282256 conn(0x7fc2780fd700 msgr2=0x7fc2780ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:16.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.890+0000 7fc27f400640 1 -- 172.21.15.103:0/3435282256 shutdown_connections 2024-09-11T01:07:16.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.890+0000 7fc27f400640 1 -- 172.21.15.103:0/3435282256 wait complete. 2024-09-11T01:07:16.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.891+0000 7fc27f400640 1 Processor -- start 2024-09-11T01:07:16.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.891+0000 7fc27f400640 1 -- start start 2024-09-11T01:07:16.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.891+0000 7fc27f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc278103cc0 0x7fc27819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:16.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.891+0000 7fc27f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2781045e0 0x7fc27819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:16.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.891+0000 7fc27f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27810d120 0x7fc2781a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:16.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.891+0000 7fc27f400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc278112d90 con 0x7fc27810d120 2024-09-11T01:07:16.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.891+0000 7fc27f400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc278112c10 con 0x7fc2781045e0 2024-09-11T01:07:16.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.891+0000 7fc27f400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc278112f10 con 0x7fc278103cc0 2024-09-11T01:07:16.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.892+0000 7fc27d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27810d120 0x7fc2781a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:16.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.892+0000 7fc27ca00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc278103cc0 0x7fc27819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:16.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.892+0000 7fc27d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27810d120 0x7fc2781a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53538/0 (socket says 172.21.15.103:53538) 2024-09-11T01:07:16.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.892+0000 7fc27d400640 1 -- 172.21.15.103:0/3931866559 learned_addr learned my addr 172.21.15.103:0/3931866559 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:16.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.892+0000 7fc26fe00640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2781045e0 0x7fc27819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:16.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.892+0000 7fc27d400640 1 -- 172.21.15.103:0/3931866559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc278103cc0 msgr2=0x7fc27819b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:16.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.892+0000 7fc27d400640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc278103cc0 0x7fc27819b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:16.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.892+0000 7fc27d400640 1 -- 172.21.15.103:0/3931866559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2781045e0 msgr2=0x7fc27819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:16.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.892+0000 7fc27d400640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2781045e0 0x7fc27819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:16.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.892+0000 7fc27d400640 1 -- 172.21.15.103:0/3931866559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2781a1510 con 0x7fc27810d120 2024-09-11T01:07:16.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.892+0000 7fc27ca00640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc278103cc0 0x7fc27819b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:16.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.892+0000 7fc26fe00640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2781045e0 0x7fc27819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:16.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.893+0000 7fc27d400640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27810d120 0x7fc2781a0d40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc270005cc0 tx=0x7fc270031700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:16.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.893+0000 7fc276000640 1 -- 172.21.15.103:0/3931866559 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc270003b70 con 0x7fc27810d120 2024-09-11T01:07:16.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.893+0000 7fc276000640 1 -- 172.21.15.103:0/3931866559 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc2700318f0 con 0x7fc27810d120 2024-09-11T01:07:16.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.893+0000 7fc27f400640 1 -- 172.21.15.103:0/3931866559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2781a17a0 con 0x7fc27810d120 2024-09-11T01:07:16.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.893+0000 7fc276000640 1 -- 172.21.15.103:0/3931866559 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27002f950 con 0x7fc27810d120 2024-09-11T01:07:16.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.893+0000 7fc27f400640 1 -- 172.21.15.103:0/3931866559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2781a7ec0 con 0x7fc27810d120 2024-09-11T01:07:16.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.894+0000 7fc27f400640 1 -- 172.21.15.103:0/3931866559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2781040a0 con 0x7fc27810d120 2024-09-11T01:07:16.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.897+0000 7fc276000640 1 -- 172.21.15.103:0/3931866559 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7fc27002fb50 con 0x7fc27810d120 2024-09-11T01:07:16.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.898+0000 7fc276000640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc25c0b53f0 0x7fc25c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:16.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.898+0000 7fc276000640 1 -- 172.21.15.103:0/3931866559 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fc2701071f0 con 0x7fc27810d120 2024-09-11T01:07:16.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.899+0000 7fc27ca00640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc25c0b53f0 0x7fc25c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:16.114 INFO:teuthology.orchestra.run.smithi103.stdout:210453397559 2024-09-11T01:07:16.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.899+0000 7fc27ca00640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc25c0b53f0 0x7fc25c0b78b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2680095f0 tx=0x7fc268005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:16.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:11.902+0000 7fc276000640 1 -- 172.21.15.103:0/3931866559 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc2700cdb40 con 0x7fc27810d120 2024-09-11T01:07:16.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.098+0000 7fc27f400640 1 -- 172.21.15.103:0/3931866559 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc2781a82a0 con 0x7fc27810d120 2024-09-11T01:07:16.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.098+0000 7fc276000640 1 -- 172.21.15.103:0/3931866559 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc2700eee20 con 0x7fc27810d120 2024-09-11T01:07:16.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.101+0000 7fc27f400640 1 -- 172.21.15.103:0/3931866559 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc25c0b53f0 msgr2=0x7fc25c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:16.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.101+0000 7fc27f400640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc25c0b53f0 0x7fc25c0b78b0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc2680095f0 tx=0x7fc268005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:16.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.101+0000 7fc27f400640 1 -- 172.21.15.103:0/3931866559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27810d120 msgr2=0x7fc2781a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:16.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.101+0000 7fc27f400640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27810d120 0x7fc2781a0d40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc270005cc0 tx=0x7fc270031700 comp rx=0 tx=0).stop 2024-09-11T01:07:16.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.101+0000 7fc27f400640 1 -- 172.21.15.103:0/3931866559 shutdown_connections 2024-09-11T01:07:16.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.101+0000 7fc27f400640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc25c0b53f0 0x7fc25c0b78b0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:16.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.101+0000 7fc27f400640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc27810d120 0x7fc2781a0d40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:16.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.101+0000 7fc27f400640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc2781045e0 0x7fc27819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:16.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.101+0000 7fc27f400640 1 --2- 172.21.15.103:0/3931866559 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc278103cc0 0x7fc27819b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:16.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.101+0000 7fc27f400640 1 -- 172.21.15.103:0/3931866559 >> 172.21.15.103:0/3931866559 conn(0x7fc2780fd700 msgr2=0x7fc27810f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:16.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.101+0000 7fc27f400640 1 -- 172.21.15.103:0/3931866559 shutdown_connections 2024-09-11T01:07:16.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:12.101+0000 7fc27f400640 1 -- 172.21.15.103:0/3931866559 wait complete. 2024-09-11T01:07:16.734 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:16 smithi103 ceph-mon[30562]: pgmap v367: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T01:07:16.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:16 smithi117 ceph-mon[35358]: pgmap v367: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T01:07:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:16 smithi183 ceph-mon[34992]: pgmap v367: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-11T01:07:17.223 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201326 got 236223201330 for osd.8 2024-09-11T01:07:17.223 DEBUG:teuthology.parallel:result is None 2024-09-11T01:07:17.767 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:17 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2086948585' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-11T01:07:17.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.731+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2159520159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e5810a800 msgr2=0x7f8e5810ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:17.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.731+0000 7f8e5cc00640 1 --2- 172.21.15.103:0/2159520159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e5810a800 0x7f8e5810ac40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009ca0 tx=0x7f8e4002a8c0 comp rx=0 tx=0).stop 2024-09-11T01:07:17.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.731+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2159520159 shutdown_connections 2024-09-11T01:07:17.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.731+0000 7f8e5cc00640 1 --2- 172.21.15.103:0/2159520159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e5810b180 0x7f8e58111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:17.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.731+0000 7f8e5cc00640 1 --2- 172.21.15.103:0/2159520159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e5810a800 0x7f8e5810ac40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:17.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.731+0000 7f8e5cc00640 1 --2- 172.21.15.103:0/2159520159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e58104df0 0x7f8e581051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:17.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.731+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2159520159 >> 172.21.15.103:0/2159520159 conn(0x7f8e58100840 msgr2=0x7f8e58102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:17.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.731+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2159520159 shutdown_connections 2024-09-11T01:07:17.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.732+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2159520159 wait complete. 2024-09-11T01:07:17.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.733+0000 7f8e5cc00640 1 Processor -- start 2024-09-11T01:07:17.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.733+0000 7f8e5cc00640 1 -- start start 2024-09-11T01:07:17.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.733+0000 7f8e5cc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e58104df0 0x7f8e5819b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:17.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.733+0000 7f8e5cc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e5810a800 0x7f8e5819b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:17.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.733+0000 7f8e5cc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e5810b180 0x7f8e581a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:17.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.733+0000 7f8e5cc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58114e40 con 0x7f8e5810b180 2024-09-11T01:07:17.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.733+0000 7f8e5cc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58114cc0 con 0x7f8e58104df0 2024-09-11T01:07:17.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.733+0000 7f8e5cc00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8e58114fc0 con 0x7f8e5810a800 2024-09-11T01:07:17.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.733+0000 7f8e57400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e58104df0 0x7f8e5819b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:17.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.733+0000 7f8e4ea00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e5810a800 0x7f8e5819b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:17.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.733+0000 7f8e57400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e58104df0 0x7f8e5819b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:35238/0 (socket says 172.21.15.103:35238) 2024-09-11T01:07:17.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.733+0000 7f8e57400640 1 -- 172.21.15.103:0/2086948585 learned_addr learned my addr 172.21.15.103:0/2086948585 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:17.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.734+0000 7f8e57e00640 1 --2- 172.21.15.103:0/2086948585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e5810b180 0x7f8e581a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:17.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.734+0000 7f8e57400640 1 -- 172.21.15.103:0/2086948585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e5810a800 msgr2=0x7f8e5819b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:17.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.734+0000 7f8e57400640 1 --2- 172.21.15.103:0/2086948585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e5810a800 0x7f8e5819b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:17.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.734+0000 7f8e57400640 1 -- 172.21.15.103:0/2086948585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e5810b180 msgr2=0x7f8e581a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:17.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.734+0000 7f8e57400640 1 --2- 172.21.15.103:0/2086948585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e5810b180 0x7f8e581a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:17.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.734+0000 7f8e57400640 1 -- 172.21.15.103:0/2086948585 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e581a12a0 con 0x7f8e58104df0 2024-09-11T01:07:17.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.734+0000 7f8e57e00640 1 --2- 172.21.15.103:0/2086948585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e5810b180 0x7f8e581a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:07:17.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.734+0000 7f8e57400640 1 --2- 172.21.15.103:0/2086948585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e58104df0 0x7f8e5819b1f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800e9f0 tx=0x7f8e4800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:17.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.734+0000 7f8e54c00640 1 -- 172.21.15.103:0/2086948585 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4800cd80 con 0x7f8e58104df0 2024-09-11T01:07:17.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.734+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2086948585 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e581a1590 con 0x7f8e58104df0 2024-09-11T01:07:17.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.734+0000 7f8e54c00640 1 -- 172.21.15.103:0/2086948585 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8e480108e0 con 0x7f8e58104df0 2024-09-11T01:07:17.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.734+0000 7f8e54c00640 1 -- 172.21.15.103:0/2086948585 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e48018980 con 0x7f8e58104df0 2024-09-11T01:07:17.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.735+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2086948585 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e581a7c50 con 0x7f8e58104df0 2024-09-11T01:07:17.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.735+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2086948585 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e581051d0 con 0x7f8e58104df0 2024-09-11T01:07:17.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.738+0000 7f8e54c00640 1 -- 172.21.15.103:0/2086948585 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f8e48010430 con 0x7f8e58104df0 2024-09-11T01:07:17.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.739+0000 7f8e54c00640 1 --2- 172.21.15.103:0/2086948585 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8e3c0b5410 0x7f8e3c0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:17.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.740+0000 7f8e54c00640 1 -- 172.21.15.103:0/2086948585 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f8e480e6760 con 0x7f8e58104df0 2024-09-11T01:07:17.921 INFO:teuthology.orchestra.run.smithi103.stdout:158913790019 2024-09-11T01:07:17.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.740+0000 7f8e4ea00640 1 --2- 172.21.15.103:0/2086948585 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8e3c0b5410 0x7f8e3c0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.740+0000 7f8e4ea00640 1 --2- 172.21.15.103:0/2086948585 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8e3c0b5410 0x7f8e3c0b78d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8e58102fe0 tx=0x7f8e40009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.741+0000 7f8e54c00640 1 -- 172.21.15.103:0/2086948585 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8e480ad110 con 0x7f8e58104df0 2024-09-11T01:07:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.933+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2086948585 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8e581a7fc0 con 0x7f8e58104df0 2024-09-11T01:07:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.934+0000 7f8e54c00640 1 -- 172.21.15.103:0/2086948585 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8e480aca10 con 0x7f8e58104df0 2024-09-11T01:07:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.936+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2086948585 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8e3c0b5410 msgr2=0x7f8e3c0b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.936+0000 7f8e5cc00640 1 --2- 172.21.15.103:0/2086948585 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8e3c0b5410 0x7f8e3c0b78d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8e58102fe0 tx=0x7f8e40009360 comp rx=0 tx=0).stop 2024-09-11T01:07:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.936+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2086948585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e58104df0 msgr2=0x7f8e5819b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.936+0000 7f8e5cc00640 1 --2- 172.21.15.103:0/2086948585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e58104df0 0x7f8e5819b1f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8e4800e9f0 tx=0x7f8e4800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:07:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.937+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2086948585 shutdown_connections 2024-09-11T01:07:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.937+0000 7f8e5cc00640 1 --2- 172.21.15.103:0/2086948585 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8e3c0b5410 0x7f8e3c0b78d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.937+0000 7f8e5cc00640 1 --2- 172.21.15.103:0/2086948585 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8e5810b180 0x7f8e581a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:17.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.937+0000 7f8e5cc00640 1 --2- 172.21.15.103:0/2086948585 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8e5810a800 0x7f8e5819b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.937+0000 7f8e5cc00640 1 --2- 172.21.15.103:0/2086948585 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8e58104df0 0x7f8e5819b1f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.937+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2086948585 >> 172.21.15.103:0/2086948585 conn(0x7f8e58100840 msgr2=0x7f8e58103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.937+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2086948585 shutdown_connections 2024-09-11T01:07:17.923 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:16.937+0000 7f8e5cc00640 1 -- 172.21.15.103:0/2086948585 wait complete. 2024-09-11T01:07:17.923 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:17 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2086948585' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-11T01:07:18.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:17 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2086948585' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-11T01:07:18.745 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:18.763 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397557 got 210453397559 for osd.7 2024-09-11T01:07:18.763 DEBUG:teuthology.parallel:result is None 2024-09-11T01:07:18.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:18 smithi103 ceph-mon[30562]: pgmap v368: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:18.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:18 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3045886099' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-11T01:07:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:18 smithi183 ceph-mon[34992]: pgmap v368: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:18 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3045886099' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-11T01:07:19.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.351+0000 7f5ceac00640 1 -- 172.21.15.103:0/1527055676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102dc0 msgr2=0x7f5ce41031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:19.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.351+0000 7f5ceac00640 1 --2- 172.21.15.103:0/1527055676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102dc0 0x7f5ce41031a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009900 tx=0x7f5cd402a410 comp rx=0 tx=0).stop 2024-09-11T01:07:19.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.351+0000 7f5ceac00640 1 -- 172.21.15.103:0/1527055676 shutdown_connections 2024-09-11T01:07:19.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.351+0000 7f5ceac00640 1 --2- 172.21.15.103:0/1527055676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ce4109150 0x7f5ce410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.351+0000 7f5ceac00640 1 --2- 172.21.15.103:0/1527055676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ce41087d0 0x7f5ce4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.351+0000 7f5ceac00640 1 --2- 172.21.15.103:0/1527055676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102dc0 0x7f5ce41031a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.351+0000 7f5ceac00640 1 -- 172.21.15.103:0/1527055676 >> 172.21.15.103:0/1527055676 conn(0x7f5ce40fe830 msgr2=0x7f5ce4100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.351+0000 7f5ceac00640 1 -- 172.21.15.103:0/1527055676 shutdown_connections 2024-09-11T01:07:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.351+0000 7f5ceac00640 1 -- 172.21.15.103:0/1527055676 wait complete. 2024-09-11T01:07:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.352+0000 7f5ceac00640 1 Processor -- start 2024-09-11T01:07:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.352+0000 7f5ceac00640 1 -- start start 2024-09-11T01:07:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.352+0000 7f5ceac00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102dc0 0x7f5ce419b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ceac00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ce41087d0 0x7f5ce419ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ceac00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ce4109150 0x7f5ce41a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ceac00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce4112e60 con 0x7f5ce4102dc0 2024-09-11T01:07:19.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ceac00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce4112ce0 con 0x7f5ce4109150 2024-09-11T01:07:19.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ceac00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce4112fe0 con 0x7f5ce41087d0 2024-09-11T01:07:19.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ce3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102dc0 0x7f5ce419b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:19.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ce3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102dc0 0x7f5ce419b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53668/0 (socket says 172.21.15.103:53668) 2024-09-11T01:07:19.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ce3e00640 1 -- 172.21.15.103:0/3045886099 learned_addr learned my addr 172.21.15.103:0/3045886099 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:19.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ce8c00640 1 --2- 172.21.15.103:0/3045886099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ce4109150 0x7f5ce41a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:19.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ce3400640 1 --2- 172.21.15.103:0/3045886099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ce41087d0 0x7f5ce419ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:19.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ce3e00640 1 -- 172.21.15.103:0/3045886099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ce41087d0 msgr2=0x7f5ce419ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:19.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ce3e00640 1 --2- 172.21.15.103:0/3045886099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ce41087d0 0x7f5ce419ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:19.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ce3e00640 1 -- 172.21.15.103:0/3045886099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ce4109150 msgr2=0x7f5ce41a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:19.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ce3e00640 1 --2- 172.21.15.103:0/3045886099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ce4109150 0x7f5ce41a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:19.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.353+0000 7f5ce3e00640 1 -- 172.21.15.103:0/3045886099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce41a15c0 con 0x7f5ce4102dc0 2024-09-11T01:07:19.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.354+0000 7f5ce3e00640 1 --2- 172.21.15.103:0/3045886099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102dc0 0x7f5ce419b510 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4005ab0 tx=0x7f5cd4003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:19.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.354+0000 7f5ce0c00640 1 -- 172.21.15.103:0/3045886099 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd403f070 con 0x7f5ce4102dc0 2024-09-11T01:07:19.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.354+0000 7f5ce0c00640 1 -- 172.21.15.103:0/3045886099 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5cd4031d60 con 0x7f5ce4102dc0 2024-09-11T01:07:19.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.354+0000 7f5ceac00640 1 -- 172.21.15.103:0/3045886099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce41a1850 con 0x7f5ce4102dc0 2024-09-11T01:07:19.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.354+0000 7f5ce0c00640 1 -- 172.21.15.103:0/3045886099 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd4035030 con 0x7f5ce4102dc0 2024-09-11T01:07:19.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.354+0000 7f5ceac00640 1 -- 172.21.15.103:0/3045886099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce41a7f70 con 0x7f5ce4102dc0 2024-09-11T01:07:19.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.355+0000 7f5ceac00640 1 -- 172.21.15.103:0/3045886099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce41031a0 con 0x7f5ce4102dc0 2024-09-11T01:07:19.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.357+0000 7f5ce0c00640 1 -- 172.21.15.103:0/3045886099 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f5cd403b460 con 0x7f5ce4102dc0 2024-09-11T01:07:19.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.359+0000 7f5ce0c00640 1 --2- 172.21.15.103:0/3045886099 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5cc80b5370 0x7f5cc80b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:19.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.359+0000 7f5ce0c00640 1 -- 172.21.15.103:0/3045886099 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5cd4106c00 con 0x7f5ce4102dc0 2024-09-11T01:07:19.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.359+0000 7f5ce3400640 1 --2- 172.21.15.103:0/3045886099 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5cc80b5370 0x7f5cc80b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:19.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.360+0000 7f5ce3400640 1 --2- 172.21.15.103:0/3045886099 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5cc80b5370 0x7f5cc80b7830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5ce41081d0 tx=0x7f5cd0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:19.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.363+0000 7f5ce0c00640 1 -- 172.21.15.103:0/3045886099 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5cd40ccf00 con 0x7f5ce4102dc0 2024-09-11T01:07:19.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.551+0000 7f5ceac00640 1 -- 172.21.15.103:0/3045886099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f5ce402e5c0 con 0x7f5ce4102dc0 2024-09-11T01:07:19.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.552+0000 7f5ce0c00640 1 -- 172.21.15.103:0/3045886099 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5cd40d1930 con 0x7f5ce4102dc0 2024-09-11T01:07:19.075 INFO:teuthology.orchestra.run.smithi103.stdout:261993005100 2024-09-11T01:07:19.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.554+0000 7f5ceac00640 1 -- 172.21.15.103:0/3045886099 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5cc80b5370 msgr2=0x7f5cc80b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:19.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.554+0000 7f5ceac00640 1 --2- 172.21.15.103:0/3045886099 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5cc80b5370 0x7f5cc80b7830 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5ce41081d0 tx=0x7f5cd0005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:19.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.554+0000 7f5ceac00640 1 -- 172.21.15.103:0/3045886099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102dc0 msgr2=0x7f5ce419b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:19.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.554+0000 7f5ceac00640 1 --2- 172.21.15.103:0/3045886099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102dc0 0x7f5ce419b510 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4005ab0 tx=0x7f5cd4003c80 comp rx=0 tx=0).stop 2024-09-11T01:07:19.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.554+0000 7f5ceac00640 1 -- 172.21.15.103:0/3045886099 shutdown_connections 2024-09-11T01:07:19.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.554+0000 7f5ceac00640 1 --2- 172.21.15.103:0/3045886099 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5cc80b5370 0x7f5cc80b7830 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:19.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.554+0000 7f5ceac00640 1 --2- 172.21.15.103:0/3045886099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ce4109150 0x7f5ce41a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:19.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.554+0000 7f5ceac00640 1 --2- 172.21.15.103:0/3045886099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ce41087d0 0x7f5ce419ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:19.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.554+0000 7f5ceac00640 1 --2- 172.21.15.103:0/3045886099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ce4102dc0 0x7f5ce419b510 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:19.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.554+0000 7f5ceac00640 1 -- 172.21.15.103:0/3045886099 >> 172.21.15.103:0/3045886099 conn(0x7f5ce40fe830 msgr2=0x7f5ce4104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:19.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.554+0000 7f5ceac00640 1 -- 172.21.15.103:0/3045886099 shutdown_connections 2024-09-11T01:07:19.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:18.554+0000 7f5ceac00640 1 -- 172.21.15.103:0/3045886099 wait complete. 2024-09-11T01:07:19.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:18 smithi117 ceph-mon[35358]: pgmap v368: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:19.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:18 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3045886099' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-11T01:07:19.815 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:19 smithi103 ceph-mon[30562]: pgmap v369: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:19.851 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953540 got 137438953543 for osd.4 2024-09-11T01:07:19.852 DEBUG:teuthology.parallel:result is None 2024-09-11T01:07:19.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:19 smithi183 ceph-mon[34992]: pgmap v369: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:20.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:19 smithi117 ceph-mon[35358]: pgmap v369: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:20.231 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790016 got 158913790019 for osd.5 2024-09-11T01:07:20.232 DEBUG:teuthology.parallel:result is None 2024-09-11T01:07:20.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.704+0000 7f8f98c00640 1 -- 172.21.15.103:0/998664526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9410a9b0 msgr2=0x7f8f9410adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:20.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.704+0000 7f8f98c00640 1 --2- 172.21.15.103:0/998664526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9410a9b0 0x7f8f9410adf0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009900 tx=0x7f8f7c02a410 comp rx=0 tx=0).stop 2024-09-11T01:07:20.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.704+0000 7f8f98c00640 1 -- 172.21.15.103:0/998664526 shutdown_connections 2024-09-11T01:07:20.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.704+0000 7f8f98c00640 1 --2- 172.21.15.103:0/998664526 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f9410b330 0x7f8f94111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.704+0000 7f8f98c00640 1 --2- 172.21.15.103:0/998664526 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9410a9b0 0x7f8f9410adf0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.704+0000 7f8f98c00640 1 --2- 172.21.15.103:0/998664526 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f94104fa0 0x7f8f94105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.704+0000 7f8f98c00640 1 -- 172.21.15.103:0/998664526 >> 172.21.15.103:0/998664526 conn(0x7f8f94100a50 msgr2=0x7f8f94102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:20.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.704+0000 7f8f98c00640 1 -- 172.21.15.103:0/998664526 shutdown_connections 2024-09-11T01:07:20.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.705+0000 7f8f98c00640 1 -- 172.21.15.103:0/998664526 wait complete. 2024-09-11T01:07:20.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.705+0000 7f8f98c00640 1 Processor -- start 2024-09-11T01:07:20.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.706+0000 7f8f98c00640 1 -- start start 2024-09-11T01:07:20.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.706+0000 7f8f98c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f94104fa0 0x7f8f9419b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:20.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.706+0000 7f8f98c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9410a9b0 0x7f8f9419bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:20.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.706+0000 7f8f98c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f9410b330 0x7f8f941a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:20.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.706+0000 7f8f98c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8f94114f50 con 0x7f8f9410a9b0 2024-09-11T01:07:20.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.706+0000 7f8f98c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8f94114dd0 con 0x7f8f94104fa0 2024-09-11T01:07:20.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.706+0000 7f8f98c00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8f941150d0 con 0x7f8f9410b330 2024-09-11T01:07:20.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.706+0000 7f8f89400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9410a9b0 0x7f8f9419bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:20.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.706+0000 7f8f89400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9410a9b0 0x7f8f9419bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57366/0 (socket says 172.21.15.103:57366) 2024-09-11T01:07:20.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.706+0000 7f8f89400640 1 -- 172.21.15.103:0/857593744 learned_addr learned my addr 172.21.15.103:0/857593744 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:20.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.706+0000 7f8f91e00640 1 --2- 172.21.15.103:0/857593744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f94104fa0 0x7f8f9419b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:20.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.706+0000 7f8f92800640 1 --2- 172.21.15.103:0/857593744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f9410b330 0x7f8f941a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:20.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.707+0000 7f8f89400640 1 -- 172.21.15.103:0/857593744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f9410b330 msgr2=0x7f8f941a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:20.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.707+0000 7f8f89400640 1 --2- 172.21.15.103:0/857593744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f9410b330 0x7f8f941a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.707+0000 7f8f89400640 1 -- 172.21.15.103:0/857593744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f94104fa0 msgr2=0x7f8f9419b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:20.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.707+0000 7f8f89400640 1 --2- 172.21.15.103:0/857593744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f94104fa0 0x7f8f9419b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.707+0000 7f8f89400640 1 -- 172.21.15.103:0/857593744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f941a1650 con 0x7f8f9410a9b0 2024-09-11T01:07:20.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.707+0000 7f8f89400640 1 --2- 172.21.15.103:0/857593744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9410a9b0 0x7f8f9419bae0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c005940 tx=0x7f8f7c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:20.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.707+0000 7f8f8b400640 1 -- 172.21.15.103:0/857593744 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c03f030 con 0x7f8f9410a9b0 2024-09-11T01:07:20.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.707+0000 7f8f8b400640 1 -- 172.21.15.103:0/857593744 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f7c003aa0 con 0x7f8f9410a9b0 2024-09-11T01:07:20.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.707+0000 7f8f8b400640 1 -- 172.21.15.103:0/857593744 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f7c035070 con 0x7f8f9410a9b0 2024-09-11T01:07:20.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.707+0000 7f8f98c00640 1 -- 172.21.15.103:0/857593744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f941a18e0 con 0x7f8f9410a9b0 2024-09-11T01:07:20.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.707+0000 7f8f98c00640 1 -- 172.21.15.103:0/857593744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f941a8000 con 0x7f8f9410a9b0 2024-09-11T01:07:20.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.709+0000 7f8f98c00640 1 -- 172.21.15.103:0/857593744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f94105380 con 0x7f8f9410a9b0 2024-09-11T01:07:20.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.711+0000 7f8f8b400640 1 -- 172.21.15.103:0/857593744 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f8f7c04c060 con 0x7f8f9410a9b0 2024-09-11T01:07:20.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.713+0000 7f8f8b400640 1 --2- 172.21.15.103:0/857593744 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8f780b53f0 0x7f8f780b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:20.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.713+0000 7f8f8b400640 1 -- 172.21.15.103:0/857593744 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f8f7c106650 con 0x7f8f9410a9b0 2024-09-11T01:07:20.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.714+0000 7f8f91e00640 1 --2- 172.21.15.103:0/857593744 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8f780b53f0 0x7f8f780b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:20.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.714+0000 7f8f91e00640 1 --2- 172.21.15.103:0/857593744 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8f780b53f0 0x7f8f780b78b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009bd0 tx=0x7f8f84005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:20.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.715+0000 7f8f8b400640 1 -- 172.21.15.103:0/857593744 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8f7c0cc950 con 0x7f8f9410a9b0 2024-09-11T01:07:20.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.907+0000 7f8f98c00640 1 -- 172.21.15.103:0/857593744 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8f9410d110 con 0x7f8f9410a9b0 2024-09-11T01:07:20.909 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.908+0000 7f8f8b400640 1 -- 172.21.15.103:0/857593744 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8f7c0d1380 con 0x7f8f9410a9b0 2024-09-11T01:07:20.909 INFO:teuthology.orchestra.run.smithi103.stdout:111669149774 2024-09-11T01:07:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.910+0000 7f8f98c00640 1 -- 172.21.15.103:0/857593744 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8f780b53f0 msgr2=0x7f8f780b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.910+0000 7f8f98c00640 1 --2- 172.21.15.103:0/857593744 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8f780b53f0 0x7f8f780b78b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8f84009bd0 tx=0x7f8f84005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.910+0000 7f8f98c00640 1 -- 172.21.15.103:0/857593744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9410a9b0 msgr2=0x7f8f9419bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.910+0000 7f8f98c00640 1 --2- 172.21.15.103:0/857593744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9410a9b0 0x7f8f9419bae0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c005940 tx=0x7f8f7c004270 comp rx=0 tx=0).stop 2024-09-11T01:07:20.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.910+0000 7f8f98c00640 1 -- 172.21.15.103:0/857593744 shutdown_connections 2024-09-11T01:07:20.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.910+0000 7f8f98c00640 1 --2- 172.21.15.103:0/857593744 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8f780b53f0 0x7f8f780b78b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.910+0000 7f8f98c00640 1 --2- 172.21.15.103:0/857593744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8f9410b330 0x7f8f941a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.910+0000 7f8f98c00640 1 --2- 172.21.15.103:0/857593744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8f9410a9b0 0x7f8f9419bae0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.910+0000 7f8f98c00640 1 --2- 172.21.15.103:0/857593744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f94104fa0 0x7f8f9419b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.910+0000 7f8f98c00640 1 -- 172.21.15.103:0/857593744 >> 172.21.15.103:0/857593744 conn(0x7f8f94100a50 msgr2=0x7f8f94102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:20.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.911+0000 7f8f98c00640 1 -- 172.21.15.103:0/857593744 shutdown_connections 2024-09-11T01:07:20.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.911+0000 7f8f98c00640 1 -- 172.21.15.103:0/857593744 wait complete. 2024-09-11T01:07:20.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.967+0000 7f923e000640 1 -- 172.21.15.103:0/372282632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f923810a820 msgr2=0x7f923810ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:20.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.967+0000 7f923e000640 1 --2- 172.21.15.103:0/372282632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f923810a820 0x7f923810ac60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9224009900 tx=0x7f922402a3f0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.967+0000 7f923e000640 1 -- 172.21.15.103:0/372282632 shutdown_connections 2024-09-11T01:07:20.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.967+0000 7f923e000640 1 --2- 172.21.15.103:0/372282632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f923810b1a0 0x7f92381119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.967+0000 7f923e000640 1 --2- 172.21.15.103:0/372282632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f923810a820 0x7f923810ac60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.967+0000 7f923e000640 1 --2- 172.21.15.103:0/372282632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9238104e10 0x7f92381051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.967+0000 7f923e000640 1 -- 172.21.15.103:0/372282632 >> 172.21.15.103:0/372282632 conn(0x7f9238100840 msgr2=0x7f9238102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:20.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.967+0000 7f923e000640 1 -- 172.21.15.103:0/372282632 shutdown_connections 2024-09-11T01:07:20.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.967+0000 7f923e000640 1 -- 172.21.15.103:0/372282632 wait complete. 2024-09-11T01:07:20.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.968+0000 7f923e000640 1 Processor -- start 2024-09-11T01:07:20.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.968+0000 7f923e000640 1 -- start start 2024-09-11T01:07:20.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.968+0000 7f923e000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9238104e10 0x7f923819b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:20.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.968+0000 7f923e000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f923810a820 0x7f923819b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:20.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.968+0000 7f923e000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923810b1a0 0x7f92381a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:20.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.968+0000 7f923e000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9238114e60 con 0x7f923810b1a0 2024-09-11T01:07:20.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.968+0000 7f923e000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9238114ce0 con 0x7f9238104e10 2024-09-11T01:07:20.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.968+0000 7f923e000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9238114fe0 con 0x7f923810a820 2024-09-11T01:07:20.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.969+0000 7f923cc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9238104e10 0x7f923819b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:20.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.969+0000 7f9237e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f923810a820 0x7f923819b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:20.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.969+0000 7f923cc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9238104e10 0x7f923819b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:52798/0 (socket says 172.21.15.103:52798) 2024-09-11T01:07:20.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.969+0000 7f923cc00640 1 -- 172.21.15.103:0/3411845451 learned_addr learned my addr 172.21.15.103:0/3411845451 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:20.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.969+0000 7f923d600640 1 --2- 172.21.15.103:0/3411845451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923810b1a0 0x7f92381a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:20.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.969+0000 7f923cc00640 1 -- 172.21.15.103:0/3411845451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f923810a820 msgr2=0x7f923819b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:20.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.969+0000 7f923cc00640 1 --2- 172.21.15.103:0/3411845451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f923810a820 0x7f923819b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.969+0000 7f923cc00640 1 -- 172.21.15.103:0/3411845451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923810b1a0 msgr2=0x7f92381a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:20.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.969+0000 7f923cc00640 1 --2- 172.21.15.103:0/3411845451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923810b1a0 0x7f92381a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:20.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.969+0000 7f923cc00640 1 -- 172.21.15.103:0/3411845451 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92381a1280 con 0x7f9238104e10 2024-09-11T01:07:20.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.969+0000 7f923cc00640 1 --2- 172.21.15.103:0/3411845451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9238104e10 0x7f923819b1d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f922c00e9f0 tx=0x7f922c00eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:20.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.969+0000 7f9235600640 1 -- 172.21.15.103:0/3411845451 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c00cd80 con 0x7f9238104e10 2024-09-11T01:07:20.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.970+0000 7f9235600640 1 -- 172.21.15.103:0/3411845451 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f922c0108e0 con 0x7f9238104e10 2024-09-11T01:07:20.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.970+0000 7f9235600640 1 -- 172.21.15.103:0/3411845451 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f922c018980 con 0x7f9238104e10 2024-09-11T01:07:20.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.970+0000 7f923e000640 1 -- 172.21.15.103:0/3411845451 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92381a1570 con 0x7f9238104e10 2024-09-11T01:07:20.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.970+0000 7f923e000640 1 -- 172.21.15.103:0/3411845451 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92381a7c30 con 0x7f9238104e10 2024-09-11T01:07:20.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.971+0000 7f923e000640 1 -- 172.21.15.103:0/3411845451 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92381051f0 con 0x7f9238104e10 2024-09-11T01:07:20.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.973+0000 7f9235600640 1 -- 172.21.15.103:0/3411845451 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f922c010430 con 0x7f9238104e10 2024-09-11T01:07:20.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.974+0000 7f9235600640 1 --2- 172.21.15.103:0/3411845451 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f92200b5410 0x7f92200b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:20.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.974+0000 7f9235600640 1 -- 172.21.15.103:0/3411845451 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f922c0e6710 con 0x7f9238104e10 2024-09-11T01:07:20.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.975+0000 7f9237e00640 1 --2- 172.21.15.103:0/3411845451 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f92200b5410 0x7f92200b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:20.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.975+0000 7f9237e00640 1 --2- 172.21.15.103:0/3411845451 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f92200b5410 0x7f92200b78d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9224031440 tx=0x7f9224005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:20.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:20.976+0000 7f9235600640 1 -- 172.21.15.103:0/3411845451 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f922c0aca10 con 0x7f9238104e10 2024-09-11T01:07:21.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:20 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/857593744' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-11T01:07:21.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:21.166+0000 7f923e000640 1 -- 172.21.15.103:0/3411845451 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f92381a7f60 con 0x7f9238104e10 2024-09-11T01:07:21.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:21.167+0000 7f9235600640 1 -- 172.21.15.103:0/3411845451 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f922c0b1440 con 0x7f9238104e10 2024-09-11T01:07:21.169 INFO:teuthology.orchestra.run.smithi103.stdout:309237645347 2024-09-11T01:07:21.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:21.169+0000 7f923e000640 1 -- 172.21.15.103:0/3411845451 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f92200b5410 msgr2=0x7f92200b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:21.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:21.169+0000 7f923e000640 1 --2- 172.21.15.103:0/3411845451 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f92200b5410 0x7f92200b78d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9224031440 tx=0x7f9224005b50 comp rx=0 tx=0).stop 2024-09-11T01:07:21.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:21.169+0000 7f923e000640 1 -- 172.21.15.103:0/3411845451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9238104e10 msgr2=0x7f923819b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:21.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:21.169+0000 7f923e000640 1 --2- 172.21.15.103:0/3411845451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9238104e10 0x7f923819b1d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f922c00e9f0 tx=0x7f922c00eeb0 comp rx=0 tx=0).stop 2024-09-11T01:07:21.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:21.170+0000 7f923e000640 1 -- 172.21.15.103:0/3411845451 shutdown_connections 2024-09-11T01:07:21.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:21.170+0000 7f923e000640 1 --2- 172.21.15.103:0/3411845451 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f92200b5410 0x7f92200b78d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:21.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:21.170+0000 7f923e000640 1 --2- 172.21.15.103:0/3411845451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f923810b1a0 0x7f92381a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:21.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:21.170+0000 7f923e000640 1 --2- 172.21.15.103:0/3411845451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f923810a820 0x7f923819b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:21.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:21.170+0000 7f923e000640 1 --2- 172.21.15.103:0/3411845451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9238104e10 0x7f923819b1d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:21.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:21.170+0000 7f923e000640 1 -- 172.21.15.103:0/3411845451 >> 172.21.15.103:0/3411845451 conn(0x7f9238100840 msgr2=0x7f9238102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:21.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:21.170+0000 7f923e000640 1 -- 172.21.15.103:0/3411845451 shutdown_connections 2024-09-11T01:07:21.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:21.170+0000 7f923e000640 1 -- 172.21.15.103:0/3411845451 wait complete. 2024-09-11T01:07:21.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:20 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/857593744' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-11T01:07:21.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:20 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/857593744' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-11T01:07:22.000 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005097 got 261993005100 for osd.9 2024-09-11T01:07:22.001 DEBUG:teuthology.parallel:result is None 2024-09-11T01:07:22.287 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:21 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3411845451' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-11T01:07:22.287 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:21 smithi103 ceph-mon[30562]: pgmap v370: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:22.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:21 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3411845451' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-11T01:07:22.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:21 smithi117 ceph-mon[35358]: pgmap v370: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:22.421 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:21 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3411845451' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-11T01:07:22.421 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:21 smithi183 ceph-mon[34992]: pgmap v370: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:22.812 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574932 got 55834574936 for osd.1 2024-09-11T01:07:22.812 DEBUG:teuthology.parallel:result is None 2024-09-11T01:07:23.252 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149769 got 111669149774 for osd.3 2024-09-11T01:07:23.253 DEBUG:teuthology.parallel:result is None 2024-09-11T01:07:23.261 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.147+0000 7fbf14200640 1 -- 172.21.15.103:0/3201261570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf0c1087d0 msgr2=0x7fbf0c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.147+0000 7fbf14200640 1 --2- 172.21.15.103:0/3201261570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf0c1087d0 0x7fbf0c108c10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fbef8009900 tx=0x7fbef802a400 comp rx=0 tx=0).stop 2024-09-11T01:07:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.147+0000 7fbf14200640 1 -- 172.21.15.103:0/3201261570 shutdown_connections 2024-09-11T01:07:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.147+0000 7fbf14200640 1 --2- 172.21.15.103:0/3201261570 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf0c109150 0x7fbf0c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.147+0000 7fbf14200640 1 --2- 172.21.15.103:0/3201261570 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf0c1087d0 0x7fbf0c108c10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.147+0000 7fbf14200640 1 --2- 172.21.15.103:0/3201261570 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf0c102dc0 0x7fbf0c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.147+0000 7fbf14200640 1 -- 172.21.15.103:0/3201261570 >> 172.21.15.103:0/3201261570 conn(0x7fbf0c0fe830 msgr2=0x7fbf0c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.147+0000 7fbf14200640 1 -- 172.21.15.103:0/3201261570 shutdown_connections 2024-09-11T01:07:24.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.147+0000 7fbf14200640 1 -- 172.21.15.103:0/3201261570 wait complete. 2024-09-11T01:07:24.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.148+0000 7fbf14200640 1 Processor -- start 2024-09-11T01:07:24.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.148+0000 7fbf14200640 1 -- start start 2024-09-11T01:07:24.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.148+0000 7fbf14200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf0c102dc0 0x7fbf0c199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:24.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.148+0000 7fbf14200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf0c1087d0 0x7fbf0c1997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:24.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.148+0000 7fbf14200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf0c109150 0x7fbf0c19eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:24.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.148+0000 7fbf14200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c112e20 con 0x7fbf0c1087d0 2024-09-11T01:07:24.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.148+0000 7fbf14200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c112ca0 con 0x7fbf0c102dc0 2024-09-11T01:07:24.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.148+0000 7fbf14200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0c112fa0 con 0x7fbf0c109150 2024-09-11T01:07:24.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.149+0000 7fbf10e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf0c1087d0 0x7fbf0c1997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:24.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.149+0000 7fbf11800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf0c102dc0 0x7fbf0c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:24.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.149+0000 7fbf12200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf0c109150 0x7fbf0c19eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:24.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.149+0000 7fbf10e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf0c1087d0 0x7fbf0c1997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57402/0 (socket says 172.21.15.103:57402) 2024-09-11T01:07:24.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.149+0000 7fbf10e00640 1 -- 172.21.15.103:0/3620743658 learned_addr learned my addr 172.21.15.103:0/3620743658 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:24.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.149+0000 7fbf10e00640 1 -- 172.21.15.103:0/3620743658 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf0c109150 msgr2=0x7fbf0c19eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:24.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.149+0000 7fbf10e00640 1 --2- 172.21.15.103:0/3620743658 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf0c109150 0x7fbf0c19eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:24.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.149+0000 7fbf10e00640 1 -- 172.21.15.103:0/3620743658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf0c102dc0 msgr2=0x7fbf0c199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:24.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.149+0000 7fbf10e00640 1 --2- 172.21.15.103:0/3620743658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf0c102dc0 0x7fbf0c199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:24.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.149+0000 7fbf10e00640 1 -- 172.21.15.103:0/3620743658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf0c19f340 con 0x7fbf0c1087d0 2024-09-11T01:07:24.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.149+0000 7fbf11800640 1 --2- 172.21.15.103:0/3620743658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf0c102dc0 0x7fbf0c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:24.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.150+0000 7fbf10e00640 1 --2- 172.21.15.103:0/3620743658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf0c1087d0 0x7fbf0c1997d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbef8005ab0 tx=0x7fbef8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:24.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.150+0000 7fbf0a000640 1 -- 172.21.15.103:0/3620743658 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef803f070 con 0x7fbf0c1087d0 2024-09-11T01:07:24.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.150+0000 7fbf0a000640 1 -- 172.21.15.103:0/3620743658 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbef8031b60 con 0x7fbf0c1087d0 2024-09-11T01:07:24.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.150+0000 7fbf0a000640 1 -- 172.21.15.103:0/3620743658 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8035030 con 0x7fbf0c1087d0 2024-09-11T01:07:24.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.150+0000 7fbf14200640 1 -- 172.21.15.103:0/3620743658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0c19f5d0 con 0x7fbf0c1087d0 2024-09-11T01:07:24.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.150+0000 7fbf14200640 1 -- 172.21.15.103:0/3620743658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf0c075380 con 0x7fbf0c1087d0 2024-09-11T01:07:24.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.151+0000 7fbf14200640 1 -- 172.21.15.103:0/3620743658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf0c1031a0 con 0x7fbf0c1087d0 2024-09-11T01:07:24.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.155+0000 7fbf0a000640 1 -- 172.21.15.103:0/3620743658 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7fbef803b460 con 0x7fbf0c1087d0 2024-09-11T01:07:24.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.156+0000 7fbf0a000640 1 --2- 172.21.15.103:0/3620743658 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbef40b5370 0x7fbef40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:24.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.156+0000 7fbf0a000640 1 -- 172.21.15.103:0/3620743658 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fbef8107190 con 0x7fbf0c1087d0 2024-09-11T01:07:24.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.157+0000 7fbf11800640 1 --2- 172.21.15.103:0/3620743658 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbef40b5370 0x7fbef40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:24.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.157+0000 7fbf11800640 1 --2- 172.21.15.103:0/3620743658 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbef40b5370 0x7fbef40b7830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbf00005fd0 tx=0x7fbf00009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:24.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.158+0000 7fbf0a000640 1 -- 172.21.15.103:0/3620743658 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbef80cd490 con 0x7fbf0c1087d0 2024-09-11T01:07:24.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.345+0000 7fbf14200640 1 -- 172.21.15.103:0/3620743658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fbf0c19a3c0 con 0x7fbf0c1087d0 2024-09-11T01:07:24.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.346+0000 7fbf0a000640 1 -- 172.21.15.103:0/3620743658 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbef80d1ec0 con 0x7fbf0c1087d0 2024-09-11T01:07:24.348 INFO:teuthology.orchestra.run.smithi103.stdout:34359738462 2024-09-11T01:07:24.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.348+0000 7fbf14200640 1 -- 172.21.15.103:0/3620743658 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbef40b5370 msgr2=0x7fbef40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:24.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.348+0000 7fbf14200640 1 --2- 172.21.15.103:0/3620743658 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbef40b5370 0x7fbef40b7830 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbf00005fd0 tx=0x7fbf00009500 comp rx=0 tx=0).stop 2024-09-11T01:07:24.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.348+0000 7fbf14200640 1 -- 172.21.15.103:0/3620743658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf0c1087d0 msgr2=0x7fbf0c1997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:24.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.348+0000 7fbf14200640 1 --2- 172.21.15.103:0/3620743658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf0c1087d0 0x7fbf0c1997d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbef8005ab0 tx=0x7fbef8003c10 comp rx=0 tx=0).stop 2024-09-11T01:07:24.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.348+0000 7fbf14200640 1 -- 172.21.15.103:0/3620743658 shutdown_connections 2024-09-11T01:07:24.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.348+0000 7fbf14200640 1 --2- 172.21.15.103:0/3620743658 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbef40b5370 0x7fbef40b7830 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:24.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.348+0000 7fbf14200640 1 --2- 172.21.15.103:0/3620743658 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf0c109150 0x7fbf0c19eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:24.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.348+0000 7fbf14200640 1 --2- 172.21.15.103:0/3620743658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf0c1087d0 0x7fbf0c1997d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:24.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.348+0000 7fbf14200640 1 --2- 172.21.15.103:0/3620743658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf0c102dc0 0x7fbf0c199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:24.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.348+0000 7fbf14200640 1 -- 172.21.15.103:0/3620743658 >> 172.21.15.103:0/3620743658 conn(0x7fbf0c0fe830 msgr2=0x7fbf0c100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:24.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.349+0000 7fbf14200640 1 -- 172.21.15.103:0/3620743658 shutdown_connections 2024-09-11T01:07:24.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:24.349+0000 7fbf14200640 1 -- 172.21.15.103:0/3620743658 wait complete. 2024-09-11T01:07:24.548 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645343 got 309237645347 for osd.11 2024-09-11T01:07:24.549 DEBUG:teuthology.parallel:result is None 2024-09-11T01:07:24.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:24 smithi103 ceph-mon[30562]: pgmap v371: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:24.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:24 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3620743658' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-11T01:07:24.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:24 smithi117 ceph-mon[35358]: pgmap v371: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:24.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:24 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3620743658' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-11T01:07:24.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:24 smithi183 ceph-mon[34992]: pgmap v371: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:24.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:24 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3620743658' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-11T01:07:25.314 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738458 got 34359738462 for osd.0 2024-09-11T01:07:25.315 DEBUG:teuthology.parallel:result is None 2024-09-11T01:07:25.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.494+0000 7ff581a00640 1 -- 172.21.15.103:0/2969280538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57c108fa0 msgr2=0x7ff57c10f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.494+0000 7ff581a00640 1 --2- 172.21.15.103:0/2969280538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57c108fa0 0x7ff57c10f7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff574009ca0 tx=0x7ff57402a8c0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.494+0000 7ff581a00640 1 -- 172.21.15.103:0/2969280538 shutdown_connections 2024-09-11T01:07:25.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.494+0000 7ff581a00640 1 --2- 172.21.15.103:0/2969280538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57c108fa0 0x7ff57c10f7a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.494+0000 7ff581a00640 1 --2- 172.21.15.103:0/2969280538 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff57c108620 0x7ff57c108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.494+0000 7ff581a00640 1 --2- 172.21.15.103:0/2969280538 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff57c102c10 0x7ff57c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.494+0000 7ff581a00640 1 -- 172.21.15.103:0/2969280538 >> 172.21.15.103:0/2969280538 conn(0x7ff57c0fe660 msgr2=0x7ff57c100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:25.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.494+0000 7ff581a00640 1 -- 172.21.15.103:0/2969280538 shutdown_connections 2024-09-11T01:07:25.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.494+0000 7ff581a00640 1 -- 172.21.15.103:0/2969280538 wait complete. 2024-09-11T01:07:25.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.495+0000 7ff581a00640 1 Processor -- start 2024-09-11T01:07:25.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.495+0000 7ff581a00640 1 -- start start 2024-09-11T01:07:25.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.496+0000 7ff581a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff57c102c10 0x7ff57c199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.496+0000 7ff581a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57c108620 0x7ff57c1995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.496+0000 7ff581a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff57c108fa0 0x7ff57c19e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.496+0000 7ff581a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c112c30 con 0x7ff57c108620 2024-09-11T01:07:25.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.496+0000 7ff581a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c112ab0 con 0x7ff57c108fa0 2024-09-11T01:07:25.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.496+0000 7ff581a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff57c112db0 con 0x7ff57c102c10 2024-09-11T01:07:25.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.496+0000 7ff57b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57c108620 0x7ff57c1995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.496+0000 7ff57b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57c108620 0x7ff57c1995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57412/0 (socket says 172.21.15.103:57412) 2024-09-11T01:07:25.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.496+0000 7ff57b400640 1 -- 172.21.15.103:0/577354787 learned_addr learned my addr 172.21.15.103:0/577354787 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:25.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.496+0000 7ff57be00640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff57c102c10 0x7ff57c199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.496+0000 7ff581000640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff57c108fa0 0x7ff57c19e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.497+0000 7ff57b400640 1 -- 172.21.15.103:0/577354787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff57c102c10 msgr2=0x7ff57c199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.497+0000 7ff57b400640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff57c102c10 0x7ff57c199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.497+0000 7ff57b400640 1 -- 172.21.15.103:0/577354787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff57c108fa0 msgr2=0x7ff57c19e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.497+0000 7ff57b400640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff57c108fa0 0x7ff57c19e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.497+0000 7ff57b400640 1 -- 172.21.15.103:0/577354787 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff57c19f130 con 0x7ff57c108620 2024-09-11T01:07:25.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.497+0000 7ff57be00640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff57c102c10 0x7ff57c199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:25.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.497+0000 7ff581000640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff57c108fa0 0x7ff57c19e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:25.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.497+0000 7ff57b400640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57c108620 0x7ff57c1995c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff56800e9f0 tx=0x7ff56800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:25.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.497+0000 7ff578c00640 1 -- 172.21.15.103:0/577354787 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56800cd80 con 0x7ff57c108620 2024-09-11T01:07:25.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.497+0000 7ff578c00640 1 -- 172.21.15.103:0/577354787 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff5680108e0 con 0x7ff57c108620 2024-09-11T01:07:25.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.497+0000 7ff581a00640 1 -- 172.21.15.103:0/577354787 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff57c19f420 con 0x7ff57c108620 2024-09-11T01:07:25.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.497+0000 7ff578c00640 1 -- 172.21.15.103:0/577354787 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568018980 con 0x7ff57c108620 2024-09-11T01:07:25.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.497+0000 7ff581a00640 1 -- 172.21.15.103:0/577354787 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff57c1a5ae0 con 0x7ff57c108620 2024-09-11T01:07:25.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.499+0000 7ff581a00640 1 -- 172.21.15.103:0/577354787 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff57c102ff0 con 0x7ff57c108620 2024-09-11T01:07:25.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.501+0000 7ff578c00640 1 -- 172.21.15.103:0/577354787 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7ff568010430 con 0x7ff57c108620 2024-09-11T01:07:25.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.503+0000 7ff578c00640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff5600b5410 0x7ff5600b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:25.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.503+0000 7ff578c00640 1 -- 172.21.15.103:0/577354787 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7ff5680e6870 con 0x7ff57c108620 2024-09-11T01:07:25.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.503+0000 7ff57be00640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff5600b5410 0x7ff5600b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:25.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.503+0000 7ff578c00640 1 -- 172.21.15.103:0/577354787 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff5680acb70 con 0x7ff57c108620 2024-09-11T01:07:25.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.504+0000 7ff57be00640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff5600b5410 0x7ff5600b78d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009fc0 tx=0x7ff56c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:25.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.693+0000 7ff581a00640 1 -- 172.21.15.103:0/577354787 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff57c02e5c0 con 0x7ff57c108620 2024-09-11T01:07:25.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.693+0000 7ff578c00640 1 -- 172.21.15.103:0/577354787 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff5680b15a0 con 0x7ff57c108620 2024-09-11T01:07:25.695 INFO:teuthology.orchestra.run.smithi103.stdout:77309411414 2024-09-11T01:07:25.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.695+0000 7ff581a00640 1 -- 172.21.15.103:0/577354787 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff5600b5410 msgr2=0x7ff5600b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.695+0000 7ff581a00640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff5600b5410 0x7ff5600b78d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009fc0 tx=0x7ff56c005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:25.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.695+0000 7ff581a00640 1 -- 172.21.15.103:0/577354787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57c108620 msgr2=0x7ff57c1995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:25.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.695+0000 7ff581a00640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57c108620 0x7ff57c1995c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff56800e9f0 tx=0x7ff56800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.695+0000 7ff581a00640 1 -- 172.21.15.103:0/577354787 shutdown_connections 2024-09-11T01:07:25.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.695+0000 7ff581a00640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff5600b5410 0x7ff5600b78d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.695+0000 7ff581a00640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff57c108fa0 0x7ff57c19e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.695+0000 7ff581a00640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff57c108620 0x7ff57c1995c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.695+0000 7ff581a00640 1 --2- 172.21.15.103:0/577354787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff57c102c10 0x7ff57c199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.696+0000 7ff581a00640 1 -- 172.21.15.103:0/577354787 >> 172.21.15.103:0/577354787 conn(0x7ff57c0fe660 msgr2=0x7ff57c0feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.696+0000 7ff581a00640 1 -- 172.21.15.103:0/577354787 shutdown_connections 2024-09-11T01:07:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:25.696+0000 7ff581a00640 1 -- 172.21.15.103:0/577354787 wait complete. 2024-09-11T01:07:26.473 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411410 got 77309411414 for osd.2 2024-09-11T01:07:26.473 DEBUG:teuthology.parallel:result is None 2024-09-11T01:07:26.473 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T01:07:26.473 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T01:07:26.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:26 smithi103 ceph-mon[30562]: pgmap v372: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:26.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:26 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/577354787' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-11T01:07:26.844 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:26.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:26 smithi117 ceph-mon[35358]: pgmap v372: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:26.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:26 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/577354787' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-11T01:07:26.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:26 smithi183 ceph-mon[34992]: pgmap v372: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:26.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:26 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/577354787' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-11T01:07:27.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.450+0000 7f45c6c00640 1 -- 172.21.15.103:0/3608128828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c0104fa0 msgr2=0x7f45c0105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:27.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.450+0000 7f45c6c00640 1 --2- 172.21.15.103:0/3608128828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c0104fa0 0x7f45c0105380 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009900 tx=0x7f45b002a3f0 comp rx=0 tx=0).stop 2024-09-11T01:07:27.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.450+0000 7f45c6c00640 1 -- 172.21.15.103:0/3608128828 shutdown_connections 2024-09-11T01:07:27.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.450+0000 7f45c6c00640 1 --2- 172.21.15.103:0/3608128828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c010b330 0x7f45c0111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:27.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.450+0000 7f45c6c00640 1 --2- 172.21.15.103:0/3608128828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45c010a9b0 0x7f45c010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:27.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.450+0000 7f45c6c00640 1 --2- 172.21.15.103:0/3608128828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c0104fa0 0x7f45c0105380 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:27.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.450+0000 7f45c6c00640 1 -- 172.21.15.103:0/3608128828 >> 172.21.15.103:0/3608128828 conn(0x7f45c0100a50 msgr2=0x7f45c0102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:27.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.450+0000 7f45c6c00640 1 -- 172.21.15.103:0/3608128828 shutdown_connections 2024-09-11T01:07:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.450+0000 7f45c6c00640 1 -- 172.21.15.103:0/3608128828 wait complete. 2024-09-11T01:07:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.451+0000 7f45c6c00640 1 Processor -- start 2024-09-11T01:07:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.451+0000 7f45c6c00640 1 -- start start 2024-09-11T01:07:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.451+0000 7f45c6c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c0104fa0 0x7f45c019b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.451+0000 7f45c6c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45c010a9b0 0x7f45c019b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.451+0000 7f45c6c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c010b330 0x7f45c01a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.451+0000 7f45c6c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f45c0114f90 con 0x7f45c010b330 2024-09-11T01:07:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.451+0000 7f45c6c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f45c0114e10 con 0x7f45c0104fa0 2024-09-11T01:07:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.451+0000 7f45c6c00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f45c0115110 con 0x7f45c010a9b0 2024-09-11T01:07:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.452+0000 7f45c4c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c010b330 0x7f45c01a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.452+0000 7f45bfe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c0104fa0 0x7f45c019b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:27.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.452+0000 7f45bf400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45c010a9b0 0x7f45c019b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.452+0000 7f45c4c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c010b330 0x7f45c01a0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57428/0 (socket says 172.21.15.103:57428) 2024-09-11T01:07:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.452+0000 7f45c4c00640 1 -- 172.21.15.103:0/623777613 learned_addr learned my addr 172.21.15.103:0/623777613 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.452+0000 7f45bfe00640 1 -- 172.21.15.103:0/623777613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45c010a9b0 msgr2=0x7f45c019b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.452+0000 7f45bfe00640 1 --2- 172.21.15.103:0/623777613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45c010a9b0 0x7f45c019b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.452+0000 7f45bfe00640 1 -- 172.21.15.103:0/623777613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c010b330 msgr2=0x7f45c01a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.452+0000 7f45bfe00640 1 --2- 172.21.15.103:0/623777613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c010b330 0x7f45c01a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.452+0000 7f45bfe00640 1 -- 172.21.15.103:0/623777613 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c01a1530 con 0x7f45c0104fa0 2024-09-11T01:07:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.452+0000 7f45c4c00640 1 --2- 172.21.15.103:0/623777613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c010b330 0x7f45c01a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.453+0000 7f45bfe00640 1 --2- 172.21.15.103:0/623777613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c0104fa0 0x7f45c019b480 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f45b002a9e0 tx=0x7f45b0003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.453+0000 7f45bcc00640 1 -- 172.21.15.103:0/623777613 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b003f070 con 0x7f45c0104fa0 2024-09-11T01:07:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.453+0000 7f45bcc00640 1 -- 172.21.15.103:0/623777613 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45b0031b50 con 0x7f45c0104fa0 2024-09-11T01:07:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.453+0000 7f45bcc00640 1 -- 172.21.15.103:0/623777613 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b0035030 con 0x7f45c0104fa0 2024-09-11T01:07:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.453+0000 7f45c6c00640 1 -- 172.21.15.103:0/623777613 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c01a17c0 con 0x7f45c0104fa0 2024-09-11T01:07:27.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.453+0000 7f45c6c00640 1 -- 172.21.15.103:0/623777613 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c01a7ee0 con 0x7f45c0104fa0 2024-09-11T01:07:27.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.454+0000 7f45c6c00640 1 -- 172.21.15.103:0/623777613 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c0105380 con 0x7f45c0104fa0 2024-09-11T01:07:27.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.456+0000 7f45bcc00640 1 -- 172.21.15.103:0/623777613 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f45b00316a0 con 0x7f45c0104fa0 2024-09-11T01:07:27.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.458+0000 7f45bcc00640 1 --2- 172.21.15.103:0/623777613 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f45a40b5370 0x7f45a40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:27.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.458+0000 7f45bcc00640 1 -- 172.21.15.103:0/623777613 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f45b0106bc0 con 0x7f45c0104fa0 2024-09-11T01:07:27.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.458+0000 7f45bf400640 1 --2- 172.21.15.103:0/623777613 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f45a40b5370 0x7f45a40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:27.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.459+0000 7f45bf400640 1 --2- 172.21.15.103:0/623777613 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f45a40b5370 0x7f45a40b7830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f45c010a150 tx=0x7f45ac005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:27.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.459+0000 7f45bcc00640 1 -- 172.21.15.103:0/623777613 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f45b0031d00 con 0x7f45c0104fa0 2024-09-11T01:07:27.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.649+0000 7f45c6c00640 1 -- 172.21.15.103:0/623777613 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45c0063590 con 0x7f45a40b5370 2024-09-11T01:07:27.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.655+0000 7f45bcc00640 1 -- 172.21.15.103:0/623777613 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340371 (secure 0 0 0) 0x7f45c0063590 con 0x7f45a40b5370 2024-09-11T01:07:27.662 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:07:27.663 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T01:07:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.660+0000 7f45c6c00640 1 -- 172.21.15.103:0/623777613 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f45a40b5370 msgr2=0x7f45a40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.660+0000 7f45c6c00640 1 --2- 172.21.15.103:0/623777613 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f45a40b5370 0x7f45a40b7830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f45c010a150 tx=0x7f45ac005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.660+0000 7f45c6c00640 1 -- 172.21.15.103:0/623777613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c0104fa0 msgr2=0x7f45c019b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:27.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.660+0000 7f45c6c00640 1 --2- 172.21.15.103:0/623777613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c0104fa0 0x7f45c019b480 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f45b002a9e0 tx=0x7f45b0003b90 comp rx=0 tx=0).stop 2024-09-11T01:07:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.660+0000 7f45c6c00640 1 -- 172.21.15.103:0/623777613 shutdown_connections 2024-09-11T01:07:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.660+0000 7f45c6c00640 1 --2- 172.21.15.103:0/623777613 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f45a40b5370 0x7f45a40b7830 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.660+0000 7f45c6c00640 1 --2- 172.21.15.103:0/623777613 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f45c010b330 0x7f45c01a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.660+0000 7f45c6c00640 1 --2- 172.21.15.103:0/623777613 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f45c010a9b0 0x7f45c019b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.660+0000 7f45c6c00640 1 --2- 172.21.15.103:0/623777613 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f45c0104fa0 0x7f45c019b480 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.660+0000 7f45c6c00640 1 -- 172.21.15.103:0/623777613 >> 172.21.15.103:0/623777613 conn(0x7f45c0100a50 msgr2=0x7f45c0101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.660+0000 7f45c6c00640 1 -- 172.21.15.103:0/623777613 shutdown_connections 2024-09-11T01:07:27.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:27.660+0000 7f45c6c00640 1 -- 172.21.15.103:0/623777613 wait complete. 2024-09-11T01:07:28.473 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":373,"stamp":"2024-09-11T01:07:27.539125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659130,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":485,"num_read_kb":341,"num_write":295,"num_write_kb":2271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2953603,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":239,"ondisk_log_size":239,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379900,"kb_used_data":13952,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124561924,"statfs":{"total":1151940427776,"available":1151551410176,"internally_reserved":0,"allocated":14286848,"data_stored":8028992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003287"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598754+0000","last_change":"2024-09-11T01:05:28.553987+0000","last_active":"2024-09-11T01:06:41.598754+0000","last_peered":"2024-09-11T01:06:41.598754+0000","last_clean":"2024-09-11T01:06:41.598754+0000","last_became_active":"2024-09-11T01:05:28.553691+0000","last_became_peered":"2024-09-11T01:05:28.553691+0000","last_unstale":"2024-09-11T01:06:41.598754+0000","last_undegraded":"2024-09-11T01:06:41.598754+0000","last_fullsized":"2024-09-11T01:06:41.598754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:50.407880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.651258+0000","last_change":"2024-09-11T01:05:31.677005+0000","last_active":"2024-09-11T01:06:41.651258+0000","last_peered":"2024-09-11T01:06:41.651258+0000","last_clean":"2024-09-11T01:06:41.651258+0000","last_became_active":"2024-09-11T01:05:31.676597+0000","last_became_peered":"2024-09-11T01:05:31.676597+0000","last_unstale":"2024-09-11T01:06:41.651258+0000","last_undegraded":"2024-09-11T01:06:41.651258+0000","last_fullsized":"2024-09-11T01:06:41.651258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:06.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594641+0000","last_change":"2024-09-11T01:05:40.975009+0000","last_active":"2024-09-11T01:06:41.594641+0000","last_peered":"2024-09-11T01:06:41.594641+0000","last_clean":"2024-09-11T01:06:41.594641+0000","last_became_active":"2024-09-11T01:05:40.974546+0000","last_became_peered":"2024-09-11T01:05:40.974546+0000","last_unstale":"2024-09-11T01:06:41.594641+0000","last_undegraded":"2024-09-11T01:06:41.594641+0000","last_fullsized":"2024-09-11T01:06:41.594641+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:56.420262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.651358+0000","last_change":"2024-09-11T01:05:28.623367+0000","last_active":"2024-09-11T01:06:41.651358+0000","last_peered":"2024-09-11T01:06:41.651358+0000","last_clean":"2024-09-11T01:06:41.651358+0000","last_became_active":"2024-09-11T01:05:28.622990+0000","last_became_peered":"2024-09-11T01:05:28.622990+0000","last_unstale":"2024-09-11T01:06:41.651358+0000","last_undegraded":"2024-09-11T01:06:41.651358+0000","last_fullsized":"2024-09-11T01:06:41.651358+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:35.022280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470507+0000","last_change":"2024-09-11T01:05:31.693910+0000","last_active":"2024-09-11T01:06:42.470507+0000","last_peered":"2024-09-11T01:06:42.470507+0000","last_clean":"2024-09-11T01:06:42.470507+0000","last_became_active":"2024-09-11T01:05:31.692906+0000","last_became_peered":"2024-09-11T01:05:31.692906+0000","last_unstale":"2024-09-11T01:06:42.470507+0000","last_undegraded":"2024-09-11T01:06:42.470507+0000","last_fullsized":"2024-09-11T01:06:42.470507+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:11.906323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594969+0000","last_change":"2024-09-11T01:05:40.975768+0000","last_active":"2024-09-11T01:06:41.594969+0000","last_peered":"2024-09-11T01:06:41.594969+0000","last_clean":"2024-09-11T01:06:41.594969+0000","last_became_active":"2024-09-11T01:05:40.974721+0000","last_became_peered":"2024-09-11T01:05:40.974721+0000","last_unstale":"2024-09-11T01:06:41.594969+0000","last_undegraded":"2024-09-11T01:06:41.594969+0000","last_fullsized":"2024-09-11T01:06:41.594969+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:27.475531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599022+0000","last_change":"2024-09-11T01:05:28.558980+0000","last_active":"2024-09-11T01:06:41.599022+0000","last_peered":"2024-09-11T01:06:41.599022+0000","last_clean":"2024-09-11T01:06:41.599022+0000","last_became_active":"2024-09-11T01:05:28.558617+0000","last_became_peered":"2024-09-11T01:05:28.558617+0000","last_unstale":"2024-09-11T01:06:41.599022+0000","last_undegraded":"2024-09-11T01:06:41.599022+0000","last_fullsized":"2024-09-11T01:06:41.599022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:13.659175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470378+0000","last_change":"2024-09-11T01:05:31.664705+0000","last_active":"2024-09-11T01:06:42.470378+0000","last_peered":"2024-09-11T01:06:42.470378+0000","last_clean":"2024-09-11T01:06:42.470378+0000","last_became_active":"2024-09-11T01:05:31.664328+0000","last_became_peered":"2024-09-11T01:05:31.664328+0000","last_unstale":"2024-09-11T01:06:42.470378+0000","last_undegraded":"2024-09-11T01:06:42.470378+0000","last_fullsized":"2024-09-11T01:06:42.470378+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:20.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.652222+0000","last_change":"2024-09-11T01:06:41.652143+0000","last_active":"2024-09-11T01:06:41.652222+0000","last_peered":"2024-09-11T01:06:41.652222+0000","last_clean":"2024-09-11T01:06:41.652222+0000","last_became_active":"2024-09-11T01:06:41.651661+0000","last_became_peered":"2024-09-11T01:06:41.651661+0000","last_unstale":"2024-09-11T01:06:41.652222+0000","last_undegraded":"2024-09-11T01:06:41.652222+0000","last_fullsized":"2024-09-11T01:06:41.652222+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:03.377915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,8],"acting":[4,3,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599638+0000","last_change":"2024-09-11T01:05:28.555081+0000","last_active":"2024-09-11T01:06:41.599638+0000","last_peered":"2024-09-11T01:06:41.599638+0000","last_clean":"2024-09-11T01:06:41.599638+0000","last_became_active":"2024-09-11T01:05:28.554562+0000","last_became_peered":"2024-09-11T01:05:28.554562+0000","last_unstale":"2024-09-11T01:06:41.599638+0000","last_undegraded":"2024-09-11T01:06:41.599638+0000","last_fullsized":"2024-09-11T01:06:41.599638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:23.922285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683854+0000","last_change":"2024-09-11T01:05:31.680442+0000","last_active":"2024-09-11T01:06:41.683854+0000","last_peered":"2024-09-11T01:06:41.683854+0000","last_clean":"2024-09-11T01:06:41.683854+0000","last_became_active":"2024-09-11T01:05:31.680107+0000","last_became_peered":"2024-09-11T01:05:31.680107+0000","last_unstale":"2024-09-11T01:06:41.683854+0000","last_undegraded":"2024-09-11T01:06:41.683854+0000","last_fullsized":"2024-09-11T01:06:41.683854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:16:02.853855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595044+0000","last_change":"2024-09-11T01:05:40.969365+0000","last_active":"2024-09-11T01:06:41.595044+0000","last_peered":"2024-09-11T01:06:41.595044+0000","last_clean":"2024-09-11T01:06:41.595044+0000","last_became_active":"2024-09-11T01:05:40.969005+0000","last_became_peered":"2024-09-11T01:05:40.969005+0000","last_unstale":"2024-09-11T01:06:41.595044+0000","last_undegraded":"2024-09-11T01:06:41.595044+0000","last_fullsized":"2024-09-11T01:06:41.595044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:42.942848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598540+0000","last_change":"2024-09-11T01:05:31.676943+0000","last_active":"2024-09-11T01:06:41.598540+0000","last_peered":"2024-09-11T01:06:41.598540+0000","last_clean":"2024-09-11T01:06:41.598540+0000","last_became_active":"2024-09-11T01:05:31.676584+0000","last_became_peered":"2024-09-11T01:05:31.676584+0000","last_unstale":"2024-09-11T01:06:41.598540+0000","last_undegraded":"2024-09-11T01:06:41.598540+0000","last_fullsized":"2024-09-11T01:06:41.598540+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:08.288439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599154+0000","last_change":"2024-09-11T01:05:28.559196+0000","last_active":"2024-09-11T01:06:41.599154+0000","last_peered":"2024-09-11T01:06:41.599154+0000","last_clean":"2024-09-11T01:06:41.599154+0000","last_became_active":"2024-09-11T01:05:28.558746+0000","last_became_peered":"2024-09-11T01:05:28.558746+0000","last_unstale":"2024-09-11T01:06:41.599154+0000","last_undegraded":"2024-09-11T01:06:41.599154+0000","last_fullsized":"2024-09-11T01:06:41.599154+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:32.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595624+0000","last_change":"2024-09-11T01:05:40.963609+0000","last_active":"2024-09-11T01:06:41.595624+0000","last_peered":"2024-09-11T01:06:41.595624+0000","last_clean":"2024-09-11T01:06:41.595624+0000","last_became_active":"2024-09-11T01:05:40.963088+0000","last_became_peered":"2024-09-11T01:05:40.963088+0000","last_unstale":"2024-09-11T01:06:41.595624+0000","last_undegraded":"2024-09-11T01:06:41.595624+0000","last_fullsized":"2024-09-11T01:06:41.595624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:27.135362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650853+0000","last_change":"2024-09-11T01:05:31.681258+0000","last_active":"2024-09-11T01:06:41.650853+0000","last_peered":"2024-09-11T01:06:41.650853+0000","last_clean":"2024-09-11T01:06:41.650853+0000","last_became_active":"2024-09-11T01:05:31.680946+0000","last_became_peered":"2024-09-11T01:05:31.680946+0000","last_unstale":"2024-09-11T01:06:41.650853+0000","last_undegraded":"2024-09-11T01:06:41.650853+0000","last_fullsized":"2024-09-11T01:06:41.650853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:42.047250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'1","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594875+0000","last_change":"2024-09-11T01:05:28.554651+0000","last_active":"2024-09-11T01:06:41.594875+0000","last_peered":"2024-09-11T01:06:41.594875+0000","last_clean":"2024-09-11T01:06:41.594875+0000","last_became_active":"2024-09-11T01:05:28.554279+0000","last_became_peered":"2024-09-11T01:05:28.554279+0000","last_unstale":"2024-09-11T01:06:41.594875+0000","last_undegraded":"2024-09-11T01:06:41.594875+0000","last_fullsized":"2024-09-11T01:06:41.594875+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:14.093403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.685785+0000","last_change":"2024-09-11T01:06:41.685672+0000","last_active":"2024-09-11T01:06:41.685785+0000","last_peered":"2024-09-11T01:06:41.685785+0000","last_clean":"2024-09-11T01:06:41.685785+0000","last_became_active":"2024-09-11T01:06:41.681272+0000","last_became_peered":"2024-09-11T01:06:41.681272+0000","last_unstale":"2024-09-11T01:06:41.685785+0000","last_undegraded":"2024-09-11T01:06:41.685785+0000","last_fullsized":"2024-09-11T01:06:41.685785+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:53:39.693530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597777+0000","last_change":"2024-09-11T01:05:31.681743+0000","last_active":"2024-09-11T01:06:41.597777+0000","last_peered":"2024-09-11T01:06:41.597777+0000","last_clean":"2024-09-11T01:06:41.597777+0000","last_became_active":"2024-09-11T01:05:31.681223+0000","last_became_peered":"2024-09-11T01:05:31.681223+0000","last_unstale":"2024-09-11T01:06:41.597777+0000","last_undegraded":"2024-09-11T01:06:41.597777+0000","last_fullsized":"2024-09-11T01:06:41.597777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:49.449622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650999+0000","last_change":"2024-09-11T01:05:28.552914+0000","last_active":"2024-09-11T01:06:41.650999+0000","last_peered":"2024-09-11T01:06:41.650999+0000","last_clean":"2024-09-11T01:06:41.650999+0000","last_became_active":"2024-09-11T01:05:28.552404+0000","last_became_peered":"2024-09-11T01:05:28.552404+0000","last_unstale":"2024-09-11T01:06:41.650999+0000","last_undegraded":"2024-09-11T01:06:41.650999+0000","last_fullsized":"2024-09-11T01:06:41.650999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:39.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598606+0000","last_change":"2024-09-11T01:05:40.985652+0000","last_active":"2024-09-11T01:06:41.598606+0000","last_peered":"2024-09-11T01:06:41.598606+0000","last_clean":"2024-09-11T01:06:41.598606+0000","last_became_active":"2024-09-11T01:05:40.984898+0000","last_became_peered":"2024-09-11T01:05:40.984898+0000","last_unstale":"2024-09-11T01:06:41.598606+0000","last_undegraded":"2024-09-11T01:06:41.598606+0000","last_fullsized":"2024-09-11T01:06:41.598606+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:58.961342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597991+0000","last_change":"2024-09-11T01:05:31.675590+0000","last_active":"2024-09-11T01:06:41.597991+0000","last_peered":"2024-09-11T01:06:41.597991+0000","last_clean":"2024-09-11T01:06:41.597991+0000","last_became_active":"2024-09-11T01:05:31.674426+0000","last_became_peered":"2024-09-11T01:05:31.674426+0000","last_unstale":"2024-09-11T01:06:41.597991+0000","last_undegraded":"2024-09-11T01:06:41.597991+0000","last_fullsized":"2024-09-11T01:06:41.597991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:49.499195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470257+0000","last_change":"2024-09-11T01:05:28.623677+0000","last_active":"2024-09-11T01:06:42.470257+0000","last_peered":"2024-09-11T01:06:42.470257+0000","last_clean":"2024-09-11T01:06:42.470257+0000","last_became_active":"2024-09-11T01:05:28.623357+0000","last_became_peered":"2024-09-11T01:05:28.623357+0000","last_unstale":"2024-09-11T01:06:42.470257+0000","last_undegraded":"2024-09-11T01:06:42.470257+0000","last_fullsized":"2024-09-11T01:06:42.470257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:10.875425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595453+0000","last_change":"2024-09-11T01:05:40.978136+0000","last_active":"2024-09-11T01:06:41.595453+0000","last_peered":"2024-09-11T01:06:41.595453+0000","last_clean":"2024-09-11T01:06:41.595453+0000","last_became_active":"2024-09-11T01:05:40.977583+0000","last_became_peered":"2024-09-11T01:05:40.977583+0000","last_unstale":"2024-09-11T01:06:41.595453+0000","last_undegraded":"2024-09-11T01:06:41.595453+0000","last_fullsized":"2024-09-11T01:06:41.595453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:58:20.297640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470318+0000","last_change":"2024-09-11T01:05:31.692938+0000","last_active":"2024-09-11T01:06:42.470318+0000","last_peered":"2024-09-11T01:06:42.470318+0000","last_clean":"2024-09-11T01:06:42.470318+0000","last_became_active":"2024-09-11T01:05:31.689869+0000","last_became_peered":"2024-09-11T01:05:31.689869+0000","last_unstale":"2024-09-11T01:06:42.470318+0000","last_undegraded":"2024-09-11T01:06:42.470318+0000","last_fullsized":"2024-09-11T01:06:42.470318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:24.820033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595809+0000","last_change":"2024-09-11T01:05:28.755985+0000","last_active":"2024-09-11T01:06:41.595809+0000","last_peered":"2024-09-11T01:06:41.595809+0000","last_clean":"2024-09-11T01:06:41.595809+0000","last_became_active":"2024-09-11T01:05:28.755604+0000","last_became_peered":"2024-09-11T01:05:28.755604+0000","last_unstale":"2024-09-11T01:06:41.595809+0000","last_undegraded":"2024-09-11T01:06:41.595809+0000","last_fullsized":"2024-09-11T01:06:41.595809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:22.570473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594745+0000","last_change":"2024-09-11T01:05:40.963465+0000","last_active":"2024-09-11T01:06:41.594745+0000","last_peered":"2024-09-11T01:06:41.594745+0000","last_clean":"2024-09-11T01:06:41.594745+0000","last_became_active":"2024-09-11T01:05:40.962899+0000","last_became_peered":"2024-09-11T01:05:40.962899+0000","last_unstale":"2024-09-11T01:06:41.594745+0000","last_undegraded":"2024-09-11T01:06:41.594745+0000","last_fullsized":"2024-09-11T01:06:41.594745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:01.728640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.651294+0000","last_change":"2024-09-11T01:05:31.675864+0000","last_active":"2024-09-11T01:06:41.651294+0000","last_peered":"2024-09-11T01:06:41.651294+0000","last_clean":"2024-09-11T01:06:41.651294+0000","last_became_active":"2024-09-11T01:05:31.675446+0000","last_became_peered":"2024-09-11T01:05:31.675446+0000","last_unstale":"2024-09-11T01:06:41.651294+0000","last_undegraded":"2024-09-11T01:06:41.651294+0000","last_fullsized":"2024-09-11T01:06:41.651294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:36.457881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'12","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598521+0000","last_change":"2024-09-11T01:05:28.553509+0000","last_active":"2024-09-11T01:06:41.598521+0000","last_peered":"2024-09-11T01:06:41.598521+0000","last_clean":"2024-09-11T01:06:41.598521+0000","last_became_active":"2024-09-11T01:05:28.553101+0000","last_became_peered":"2024-09-11T01:05:28.553101+0000","last_unstale":"2024-09-11T01:06:41.598521+0000","last_undegraded":"2024-09-11T01:06:41.598521+0000","last_fullsized":"2024-09-11T01:06:41.598521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:41.300518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650536+0000","last_change":"2024-09-11T01:05:40.977146+0000","last_active":"2024-09-11T01:06:41.650536+0000","last_peered":"2024-09-11T01:06:41.650536+0000","last_clean":"2024-09-11T01:06:41.650536+0000","last_became_active":"2024-09-11T01:05:40.976804+0000","last_became_peered":"2024-09-11T01:05:40.976804+0000","last_unstale":"2024-09-11T01:06:41.650536+0000","last_undegraded":"2024-09-11T01:06:41.650536+0000","last_fullsized":"2024-09-11T01:06:41.650536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:49.753417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595424+0000","last_change":"2024-09-11T01:05:31.684219+0000","last_active":"2024-09-11T01:06:41.595424+0000","last_peered":"2024-09-11T01:06:41.595424+0000","last_clean":"2024-09-11T01:06:41.595424+0000","last_became_active":"2024-09-11T01:05:31.683937+0000","last_became_peered":"2024-09-11T01:05:31.683937+0000","last_unstale":"2024-09-11T01:06:41.595424+0000","last_undegraded":"2024-09-11T01:06:41.595424+0000","last_fullsized":"2024-09-11T01:06:41.595424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:53.813624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599170+0000","last_change":"2024-09-11T01:05:28.623680+0000","last_active":"2024-09-11T01:06:41.599170+0000","last_peered":"2024-09-11T01:06:41.599170+0000","last_clean":"2024-09-11T01:06:41.599170+0000","last_became_active":"2024-09-11T01:05:28.623261+0000","last_became_peered":"2024-09-11T01:05:28.623261+0000","last_unstale":"2024-09-11T01:06:41.599170+0000","last_undegraded":"2024-09-11T01:06:41.599170+0000","last_fullsized":"2024-09-11T01:06:41.599170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:17.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597354+0000","last_change":"2024-09-11T01:05:40.967165+0000","last_active":"2024-09-11T01:06:41.597354+0000","last_peered":"2024-09-11T01:06:41.597354+0000","last_clean":"2024-09-11T01:06:41.597354+0000","last_became_active":"2024-09-11T01:05:40.966723+0000","last_became_peered":"2024-09-11T01:05:40.966723+0000","last_unstale":"2024-09-11T01:06:41.597354+0000","last_undegraded":"2024-09-11T01:06:41.597354+0000","last_fullsized":"2024-09-11T01:06:41.597354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:48.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.680374+0000","last_change":"2024-09-11T01:05:31.679865+0000","last_active":"2024-09-11T01:06:41.680374+0000","last_peered":"2024-09-11T01:06:41.680374+0000","last_clean":"2024-09-11T01:06:41.680374+0000","last_became_active":"2024-09-11T01:05:31.679494+0000","last_became_peered":"2024-09-11T01:05:31.679494+0000","last_unstale":"2024-09-11T01:06:41.680374+0000","last_undegraded":"2024-09-11T01:06:41.680374+0000","last_fullsized":"2024-09-11T01:06:41.680374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:56.300799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598508+0000","last_change":"2024-09-11T01:05:28.623746+0000","last_active":"2024-09-11T01:06:41.598508+0000","last_peered":"2024-09-11T01:06:41.598508+0000","last_clean":"2024-09-11T01:06:41.598508+0000","last_became_active":"2024-09-11T01:05:28.623358+0000","last_became_peered":"2024-09-11T01:05:28.623358+0000","last_unstale":"2024-09-11T01:06:41.598508+0000","last_undegraded":"2024-09-11T01:06:41.598508+0000","last_fullsized":"2024-09-11T01:06:41.598508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:13.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598128+0000","last_change":"2024-09-11T01:05:40.982108+0000","last_active":"2024-09-11T01:06:41.598128+0000","last_peered":"2024-09-11T01:06:41.598128+0000","last_clean":"2024-09-11T01:06:41.598128+0000","last_became_active":"2024-09-11T01:05:40.981737+0000","last_became_peered":"2024-09-11T01:05:40.981737+0000","last_unstale":"2024-09-11T01:06:41.598128+0000","last_undegraded":"2024-09-11T01:06:41.598128+0000","last_fullsized":"2024-09-11T01:06:41.598128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:16.717933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.680277+0000","last_change":"2024-09-11T01:05:31.680885+0000","last_active":"2024-09-11T01:06:41.680277+0000","last_peered":"2024-09-11T01:06:41.680277+0000","last_clean":"2024-09-11T01:06:41.680277+0000","last_became_active":"2024-09-11T01:05:31.680536+0000","last_became_peered":"2024-09-11T01:05:31.680536+0000","last_unstale":"2024-09-11T01:06:41.680277+0000","last_undegraded":"2024-09-11T01:06:41.680277+0000","last_fullsized":"2024-09-11T01:06:41.680277+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:12.963321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598653+0000","last_change":"2024-09-11T01:05:28.553957+0000","last_active":"2024-09-11T01:06:41.598653+0000","last_peered":"2024-09-11T01:06:41.598653+0000","last_clean":"2024-09-11T01:06:41.598653+0000","last_became_active":"2024-09-11T01:05:28.553572+0000","last_became_peered":"2024-09-11T01:05:28.553572+0000","last_unstale":"2024-09-11T01:06:41.598653+0000","last_undegraded":"2024-09-11T01:06:41.598653+0000","last_fullsized":"2024-09-11T01:06:41.598653+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:14.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595188+0000","last_change":"2024-09-11T01:05:40.971221+0000","last_active":"2024-09-11T01:06:41.595188+0000","last_peered":"2024-09-11T01:06:41.595188+0000","last_clean":"2024-09-11T01:06:41.595188+0000","last_became_active":"2024-09-11T01:05:40.970063+0000","last_became_peered":"2024-09-11T01:05:40.970063+0000","last_unstale":"2024-09-11T01:06:41.595188+0000","last_undegraded":"2024-09-11T01:06:41.595188+0000","last_fullsized":"2024-09-11T01:06:41.595188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:46.299357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683432+0000","last_change":"2024-09-11T01:05:31.677125+0000","last_active":"2024-09-11T01:06:41.683432+0000","last_peered":"2024-09-11T01:06:41.683432+0000","last_clean":"2024-09-11T01:06:41.683432+0000","last_became_active":"2024-09-11T01:05:31.676803+0000","last_became_peered":"2024-09-11T01:05:31.676803+0000","last_unstale":"2024-09-11T01:06:41.683432+0000","last_undegraded":"2024-09-11T01:06:41.683432+0000","last_fullsized":"2024-09-11T01:06:41.683432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:01:38.922178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'4","reported_seq":108,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:21.739553+0000","last_change":"2024-09-11T01:05:28.623895+0000","last_active":"2024-09-11T01:07:21.739553+0000","last_peered":"2024-09-11T01:07:21.739553+0000","last_clean":"2024-09-11T01:07:21.739553+0000","last_became_active":"2024-09-11T01:05:28.623520+0000","last_became_peered":"2024-09-11T01:05:28.623520+0000","last_unstale":"2024-09-11T01:07:21.739553+0000","last_undegraded":"2024-09-11T01:07:21.739553+0000","last_fullsized":"2024-09-11T01:07:21.739553+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:22.309521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":63,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595154+0000","last_change":"2024-09-11T01:05:40.974416+0000","last_active":"2024-09-11T01:06:41.595154+0000","last_peered":"2024-09-11T01:06:41.595154+0000","last_clean":"2024-09-11T01:06:41.595154+0000","last_became_active":"2024-09-11T01:05:40.973990+0000","last_became_peered":"2024-09-11T01:05:40.973990+0000","last_unstale":"2024-09-11T01:06:41.595154+0000","last_undegraded":"2024-09-11T01:06:41.595154+0000","last_fullsized":"2024-09-11T01:06:41.595154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:30.018876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594453+0000","last_change":"2024-09-11T01:05:31.688968+0000","last_active":"2024-09-11T01:06:41.594453+0000","last_peered":"2024-09-11T01:06:41.594453+0000","last_clean":"2024-09-11T01:06:41.594453+0000","last_became_active":"2024-09-11T01:05:31.688672+0000","last_became_peered":"2024-09-11T01:05:31.688672+0000","last_unstale":"2024-09-11T01:06:41.594453+0000","last_undegraded":"2024-09-11T01:06:41.594453+0000","last_fullsized":"2024-09-11T01:06:41.594453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:39.080386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597726+0000","last_change":"2024-09-11T01:05:28.554126+0000","last_active":"2024-09-11T01:06:41.597726+0000","last_peered":"2024-09-11T01:06:41.597726+0000","last_clean":"2024-09-11T01:06:41.597726+0000","last_became_active":"2024-09-11T01:05:28.553575+0000","last_became_peered":"2024-09-11T01:05:28.553575+0000","last_unstale":"2024-09-11T01:06:41.597726+0000","last_undegraded":"2024-09-11T01:06:41.597726+0000","last_fullsized":"2024-09-11T01:06:41.597726+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:42.203339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683940+0000","last_change":"2024-09-11T01:05:40.980415+0000","last_active":"2024-09-11T01:06:41.683940+0000","last_peered":"2024-09-11T01:06:41.683940+0000","last_clean":"2024-09-11T01:06:41.683940+0000","last_became_active":"2024-09-11T01:05:40.980062+0000","last_became_peered":"2024-09-11T01:05:40.980062+0000","last_unstale":"2024-09-11T01:06:41.683940+0000","last_undegraded":"2024-09-11T01:06:41.683940+0000","last_fullsized":"2024-09-11T01:06:41.683940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:25.889972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650954+0000","last_change":"2024-09-11T01:05:31.679622+0000","last_active":"2024-09-11T01:06:41.650954+0000","last_peered":"2024-09-11T01:06:41.650954+0000","last_clean":"2024-09-11T01:06:41.650954+0000","last_became_active":"2024-09-11T01:05:31.679239+0000","last_became_peered":"2024-09-11T01:05:31.679239+0000","last_unstale":"2024-09-11T01:06:41.650954+0000","last_undegraded":"2024-09-11T01:06:41.650954+0000","last_fullsized":"2024-09-11T01:06:41.650954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:32.240196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595521+0000","last_change":"2024-09-11T01:05:28.552203+0000","last_active":"2024-09-11T01:06:41.595521+0000","last_peered":"2024-09-11T01:06:41.595521+0000","last_clean":"2024-09-11T01:06:41.595521+0000","last_became_active":"2024-09-11T01:05:28.551658+0000","last_became_peered":"2024-09-11T01:05:28.551658+0000","last_unstale":"2024-09-11T01:06:41.595521+0000","last_undegraded":"2024-09-11T01:06:41.595521+0000","last_fullsized":"2024-09-11T01:06:41.595521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:46.102466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":117,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598067+0000","last_change":"2024-09-11T01:04:12.299017+0000","last_active":"2024-09-11T01:06:41.598067+0000","last_peered":"2024-09-11T01:06:41.598067+0000","last_clean":"2024-09-11T01:06:41.598067+0000","last_became_active":"2024-09-11T01:04:11.998504+0000","last_became_peered":"2024-09-11T01:04:11.998504+0000","last_unstale":"2024-09-11T01:06:41.598067+0000","last_undegraded":"2024-09-11T01:06:41.598067+0000","last_fullsized":"2024-09-11T01:06:41.598067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:00:34.569322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:00:34.569322+0000","last_clean_scrub_stamp":"2024-09-11T01:00:34.569322+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:54.949789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597909+0000","last_change":"2024-09-11T01:05:40.982181+0000","last_active":"2024-09-11T01:06:41.597909+0000","last_peered":"2024-09-11T01:06:41.597909+0000","last_clean":"2024-09-11T01:06:41.597909+0000","last_became_active":"2024-09-11T01:05:40.981668+0000","last_became_peered":"2024-09-11T01:05:40.981668+0000","last_unstale":"2024-09-11T01:06:41.597909+0000","last_undegraded":"2024-09-11T01:06:41.597909+0000","last_fullsized":"2024-09-11T01:06:41.597909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:48.199189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598067+0000","last_change":"2024-09-11T01:05:31.677978+0000","last_active":"2024-09-11T01:06:41.598067+0000","last_peered":"2024-09-11T01:06:41.598067+0000","last_clean":"2024-09-11T01:06:41.598067+0000","last_became_active":"2024-09-11T01:05:31.677478+0000","last_became_peered":"2024-09-11T01:05:31.677478+0000","last_unstale":"2024-09-11T01:06:41.598067+0000","last_undegraded":"2024-09-11T01:06:41.598067+0000","last_fullsized":"2024-09-11T01:06:41.598067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:39.568921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595398+0000","last_change":"2024-09-11T01:05:28.755866+0000","last_active":"2024-09-11T01:06:41.595398+0000","last_peered":"2024-09-11T01:06:41.595398+0000","last_clean":"2024-09-11T01:06:41.595398+0000","last_became_active":"2024-09-11T01:05:28.755475+0000","last_became_peered":"2024-09-11T01:05:28.755475+0000","last_unstale":"2024-09-11T01:06:41.595398+0000","last_undegraded":"2024-09-11T01:06:41.595398+0000","last_fullsized":"2024-09-11T01:06:41.595398+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:22.324584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470168+0000","last_change":"2024-09-11T01:05:40.967181+0000","last_active":"2024-09-11T01:06:42.470168+0000","last_peered":"2024-09-11T01:06:42.470168+0000","last_clean":"2024-09-11T01:06:42.470168+0000","last_became_active":"2024-09-11T01:05:40.966748+0000","last_became_peered":"2024-09-11T01:05:40.966748+0000","last_unstale":"2024-09-11T01:06:42.470168+0000","last_undegraded":"2024-09-11T01:06:42.470168+0000","last_fullsized":"2024-09-11T01:06:42.470168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:15:28.446190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598538+0000","last_change":"2024-09-11T01:05:40.981823+0000","last_active":"2024-09-11T01:06:41.598538+0000","last_peered":"2024-09-11T01:06:41.598538+0000","last_clean":"2024-09-11T01:06:41.598538+0000","last_became_active":"2024-09-11T01:05:40.981478+0000","last_became_peered":"2024-09-11T01:05:40.981478+0000","last_unstale":"2024-09-11T01:06:41.598538+0000","last_undegraded":"2024-09-11T01:06:41.598538+0000","last_fullsized":"2024-09-11T01:06:41.598538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:55.848492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.684059+0000","last_change":"2024-09-11T01:05:28.549207+0000","last_active":"2024-09-11T01:06:41.684059+0000","last_peered":"2024-09-11T01:06:41.684059+0000","last_clean":"2024-09-11T01:06:41.684059+0000","last_became_active":"2024-09-11T01:05:28.548156+0000","last_became_peered":"2024-09-11T01:05:28.548156+0000","last_unstale":"2024-09-11T01:06:41.684059+0000","last_undegraded":"2024-09-11T01:06:41.684059+0000","last_fullsized":"2024-09-11T01:06:41.684059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:58.698379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470297+0000","last_change":"2024-09-11T01:05:40.982213+0000","last_active":"2024-09-11T01:06:42.470297+0000","last_peered":"2024-09-11T01:06:42.470297+0000","last_clean":"2024-09-11T01:06:42.470297+0000","last_became_active":"2024-09-11T01:05:40.981066+0000","last_became_peered":"2024-09-11T01:05:40.981066+0000","last_unstale":"2024-09-11T01:06:42.470297+0000","last_undegraded":"2024-09-11T01:06:42.470297+0000","last_fullsized":"2024-09-11T01:06:42.470297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:09.348973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598084+0000","last_change":"2024-09-11T01:05:31.677613+0000","last_active":"2024-09-11T01:06:41.598084+0000","last_peered":"2024-09-11T01:06:41.598084+0000","last_clean":"2024-09-11T01:06:41.598084+0000","last_became_active":"2024-09-11T01:05:31.677263+0000","last_became_peered":"2024-09-11T01:05:31.677263+0000","last_unstale":"2024-09-11T01:06:41.598084+0000","last_undegraded":"2024-09-11T01:06:41.598084+0000","last_fullsized":"2024-09-11T01:06:41.598084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:32.490982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595356+0000","last_change":"2024-09-11T01:05:28.558437+0000","last_active":"2024-09-11T01:06:41.595356+0000","last_peered":"2024-09-11T01:06:41.595356+0000","last_clean":"2024-09-11T01:06:41.595356+0000","last_became_active":"2024-09-11T01:05:28.558070+0000","last_became_peered":"2024-09-11T01:05:28.558070+0000","last_unstale":"2024-09-11T01:06:41.595356+0000","last_undegraded":"2024-09-11T01:06:41.595356+0000","last_fullsized":"2024-09-11T01:06:41.595356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:26.589209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.682969+0000","last_change":"2024-09-11T01:05:40.970422+0000","last_active":"2024-09-11T01:06:41.682969+0000","last_peered":"2024-09-11T01:06:41.682969+0000","last_clean":"2024-09-11T01:06:41.682969+0000","last_became_active":"2024-09-11T01:05:40.970087+0000","last_became_peered":"2024-09-11T01:05:40.970087+0000","last_unstale":"2024-09-11T01:06:41.682969+0000","last_undegraded":"2024-09-11T01:06:41.682969+0000","last_fullsized":"2024-09-11T01:06:41.682969+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:05.171700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597426+0000","last_change":"2024-09-11T01:05:40.967014+0000","last_active":"2024-09-11T01:06:41.597426+0000","last_peered":"2024-09-11T01:06:41.597426+0000","last_clean":"2024-09-11T01:06:41.597426+0000","last_became_active":"2024-09-11T01:05:40.966567+0000","last_became_peered":"2024-09-11T01:05:40.966567+0000","last_unstale":"2024-09-11T01:06:41.597426+0000","last_undegraded":"2024-09-11T01:06:41.597426+0000","last_fullsized":"2024-09-11T01:06:41.597426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:50.868245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599148+0000","last_change":"2024-09-11T01:05:28.553646+0000","last_active":"2024-09-11T01:06:41.599148+0000","last_peered":"2024-09-11T01:06:41.599148+0000","last_clean":"2024-09-11T01:06:41.599148+0000","last_became_active":"2024-09-11T01:05:28.553238+0000","last_became_peered":"2024-09-11T01:05:28.553238+0000","last_unstale":"2024-09-11T01:06:41.599148+0000","last_undegraded":"2024-09-11T01:06:41.599148+0000","last_fullsized":"2024-09-11T01:06:41.599148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:31.670321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683106+0000","last_change":"2024-09-11T01:05:40.973220+0000","last_active":"2024-09-11T01:06:41.683106+0000","last_peered":"2024-09-11T01:06:41.683106+0000","last_clean":"2024-09-11T01:06:41.683106+0000","last_became_active":"2024-09-11T01:05:40.972843+0000","last_became_peered":"2024-09-11T01:05:40.972843+0000","last_unstale":"2024-09-11T01:06:41.683106+0000","last_undegraded":"2024-09-11T01:06:41.683106+0000","last_fullsized":"2024-09-11T01:06:41.683106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:07.785474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683330+0000","last_change":"2024-09-11T01:05:31.682064+0000","last_active":"2024-09-11T01:06:41.683330+0000","last_peered":"2024-09-11T01:06:41.683330+0000","last_clean":"2024-09-11T01:06:41.683330+0000","last_became_active":"2024-09-11T01:05:31.681744+0000","last_became_peered":"2024-09-11T01:05:31.681744+0000","last_unstale":"2024-09-11T01:06:41.683330+0000","last_undegraded":"2024-09-11T01:06:41.683330+0000","last_fullsized":"2024-09-11T01:06:41.683330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:29.055133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597053+0000","last_change":"2024-09-11T01:05:40.986656+0000","last_active":"2024-09-11T01:06:41.597053+0000","last_peered":"2024-09-11T01:06:41.597053+0000","last_clean":"2024-09-11T01:06:41.597053+0000","last_became_active":"2024-09-11T01:05:40.970230+0000","last_became_peered":"2024-09-11T01:05:40.970230+0000","last_unstale":"2024-09-11T01:06:41.597053+0000","last_undegraded":"2024-09-11T01:06:41.597053+0000","last_fullsized":"2024-09-11T01:06:41.597053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:25.468986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595255+0000","last_change":"2024-09-11T01:05:40.980843+0000","last_active":"2024-09-11T01:06:41.595255+0000","last_peered":"2024-09-11T01:06:41.595255+0000","last_clean":"2024-09-11T01:06:41.595255+0000","last_became_active":"2024-09-11T01:05:40.979033+0000","last_became_peered":"2024-09-11T01:05:40.979033+0000","last_unstale":"2024-09-11T01:06:41.595255+0000","last_undegraded":"2024-09-11T01:06:41.595255+0000","last_fullsized":"2024-09-11T01:06:41.595255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:44.039548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597582+0000","last_change":"2024-09-11T01:05:31.676046+0000","last_active":"2024-09-11T01:06:41.597582+0000","last_peered":"2024-09-11T01:06:41.597582+0000","last_clean":"2024-09-11T01:06:41.597582+0000","last_became_active":"2024-09-11T01:05:31.675704+0000","last_became_peered":"2024-09-11T01:05:31.675704+0000","last_unstale":"2024-09-11T01:06:41.597582+0000","last_undegraded":"2024-09-11T01:06:41.597582+0000","last_fullsized":"2024-09-11T01:06:41.597582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:17.907270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'4","reported_seq":111,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:21.740370+0000","last_change":"2024-09-11T01:05:28.550131+0000","last_active":"2024-09-11T01:07:21.740370+0000","last_peered":"2024-09-11T01:07:21.740370+0000","last_clean":"2024-09-11T01:07:21.740370+0000","last_became_active":"2024-09-11T01:05:28.549561+0000","last_became_peered":"2024-09-11T01:05:28.549561+0000","last_unstale":"2024-09-11T01:07:21.740370+0000","last_undegraded":"2024-09-11T01:07:21.740370+0000","last_fullsized":"2024-09-11T01:07:21.740370+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:52.001757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":67,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598604+0000","last_change":"2024-09-11T01:05:40.984877+0000","last_active":"2024-09-11T01:06:41.598604+0000","last_peered":"2024-09-11T01:06:41.598604+0000","last_clean":"2024-09-11T01:06:41.598604+0000","last_became_active":"2024-09-11T01:05:40.984500+0000","last_became_peered":"2024-09-11T01:05:40.984500+0000","last_unstale":"2024-09-11T01:06:41.598604+0000","last_undegraded":"2024-09-11T01:06:41.598604+0000","last_fullsized":"2024-09-11T01:06:41.598604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:44.309560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598336+0000","last_change":"2024-09-11T01:05:40.976014+0000","last_active":"2024-09-11T01:06:41.598336+0000","last_peered":"2024-09-11T01:06:41.598336+0000","last_clean":"2024-09-11T01:06:41.598336+0000","last_became_active":"2024-09-11T01:05:40.975610+0000","last_became_peered":"2024-09-11T01:05:40.975610+0000","last_unstale":"2024-09-11T01:06:41.598336+0000","last_undegraded":"2024-09-11T01:06:41.598336+0000","last_fullsized":"2024-09-11T01:06:41.598336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:26.920957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683432+0000","last_change":"2024-09-11T01:05:28.553043+0000","last_active":"2024-09-11T01:06:41.683432+0000","last_peered":"2024-09-11T01:06:41.683432+0000","last_clean":"2024-09-11T01:06:41.683432+0000","last_became_active":"2024-09-11T01:05:28.552678+0000","last_became_peered":"2024-09-11T01:05:28.552678+0000","last_unstale":"2024-09-11T01:06:41.683432+0000","last_undegraded":"2024-09-11T01:06:41.683432+0000","last_fullsized":"2024-09-11T01:06:41.683432+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:23.279056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.600956+0000","last_change":"2024-09-11T01:06:41.600861+0000","last_active":"2024-09-11T01:06:41.600956+0000","last_peered":"2024-09-11T01:06:41.600956+0000","last_clean":"2024-09-11T01:06:41.600956+0000","last_became_active":"2024-09-11T01:06:41.600314+0000","last_became_peered":"2024-09-11T01:06:41.600314+0000","last_unstale":"2024-09-11T01:06:41.600956+0000","last_undegraded":"2024-09-11T01:06:41.600956+0000","last_fullsized":"2024-09-11T01:06:41.600956+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:29.070620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594750+0000","last_change":"2024-09-11T01:05:31.674324+0000","last_active":"2024-09-11T01:06:41.594750+0000","last_peered":"2024-09-11T01:06:41.594750+0000","last_clean":"2024-09-11T01:06:41.594750+0000","last_became_active":"2024-09-11T01:05:31.673648+0000","last_became_peered":"2024-09-11T01:05:31.673648+0000","last_unstale":"2024-09-11T01:06:41.594750+0000","last_undegraded":"2024-09-11T01:06:41.594750+0000","last_fullsized":"2024-09-11T01:06:41.594750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:02.134422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597320+0000","last_change":"2024-09-11T01:05:40.972605+0000","last_active":"2024-09-11T01:06:41.597320+0000","last_peered":"2024-09-11T01:06:41.597320+0000","last_clean":"2024-09-11T01:06:41.597320+0000","last_became_active":"2024-09-11T01:05:40.961704+0000","last_became_peered":"2024-09-11T01:05:40.961704+0000","last_unstale":"2024-09-11T01:06:41.597320+0000","last_undegraded":"2024-09-11T01:06:41.597320+0000","last_fullsized":"2024-09-11T01:06:41.597320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:45.276739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683793+0000","last_change":"2024-09-11T01:05:40.969424+0000","last_active":"2024-09-11T01:06:41.683793+0000","last_peered":"2024-09-11T01:06:41.683793+0000","last_clean":"2024-09-11T01:06:41.683793+0000","last_became_active":"2024-09-11T01:05:40.968994+0000","last_became_peered":"2024-09-11T01:05:40.968994+0000","last_unstale":"2024-09-11T01:06:41.683793+0000","last_undegraded":"2024-09-11T01:06:41.683793+0000","last_fullsized":"2024-09-11T01:06:41.683793+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:08.554953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598788+0000","last_change":"2024-09-11T01:05:31.675764+0000","last_active":"2024-09-11T01:06:41.598788+0000","last_peered":"2024-09-11T01:06:41.598788+0000","last_clean":"2024-09-11T01:06:41.598788+0000","last_became_active":"2024-09-11T01:05:31.674553+0000","last_became_peered":"2024-09-11T01:05:31.674553+0000","last_unstale":"2024-09-11T01:06:41.598788+0000","last_undegraded":"2024-09-11T01:06:41.598788+0000","last_fullsized":"2024-09-11T01:06:41.598788+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:30.026758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'33","reported_seq":227,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:23.741865+0000","last_change":"2024-09-11T01:05:40.975735+0000","last_active":"2024-09-11T01:07:23.741865+0000","last_peered":"2024-09-11T01:07:23.741865+0000","last_clean":"2024-09-11T01:07:23.741865+0000","last_became_active":"2024-09-11T01:05:40.964582+0000","last_became_peered":"2024-09-11T01:05:40.964582+0000","last_unstale":"2024-09-11T01:07:23.741865+0000","last_undegraded":"2024-09-11T01:07:23.741865+0000","last_fullsized":"2024-09-11T01:07:23.741865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:57.424468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64136,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":34,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597781+0000","last_change":"2024-09-11T01:05:40.981306+0000","last_active":"2024-09-11T01:06:41.597781+0000","last_peered":"2024-09-11T01:06:41.597781+0000","last_clean":"2024-09-11T01:06:41.597781+0000","last_became_active":"2024-09-11T01:05:40.977531+0000","last_became_peered":"2024-09-11T01:05:40.977531+0000","last_unstale":"2024-09-11T01:06:41.597781+0000","last_undegraded":"2024-09-11T01:06:41.597781+0000","last_fullsized":"2024-09-11T01:06:41.597781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:21.613080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470377+0000","last_change":"2024-09-11T01:05:31.681612+0000","last_active":"2024-09-11T01:06:42.470377+0000","last_peered":"2024-09-11T01:06:42.470377+0000","last_clean":"2024-09-11T01:06:42.470377+0000","last_became_active":"2024-09-11T01:05:31.680609+0000","last_became_peered":"2024-09-11T01:05:31.680609+0000","last_unstale":"2024-09-11T01:06:42.470377+0000","last_undegraded":"2024-09-11T01:06:42.470377+0000","last_fullsized":"2024-09-11T01:06:42.470377+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:44.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.684409+0000","last_change":"2024-09-11T01:05:28.625177+0000","last_active":"2024-09-11T01:06:41.684409+0000","last_peered":"2024-09-11T01:06:41.684409+0000","last_clean":"2024-09-11T01:06:41.684409+0000","last_became_active":"2024-09-11T01:05:28.624819+0000","last_became_peered":"2024-09-11T01:05:28.624819+0000","last_unstale":"2024-09-11T01:06:41.684409+0000","last_undegraded":"2024-09-11T01:06:41.684409+0000","last_fullsized":"2024-09-11T01:06:41.684409+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:11.709636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595295+0000","last_change":"2024-09-11T01:05:40.978481+0000","last_active":"2024-09-11T01:06:41.595295+0000","last_peered":"2024-09-11T01:06:41.595295+0000","last_clean":"2024-09-11T01:06:41.595295+0000","last_became_active":"2024-09-11T01:05:40.977501+0000","last_became_peered":"2024-09-11T01:05:40.977501+0000","last_unstale":"2024-09-11T01:06:41.595295+0000","last_undegraded":"2024-09-11T01:06:41.595295+0000","last_fullsized":"2024-09-11T01:06:41.595295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:08.427274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470537+0000","last_change":"2024-09-11T01:05:31.692675+0000","last_active":"2024-09-11T01:06:42.470537+0000","last_peered":"2024-09-11T01:06:42.470537+0000","last_clean":"2024-09-11T01:06:42.470537+0000","last_became_active":"2024-09-11T01:05:31.690308+0000","last_became_peered":"2024-09-11T01:05:31.690308+0000","last_unstale":"2024-09-11T01:06:42.470537+0000","last_undegraded":"2024-09-11T01:06:42.470537+0000","last_fullsized":"2024-09-11T01:06:42.470537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:14.823786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598003+0000","last_change":"2024-09-11T01:05:28.557868+0000","last_active":"2024-09-11T01:06:41.598003+0000","last_peered":"2024-09-11T01:06:41.598003+0000","last_clean":"2024-09-11T01:06:41.598003+0000","last_became_active":"2024-09-11T01:05:28.557512+0000","last_became_peered":"2024-09-11T01:05:28.557512+0000","last_unstale":"2024-09-11T01:06:41.598003+0000","last_undegraded":"2024-09-11T01:06:41.598003+0000","last_fullsized":"2024-09-11T01:06:41.598003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:50.733551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597667+0000","last_change":"2024-09-11T01:05:40.982368+0000","last_active":"2024-09-11T01:06:41.597667+0000","last_peered":"2024-09-11T01:06:41.597667+0000","last_clean":"2024-09-11T01:06:41.597667+0000","last_became_active":"2024-09-11T01:05:40.980337+0000","last_became_peered":"2024-09-11T01:05:40.980337+0000","last_unstale":"2024-09-11T01:06:41.597667+0000","last_undegraded":"2024-09-11T01:06:41.597667+0000","last_fullsized":"2024-09-11T01:06:41.597667+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:22.010496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470527+0000","last_change":"2024-09-11T01:05:31.670806+0000","last_active":"2024-09-11T01:06:42.470527+0000","last_peered":"2024-09-11T01:06:42.470527+0000","last_clean":"2024-09-11T01:06:42.470527+0000","last_became_active":"2024-09-11T01:05:31.670452+0000","last_became_peered":"2024-09-11T01:05:31.670452+0000","last_unstale":"2024-09-11T01:06:42.470527+0000","last_undegraded":"2024-09-11T01:06:42.470527+0000","last_fullsized":"2024-09-11T01:06:42.470527+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:22.489650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'3","reported_seq":107,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:22.740191+0000","last_change":"2024-09-11T01:05:28.555885+0000","last_active":"2024-09-11T01:07:22.740191+0000","last_peered":"2024-09-11T01:07:22.740191+0000","last_clean":"2024-09-11T01:07:22.740191+0000","last_became_active":"2024-09-11T01:05:28.555471+0000","last_became_peered":"2024-09-11T01:05:28.555471+0000","last_unstale":"2024-09-11T01:07:22.740191+0000","last_undegraded":"2024-09-11T01:07:22.740191+0000","last_fullsized":"2024-09-11T01:07:22.740191+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:50.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650702+0000","last_change":"2024-09-11T01:05:40.971982+0000","last_active":"2024-09-11T01:06:41.650702+0000","last_peered":"2024-09-11T01:06:41.650702+0000","last_clean":"2024-09-11T01:06:41.650702+0000","last_became_active":"2024-09-11T01:05:40.971614+0000","last_became_peered":"2024-09-11T01:05:40.971614+0000","last_unstale":"2024-09-11T01:06:41.650702+0000","last_undegraded":"2024-09-11T01:06:41.650702+0000","last_fullsized":"2024-09-11T01:06:41.650702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:11.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470105+0000","last_change":"2024-09-11T01:05:40.972734+0000","last_active":"2024-09-11T01:06:42.470105+0000","last_peered":"2024-09-11T01:06:42.470105+0000","last_clean":"2024-09-11T01:06:42.470105+0000","last_became_active":"2024-09-11T01:05:40.969428+0000","last_became_peered":"2024-09-11T01:05:40.969428+0000","last_unstale":"2024-09-11T01:06:42.470105+0000","last_undegraded":"2024-09-11T01:06:42.470105+0000","last_fullsized":"2024-09-11T01:06:42.470105+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:30.199055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598079+0000","last_change":"2024-09-11T01:05:31.684114+0000","last_active":"2024-09-11T01:06:41.598079+0000","last_peered":"2024-09-11T01:06:41.598079+0000","last_clean":"2024-09-11T01:06:41.598079+0000","last_became_active":"2024-09-11T01:05:31.683830+0000","last_became_peered":"2024-09-11T01:05:31.683830+0000","last_unstale":"2024-09-11T01:06:41.598079+0000","last_undegraded":"2024-09-11T01:06:41.598079+0000","last_fullsized":"2024-09-11T01:06:41.598079+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:43.695706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683657+0000","last_change":"2024-09-11T01:05:28.554745+0000","last_active":"2024-09-11T01:06:41.683657+0000","last_peered":"2024-09-11T01:06:41.683657+0000","last_clean":"2024-09-11T01:06:41.683657+0000","last_became_active":"2024-09-11T01:05:28.554354+0000","last_became_peered":"2024-09-11T01:05:28.554354+0000","last_unstale":"2024-09-11T01:06:41.683657+0000","last_undegraded":"2024-09-11T01:06:41.683657+0000","last_fullsized":"2024-09-11T01:06:41.683657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:33.663536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597424+0000","last_change":"2024-09-11T01:05:40.974956+0000","last_active":"2024-09-11T01:06:41.597424+0000","last_peered":"2024-09-11T01:06:41.597424+0000","last_clean":"2024-09-11T01:06:41.597424+0000","last_became_active":"2024-09-11T01:05:40.974434+0000","last_became_peered":"2024-09-11T01:05:40.974434+0000","last_unstale":"2024-09-11T01:06:41.597424+0000","last_undegraded":"2024-09-11T01:06:41.597424+0000","last_fullsized":"2024-09-11T01:06:41.597424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:01.196098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650762+0000","last_change":"2024-09-11T01:05:31.679904+0000","last_active":"2024-09-11T01:06:41.650762+0000","last_peered":"2024-09-11T01:06:41.650762+0000","last_clean":"2024-09-11T01:06:41.650762+0000","last_became_active":"2024-09-11T01:05:31.679517+0000","last_became_peered":"2024-09-11T01:05:31.679517+0000","last_unstale":"2024-09-11T01:06:41.650762+0000","last_undegraded":"2024-09-11T01:06:41.650762+0000","last_fullsized":"2024-09-11T01:06:41.650762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:24.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594607+0000","last_change":"2024-09-11T01:05:28.549752+0000","last_active":"2024-09-11T01:06:41.594607+0000","last_peered":"2024-09-11T01:06:41.594607+0000","last_clean":"2024-09-11T01:06:41.594607+0000","last_became_active":"2024-09-11T01:05:28.549253+0000","last_became_peered":"2024-09-11T01:05:28.549253+0000","last_unstale":"2024-09-11T01:06:41.594607+0000","last_undegraded":"2024-09-11T01:06:41.594607+0000","last_fullsized":"2024-09-11T01:06:41.594607+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:25.774363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.680264+0000","last_change":"2024-09-11T01:05:28.553118+0000","last_active":"2024-09-11T01:06:41.680264+0000","last_peered":"2024-09-11T01:06:41.680264+0000","last_clean":"2024-09-11T01:06:41.680264+0000","last_became_active":"2024-09-11T01:05:28.552779+0000","last_became_peered":"2024-09-11T01:05:28.552779+0000","last_unstale":"2024-09-11T01:06:41.680264+0000","last_undegraded":"2024-09-11T01:06:41.680264+0000","last_fullsized":"2024-09-11T01:06:41.680264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:58.297579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597940+0000","last_change":"2024-09-11T01:05:40.981936+0000","last_active":"2024-09-11T01:06:41.597940+0000","last_peered":"2024-09-11T01:06:41.597940+0000","last_clean":"2024-09-11T01:06:41.597940+0000","last_became_active":"2024-09-11T01:05:40.981623+0000","last_became_peered":"2024-09-11T01:05:40.981623+0000","last_unstale":"2024-09-11T01:06:41.597940+0000","last_undegraded":"2024-09-11T01:06:41.597940+0000","last_fullsized":"2024-09-11T01:06:41.597940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:14.773406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.685158+0000","last_change":"2024-09-11T01:06:41.685046+0000","last_active":"2024-09-11T01:06:41.685158+0000","last_peered":"2024-09-11T01:06:41.685158+0000","last_clean":"2024-09-11T01:06:41.685158+0000","last_became_active":"2024-09-11T01:06:41.684442+0000","last_became_peered":"2024-09-11T01:06:41.684442+0000","last_unstale":"2024-09-11T01:06:41.685158+0000","last_undegraded":"2024-09-11T01:06:41.685158+0000","last_fullsized":"2024-09-11T01:06:41.685158+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:51.290772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'6","reported_seq":112,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:20.737948+0000","last_change":"2024-09-11T01:05:28.553479+0000","last_active":"2024-09-11T01:07:20.737948+0000","last_peered":"2024-09-11T01:07:20.737948+0000","last_clean":"2024-09-11T01:07:20.737948+0000","last_became_active":"2024-09-11T01:05:28.553171+0000","last_became_peered":"2024-09-11T01:05:28.553171+0000","last_unstale":"2024-09-11T01:07:20.737948+0000","last_undegraded":"2024-09-11T01:07:20.737948+0000","last_fullsized":"2024-09-11T01:07:20.737948+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:04.877982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":65,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598296+0000","last_change":"2024-09-11T01:05:40.982070+0000","last_active":"2024-09-11T01:06:41.598296+0000","last_peered":"2024-09-11T01:06:41.598296+0000","last_clean":"2024-09-11T01:06:41.598296+0000","last_became_active":"2024-09-11T01:05:40.981601+0000","last_became_peered":"2024-09-11T01:05:40.981601+0000","last_unstale":"2024-09-11T01:06:41.598296+0000","last_undegraded":"2024-09-11T01:06:41.598296+0000","last_fullsized":"2024-09-11T01:06:41.598296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:31.409711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595068+0000","last_change":"2024-09-11T01:05:40.967374+0000","last_active":"2024-09-11T01:06:41.595068+0000","last_peered":"2024-09-11T01:06:41.595068+0000","last_clean":"2024-09-11T01:06:41.595068+0000","last_became_active":"2024-09-11T01:05:40.966705+0000","last_became_peered":"2024-09-11T01:05:40.966705+0000","last_unstale":"2024-09-11T01:06:41.595068+0000","last_undegraded":"2024-09-11T01:06:41.595068+0000","last_fullsized":"2024-09-11T01:06:41.595068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:17.278999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597212+0000","last_change":"2024-09-11T01:05:31.675298+0000","last_active":"2024-09-11T01:06:41.597212+0000","last_peered":"2024-09-11T01:06:41.597212+0000","last_clean":"2024-09-11T01:06:41.597212+0000","last_became_active":"2024-09-11T01:05:31.674922+0000","last_became_peered":"2024-09-11T01:05:31.674922+0000","last_unstale":"2024-09-11T01:06:41.597212+0000","last_undegraded":"2024-09-11T01:06:41.597212+0000","last_fullsized":"2024-09-11T01:06:41.597212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:54.059202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594923+0000","last_change":"2024-09-11T01:05:31.685494+0000","last_active":"2024-09-11T01:06:41.594923+0000","last_peered":"2024-09-11T01:06:41.594923+0000","last_clean":"2024-09-11T01:06:41.594923+0000","last_became_active":"2024-09-11T01:05:31.685131+0000","last_became_peered":"2024-09-11T01:05:31.685131+0000","last_unstale":"2024-09-11T01:06:41.594923+0000","last_undegraded":"2024-09-11T01:06:41.594923+0000","last_fullsized":"2024-09-11T01:06:41.594923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:41.805135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594719+0000","last_change":"2024-09-11T01:05:31.686473+0000","last_active":"2024-09-11T01:06:41.594719+0000","last_peered":"2024-09-11T01:06:41.594719+0000","last_clean":"2024-09-11T01:06:41.594719+0000","last_became_active":"2024-09-11T01:05:31.685858+0000","last_became_peered":"2024-09-11T01:05:31.685858+0000","last_unstale":"2024-09-11T01:06:41.594719+0000","last_undegraded":"2024-09-11T01:06:41.594719+0000","last_fullsized":"2024-09-11T01:06:41.594719+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:52.174889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470250+0000","last_change":"2024-09-11T01:05:31.691078+0000","last_active":"2024-09-11T01:06:42.470250+0000","last_peered":"2024-09-11T01:06:42.470250+0000","last_clean":"2024-09-11T01:06:42.470250+0000","last_became_active":"2024-09-11T01:05:31.690755+0000","last_became_peered":"2024-09-11T01:05:31.690755+0000","last_unstale":"2024-09-11T01:06:42.470250+0000","last_undegraded":"2024-09-11T01:06:42.470250+0000","last_fullsized":"2024-09-11T01:06:42.470250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:50.643233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595336+0000","last_change":"2024-09-11T01:05:31.681933+0000","last_active":"2024-09-11T01:06:41.595336+0000","last_peered":"2024-09-11T01:06:41.595336+0000","last_clean":"2024-09-11T01:06:41.595336+0000","last_became_active":"2024-09-11T01:05:31.681642+0000","last_became_peered":"2024-09-11T01:05:31.681642+0000","last_unstale":"2024-09-11T01:06:41.595336+0000","last_undegraded":"2024-09-11T01:06:41.595336+0000","last_fullsized":"2024-09-11T01:06:41.595336+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:05:10.434843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597814+0000","last_change":"2024-09-11T01:05:31.677188+0000","last_active":"2024-09-11T01:06:41.597814+0000","last_peered":"2024-09-11T01:06:41.597814+0000","last_clean":"2024-09-11T01:06:41.597814+0000","last_became_active":"2024-09-11T01:05:31.676689+0000","last_became_peered":"2024-09-11T01:05:31.676689+0000","last_unstale":"2024-09-11T01:06:41.597814+0000","last_undegraded":"2024-09-11T01:06:41.597814+0000","last_fullsized":"2024-09-11T01:06:41.597814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:51.899743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595193+0000","last_change":"2024-09-11T01:05:31.678994+0000","last_active":"2024-09-11T01:06:41.595193+0000","last_peered":"2024-09-11T01:06:41.595193+0000","last_clean":"2024-09-11T01:06:41.595193+0000","last_became_active":"2024-09-11T01:05:31.678675+0000","last_became_peered":"2024-09-11T01:05:31.678675+0000","last_unstale":"2024-09-11T01:06:41.595193+0000","last_undegraded":"2024-09-11T01:06:41.595193+0000","last_fullsized":"2024-09-11T01:06:41.595193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:35.740872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.651259+0000","last_change":"2024-09-11T01:05:31.680046+0000","last_active":"2024-09-11T01:06:41.651259+0000","last_peered":"2024-09-11T01:06:41.651259+0000","last_clean":"2024-09-11T01:06:41.651259+0000","last_became_active":"2024-09-11T01:05:31.679626+0000","last_became_peered":"2024-09-11T01:05:31.679626+0000","last_unstale":"2024-09-11T01:06:41.651259+0000","last_undegraded":"2024-09-11T01:06:41.651259+0000","last_fullsized":"2024-09-11T01:06:41.651259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:15.260470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683173+0000","last_change":"2024-09-11T01:05:31.683545+0000","last_active":"2024-09-11T01:06:41.683173+0000","last_peered":"2024-09-11T01:06:41.683173+0000","last_clean":"2024-09-11T01:06:41.683173+0000","last_became_active":"2024-09-11T01:05:31.683166+0000","last_became_peered":"2024-09-11T01:05:31.683166+0000","last_unstale":"2024-09-11T01:06:41.683173+0000","last_undegraded":"2024-09-11T01:06:41.683173+0000","last_fullsized":"2024-09-11T01:06:41.683173+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:57.378211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650834+0000","last_change":"2024-09-11T01:05:31.678031+0000","last_active":"2024-09-11T01:06:41.650834+0000","last_peered":"2024-09-11T01:06:41.650834+0000","last_clean":"2024-09-11T01:06:41.650834+0000","last_became_active":"2024-09-11T01:05:31.677760+0000","last_became_peered":"2024-09-11T01:05:31.677760+0000","last_unstale":"2024-09-11T01:06:41.650834+0000","last_undegraded":"2024-09-11T01:06:41.650834+0000","last_fullsized":"2024-09-11T01:06:41.650834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:39.252655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470417+0000","last_change":"2024-09-11T01:05:31.677991+0000","last_active":"2024-09-11T01:06:42.470417+0000","last_peered":"2024-09-11T01:06:42.470417+0000","last_clean":"2024-09-11T01:06:42.470417+0000","last_became_active":"2024-09-11T01:05:31.677670+0000","last_became_peered":"2024-09-11T01:05:31.677670+0000","last_unstale":"2024-09-11T01:06:42.470417+0000","last_undegraded":"2024-09-11T01:06:42.470417+0000","last_fullsized":"2024-09-11T01:06:42.470417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:55.622757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595297+0000","last_change":"2024-09-11T01:05:31.678213+0000","last_active":"2024-09-11T01:06:41.595297+0000","last_peered":"2024-09-11T01:06:41.595297+0000","last_clean":"2024-09-11T01:06:41.595297+0000","last_became_active":"2024-09-11T01:05:31.676422+0000","last_became_peered":"2024-09-11T01:05:31.676422+0000","last_unstale":"2024-09-11T01:06:41.595297+0000","last_undegraded":"2024-09-11T01:06:41.595297+0000","last_fullsized":"2024-09-11T01:06:41.595297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:29.096123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597714+0000","last_change":"2024-09-11T01:05:31.680945+0000","last_active":"2024-09-11T01:06:41.597714+0000","last_peered":"2024-09-11T01:06:41.597714+0000","last_clean":"2024-09-11T01:06:41.597714+0000","last_became_active":"2024-09-11T01:05:31.680458+0000","last_became_peered":"2024-09-11T01:05:31.680458+0000","last_unstale":"2024-09-11T01:06:41.597714+0000","last_undegraded":"2024-09-11T01:06:41.597714+0000","last_fullsized":"2024-09-11T01:06:41.597714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:01.382341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595184+0000","last_change":"2024-09-11T01:05:31.685792+0000","last_active":"2024-09-11T01:06:41.595184+0000","last_peered":"2024-09-11T01:06:41.595184+0000","last_clean":"2024-09-11T01:06:41.595184+0000","last_became_active":"2024-09-11T01:05:31.685467+0000","last_became_peered":"2024-09-11T01:05:31.685467+0000","last_unstale":"2024-09-11T01:06:41.595184+0000","last_undegraded":"2024-09-11T01:06:41.595184+0000","last_fullsized":"2024-09-11T01:06:41.595184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:37.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598488+0000","last_change":"2024-09-11T01:05:31.678855+0000","last_active":"2024-09-11T01:06:41.598488+0000","last_peered":"2024-09-11T01:06:41.598488+0000","last_clean":"2024-09-11T01:06:41.598488+0000","last_became_active":"2024-09-11T01:05:31.678583+0000","last_became_peered":"2024-09-11T01:05:31.678583+0000","last_unstale":"2024-09-11T01:06:41.598488+0000","last_undegraded":"2024-09-11T01:06:41.598488+0000","last_fullsized":"2024-09-11T01:06:41.598488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:24.112383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598126+0000","last_change":"2024-09-11T01:05:31.682261+0000","last_active":"2024-09-11T01:06:41.598126+0000","last_peered":"2024-09-11T01:06:41.598126+0000","last_clean":"2024-09-11T01:06:41.598126+0000","last_became_active":"2024-09-11T01:05:31.681924+0000","last_became_peered":"2024-09-11T01:05:31.681924+0000","last_unstale":"2024-09-11T01:06:41.598126+0000","last_undegraded":"2024-09-11T01:06:41.598126+0000","last_fullsized":"2024-09-11T01:06:41.598126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:54.556438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470125+0000","last_change":"2024-09-11T01:05:31.674687+0000","last_active":"2024-09-11T01:06:42.470125+0000","last_peered":"2024-09-11T01:06:42.470125+0000","last_clean":"2024-09-11T01:06:42.470125+0000","last_became_active":"2024-09-11T01:05:31.674348+0000","last_became_peered":"2024-09-11T01:05:31.674348+0000","last_unstale":"2024-09-11T01:06:42.470125+0000","last_undegraded":"2024-09-11T01:06:42.470125+0000","last_fullsized":"2024-09-11T01:06:42.470125+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:46.086798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470235+0000","last_change":"2024-09-11T01:05:40.967775+0000","last_active":"2024-09-11T01:06:42.470235+0000","last_peered":"2024-09-11T01:06:42.470235+0000","last_clean":"2024-09-11T01:06:42.470235+0000","last_became_active":"2024-09-11T01:05:40.967355+0000","last_became_peered":"2024-09-11T01:05:40.967355+0000","last_unstale":"2024-09-11T01:06:42.470235+0000","last_undegraded":"2024-09-11T01:06:42.470235+0000","last_fullsized":"2024-09-11T01:06:42.470235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:43.224010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.469980+0000","last_change":"2024-09-11T01:05:31.674655+0000","last_active":"2024-09-11T01:06:42.469980+0000","last_peered":"2024-09-11T01:06:42.469980+0000","last_clean":"2024-09-11T01:06:42.469980+0000","last_became_active":"2024-09-11T01:05:31.674342+0000","last_became_peered":"2024-09-11T01:05:31.674342+0000","last_unstale":"2024-09-11T01:06:42.469980+0000","last_undegraded":"2024-09-11T01:06:42.469980+0000","last_fullsized":"2024-09-11T01:06:42.469980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:28.593441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595265+0000","last_change":"2024-09-11T01:05:31.678521+0000","last_active":"2024-09-11T01:06:41.595265+0000","last_peered":"2024-09-11T01:06:41.595265+0000","last_clean":"2024-09-11T01:06:41.595265+0000","last_became_active":"2024-09-11T01:05:31.674828+0000","last_became_peered":"2024-09-11T01:05:31.674828+0000","last_unstale":"2024-09-11T01:06:41.595265+0000","last_undegraded":"2024-09-11T01:06:41.595265+0000","last_fullsized":"2024-09-11T01:06:41.595265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:38.797887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595536+0000","last_change":"2024-09-11T01:05:31.685075+0000","last_active":"2024-09-11T01:06:41.595536+0000","last_peered":"2024-09-11T01:06:41.595536+0000","last_clean":"2024-09-11T01:06:41.595536+0000","last_became_active":"2024-09-11T01:05:31.684742+0000","last_became_peered":"2024-09-11T01:05:31.684742+0000","last_unstale":"2024-09-11T01:06:41.595536+0000","last_undegraded":"2024-09-11T01:06:41.595536+0000","last_fullsized":"2024-09-11T01:06:41.595536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:29.381976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598006+0000","last_change":"2024-09-11T01:05:31.678921+0000","last_active":"2024-09-11T01:06:41.598006+0000","last_peered":"2024-09-11T01:06:41.598006+0000","last_clean":"2024-09-11T01:06:41.598006+0000","last_became_active":"2024-09-11T01:05:31.678547+0000","last_became_peered":"2024-09-11T01:05:31.678547+0000","last_unstale":"2024-09-11T01:06:41.598006+0000","last_undegraded":"2024-09-11T01:06:41.598006+0000","last_fullsized":"2024-09-11T01:06:41.598006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:59.618685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.680680+0000","last_change":"2024-09-11T01:05:31.685565+0000","last_active":"2024-09-11T01:06:41.680680+0000","last_peered":"2024-09-11T01:06:41.680680+0000","last_clean":"2024-09-11T01:06:41.680680+0000","last_became_active":"2024-09-11T01:05:31.685234+0000","last_became_peered":"2024-09-11T01:05:31.685234+0000","last_unstale":"2024-09-11T01:06:41.680680+0000","last_undegraded":"2024-09-11T01:06:41.680680+0000","last_fullsized":"2024-09-11T01:06:41.680680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:07.831922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470667+0000","last_change":"2024-09-11T01:05:31.677464+0000","last_active":"2024-09-11T01:06:42.470667+0000","last_peered":"2024-09-11T01:06:42.470667+0000","last_clean":"2024-09-11T01:06:42.470667+0000","last_became_active":"2024-09-11T01:05:31.677161+0000","last_became_peered":"2024-09-11T01:05:31.677161+0000","last_unstale":"2024-09-11T01:06:42.470667+0000","last_undegraded":"2024-09-11T01:06:42.470667+0000","last_fullsized":"2024-09-11T01:06:42.470667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:26.590429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650658+0000","last_change":"2024-09-11T01:05:31.679977+0000","last_active":"2024-09-11T01:06:41.650658+0000","last_peered":"2024-09-11T01:06:41.650658+0000","last_clean":"2024-09-11T01:06:41.650658+0000","last_became_active":"2024-09-11T01:05:31.679661+0000","last_became_peered":"2024-09-11T01:05:31.679661+0000","last_unstale":"2024-09-11T01:06:41.650658+0000","last_undegraded":"2024-09-11T01:06:41.650658+0000","last_fullsized":"2024-09-11T01:06:41.650658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:00.040651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597813+0000","last_change":"2024-09-11T01:05:31.685419+0000","last_active":"2024-09-11T01:06:41.597813+0000","last_peered":"2024-09-11T01:06:41.597813+0000","last_clean":"2024-09-11T01:06:41.597813+0000","last_became_active":"2024-09-11T01:05:31.684772+0000","last_became_peered":"2024-09-11T01:05:31.684772+0000","last_unstale":"2024-09-11T01:06:41.597813+0000","last_undegraded":"2024-09-11T01:06:41.597813+0000","last_fullsized":"2024-09-11T01:06:41.597813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:19.283742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.680138+0000","last_change":"2024-09-11T01:05:31.681691+0000","last_active":"2024-09-11T01:06:41.680138+0000","last_peered":"2024-09-11T01:06:41.680138+0000","last_clean":"2024-09-11T01:06:41.680138+0000","last_became_active":"2024-09-11T01:05:31.680549+0000","last_became_peered":"2024-09-11T01:05:31.680549+0000","last_unstale":"2024-09-11T01:06:41.680138+0000","last_undegraded":"2024-09-11T01:06:41.680138+0000","last_fullsized":"2024-09-11T01:06:41.680138+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:15.561978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598970+0000","last_change":"2024-09-11T01:05:31.687135+0000","last_active":"2024-09-11T01:06:41.598970+0000","last_peered":"2024-09-11T01:06:41.598970+0000","last_clean":"2024-09-11T01:06:41.598970+0000","last_became_active":"2024-09-11T01:05:31.686719+0000","last_became_peered":"2024-09-11T01:05:31.686719+0000","last_unstale":"2024-09-11T01:06:41.598970+0000","last_undegraded":"2024-09-11T01:06:41.598970+0000","last_fullsized":"2024-09-11T01:06:41.598970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:42.044930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595425+0000","last_change":"2024-09-11T01:05:31.688154+0000","last_active":"2024-09-11T01:06:41.595425+0000","last_peered":"2024-09-11T01:06:41.595425+0000","last_clean":"2024-09-11T01:06:41.595425+0000","last_became_active":"2024-09-11T01:05:31.687734+0000","last_became_peered":"2024-09-11T01:05:31.687734+0000","last_unstale":"2024-09-11T01:06:41.595425+0000","last_undegraded":"2024-09-11T01:06:41.595425+0000","last_fullsized":"2024-09-11T01:06:41.595425+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:57.789086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470061+0000","last_change":"2024-09-11T01:05:31.679761+0000","last_active":"2024-09-11T01:06:42.470061+0000","last_peered":"2024-09-11T01:06:42.470061+0000","last_clean":"2024-09-11T01:06:42.470061+0000","last_became_active":"2024-09-11T01:05:31.679345+0000","last_became_peered":"2024-09-11T01:05:31.679345+0000","last_unstale":"2024-09-11T01:06:42.470061+0000","last_undegraded":"2024-09-11T01:06:42.470061+0000","last_fullsized":"2024-09-11T01:06:42.470061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:28.480561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470215+0000","last_change":"2024-09-11T01:05:31.680782+0000","last_active":"2024-09-11T01:06:42.470215+0000","last_peered":"2024-09-11T01:06:42.470215+0000","last_clean":"2024-09-11T01:06:42.470215+0000","last_became_active":"2024-09-11T01:05:31.679984+0000","last_became_peered":"2024-09-11T01:05:31.679984+0000","last_unstale":"2024-09-11T01:06:42.470215+0000","last_undegraded":"2024-09-11T01:06:42.470215+0000","last_fullsized":"2024-09-11T01:06:42.470215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:10.306868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598022+0000","last_change":"2024-09-11T01:05:31.681462+0000","last_active":"2024-09-11T01:06:41.598022+0000","last_peered":"2024-09-11T01:06:41.598022+0000","last_clean":"2024-09-11T01:06:41.598022+0000","last_became_active":"2024-09-11T01:05:31.680799+0000","last_became_peered":"2024-09-11T01:05:31.680799+0000","last_unstale":"2024-09-11T01:06:41.598022+0000","last_undegraded":"2024-09-11T01:06:41.598022+0000","last_fullsized":"2024-09-11T01:06:41.598022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:56:44.512831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68528,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":409,"num_read_kb":277,"num_write":170,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1646,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":205584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645349,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1024000,"data_stored":506452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841578,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28696,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716456,"statfs":{"total":95995035648,"available":95965650944,"internally_reserved":0,"allocated":1708032,"data_stored":1162197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005102,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1028096,"data_stored":506542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1019904,"data_stored":506350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397562,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1622016,"data_stored":1102762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593791,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":501718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790021,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1630208,"data_stored":1097959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953546,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32260,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712892,"statfs":{"total":95995035648,"available":95962001408,"internally_reserved":0,"allocated":1093632,"data_stored":570895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149776,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1019904,"data_stored":501912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1024000,"data_stored":503335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1077248,"data_stored":565764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1032192,"data_stored":503106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:07:28.479 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T01:07:28.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:28 smithi103 ceph-mon[30562]: pgmap v373: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:28.860 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:28.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:28 smithi117 ceph-mon[35358]: pgmap v373: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:28.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:28 smithi183 ceph-mon[34992]: pgmap v373: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:29.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.506+0000 7f318b200640 1 -- 172.21.15.103:0/3242252642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f318c104430 msgr2=0x7f318c10c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:29.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.506+0000 7f318b200640 1 --2- 172.21.15.103:0/3242252642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f318c104430 0x7f318c10c920 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3174009900 tx=0x7f317402a410 comp rx=0 tx=0).stop 2024-09-11T01:07:29.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.506+0000 7f318b200640 1 -- 172.21.15.103:0/3242252642 shutdown_connections 2024-09-11T01:07:29.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.506+0000 7f318b200640 1 --2- 172.21.15.103:0/3242252642 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f318c10cf70 0x7f318c10f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:29.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.506+0000 7f318b200640 1 --2- 172.21.15.103:0/3242252642 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f318c104430 0x7f318c10c920 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:29.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.506+0000 7f318b200640 1 --2- 172.21.15.103:0/3242252642 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f318c103b10 0x7f318c103ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:29.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.506+0000 7f318b200640 1 -- 172.21.15.103:0/3242252642 >> 172.21.15.103:0/3242252642 conn(0x7f318c0fd5b0 msgr2=0x7f318c0ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:29.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.506+0000 7f318b200640 1 -- 172.21.15.103:0/3242252642 shutdown_connections 2024-09-11T01:07:29.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.506+0000 7f318b200640 1 -- 172.21.15.103:0/3242252642 wait complete. 2024-09-11T01:07:29.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.507+0000 7f318b200640 1 Processor -- start 2024-09-11T01:07:29.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.507+0000 7f318b200640 1 -- start start 2024-09-11T01:07:29.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.507+0000 7f318b200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f318c103b10 0x7f318c19b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:29.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.507+0000 7f318b200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f318c104430 0x7f318c19b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:29.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.507+0000 7f318b200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f318c10cf70 0x7f318c1a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:29.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f318b200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f318c112be0 con 0x7f318c103b10 2024-09-11T01:07:29.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f318b200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f318c112a60 con 0x7f318c10cf70 2024-09-11T01:07:29.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f318b200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f318c112d60 con 0x7f318c104430 2024-09-11T01:07:29.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f3189e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f318c103b10 0x7f318c19b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:29.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f3189e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f318c103b10 0x7f318c19b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57442/0 (socket says 172.21.15.103:57442) 2024-09-11T01:07:29.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f3189e00640 1 -- 172.21.15.103:0/1470805281 learned_addr learned my addr 172.21.15.103:0/1470805281 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:29.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f318a800640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f318c10cf70 0x7f318c1a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:29.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f3181400640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f318c104430 0x7f318c19b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:29.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f3189e00640 1 -- 172.21.15.103:0/1470805281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f318c104430 msgr2=0x7f318c19b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:29.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f3189e00640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f318c104430 0x7f318c19b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:29.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f3189e00640 1 -- 172.21.15.103:0/1470805281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f318c10cf70 msgr2=0x7f318c1a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:29.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f3189e00640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f318c10cf70 0x7f318c1a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:29.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f3189e00640 1 -- 172.21.15.103:0/1470805281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318c1a1310 con 0x7f318c103b10 2024-09-11T01:07:29.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f318a800640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f318c10cf70 0x7f318c1a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:07:29.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.508+0000 7f3189e00640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f318c103b10 0x7f318c19b260 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f317c00d950 tx=0x7f317c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:29.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.509+0000 7f3183400640 1 -- 172.21.15.103:0/1470805281 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c017070 con 0x7f318c103b10 2024-09-11T01:07:29.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.509+0000 7f3183400640 1 -- 172.21.15.103:0/1470805281 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f317c009c30 con 0x7f318c103b10 2024-09-11T01:07:29.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.509+0000 7f318b200640 1 -- 172.21.15.103:0/1470805281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318c1a1600 con 0x7f318c103b10 2024-09-11T01:07:29.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.509+0000 7f3183400640 1 -- 172.21.15.103:0/1470805281 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317c00f620 con 0x7f318c103b10 2024-09-11T01:07:29.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.509+0000 7f318b200640 1 -- 172.21.15.103:0/1470805281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318c1a7e90 con 0x7f318c103b10 2024-09-11T01:07:29.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.510+0000 7f318b200640 1 -- 172.21.15.103:0/1470805281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f318c06b1b0 con 0x7f318c103b10 2024-09-11T01:07:29.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.512+0000 7f3183400640 1 -- 172.21.15.103:0/1470805281 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f317c010460 con 0x7f318c103b10 2024-09-11T01:07:29.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.513+0000 7f3183400640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f31700b5490 0x7f31700b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:29.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.514+0000 7f3183400640 1 -- 172.21.15.103:0/1470805281 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f317c0e5de0 con 0x7f318c103b10 2024-09-11T01:07:29.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.514+0000 7f3181400640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f31700b5490 0x7f31700b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:29.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.514+0000 7f3181400640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f31700b5490 0x7f31700b7950 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3174000c00 tx=0x7f3174031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:29.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.515+0000 7f3183400640 1 -- 172.21.15.103:0/1470805281 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f317c0ac7b0 con 0x7f318c103b10 2024-09-11T01:07:29.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.701+0000 7f318b200640 1 -- 172.21.15.103:0/1470805281 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f318c102ed0 con 0x7f31700b5490 2024-09-11T01:07:29.703 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:29 smithi103 ceph-mon[30562]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:07:29.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.709+0000 7f3183400640 1 -- 172.21.15.103:0/1470805281 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340371 (secure 0 0 0) 0x7f318c102ed0 con 0x7f31700b5490 2024-09-11T01:07:29.717 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:07:29.718 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T01:07:29.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.714+0000 7f318b200640 1 -- 172.21.15.103:0/1470805281 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f31700b5490 msgr2=0x7f31700b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.714+0000 7f318b200640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f31700b5490 0x7f31700b7950 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3174000c00 tx=0x7f3174031400 comp rx=0 tx=0).stop 2024-09-11T01:07:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.714+0000 7f318b200640 1 -- 172.21.15.103:0/1470805281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f318c103b10 msgr2=0x7f318c19b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.714+0000 7f318b200640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f318c103b10 0x7f318c19b260 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f317c00d950 tx=0x7f317c00de10 comp rx=0 tx=0).stop 2024-09-11T01:07:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.714+0000 7f318b200640 1 -- 172.21.15.103:0/1470805281 shutdown_connections 2024-09-11T01:07:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.714+0000 7f318b200640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f31700b5490 0x7f31700b7950 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.714+0000 7f318b200640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f318c10cf70 0x7f318c1a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.714+0000 7f318b200640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f318c104430 0x7f318c19b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.714+0000 7f318b200640 1 --2- 172.21.15.103:0/1470805281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f318c103b10 0x7f318c19b260 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.714+0000 7f318b200640 1 -- 172.21.15.103:0/1470805281 >> 172.21.15.103:0/1470805281 conn(0x7f318c0fd5b0 msgr2=0x7f318c10f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.714+0000 7f318b200640 1 -- 172.21.15.103:0/1470805281 shutdown_connections 2024-09-11T01:07:29.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:29.714+0000 7f318b200640 1 -- 172.21.15.103:0/1470805281 wait complete. 2024-09-11T01:07:29.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:29 smithi117 ceph-mon[35358]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:07:29.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:29 smithi183 ceph-mon[34992]: from='client.25061 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:07:30.484 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":374,"stamp":"2024-09-11T01:07:29.539539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659130,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":500,"num_read_kb":346,"num_write":295,"num_write_kb":2271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2953603,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":239,"ondisk_log_size":239,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":379900,"kb_used_data":13952,"kb_used_omap":18,"kb_used_meta":365677,"kb_avail":1124561924,"statfs":{"total":1151940427776,"available":1151551410176,"internally_reserved":0,"allocated":14286848,"data_stored":8028992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":374453561},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003066"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598754+0000","last_change":"2024-09-11T01:05:28.553987+0000","last_active":"2024-09-11T01:06:41.598754+0000","last_peered":"2024-09-11T01:06:41.598754+0000","last_clean":"2024-09-11T01:06:41.598754+0000","last_became_active":"2024-09-11T01:05:28.553691+0000","last_became_peered":"2024-09-11T01:05:28.553691+0000","last_unstale":"2024-09-11T01:06:41.598754+0000","last_undegraded":"2024-09-11T01:06:41.598754+0000","last_fullsized":"2024-09-11T01:06:41.598754+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:50.407880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.651258+0000","last_change":"2024-09-11T01:05:31.677005+0000","last_active":"2024-09-11T01:06:41.651258+0000","last_peered":"2024-09-11T01:06:41.651258+0000","last_clean":"2024-09-11T01:06:41.651258+0000","last_became_active":"2024-09-11T01:05:31.676597+0000","last_became_peered":"2024-09-11T01:05:31.676597+0000","last_unstale":"2024-09-11T01:06:41.651258+0000","last_undegraded":"2024-09-11T01:06:41.651258+0000","last_fullsized":"2024-09-11T01:06:41.651258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:06.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594641+0000","last_change":"2024-09-11T01:05:40.975009+0000","last_active":"2024-09-11T01:06:41.594641+0000","last_peered":"2024-09-11T01:06:41.594641+0000","last_clean":"2024-09-11T01:06:41.594641+0000","last_became_active":"2024-09-11T01:05:40.974546+0000","last_became_peered":"2024-09-11T01:05:40.974546+0000","last_unstale":"2024-09-11T01:06:41.594641+0000","last_undegraded":"2024-09-11T01:06:41.594641+0000","last_fullsized":"2024-09-11T01:06:41.594641+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:56.420262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.651358+0000","last_change":"2024-09-11T01:05:28.623367+0000","last_active":"2024-09-11T01:06:41.651358+0000","last_peered":"2024-09-11T01:06:41.651358+0000","last_clean":"2024-09-11T01:06:41.651358+0000","last_became_active":"2024-09-11T01:05:28.622990+0000","last_became_peered":"2024-09-11T01:05:28.622990+0000","last_unstale":"2024-09-11T01:06:41.651358+0000","last_undegraded":"2024-09-11T01:06:41.651358+0000","last_fullsized":"2024-09-11T01:06:41.651358+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:35.022280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470507+0000","last_change":"2024-09-11T01:05:31.693910+0000","last_active":"2024-09-11T01:06:42.470507+0000","last_peered":"2024-09-11T01:06:42.470507+0000","last_clean":"2024-09-11T01:06:42.470507+0000","last_became_active":"2024-09-11T01:05:31.692906+0000","last_became_peered":"2024-09-11T01:05:31.692906+0000","last_unstale":"2024-09-11T01:06:42.470507+0000","last_undegraded":"2024-09-11T01:06:42.470507+0000","last_fullsized":"2024-09-11T01:06:42.470507+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:11.906323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594969+0000","last_change":"2024-09-11T01:05:40.975768+0000","last_active":"2024-09-11T01:06:41.594969+0000","last_peered":"2024-09-11T01:06:41.594969+0000","last_clean":"2024-09-11T01:06:41.594969+0000","last_became_active":"2024-09-11T01:05:40.974721+0000","last_became_peered":"2024-09-11T01:05:40.974721+0000","last_unstale":"2024-09-11T01:06:41.594969+0000","last_undegraded":"2024-09-11T01:06:41.594969+0000","last_fullsized":"2024-09-11T01:06:41.594969+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:27.475531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599022+0000","last_change":"2024-09-11T01:05:28.558980+0000","last_active":"2024-09-11T01:06:41.599022+0000","last_peered":"2024-09-11T01:06:41.599022+0000","last_clean":"2024-09-11T01:06:41.599022+0000","last_became_active":"2024-09-11T01:05:28.558617+0000","last_became_peered":"2024-09-11T01:05:28.558617+0000","last_unstale":"2024-09-11T01:06:41.599022+0000","last_undegraded":"2024-09-11T01:06:41.599022+0000","last_fullsized":"2024-09-11T01:06:41.599022+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:13.659175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470378+0000","last_change":"2024-09-11T01:05:31.664705+0000","last_active":"2024-09-11T01:06:42.470378+0000","last_peered":"2024-09-11T01:06:42.470378+0000","last_clean":"2024-09-11T01:06:42.470378+0000","last_became_active":"2024-09-11T01:05:31.664328+0000","last_became_peered":"2024-09-11T01:05:31.664328+0000","last_unstale":"2024-09-11T01:06:42.470378+0000","last_undegraded":"2024-09-11T01:06:42.470378+0000","last_fullsized":"2024-09-11T01:06:42.470378+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:20.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.652222+0000","last_change":"2024-09-11T01:06:41.652143+0000","last_active":"2024-09-11T01:06:41.652222+0000","last_peered":"2024-09-11T01:06:41.652222+0000","last_clean":"2024-09-11T01:06:41.652222+0000","last_became_active":"2024-09-11T01:06:41.651661+0000","last_became_peered":"2024-09-11T01:06:41.651661+0000","last_unstale":"2024-09-11T01:06:41.652222+0000","last_undegraded":"2024-09-11T01:06:41.652222+0000","last_fullsized":"2024-09-11T01:06:41.652222+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:03.377915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,8],"acting":[4,3,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599638+0000","last_change":"2024-09-11T01:05:28.555081+0000","last_active":"2024-09-11T01:06:41.599638+0000","last_peered":"2024-09-11T01:06:41.599638+0000","last_clean":"2024-09-11T01:06:41.599638+0000","last_became_active":"2024-09-11T01:05:28.554562+0000","last_became_peered":"2024-09-11T01:05:28.554562+0000","last_unstale":"2024-09-11T01:06:41.599638+0000","last_undegraded":"2024-09-11T01:06:41.599638+0000","last_fullsized":"2024-09-11T01:06:41.599638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:23.922285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683854+0000","last_change":"2024-09-11T01:05:31.680442+0000","last_active":"2024-09-11T01:06:41.683854+0000","last_peered":"2024-09-11T01:06:41.683854+0000","last_clean":"2024-09-11T01:06:41.683854+0000","last_became_active":"2024-09-11T01:05:31.680107+0000","last_became_peered":"2024-09-11T01:05:31.680107+0000","last_unstale":"2024-09-11T01:06:41.683854+0000","last_undegraded":"2024-09-11T01:06:41.683854+0000","last_fullsized":"2024-09-11T01:06:41.683854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:16:02.853855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595044+0000","last_change":"2024-09-11T01:05:40.969365+0000","last_active":"2024-09-11T01:06:41.595044+0000","last_peered":"2024-09-11T01:06:41.595044+0000","last_clean":"2024-09-11T01:06:41.595044+0000","last_became_active":"2024-09-11T01:05:40.969005+0000","last_became_peered":"2024-09-11T01:05:40.969005+0000","last_unstale":"2024-09-11T01:06:41.595044+0000","last_undegraded":"2024-09-11T01:06:41.595044+0000","last_fullsized":"2024-09-11T01:06:41.595044+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:42.942848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598540+0000","last_change":"2024-09-11T01:05:31.676943+0000","last_active":"2024-09-11T01:06:41.598540+0000","last_peered":"2024-09-11T01:06:41.598540+0000","last_clean":"2024-09-11T01:06:41.598540+0000","last_became_active":"2024-09-11T01:05:31.676584+0000","last_became_peered":"2024-09-11T01:05:31.676584+0000","last_unstale":"2024-09-11T01:06:41.598540+0000","last_undegraded":"2024-09-11T01:06:41.598540+0000","last_fullsized":"2024-09-11T01:06:41.598540+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:08.288439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599154+0000","last_change":"2024-09-11T01:05:28.559196+0000","last_active":"2024-09-11T01:06:41.599154+0000","last_peered":"2024-09-11T01:06:41.599154+0000","last_clean":"2024-09-11T01:06:41.599154+0000","last_became_active":"2024-09-11T01:05:28.558746+0000","last_became_peered":"2024-09-11T01:05:28.558746+0000","last_unstale":"2024-09-11T01:06:41.599154+0000","last_undegraded":"2024-09-11T01:06:41.599154+0000","last_fullsized":"2024-09-11T01:06:41.599154+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:32.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595624+0000","last_change":"2024-09-11T01:05:40.963609+0000","last_active":"2024-09-11T01:06:41.595624+0000","last_peered":"2024-09-11T01:06:41.595624+0000","last_clean":"2024-09-11T01:06:41.595624+0000","last_became_active":"2024-09-11T01:05:40.963088+0000","last_became_peered":"2024-09-11T01:05:40.963088+0000","last_unstale":"2024-09-11T01:06:41.595624+0000","last_undegraded":"2024-09-11T01:06:41.595624+0000","last_fullsized":"2024-09-11T01:06:41.595624+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:27.135362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650853+0000","last_change":"2024-09-11T01:05:31.681258+0000","last_active":"2024-09-11T01:06:41.650853+0000","last_peered":"2024-09-11T01:06:41.650853+0000","last_clean":"2024-09-11T01:06:41.650853+0000","last_became_active":"2024-09-11T01:05:31.680946+0000","last_became_peered":"2024-09-11T01:05:31.680946+0000","last_unstale":"2024-09-11T01:06:41.650853+0000","last_undegraded":"2024-09-11T01:06:41.650853+0000","last_fullsized":"2024-09-11T01:06:41.650853+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:42.047250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'1","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594875+0000","last_change":"2024-09-11T01:05:28.554651+0000","last_active":"2024-09-11T01:06:41.594875+0000","last_peered":"2024-09-11T01:06:41.594875+0000","last_clean":"2024-09-11T01:06:41.594875+0000","last_became_active":"2024-09-11T01:05:28.554279+0000","last_became_peered":"2024-09-11T01:05:28.554279+0000","last_unstale":"2024-09-11T01:06:41.594875+0000","last_undegraded":"2024-09-11T01:06:41.594875+0000","last_fullsized":"2024-09-11T01:06:41.594875+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:14.093403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.685785+0000","last_change":"2024-09-11T01:06:41.685672+0000","last_active":"2024-09-11T01:06:41.685785+0000","last_peered":"2024-09-11T01:06:41.685785+0000","last_clean":"2024-09-11T01:06:41.685785+0000","last_became_active":"2024-09-11T01:06:41.681272+0000","last_became_peered":"2024-09-11T01:06:41.681272+0000","last_unstale":"2024-09-11T01:06:41.685785+0000","last_undegraded":"2024-09-11T01:06:41.685785+0000","last_fullsized":"2024-09-11T01:06:41.685785+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:53:39.693530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597777+0000","last_change":"2024-09-11T01:05:31.681743+0000","last_active":"2024-09-11T01:06:41.597777+0000","last_peered":"2024-09-11T01:06:41.597777+0000","last_clean":"2024-09-11T01:06:41.597777+0000","last_became_active":"2024-09-11T01:05:31.681223+0000","last_became_peered":"2024-09-11T01:05:31.681223+0000","last_unstale":"2024-09-11T01:06:41.597777+0000","last_undegraded":"2024-09-11T01:06:41.597777+0000","last_fullsized":"2024-09-11T01:06:41.597777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:49.449622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650999+0000","last_change":"2024-09-11T01:05:28.552914+0000","last_active":"2024-09-11T01:06:41.650999+0000","last_peered":"2024-09-11T01:06:41.650999+0000","last_clean":"2024-09-11T01:06:41.650999+0000","last_became_active":"2024-09-11T01:05:28.552404+0000","last_became_peered":"2024-09-11T01:05:28.552404+0000","last_unstale":"2024-09-11T01:06:41.650999+0000","last_undegraded":"2024-09-11T01:06:41.650999+0000","last_fullsized":"2024-09-11T01:06:41.650999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:39.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598606+0000","last_change":"2024-09-11T01:05:40.985652+0000","last_active":"2024-09-11T01:06:41.598606+0000","last_peered":"2024-09-11T01:06:41.598606+0000","last_clean":"2024-09-11T01:06:41.598606+0000","last_became_active":"2024-09-11T01:05:40.984898+0000","last_became_peered":"2024-09-11T01:05:40.984898+0000","last_unstale":"2024-09-11T01:06:41.598606+0000","last_undegraded":"2024-09-11T01:06:41.598606+0000","last_fullsized":"2024-09-11T01:06:41.598606+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:58.961342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597991+0000","last_change":"2024-09-11T01:05:31.675590+0000","last_active":"2024-09-11T01:06:41.597991+0000","last_peered":"2024-09-11T01:06:41.597991+0000","last_clean":"2024-09-11T01:06:41.597991+0000","last_became_active":"2024-09-11T01:05:31.674426+0000","last_became_peered":"2024-09-11T01:05:31.674426+0000","last_unstale":"2024-09-11T01:06:41.597991+0000","last_undegraded":"2024-09-11T01:06:41.597991+0000","last_fullsized":"2024-09-11T01:06:41.597991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:49.499195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470257+0000","last_change":"2024-09-11T01:05:28.623677+0000","last_active":"2024-09-11T01:06:42.470257+0000","last_peered":"2024-09-11T01:06:42.470257+0000","last_clean":"2024-09-11T01:06:42.470257+0000","last_became_active":"2024-09-11T01:05:28.623357+0000","last_became_peered":"2024-09-11T01:05:28.623357+0000","last_unstale":"2024-09-11T01:06:42.470257+0000","last_undegraded":"2024-09-11T01:06:42.470257+0000","last_fullsized":"2024-09-11T01:06:42.470257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:10.875425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595453+0000","last_change":"2024-09-11T01:05:40.978136+0000","last_active":"2024-09-11T01:06:41.595453+0000","last_peered":"2024-09-11T01:06:41.595453+0000","last_clean":"2024-09-11T01:06:41.595453+0000","last_became_active":"2024-09-11T01:05:40.977583+0000","last_became_peered":"2024-09-11T01:05:40.977583+0000","last_unstale":"2024-09-11T01:06:41.595453+0000","last_undegraded":"2024-09-11T01:06:41.595453+0000","last_fullsized":"2024-09-11T01:06:41.595453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:58:20.297640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470318+0000","last_change":"2024-09-11T01:05:31.692938+0000","last_active":"2024-09-11T01:06:42.470318+0000","last_peered":"2024-09-11T01:06:42.470318+0000","last_clean":"2024-09-11T01:06:42.470318+0000","last_became_active":"2024-09-11T01:05:31.689869+0000","last_became_peered":"2024-09-11T01:05:31.689869+0000","last_unstale":"2024-09-11T01:06:42.470318+0000","last_undegraded":"2024-09-11T01:06:42.470318+0000","last_fullsized":"2024-09-11T01:06:42.470318+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:24.820033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595809+0000","last_change":"2024-09-11T01:05:28.755985+0000","last_active":"2024-09-11T01:06:41.595809+0000","last_peered":"2024-09-11T01:06:41.595809+0000","last_clean":"2024-09-11T01:06:41.595809+0000","last_became_active":"2024-09-11T01:05:28.755604+0000","last_became_peered":"2024-09-11T01:05:28.755604+0000","last_unstale":"2024-09-11T01:06:41.595809+0000","last_undegraded":"2024-09-11T01:06:41.595809+0000","last_fullsized":"2024-09-11T01:06:41.595809+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:22.570473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594745+0000","last_change":"2024-09-11T01:05:40.963465+0000","last_active":"2024-09-11T01:06:41.594745+0000","last_peered":"2024-09-11T01:06:41.594745+0000","last_clean":"2024-09-11T01:06:41.594745+0000","last_became_active":"2024-09-11T01:05:40.962899+0000","last_became_peered":"2024-09-11T01:05:40.962899+0000","last_unstale":"2024-09-11T01:06:41.594745+0000","last_undegraded":"2024-09-11T01:06:41.594745+0000","last_fullsized":"2024-09-11T01:06:41.594745+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:01.728640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.651294+0000","last_change":"2024-09-11T01:05:31.675864+0000","last_active":"2024-09-11T01:06:41.651294+0000","last_peered":"2024-09-11T01:06:41.651294+0000","last_clean":"2024-09-11T01:06:41.651294+0000","last_became_active":"2024-09-11T01:05:31.675446+0000","last_became_peered":"2024-09-11T01:05:31.675446+0000","last_unstale":"2024-09-11T01:06:41.651294+0000","last_undegraded":"2024-09-11T01:06:41.651294+0000","last_fullsized":"2024-09-11T01:06:41.651294+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:36.457881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"87'12","reported_seq":52,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598521+0000","last_change":"2024-09-11T01:05:28.553509+0000","last_active":"2024-09-11T01:06:41.598521+0000","last_peered":"2024-09-11T01:06:41.598521+0000","last_clean":"2024-09-11T01:06:41.598521+0000","last_became_active":"2024-09-11T01:05:28.553101+0000","last_became_peered":"2024-09-11T01:05:28.553101+0000","last_unstale":"2024-09-11T01:06:41.598521+0000","last_undegraded":"2024-09-11T01:06:41.598521+0000","last_fullsized":"2024-09-11T01:06:41.598521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:41.300518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650536+0000","last_change":"2024-09-11T01:05:40.977146+0000","last_active":"2024-09-11T01:06:41.650536+0000","last_peered":"2024-09-11T01:06:41.650536+0000","last_clean":"2024-09-11T01:06:41.650536+0000","last_became_active":"2024-09-11T01:05:40.976804+0000","last_became_peered":"2024-09-11T01:05:40.976804+0000","last_unstale":"2024-09-11T01:06:41.650536+0000","last_undegraded":"2024-09-11T01:06:41.650536+0000","last_fullsized":"2024-09-11T01:06:41.650536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:49.753417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595424+0000","last_change":"2024-09-11T01:05:31.684219+0000","last_active":"2024-09-11T01:06:41.595424+0000","last_peered":"2024-09-11T01:06:41.595424+0000","last_clean":"2024-09-11T01:06:41.595424+0000","last_became_active":"2024-09-11T01:05:31.683937+0000","last_became_peered":"2024-09-11T01:05:31.683937+0000","last_unstale":"2024-09-11T01:06:41.595424+0000","last_undegraded":"2024-09-11T01:06:41.595424+0000","last_fullsized":"2024-09-11T01:06:41.595424+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:53.813624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599170+0000","last_change":"2024-09-11T01:05:28.623680+0000","last_active":"2024-09-11T01:06:41.599170+0000","last_peered":"2024-09-11T01:06:41.599170+0000","last_clean":"2024-09-11T01:06:41.599170+0000","last_became_active":"2024-09-11T01:05:28.623261+0000","last_became_peered":"2024-09-11T01:05:28.623261+0000","last_unstale":"2024-09-11T01:06:41.599170+0000","last_undegraded":"2024-09-11T01:06:41.599170+0000","last_fullsized":"2024-09-11T01:06:41.599170+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:17.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597354+0000","last_change":"2024-09-11T01:05:40.967165+0000","last_active":"2024-09-11T01:06:41.597354+0000","last_peered":"2024-09-11T01:06:41.597354+0000","last_clean":"2024-09-11T01:06:41.597354+0000","last_became_active":"2024-09-11T01:05:40.966723+0000","last_became_peered":"2024-09-11T01:05:40.966723+0000","last_unstale":"2024-09-11T01:06:41.597354+0000","last_undegraded":"2024-09-11T01:06:41.597354+0000","last_fullsized":"2024-09-11T01:06:41.597354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:48.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.680374+0000","last_change":"2024-09-11T01:05:31.679865+0000","last_active":"2024-09-11T01:06:41.680374+0000","last_peered":"2024-09-11T01:06:41.680374+0000","last_clean":"2024-09-11T01:06:41.680374+0000","last_became_active":"2024-09-11T01:05:31.679494+0000","last_became_peered":"2024-09-11T01:05:31.679494+0000","last_unstale":"2024-09-11T01:06:41.680374+0000","last_undegraded":"2024-09-11T01:06:41.680374+0000","last_fullsized":"2024-09-11T01:06:41.680374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:56.300799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598508+0000","last_change":"2024-09-11T01:05:28.623746+0000","last_active":"2024-09-11T01:06:41.598508+0000","last_peered":"2024-09-11T01:06:41.598508+0000","last_clean":"2024-09-11T01:06:41.598508+0000","last_became_active":"2024-09-11T01:05:28.623358+0000","last_became_peered":"2024-09-11T01:05:28.623358+0000","last_unstale":"2024-09-11T01:06:41.598508+0000","last_undegraded":"2024-09-11T01:06:41.598508+0000","last_fullsized":"2024-09-11T01:06:41.598508+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:13.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598128+0000","last_change":"2024-09-11T01:05:40.982108+0000","last_active":"2024-09-11T01:06:41.598128+0000","last_peered":"2024-09-11T01:06:41.598128+0000","last_clean":"2024-09-11T01:06:41.598128+0000","last_became_active":"2024-09-11T01:05:40.981737+0000","last_became_peered":"2024-09-11T01:05:40.981737+0000","last_unstale":"2024-09-11T01:06:41.598128+0000","last_undegraded":"2024-09-11T01:06:41.598128+0000","last_fullsized":"2024-09-11T01:06:41.598128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:16.717933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.680277+0000","last_change":"2024-09-11T01:05:31.680885+0000","last_active":"2024-09-11T01:06:41.680277+0000","last_peered":"2024-09-11T01:06:41.680277+0000","last_clean":"2024-09-11T01:06:41.680277+0000","last_became_active":"2024-09-11T01:05:31.680536+0000","last_became_peered":"2024-09-11T01:05:31.680536+0000","last_unstale":"2024-09-11T01:06:41.680277+0000","last_undegraded":"2024-09-11T01:06:41.680277+0000","last_fullsized":"2024-09-11T01:06:41.680277+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:12.963321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598653+0000","last_change":"2024-09-11T01:05:28.553957+0000","last_active":"2024-09-11T01:06:41.598653+0000","last_peered":"2024-09-11T01:06:41.598653+0000","last_clean":"2024-09-11T01:06:41.598653+0000","last_became_active":"2024-09-11T01:05:28.553572+0000","last_became_peered":"2024-09-11T01:05:28.553572+0000","last_unstale":"2024-09-11T01:06:41.598653+0000","last_undegraded":"2024-09-11T01:06:41.598653+0000","last_fullsized":"2024-09-11T01:06:41.598653+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:14.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595188+0000","last_change":"2024-09-11T01:05:40.971221+0000","last_active":"2024-09-11T01:06:41.595188+0000","last_peered":"2024-09-11T01:06:41.595188+0000","last_clean":"2024-09-11T01:06:41.595188+0000","last_became_active":"2024-09-11T01:05:40.970063+0000","last_became_peered":"2024-09-11T01:05:40.970063+0000","last_unstale":"2024-09-11T01:06:41.595188+0000","last_undegraded":"2024-09-11T01:06:41.595188+0000","last_fullsized":"2024-09-11T01:06:41.595188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:46.299357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683432+0000","last_change":"2024-09-11T01:05:31.677125+0000","last_active":"2024-09-11T01:06:41.683432+0000","last_peered":"2024-09-11T01:06:41.683432+0000","last_clean":"2024-09-11T01:06:41.683432+0000","last_became_active":"2024-09-11T01:05:31.676803+0000","last_became_peered":"2024-09-11T01:05:31.676803+0000","last_unstale":"2024-09-11T01:06:41.683432+0000","last_undegraded":"2024-09-11T01:06:41.683432+0000","last_fullsized":"2024-09-11T01:06:41.683432+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:01:38.922178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'4","reported_seq":113,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:26.747063+0000","last_change":"2024-09-11T01:05:28.623895+0000","last_active":"2024-09-11T01:07:26.747063+0000","last_peered":"2024-09-11T01:07:26.747063+0000","last_clean":"2024-09-11T01:07:26.747063+0000","last_became_active":"2024-09-11T01:05:28.623520+0000","last_became_peered":"2024-09-11T01:05:28.623520+0000","last_unstale":"2024-09-11T01:07:26.747063+0000","last_undegraded":"2024-09-11T01:07:26.747063+0000","last_fullsized":"2024-09-11T01:07:26.747063+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:22.309521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595154+0000","last_change":"2024-09-11T01:05:40.974416+0000","last_active":"2024-09-11T01:06:41.595154+0000","last_peered":"2024-09-11T01:06:41.595154+0000","last_clean":"2024-09-11T01:06:41.595154+0000","last_became_active":"2024-09-11T01:05:40.973990+0000","last_became_peered":"2024-09-11T01:05:40.973990+0000","last_unstale":"2024-09-11T01:06:41.595154+0000","last_undegraded":"2024-09-11T01:06:41.595154+0000","last_fullsized":"2024-09-11T01:06:41.595154+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:30.018876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594453+0000","last_change":"2024-09-11T01:05:31.688968+0000","last_active":"2024-09-11T01:06:41.594453+0000","last_peered":"2024-09-11T01:06:41.594453+0000","last_clean":"2024-09-11T01:06:41.594453+0000","last_became_active":"2024-09-11T01:05:31.688672+0000","last_became_peered":"2024-09-11T01:05:31.688672+0000","last_unstale":"2024-09-11T01:06:41.594453+0000","last_undegraded":"2024-09-11T01:06:41.594453+0000","last_fullsized":"2024-09-11T01:06:41.594453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:39.080386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597789+0000","last_change":"2024-09-11T01:05:28.554126+0000","last_active":"2024-09-11T01:06:41.597789+0000","last_peered":"2024-09-11T01:06:41.597789+0000","last_clean":"2024-09-11T01:06:41.597789+0000","last_became_active":"2024-09-11T01:05:28.553575+0000","last_became_peered":"2024-09-11T01:05:28.553575+0000","last_unstale":"2024-09-11T01:06:41.597789+0000","last_undegraded":"2024-09-11T01:06:41.597789+0000","last_fullsized":"2024-09-11T01:06:41.597789+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:42.203339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683940+0000","last_change":"2024-09-11T01:05:40.980415+0000","last_active":"2024-09-11T01:06:41.683940+0000","last_peered":"2024-09-11T01:06:41.683940+0000","last_clean":"2024-09-11T01:06:41.683940+0000","last_became_active":"2024-09-11T01:05:40.980062+0000","last_became_peered":"2024-09-11T01:05:40.980062+0000","last_unstale":"2024-09-11T01:06:41.683940+0000","last_undegraded":"2024-09-11T01:06:41.683940+0000","last_fullsized":"2024-09-11T01:06:41.683940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:25.889972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650954+0000","last_change":"2024-09-11T01:05:31.679622+0000","last_active":"2024-09-11T01:06:41.650954+0000","last_peered":"2024-09-11T01:06:41.650954+0000","last_clean":"2024-09-11T01:06:41.650954+0000","last_became_active":"2024-09-11T01:05:31.679239+0000","last_became_peered":"2024-09-11T01:05:31.679239+0000","last_unstale":"2024-09-11T01:06:41.650954+0000","last_undegraded":"2024-09-11T01:06:41.650954+0000","last_fullsized":"2024-09-11T01:06:41.650954+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:32.240196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595521+0000","last_change":"2024-09-11T01:05:28.552203+0000","last_active":"2024-09-11T01:06:41.595521+0000","last_peered":"2024-09-11T01:06:41.595521+0000","last_clean":"2024-09-11T01:06:41.595521+0000","last_became_active":"2024-09-11T01:05:28.551658+0000","last_became_peered":"2024-09-11T01:05:28.551658+0000","last_unstale":"2024-09-11T01:06:41.595521+0000","last_undegraded":"2024-09-11T01:06:41.595521+0000","last_fullsized":"2024-09-11T01:06:41.595521+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:46.102466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":117,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598067+0000","last_change":"2024-09-11T01:04:12.299017+0000","last_active":"2024-09-11T01:06:41.598067+0000","last_peered":"2024-09-11T01:06:41.598067+0000","last_clean":"2024-09-11T01:06:41.598067+0000","last_became_active":"2024-09-11T01:04:11.998504+0000","last_became_peered":"2024-09-11T01:04:11.998504+0000","last_unstale":"2024-09-11T01:06:41.598067+0000","last_undegraded":"2024-09-11T01:06:41.598067+0000","last_fullsized":"2024-09-11T01:06:41.598067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:00:34.569322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:00:34.569322+0000","last_clean_scrub_stamp":"2024-09-11T01:00:34.569322+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:54.949789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597909+0000","last_change":"2024-09-11T01:05:40.982181+0000","last_active":"2024-09-11T01:06:41.597909+0000","last_peered":"2024-09-11T01:06:41.597909+0000","last_clean":"2024-09-11T01:06:41.597909+0000","last_became_active":"2024-09-11T01:05:40.981668+0000","last_became_peered":"2024-09-11T01:05:40.981668+0000","last_unstale":"2024-09-11T01:06:41.597909+0000","last_undegraded":"2024-09-11T01:06:41.597909+0000","last_fullsized":"2024-09-11T01:06:41.597909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:48.199189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598067+0000","last_change":"2024-09-11T01:05:31.677978+0000","last_active":"2024-09-11T01:06:41.598067+0000","last_peered":"2024-09-11T01:06:41.598067+0000","last_clean":"2024-09-11T01:06:41.598067+0000","last_became_active":"2024-09-11T01:05:31.677478+0000","last_became_peered":"2024-09-11T01:05:31.677478+0000","last_unstale":"2024-09-11T01:06:41.598067+0000","last_undegraded":"2024-09-11T01:06:41.598067+0000","last_fullsized":"2024-09-11T01:06:41.598067+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:39.568921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595398+0000","last_change":"2024-09-11T01:05:28.755866+0000","last_active":"2024-09-11T01:06:41.595398+0000","last_peered":"2024-09-11T01:06:41.595398+0000","last_clean":"2024-09-11T01:06:41.595398+0000","last_became_active":"2024-09-11T01:05:28.755475+0000","last_became_peered":"2024-09-11T01:05:28.755475+0000","last_unstale":"2024-09-11T01:06:41.595398+0000","last_undegraded":"2024-09-11T01:06:41.595398+0000","last_fullsized":"2024-09-11T01:06:41.595398+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:22.324584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470168+0000","last_change":"2024-09-11T01:05:40.967181+0000","last_active":"2024-09-11T01:06:42.470168+0000","last_peered":"2024-09-11T01:06:42.470168+0000","last_clean":"2024-09-11T01:06:42.470168+0000","last_became_active":"2024-09-11T01:05:40.966748+0000","last_became_peered":"2024-09-11T01:05:40.966748+0000","last_unstale":"2024-09-11T01:06:42.470168+0000","last_undegraded":"2024-09-11T01:06:42.470168+0000","last_fullsized":"2024-09-11T01:06:42.470168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:15:28.446190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598538+0000","last_change":"2024-09-11T01:05:40.981823+0000","last_active":"2024-09-11T01:06:41.598538+0000","last_peered":"2024-09-11T01:06:41.598538+0000","last_clean":"2024-09-11T01:06:41.598538+0000","last_became_active":"2024-09-11T01:05:40.981478+0000","last_became_peered":"2024-09-11T01:05:40.981478+0000","last_unstale":"2024-09-11T01:06:41.598538+0000","last_undegraded":"2024-09-11T01:06:41.598538+0000","last_fullsized":"2024-09-11T01:06:41.598538+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:55.848492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.684059+0000","last_change":"2024-09-11T01:05:28.549207+0000","last_active":"2024-09-11T01:06:41.684059+0000","last_peered":"2024-09-11T01:06:41.684059+0000","last_clean":"2024-09-11T01:06:41.684059+0000","last_became_active":"2024-09-11T01:05:28.548156+0000","last_became_peered":"2024-09-11T01:05:28.548156+0000","last_unstale":"2024-09-11T01:06:41.684059+0000","last_undegraded":"2024-09-11T01:06:41.684059+0000","last_fullsized":"2024-09-11T01:06:41.684059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:58.698379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470297+0000","last_change":"2024-09-11T01:05:40.982213+0000","last_active":"2024-09-11T01:06:42.470297+0000","last_peered":"2024-09-11T01:06:42.470297+0000","last_clean":"2024-09-11T01:06:42.470297+0000","last_became_active":"2024-09-11T01:05:40.981066+0000","last_became_peered":"2024-09-11T01:05:40.981066+0000","last_unstale":"2024-09-11T01:06:42.470297+0000","last_undegraded":"2024-09-11T01:06:42.470297+0000","last_fullsized":"2024-09-11T01:06:42.470297+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:09.348973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598084+0000","last_change":"2024-09-11T01:05:31.677613+0000","last_active":"2024-09-11T01:06:41.598084+0000","last_peered":"2024-09-11T01:06:41.598084+0000","last_clean":"2024-09-11T01:06:41.598084+0000","last_became_active":"2024-09-11T01:05:31.677263+0000","last_became_peered":"2024-09-11T01:05:31.677263+0000","last_unstale":"2024-09-11T01:06:41.598084+0000","last_undegraded":"2024-09-11T01:06:41.598084+0000","last_fullsized":"2024-09-11T01:06:41.598084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:32.490982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595356+0000","last_change":"2024-09-11T01:05:28.558437+0000","last_active":"2024-09-11T01:06:41.595356+0000","last_peered":"2024-09-11T01:06:41.595356+0000","last_clean":"2024-09-11T01:06:41.595356+0000","last_became_active":"2024-09-11T01:05:28.558070+0000","last_became_peered":"2024-09-11T01:05:28.558070+0000","last_unstale":"2024-09-11T01:06:41.595356+0000","last_undegraded":"2024-09-11T01:06:41.595356+0000","last_fullsized":"2024-09-11T01:06:41.595356+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:26.589209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.682969+0000","last_change":"2024-09-11T01:05:40.970422+0000","last_active":"2024-09-11T01:06:41.682969+0000","last_peered":"2024-09-11T01:06:41.682969+0000","last_clean":"2024-09-11T01:06:41.682969+0000","last_became_active":"2024-09-11T01:05:40.970087+0000","last_became_peered":"2024-09-11T01:05:40.970087+0000","last_unstale":"2024-09-11T01:06:41.682969+0000","last_undegraded":"2024-09-11T01:06:41.682969+0000","last_fullsized":"2024-09-11T01:06:41.682969+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:05.171700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597426+0000","last_change":"2024-09-11T01:05:40.967014+0000","last_active":"2024-09-11T01:06:41.597426+0000","last_peered":"2024-09-11T01:06:41.597426+0000","last_clean":"2024-09-11T01:06:41.597426+0000","last_became_active":"2024-09-11T01:05:40.966567+0000","last_became_peered":"2024-09-11T01:05:40.966567+0000","last_unstale":"2024-09-11T01:06:41.597426+0000","last_undegraded":"2024-09-11T01:06:41.597426+0000","last_fullsized":"2024-09-11T01:06:41.597426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:50.868245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599148+0000","last_change":"2024-09-11T01:05:28.553646+0000","last_active":"2024-09-11T01:06:41.599148+0000","last_peered":"2024-09-11T01:06:41.599148+0000","last_clean":"2024-09-11T01:06:41.599148+0000","last_became_active":"2024-09-11T01:05:28.553238+0000","last_became_peered":"2024-09-11T01:05:28.553238+0000","last_unstale":"2024-09-11T01:06:41.599148+0000","last_undegraded":"2024-09-11T01:06:41.599148+0000","last_fullsized":"2024-09-11T01:06:41.599148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:31.670321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683106+0000","last_change":"2024-09-11T01:05:40.973220+0000","last_active":"2024-09-11T01:06:41.683106+0000","last_peered":"2024-09-11T01:06:41.683106+0000","last_clean":"2024-09-11T01:06:41.683106+0000","last_became_active":"2024-09-11T01:05:40.972843+0000","last_became_peered":"2024-09-11T01:05:40.972843+0000","last_unstale":"2024-09-11T01:06:41.683106+0000","last_undegraded":"2024-09-11T01:06:41.683106+0000","last_fullsized":"2024-09-11T01:06:41.683106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:07.785474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683330+0000","last_change":"2024-09-11T01:05:31.682064+0000","last_active":"2024-09-11T01:06:41.683330+0000","last_peered":"2024-09-11T01:06:41.683330+0000","last_clean":"2024-09-11T01:06:41.683330+0000","last_became_active":"2024-09-11T01:05:31.681744+0000","last_became_peered":"2024-09-11T01:05:31.681744+0000","last_unstale":"2024-09-11T01:06:41.683330+0000","last_undegraded":"2024-09-11T01:06:41.683330+0000","last_fullsized":"2024-09-11T01:06:41.683330+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:29.055133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597053+0000","last_change":"2024-09-11T01:05:40.986656+0000","last_active":"2024-09-11T01:06:41.597053+0000","last_peered":"2024-09-11T01:06:41.597053+0000","last_clean":"2024-09-11T01:06:41.597053+0000","last_became_active":"2024-09-11T01:05:40.970230+0000","last_became_peered":"2024-09-11T01:05:40.970230+0000","last_unstale":"2024-09-11T01:06:41.597053+0000","last_undegraded":"2024-09-11T01:06:41.597053+0000","last_fullsized":"2024-09-11T01:06:41.597053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:25.468986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595255+0000","last_change":"2024-09-11T01:05:40.980843+0000","last_active":"2024-09-11T01:06:41.595255+0000","last_peered":"2024-09-11T01:06:41.595255+0000","last_clean":"2024-09-11T01:06:41.595255+0000","last_became_active":"2024-09-11T01:05:40.979033+0000","last_became_peered":"2024-09-11T01:05:40.979033+0000","last_unstale":"2024-09-11T01:06:41.595255+0000","last_undegraded":"2024-09-11T01:06:41.595255+0000","last_fullsized":"2024-09-11T01:06:41.595255+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:44.039548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597582+0000","last_change":"2024-09-11T01:05:31.676046+0000","last_active":"2024-09-11T01:06:41.597582+0000","last_peered":"2024-09-11T01:06:41.597582+0000","last_clean":"2024-09-11T01:06:41.597582+0000","last_became_active":"2024-09-11T01:05:31.675704+0000","last_became_peered":"2024-09-11T01:05:31.675704+0000","last_unstale":"2024-09-11T01:06:41.597582+0000","last_undegraded":"2024-09-11T01:06:41.597582+0000","last_fullsized":"2024-09-11T01:06:41.597582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:17.907270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'4","reported_seq":116,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:26.747642+0000","last_change":"2024-09-11T01:05:28.550131+0000","last_active":"2024-09-11T01:07:26.747642+0000","last_peered":"2024-09-11T01:07:26.747642+0000","last_clean":"2024-09-11T01:07:26.747642+0000","last_became_active":"2024-09-11T01:05:28.549561+0000","last_became_peered":"2024-09-11T01:05:28.549561+0000","last_unstale":"2024-09-11T01:07:26.747642+0000","last_undegraded":"2024-09-11T01:07:26.747642+0000","last_fullsized":"2024-09-11T01:07:26.747642+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:52.001757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":72,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598604+0000","last_change":"2024-09-11T01:05:40.984877+0000","last_active":"2024-09-11T01:06:41.598604+0000","last_peered":"2024-09-11T01:06:41.598604+0000","last_clean":"2024-09-11T01:06:41.598604+0000","last_became_active":"2024-09-11T01:05:40.984500+0000","last_became_peered":"2024-09-11T01:05:40.984500+0000","last_unstale":"2024-09-11T01:06:41.598604+0000","last_undegraded":"2024-09-11T01:06:41.598604+0000","last_fullsized":"2024-09-11T01:06:41.598604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:44.309560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598336+0000","last_change":"2024-09-11T01:05:40.976014+0000","last_active":"2024-09-11T01:06:41.598336+0000","last_peered":"2024-09-11T01:06:41.598336+0000","last_clean":"2024-09-11T01:06:41.598336+0000","last_became_active":"2024-09-11T01:05:40.975610+0000","last_became_peered":"2024-09-11T01:05:40.975610+0000","last_unstale":"2024-09-11T01:06:41.598336+0000","last_undegraded":"2024-09-11T01:06:41.598336+0000","last_fullsized":"2024-09-11T01:06:41.598336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:26.920957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683432+0000","last_change":"2024-09-11T01:05:28.553043+0000","last_active":"2024-09-11T01:06:41.683432+0000","last_peered":"2024-09-11T01:06:41.683432+0000","last_clean":"2024-09-11T01:06:41.683432+0000","last_became_active":"2024-09-11T01:05:28.552678+0000","last_became_peered":"2024-09-11T01:05:28.552678+0000","last_unstale":"2024-09-11T01:06:41.683432+0000","last_undegraded":"2024-09-11T01:06:41.683432+0000","last_fullsized":"2024-09-11T01:06:41.683432+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:23.279056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.600956+0000","last_change":"2024-09-11T01:06:41.600861+0000","last_active":"2024-09-11T01:06:41.600956+0000","last_peered":"2024-09-11T01:06:41.600956+0000","last_clean":"2024-09-11T01:06:41.600956+0000","last_became_active":"2024-09-11T01:06:41.600314+0000","last_became_peered":"2024-09-11T01:06:41.600314+0000","last_unstale":"2024-09-11T01:06:41.600956+0000","last_undegraded":"2024-09-11T01:06:41.600956+0000","last_fullsized":"2024-09-11T01:06:41.600956+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:29.070620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594750+0000","last_change":"2024-09-11T01:05:31.674324+0000","last_active":"2024-09-11T01:06:41.594750+0000","last_peered":"2024-09-11T01:06:41.594750+0000","last_clean":"2024-09-11T01:06:41.594750+0000","last_became_active":"2024-09-11T01:05:31.673648+0000","last_became_peered":"2024-09-11T01:05:31.673648+0000","last_unstale":"2024-09-11T01:06:41.594750+0000","last_undegraded":"2024-09-11T01:06:41.594750+0000","last_fullsized":"2024-09-11T01:06:41.594750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:02.134422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597320+0000","last_change":"2024-09-11T01:05:40.972605+0000","last_active":"2024-09-11T01:06:41.597320+0000","last_peered":"2024-09-11T01:06:41.597320+0000","last_clean":"2024-09-11T01:06:41.597320+0000","last_became_active":"2024-09-11T01:05:40.961704+0000","last_became_peered":"2024-09-11T01:05:40.961704+0000","last_unstale":"2024-09-11T01:06:41.597320+0000","last_undegraded":"2024-09-11T01:06:41.597320+0000","last_fullsized":"2024-09-11T01:06:41.597320+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:45.276739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683793+0000","last_change":"2024-09-11T01:05:40.969424+0000","last_active":"2024-09-11T01:06:41.683793+0000","last_peered":"2024-09-11T01:06:41.683793+0000","last_clean":"2024-09-11T01:06:41.683793+0000","last_became_active":"2024-09-11T01:05:40.968994+0000","last_became_peered":"2024-09-11T01:05:40.968994+0000","last_unstale":"2024-09-11T01:06:41.683793+0000","last_undegraded":"2024-09-11T01:06:41.683793+0000","last_fullsized":"2024-09-11T01:06:41.683793+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:08.554953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598788+0000","last_change":"2024-09-11T01:05:31.675764+0000","last_active":"2024-09-11T01:06:41.598788+0000","last_peered":"2024-09-11T01:06:41.598788+0000","last_clean":"2024-09-11T01:06:41.598788+0000","last_became_active":"2024-09-11T01:05:31.674553+0000","last_became_peered":"2024-09-11T01:05:31.674553+0000","last_unstale":"2024-09-11T01:06:41.598788+0000","last_undegraded":"2024-09-11T01:06:41.598788+0000","last_fullsized":"2024-09-11T01:06:41.598788+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:30.026758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'33","reported_seq":227,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:23.741865+0000","last_change":"2024-09-11T01:05:40.975735+0000","last_active":"2024-09-11T01:07:23.741865+0000","last_peered":"2024-09-11T01:07:23.741865+0000","last_clean":"2024-09-11T01:07:23.741865+0000","last_became_active":"2024-09-11T01:05:40.964582+0000","last_became_peered":"2024-09-11T01:05:40.964582+0000","last_unstale":"2024-09-11T01:07:23.741865+0000","last_undegraded":"2024-09-11T01:07:23.741865+0000","last_fullsized":"2024-09-11T01:07:23.741865+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:57.424468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64136,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":137,"num_read_kb":130,"num_write":34,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597781+0000","last_change":"2024-09-11T01:05:40.981306+0000","last_active":"2024-09-11T01:06:41.597781+0000","last_peered":"2024-09-11T01:06:41.597781+0000","last_clean":"2024-09-11T01:06:41.597781+0000","last_became_active":"2024-09-11T01:05:40.977531+0000","last_became_peered":"2024-09-11T01:05:40.977531+0000","last_unstale":"2024-09-11T01:06:41.597781+0000","last_undegraded":"2024-09-11T01:06:41.597781+0000","last_fullsized":"2024-09-11T01:06:41.597781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:21.613080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470377+0000","last_change":"2024-09-11T01:05:31.681612+0000","last_active":"2024-09-11T01:06:42.470377+0000","last_peered":"2024-09-11T01:06:42.470377+0000","last_clean":"2024-09-11T01:06:42.470377+0000","last_became_active":"2024-09-11T01:05:31.680609+0000","last_became_peered":"2024-09-11T01:05:31.680609+0000","last_unstale":"2024-09-11T01:06:42.470377+0000","last_undegraded":"2024-09-11T01:06:42.470377+0000","last_fullsized":"2024-09-11T01:06:42.470377+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:44.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.684409+0000","last_change":"2024-09-11T01:05:28.625177+0000","last_active":"2024-09-11T01:06:41.684409+0000","last_peered":"2024-09-11T01:06:41.684409+0000","last_clean":"2024-09-11T01:06:41.684409+0000","last_became_active":"2024-09-11T01:05:28.624819+0000","last_became_peered":"2024-09-11T01:05:28.624819+0000","last_unstale":"2024-09-11T01:06:41.684409+0000","last_undegraded":"2024-09-11T01:06:41.684409+0000","last_fullsized":"2024-09-11T01:06:41.684409+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:11.709636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595295+0000","last_change":"2024-09-11T01:05:40.978481+0000","last_active":"2024-09-11T01:06:41.595295+0000","last_peered":"2024-09-11T01:06:41.595295+0000","last_clean":"2024-09-11T01:06:41.595295+0000","last_became_active":"2024-09-11T01:05:40.977501+0000","last_became_peered":"2024-09-11T01:05:40.977501+0000","last_unstale":"2024-09-11T01:06:41.595295+0000","last_undegraded":"2024-09-11T01:06:41.595295+0000","last_fullsized":"2024-09-11T01:06:41.595295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:08.427274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470537+0000","last_change":"2024-09-11T01:05:31.692675+0000","last_active":"2024-09-11T01:06:42.470537+0000","last_peered":"2024-09-11T01:06:42.470537+0000","last_clean":"2024-09-11T01:06:42.470537+0000","last_became_active":"2024-09-11T01:05:31.690308+0000","last_became_peered":"2024-09-11T01:05:31.690308+0000","last_unstale":"2024-09-11T01:06:42.470537+0000","last_undegraded":"2024-09-11T01:06:42.470537+0000","last_fullsized":"2024-09-11T01:06:42.470537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:14.823786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598003+0000","last_change":"2024-09-11T01:05:28.557868+0000","last_active":"2024-09-11T01:06:41.598003+0000","last_peered":"2024-09-11T01:06:41.598003+0000","last_clean":"2024-09-11T01:06:41.598003+0000","last_became_active":"2024-09-11T01:05:28.557512+0000","last_became_peered":"2024-09-11T01:05:28.557512+0000","last_unstale":"2024-09-11T01:06:41.598003+0000","last_undegraded":"2024-09-11T01:06:41.598003+0000","last_fullsized":"2024-09-11T01:06:41.598003+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:50.733551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597667+0000","last_change":"2024-09-11T01:05:40.982368+0000","last_active":"2024-09-11T01:06:41.597667+0000","last_peered":"2024-09-11T01:06:41.597667+0000","last_clean":"2024-09-11T01:06:41.597667+0000","last_became_active":"2024-09-11T01:05:40.980337+0000","last_became_peered":"2024-09-11T01:05:40.980337+0000","last_unstale":"2024-09-11T01:06:41.597667+0000","last_undegraded":"2024-09-11T01:06:41.597667+0000","last_fullsized":"2024-09-11T01:06:41.597667+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:22.010496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470527+0000","last_change":"2024-09-11T01:05:31.670806+0000","last_active":"2024-09-11T01:06:42.470527+0000","last_peered":"2024-09-11T01:06:42.470527+0000","last_clean":"2024-09-11T01:06:42.470527+0000","last_became_active":"2024-09-11T01:05:31.670452+0000","last_became_peered":"2024-09-11T01:05:31.670452+0000","last_unstale":"2024-09-11T01:06:42.470527+0000","last_undegraded":"2024-09-11T01:06:42.470527+0000","last_fullsized":"2024-09-11T01:06:42.470527+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:22.489650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'3","reported_seq":107,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:22.740191+0000","last_change":"2024-09-11T01:05:28.555885+0000","last_active":"2024-09-11T01:07:22.740191+0000","last_peered":"2024-09-11T01:07:22.740191+0000","last_clean":"2024-09-11T01:07:22.740191+0000","last_became_active":"2024-09-11T01:05:28.555471+0000","last_became_peered":"2024-09-11T01:05:28.555471+0000","last_unstale":"2024-09-11T01:07:22.740191+0000","last_undegraded":"2024-09-11T01:07:22.740191+0000","last_fullsized":"2024-09-11T01:07:22.740191+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:50.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":64,"num_read_kb":64,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650702+0000","last_change":"2024-09-11T01:05:40.971982+0000","last_active":"2024-09-11T01:06:41.650702+0000","last_peered":"2024-09-11T01:06:41.650702+0000","last_clean":"2024-09-11T01:06:41.650702+0000","last_became_active":"2024-09-11T01:05:40.971614+0000","last_became_peered":"2024-09-11T01:05:40.971614+0000","last_unstale":"2024-09-11T01:06:41.650702+0000","last_undegraded":"2024-09-11T01:06:41.650702+0000","last_fullsized":"2024-09-11T01:06:41.650702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:11.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470105+0000","last_change":"2024-09-11T01:05:40.972734+0000","last_active":"2024-09-11T01:06:42.470105+0000","last_peered":"2024-09-11T01:06:42.470105+0000","last_clean":"2024-09-11T01:06:42.470105+0000","last_became_active":"2024-09-11T01:05:40.969428+0000","last_became_peered":"2024-09-11T01:05:40.969428+0000","last_unstale":"2024-09-11T01:06:42.470105+0000","last_undegraded":"2024-09-11T01:06:42.470105+0000","last_fullsized":"2024-09-11T01:06:42.470105+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:30.199055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598079+0000","last_change":"2024-09-11T01:05:31.684114+0000","last_active":"2024-09-11T01:06:41.598079+0000","last_peered":"2024-09-11T01:06:41.598079+0000","last_clean":"2024-09-11T01:06:41.598079+0000","last_became_active":"2024-09-11T01:05:31.683830+0000","last_became_peered":"2024-09-11T01:05:31.683830+0000","last_unstale":"2024-09-11T01:06:41.598079+0000","last_undegraded":"2024-09-11T01:06:41.598079+0000","last_fullsized":"2024-09-11T01:06:41.598079+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:43.695706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683657+0000","last_change":"2024-09-11T01:05:28.554745+0000","last_active":"2024-09-11T01:06:41.683657+0000","last_peered":"2024-09-11T01:06:41.683657+0000","last_clean":"2024-09-11T01:06:41.683657+0000","last_became_active":"2024-09-11T01:05:28.554354+0000","last_became_peered":"2024-09-11T01:05:28.554354+0000","last_unstale":"2024-09-11T01:06:41.683657+0000","last_undegraded":"2024-09-11T01:06:41.683657+0000","last_fullsized":"2024-09-11T01:06:41.683657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:33.663536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597424+0000","last_change":"2024-09-11T01:05:40.974956+0000","last_active":"2024-09-11T01:06:41.597424+0000","last_peered":"2024-09-11T01:06:41.597424+0000","last_clean":"2024-09-11T01:06:41.597424+0000","last_became_active":"2024-09-11T01:05:40.974434+0000","last_became_peered":"2024-09-11T01:05:40.974434+0000","last_unstale":"2024-09-11T01:06:41.597424+0000","last_undegraded":"2024-09-11T01:06:41.597424+0000","last_fullsized":"2024-09-11T01:06:41.597424+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:01.196098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650762+0000","last_change":"2024-09-11T01:05:31.679904+0000","last_active":"2024-09-11T01:06:41.650762+0000","last_peered":"2024-09-11T01:06:41.650762+0000","last_clean":"2024-09-11T01:06:41.650762+0000","last_became_active":"2024-09-11T01:05:31.679517+0000","last_became_peered":"2024-09-11T01:05:31.679517+0000","last_unstale":"2024-09-11T01:06:41.650762+0000","last_undegraded":"2024-09-11T01:06:41.650762+0000","last_fullsized":"2024-09-11T01:06:41.650762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:24.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594607+0000","last_change":"2024-09-11T01:05:28.549752+0000","last_active":"2024-09-11T01:06:41.594607+0000","last_peered":"2024-09-11T01:06:41.594607+0000","last_clean":"2024-09-11T01:06:41.594607+0000","last_became_active":"2024-09-11T01:05:28.549253+0000","last_became_peered":"2024-09-11T01:05:28.549253+0000","last_unstale":"2024-09-11T01:06:41.594607+0000","last_undegraded":"2024-09-11T01:06:41.594607+0000","last_fullsized":"2024-09-11T01:06:41.594607+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:25.774363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.680264+0000","last_change":"2024-09-11T01:05:28.553118+0000","last_active":"2024-09-11T01:06:41.680264+0000","last_peered":"2024-09-11T01:06:41.680264+0000","last_clean":"2024-09-11T01:06:41.680264+0000","last_became_active":"2024-09-11T01:05:28.552779+0000","last_became_peered":"2024-09-11T01:05:28.552779+0000","last_unstale":"2024-09-11T01:06:41.680264+0000","last_undegraded":"2024-09-11T01:06:41.680264+0000","last_fullsized":"2024-09-11T01:06:41.680264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:58.297579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597940+0000","last_change":"2024-09-11T01:05:40.981936+0000","last_active":"2024-09-11T01:06:41.597940+0000","last_peered":"2024-09-11T01:06:41.597940+0000","last_clean":"2024-09-11T01:06:41.597940+0000","last_became_active":"2024-09-11T01:05:40.981623+0000","last_became_peered":"2024-09-11T01:05:40.981623+0000","last_unstale":"2024-09-11T01:06:41.597940+0000","last_undegraded":"2024-09-11T01:06:41.597940+0000","last_fullsized":"2024-09-11T01:06:41.597940+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:14.773406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.685158+0000","last_change":"2024-09-11T01:06:41.685046+0000","last_active":"2024-09-11T01:06:41.685158+0000","last_peered":"2024-09-11T01:06:41.685158+0000","last_clean":"2024-09-11T01:06:41.685158+0000","last_became_active":"2024-09-11T01:06:41.684442+0000","last_became_peered":"2024-09-11T01:06:41.684442+0000","last_unstale":"2024-09-11T01:06:41.685158+0000","last_undegraded":"2024-09-11T01:06:41.685158+0000","last_fullsized":"2024-09-11T01:06:41.685158+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:51.290772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"87'6","reported_seq":117,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:25.745352+0000","last_change":"2024-09-11T01:05:28.553479+0000","last_active":"2024-09-11T01:07:25.745352+0000","last_peered":"2024-09-11T01:07:25.745352+0000","last_clean":"2024-09-11T01:07:25.745352+0000","last_became_active":"2024-09-11T01:05:28.553171+0000","last_became_peered":"2024-09-11T01:05:28.553171+0000","last_unstale":"2024-09-11T01:07:25.745352+0000","last_undegraded":"2024-09-11T01:07:25.745352+0000","last_fullsized":"2024-09-11T01:07:25.745352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:04.877982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":70,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598296+0000","last_change":"2024-09-11T01:05:40.982070+0000","last_active":"2024-09-11T01:06:41.598296+0000","last_peered":"2024-09-11T01:06:41.598296+0000","last_clean":"2024-09-11T01:06:41.598296+0000","last_became_active":"2024-09-11T01:05:40.981601+0000","last_became_peered":"2024-09-11T01:05:40.981601+0000","last_unstale":"2024-09-11T01:06:41.598296+0000","last_undegraded":"2024-09-11T01:06:41.598296+0000","last_fullsized":"2024-09-11T01:06:41.598296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:31.409711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595068+0000","last_change":"2024-09-11T01:05:40.967374+0000","last_active":"2024-09-11T01:06:41.595068+0000","last_peered":"2024-09-11T01:06:41.595068+0000","last_clean":"2024-09-11T01:06:41.595068+0000","last_became_active":"2024-09-11T01:05:40.966705+0000","last_became_peered":"2024-09-11T01:05:40.966705+0000","last_unstale":"2024-09-11T01:06:41.595068+0000","last_undegraded":"2024-09-11T01:06:41.595068+0000","last_fullsized":"2024-09-11T01:06:41.595068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:17.278999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597212+0000","last_change":"2024-09-11T01:05:31.675298+0000","last_active":"2024-09-11T01:06:41.597212+0000","last_peered":"2024-09-11T01:06:41.597212+0000","last_clean":"2024-09-11T01:06:41.597212+0000","last_became_active":"2024-09-11T01:05:31.674922+0000","last_became_peered":"2024-09-11T01:05:31.674922+0000","last_unstale":"2024-09-11T01:06:41.597212+0000","last_undegraded":"2024-09-11T01:06:41.597212+0000","last_fullsized":"2024-09-11T01:06:41.597212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:54.059202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594923+0000","last_change":"2024-09-11T01:05:31.685494+0000","last_active":"2024-09-11T01:06:41.594923+0000","last_peered":"2024-09-11T01:06:41.594923+0000","last_clean":"2024-09-11T01:06:41.594923+0000","last_became_active":"2024-09-11T01:05:31.685131+0000","last_became_peered":"2024-09-11T01:05:31.685131+0000","last_unstale":"2024-09-11T01:06:41.594923+0000","last_undegraded":"2024-09-11T01:06:41.594923+0000","last_fullsized":"2024-09-11T01:06:41.594923+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:41.805135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594719+0000","last_change":"2024-09-11T01:05:31.686473+0000","last_active":"2024-09-11T01:06:41.594719+0000","last_peered":"2024-09-11T01:06:41.594719+0000","last_clean":"2024-09-11T01:06:41.594719+0000","last_became_active":"2024-09-11T01:05:31.685858+0000","last_became_peered":"2024-09-11T01:05:31.685858+0000","last_unstale":"2024-09-11T01:06:41.594719+0000","last_undegraded":"2024-09-11T01:06:41.594719+0000","last_fullsized":"2024-09-11T01:06:41.594719+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:52.174889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470250+0000","last_change":"2024-09-11T01:05:31.691078+0000","last_active":"2024-09-11T01:06:42.470250+0000","last_peered":"2024-09-11T01:06:42.470250+0000","last_clean":"2024-09-11T01:06:42.470250+0000","last_became_active":"2024-09-11T01:05:31.690755+0000","last_became_peered":"2024-09-11T01:05:31.690755+0000","last_unstale":"2024-09-11T01:06:42.470250+0000","last_undegraded":"2024-09-11T01:06:42.470250+0000","last_fullsized":"2024-09-11T01:06:42.470250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:50.643233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595336+0000","last_change":"2024-09-11T01:05:31.681933+0000","last_active":"2024-09-11T01:06:41.595336+0000","last_peered":"2024-09-11T01:06:41.595336+0000","last_clean":"2024-09-11T01:06:41.595336+0000","last_became_active":"2024-09-11T01:05:31.681642+0000","last_became_peered":"2024-09-11T01:05:31.681642+0000","last_unstale":"2024-09-11T01:06:41.595336+0000","last_undegraded":"2024-09-11T01:06:41.595336+0000","last_fullsized":"2024-09-11T01:06:41.595336+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:05:10.434843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597814+0000","last_change":"2024-09-11T01:05:31.677188+0000","last_active":"2024-09-11T01:06:41.597814+0000","last_peered":"2024-09-11T01:06:41.597814+0000","last_clean":"2024-09-11T01:06:41.597814+0000","last_became_active":"2024-09-11T01:05:31.676689+0000","last_became_peered":"2024-09-11T01:05:31.676689+0000","last_unstale":"2024-09-11T01:06:41.597814+0000","last_undegraded":"2024-09-11T01:06:41.597814+0000","last_fullsized":"2024-09-11T01:06:41.597814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:51.899743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595193+0000","last_change":"2024-09-11T01:05:31.678994+0000","last_active":"2024-09-11T01:06:41.595193+0000","last_peered":"2024-09-11T01:06:41.595193+0000","last_clean":"2024-09-11T01:06:41.595193+0000","last_became_active":"2024-09-11T01:05:31.678675+0000","last_became_peered":"2024-09-11T01:05:31.678675+0000","last_unstale":"2024-09-11T01:06:41.595193+0000","last_undegraded":"2024-09-11T01:06:41.595193+0000","last_fullsized":"2024-09-11T01:06:41.595193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:35.740872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.651259+0000","last_change":"2024-09-11T01:05:31.680046+0000","last_active":"2024-09-11T01:06:41.651259+0000","last_peered":"2024-09-11T01:06:41.651259+0000","last_clean":"2024-09-11T01:06:41.651259+0000","last_became_active":"2024-09-11T01:05:31.679626+0000","last_became_peered":"2024-09-11T01:05:31.679626+0000","last_unstale":"2024-09-11T01:06:41.651259+0000","last_undegraded":"2024-09-11T01:06:41.651259+0000","last_fullsized":"2024-09-11T01:06:41.651259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:15.260470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683173+0000","last_change":"2024-09-11T01:05:31.683545+0000","last_active":"2024-09-11T01:06:41.683173+0000","last_peered":"2024-09-11T01:06:41.683173+0000","last_clean":"2024-09-11T01:06:41.683173+0000","last_became_active":"2024-09-11T01:05:31.683166+0000","last_became_peered":"2024-09-11T01:05:31.683166+0000","last_unstale":"2024-09-11T01:06:41.683173+0000","last_undegraded":"2024-09-11T01:06:41.683173+0000","last_fullsized":"2024-09-11T01:06:41.683173+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:57.378211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650834+0000","last_change":"2024-09-11T01:05:31.678031+0000","last_active":"2024-09-11T01:06:41.650834+0000","last_peered":"2024-09-11T01:06:41.650834+0000","last_clean":"2024-09-11T01:06:41.650834+0000","last_became_active":"2024-09-11T01:05:31.677760+0000","last_became_peered":"2024-09-11T01:05:31.677760+0000","last_unstale":"2024-09-11T01:06:41.650834+0000","last_undegraded":"2024-09-11T01:06:41.650834+0000","last_fullsized":"2024-09-11T01:06:41.650834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:39.252655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470417+0000","last_change":"2024-09-11T01:05:31.677991+0000","last_active":"2024-09-11T01:06:42.470417+0000","last_peered":"2024-09-11T01:06:42.470417+0000","last_clean":"2024-09-11T01:06:42.470417+0000","last_became_active":"2024-09-11T01:05:31.677670+0000","last_became_peered":"2024-09-11T01:05:31.677670+0000","last_unstale":"2024-09-11T01:06:42.470417+0000","last_undegraded":"2024-09-11T01:06:42.470417+0000","last_fullsized":"2024-09-11T01:06:42.470417+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:55.622757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595297+0000","last_change":"2024-09-11T01:05:31.678213+0000","last_active":"2024-09-11T01:06:41.595297+0000","last_peered":"2024-09-11T01:06:41.595297+0000","last_clean":"2024-09-11T01:06:41.595297+0000","last_became_active":"2024-09-11T01:05:31.676422+0000","last_became_peered":"2024-09-11T01:05:31.676422+0000","last_unstale":"2024-09-11T01:06:41.595297+0000","last_undegraded":"2024-09-11T01:06:41.595297+0000","last_fullsized":"2024-09-11T01:06:41.595297+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:29.096123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597714+0000","last_change":"2024-09-11T01:05:31.680945+0000","last_active":"2024-09-11T01:06:41.597714+0000","last_peered":"2024-09-11T01:06:41.597714+0000","last_clean":"2024-09-11T01:06:41.597714+0000","last_became_active":"2024-09-11T01:05:31.680458+0000","last_became_peered":"2024-09-11T01:05:31.680458+0000","last_unstale":"2024-09-11T01:06:41.597714+0000","last_undegraded":"2024-09-11T01:06:41.597714+0000","last_fullsized":"2024-09-11T01:06:41.597714+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:01.382341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595184+0000","last_change":"2024-09-11T01:05:31.685792+0000","last_active":"2024-09-11T01:06:41.595184+0000","last_peered":"2024-09-11T01:06:41.595184+0000","last_clean":"2024-09-11T01:06:41.595184+0000","last_became_active":"2024-09-11T01:05:31.685467+0000","last_became_peered":"2024-09-11T01:05:31.685467+0000","last_unstale":"2024-09-11T01:06:41.595184+0000","last_undegraded":"2024-09-11T01:06:41.595184+0000","last_fullsized":"2024-09-11T01:06:41.595184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:37.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598488+0000","last_change":"2024-09-11T01:05:31.678855+0000","last_active":"2024-09-11T01:06:41.598488+0000","last_peered":"2024-09-11T01:06:41.598488+0000","last_clean":"2024-09-11T01:06:41.598488+0000","last_became_active":"2024-09-11T01:05:31.678583+0000","last_became_peered":"2024-09-11T01:05:31.678583+0000","last_unstale":"2024-09-11T01:06:41.598488+0000","last_undegraded":"2024-09-11T01:06:41.598488+0000","last_fullsized":"2024-09-11T01:06:41.598488+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:24.112383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598126+0000","last_change":"2024-09-11T01:05:31.682261+0000","last_active":"2024-09-11T01:06:41.598126+0000","last_peered":"2024-09-11T01:06:41.598126+0000","last_clean":"2024-09-11T01:06:41.598126+0000","last_became_active":"2024-09-11T01:05:31.681924+0000","last_became_peered":"2024-09-11T01:05:31.681924+0000","last_unstale":"2024-09-11T01:06:41.598126+0000","last_undegraded":"2024-09-11T01:06:41.598126+0000","last_fullsized":"2024-09-11T01:06:41.598126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:54.556438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470125+0000","last_change":"2024-09-11T01:05:31.674687+0000","last_active":"2024-09-11T01:06:42.470125+0000","last_peered":"2024-09-11T01:06:42.470125+0000","last_clean":"2024-09-11T01:06:42.470125+0000","last_became_active":"2024-09-11T01:05:31.674348+0000","last_became_peered":"2024-09-11T01:05:31.674348+0000","last_unstale":"2024-09-11T01:06:42.470125+0000","last_undegraded":"2024-09-11T01:06:42.470125+0000","last_fullsized":"2024-09-11T01:06:42.470125+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:46.086798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470235+0000","last_change":"2024-09-11T01:05:40.967775+0000","last_active":"2024-09-11T01:06:42.470235+0000","last_peered":"2024-09-11T01:06:42.470235+0000","last_clean":"2024-09-11T01:06:42.470235+0000","last_became_active":"2024-09-11T01:05:40.967355+0000","last_became_peered":"2024-09-11T01:05:40.967355+0000","last_unstale":"2024-09-11T01:06:42.470235+0000","last_undegraded":"2024-09-11T01:06:42.470235+0000","last_fullsized":"2024-09-11T01:06:42.470235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:43.224010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.469980+0000","last_change":"2024-09-11T01:05:31.674655+0000","last_active":"2024-09-11T01:06:42.469980+0000","last_peered":"2024-09-11T01:06:42.469980+0000","last_clean":"2024-09-11T01:06:42.469980+0000","last_became_active":"2024-09-11T01:05:31.674342+0000","last_became_peered":"2024-09-11T01:05:31.674342+0000","last_unstale":"2024-09-11T01:06:42.469980+0000","last_undegraded":"2024-09-11T01:06:42.469980+0000","last_fullsized":"2024-09-11T01:06:42.469980+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:28.593441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595265+0000","last_change":"2024-09-11T01:05:31.678521+0000","last_active":"2024-09-11T01:06:41.595265+0000","last_peered":"2024-09-11T01:06:41.595265+0000","last_clean":"2024-09-11T01:06:41.595265+0000","last_became_active":"2024-09-11T01:05:31.674828+0000","last_became_peered":"2024-09-11T01:05:31.674828+0000","last_unstale":"2024-09-11T01:06:41.595265+0000","last_undegraded":"2024-09-11T01:06:41.595265+0000","last_fullsized":"2024-09-11T01:06:41.595265+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:38.797887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595536+0000","last_change":"2024-09-11T01:05:31.685075+0000","last_active":"2024-09-11T01:06:41.595536+0000","last_peered":"2024-09-11T01:06:41.595536+0000","last_clean":"2024-09-11T01:06:41.595536+0000","last_became_active":"2024-09-11T01:05:31.684742+0000","last_became_peered":"2024-09-11T01:05:31.684742+0000","last_unstale":"2024-09-11T01:06:41.595536+0000","last_undegraded":"2024-09-11T01:06:41.595536+0000","last_fullsized":"2024-09-11T01:06:41.595536+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:29.381976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598006+0000","last_change":"2024-09-11T01:05:31.678921+0000","last_active":"2024-09-11T01:06:41.598006+0000","last_peered":"2024-09-11T01:06:41.598006+0000","last_clean":"2024-09-11T01:06:41.598006+0000","last_became_active":"2024-09-11T01:05:31.678547+0000","last_became_peered":"2024-09-11T01:05:31.678547+0000","last_unstale":"2024-09-11T01:06:41.598006+0000","last_undegraded":"2024-09-11T01:06:41.598006+0000","last_fullsized":"2024-09-11T01:06:41.598006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:59.618685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.680680+0000","last_change":"2024-09-11T01:05:31.685565+0000","last_active":"2024-09-11T01:06:41.680680+0000","last_peered":"2024-09-11T01:06:41.680680+0000","last_clean":"2024-09-11T01:06:41.680680+0000","last_became_active":"2024-09-11T01:05:31.685234+0000","last_became_peered":"2024-09-11T01:05:31.685234+0000","last_unstale":"2024-09-11T01:06:41.680680+0000","last_undegraded":"2024-09-11T01:06:41.680680+0000","last_fullsized":"2024-09-11T01:06:41.680680+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:07.831922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470667+0000","last_change":"2024-09-11T01:05:31.677464+0000","last_active":"2024-09-11T01:06:42.470667+0000","last_peered":"2024-09-11T01:06:42.470667+0000","last_clean":"2024-09-11T01:06:42.470667+0000","last_became_active":"2024-09-11T01:05:31.677161+0000","last_became_peered":"2024-09-11T01:05:31.677161+0000","last_unstale":"2024-09-11T01:06:42.470667+0000","last_undegraded":"2024-09-11T01:06:42.470667+0000","last_fullsized":"2024-09-11T01:06:42.470667+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:26.590429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650658+0000","last_change":"2024-09-11T01:05:31.679977+0000","last_active":"2024-09-11T01:06:41.650658+0000","last_peered":"2024-09-11T01:06:41.650658+0000","last_clean":"2024-09-11T01:06:41.650658+0000","last_became_active":"2024-09-11T01:05:31.679661+0000","last_became_peered":"2024-09-11T01:05:31.679661+0000","last_unstale":"2024-09-11T01:06:41.650658+0000","last_undegraded":"2024-09-11T01:06:41.650658+0000","last_fullsized":"2024-09-11T01:06:41.650658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:00.040651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597813+0000","last_change":"2024-09-11T01:05:31.685419+0000","last_active":"2024-09-11T01:06:41.597813+0000","last_peered":"2024-09-11T01:06:41.597813+0000","last_clean":"2024-09-11T01:06:41.597813+0000","last_became_active":"2024-09-11T01:05:31.684772+0000","last_became_peered":"2024-09-11T01:05:31.684772+0000","last_unstale":"2024-09-11T01:06:41.597813+0000","last_undegraded":"2024-09-11T01:06:41.597813+0000","last_fullsized":"2024-09-11T01:06:41.597813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:19.283742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.680138+0000","last_change":"2024-09-11T01:05:31.681691+0000","last_active":"2024-09-11T01:06:41.680138+0000","last_peered":"2024-09-11T01:06:41.680138+0000","last_clean":"2024-09-11T01:06:41.680138+0000","last_became_active":"2024-09-11T01:05:31.680549+0000","last_became_peered":"2024-09-11T01:05:31.680549+0000","last_unstale":"2024-09-11T01:06:41.680138+0000","last_undegraded":"2024-09-11T01:06:41.680138+0000","last_fullsized":"2024-09-11T01:06:41.680138+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:15.561978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598970+0000","last_change":"2024-09-11T01:05:31.687135+0000","last_active":"2024-09-11T01:06:41.598970+0000","last_peered":"2024-09-11T01:06:41.598970+0000","last_clean":"2024-09-11T01:06:41.598970+0000","last_became_active":"2024-09-11T01:05:31.686719+0000","last_became_peered":"2024-09-11T01:05:31.686719+0000","last_unstale":"2024-09-11T01:06:41.598970+0000","last_undegraded":"2024-09-11T01:06:41.598970+0000","last_fullsized":"2024-09-11T01:06:41.598970+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:42.044930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595425+0000","last_change":"2024-09-11T01:05:31.688154+0000","last_active":"2024-09-11T01:06:41.595425+0000","last_peered":"2024-09-11T01:06:41.595425+0000","last_clean":"2024-09-11T01:06:41.595425+0000","last_became_active":"2024-09-11T01:05:31.687734+0000","last_became_peered":"2024-09-11T01:05:31.687734+0000","last_unstale":"2024-09-11T01:06:41.595425+0000","last_undegraded":"2024-09-11T01:06:41.595425+0000","last_fullsized":"2024-09-11T01:06:41.595425+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:57.789086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470061+0000","last_change":"2024-09-11T01:05:31.679761+0000","last_active":"2024-09-11T01:06:42.470061+0000","last_peered":"2024-09-11T01:06:42.470061+0000","last_clean":"2024-09-11T01:06:42.470061+0000","last_became_active":"2024-09-11T01:05:31.679345+0000","last_became_peered":"2024-09-11T01:05:31.679345+0000","last_unstale":"2024-09-11T01:06:42.470061+0000","last_undegraded":"2024-09-11T01:06:42.470061+0000","last_fullsized":"2024-09-11T01:06:42.470061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:28.480561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470215+0000","last_change":"2024-09-11T01:05:31.680782+0000","last_active":"2024-09-11T01:06:42.470215+0000","last_peered":"2024-09-11T01:06:42.470215+0000","last_clean":"2024-09-11T01:06:42.470215+0000","last_became_active":"2024-09-11T01:05:31.679984+0000","last_became_peered":"2024-09-11T01:05:31.679984+0000","last_unstale":"2024-09-11T01:06:42.470215+0000","last_undegraded":"2024-09-11T01:06:42.470215+0000","last_fullsized":"2024-09-11T01:06:42.470215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:10.306868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598022+0000","last_change":"2024-09-11T01:05:31.681462+0000","last_active":"2024-09-11T01:06:41.598022+0000","last_peered":"2024-09-11T01:06:41.598022+0000","last_clean":"2024-09-11T01:06:41.598022+0000","last_became_active":"2024-09-11T01:05:31.680799+0000","last_became_peered":"2024-09-11T01:05:31.680799+0000","last_unstale":"2024-09-11T01:06:41.598022+0000","last_undegraded":"2024-09-11T01:06:41.598022+0000","last_fullsized":"2024-09-11T01:06:41.598022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:56:44.512831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68528,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":424,"num_read_kb":282,"num_write":170,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1646,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":205584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":145,"ondisk_log_size":145,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645349,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1024000,"data_stored":506452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841578,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28696,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716456,"statfs":{"total":95995035648,"available":95965650944,"internally_reserved":0,"allocated":1708032,"data_stored":1162197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005102,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1028096,"data_stored":506542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201333,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1019904,"data_stored":506350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397563,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1622016,"data_stored":1102762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593792,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1007616,"data_stored":501718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790022,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28620,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716532,"statfs":{"total":95995035648,"available":95965728768,"internally_reserved":0,"allocated":1630208,"data_stored":1097959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953547,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32260,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712892,"statfs":{"total":95995035648,"available":95962001408,"internally_reserved":0,"allocated":1093632,"data_stored":570895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149776,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1019904,"data_stored":501912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717124,"statfs":{"total":95995035648,"available":95966334976,"internally_reserved":0,"allocated":1024000,"data_stored":503335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36400,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708752,"statfs":{"total":95995035648,"available":95957762048,"internally_reserved":0,"allocated":1077248,"data_stored":565764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1032192,"data_stored":503106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:07:30.490 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T01:07:30.490 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T01:07:30.490 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-11T01:07:30.490 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph health --format=json 2024-09-11T01:07:30.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:30 smithi103 ceph-mon[30562]: pgmap v374: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:30.863 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:30.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:30 smithi117 ceph-mon[35358]: pgmap v374: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:30 smithi183 ceph-mon[34992]: pgmap v374: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:31.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.472+0000 7f8fb3e00640 1 -- 172.21.15.103:0/4222929145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fac075f40 msgr2=0x7f8fac10ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:31.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.472+0000 7f8fb3e00640 1 --2- 172.21.15.103:0/4222929145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fac075f40 0x7f8fac10ee10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8f98009900 tx=0x7f8f9802a410 comp rx=0 tx=0).stop 2024-09-11T01:07:31.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.472+0000 7f8fb3e00640 1 -- 172.21.15.103:0/4222929145 shutdown_connections 2024-09-11T01:07:31.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.472+0000 7f8fb3e00640 1 --2- 172.21.15.103:0/4222929145 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fac10f3e0 0x7f8fac1117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:31.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.472+0000 7f8fb3e00640 1 --2- 172.21.15.103:0/4222929145 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fac075f40 0x7f8fac10ee10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:31.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.472+0000 7f8fb3e00640 1 --2- 172.21.15.103:0/4222929145 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fac075540 0x7f8fac075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:31.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.472+0000 7f8fb3e00640 1 -- 172.21.15.103:0/4222929145 >> 172.21.15.103:0/4222929145 conn(0x7f8fac0fe830 msgr2=0x7f8fac100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:31.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.472+0000 7f8fb3e00640 1 -- 172.21.15.103:0/4222929145 shutdown_connections 2024-09-11T01:07:31.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.472+0000 7f8fb3e00640 1 -- 172.21.15.103:0/4222929145 wait complete. 2024-09-11T01:07:31.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.473+0000 7f8fb3e00640 1 Processor -- start 2024-09-11T01:07:31.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.474+0000 7f8fb3e00640 1 -- start start 2024-09-11T01:07:31.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.474+0000 7f8fb3e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fac075540 0x7f8fac19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:31.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.474+0000 7f8fb3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fac075f40 0x7f8fac19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:31.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.474+0000 7f8fb3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fac10f3e0 0x7f8fac1a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:31.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.474+0000 7f8fb3e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac114f90 con 0x7f8fac10f3e0 2024-09-11T01:07:31.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.474+0000 7f8fb3e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac114e10 con 0x7f8fac075f40 2024-09-11T01:07:31.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.474+0000 7f8fb3e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8fac115110 con 0x7f8fac075540 2024-09-11T01:07:31.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.474+0000 7f8fb1400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fac075540 0x7f8fac19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:31.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.474+0000 7f8fb1400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fac075540 0x7f8fac19b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:53620/0 (socket says 172.21.15.103:53620) 2024-09-11T01:07:31.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.474+0000 7f8fb1400640 1 -- 172.21.15.103:0/2415567004 learned_addr learned my addr 172.21.15.103:0/2415567004 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:31.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.474+0000 7f8fb1e00640 1 --2- 172.21.15.103:0/2415567004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fac10f3e0 0x7f8fac1a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:31.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.474+0000 7f8fb0a00640 1 --2- 172.21.15.103:0/2415567004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fac075f40 0x7f8fac19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:31.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.475+0000 7f8fb1400640 1 -- 172.21.15.103:0/2415567004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fac075f40 msgr2=0x7f8fac19ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.475+0000 7f8fb1400640 1 --2- 172.21.15.103:0/2415567004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fac075f40 0x7f8fac19ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.475+0000 7f8fb1400640 1 -- 172.21.15.103:0/2415567004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fac10f3e0 msgr2=0x7f8fac1a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.475+0000 7f8fb1400640 1 --2- 172.21.15.103:0/2415567004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fac10f3e0 0x7f8fac1a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.475+0000 7f8fb1400640 1 -- 172.21.15.103:0/2415567004 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fac1a1570 con 0x7f8fac075540 2024-09-11T01:07:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.475+0000 7f8fb1400640 1 --2- 172.21.15.103:0/2415567004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fac075540 0x7f8fac19b4c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000eb90 tx=0x7f8fa000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.475+0000 7f8faa000640 1 -- 172.21.15.103:0/2415567004 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0004d20 con 0x7f8fac075540 2024-09-11T01:07:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.475+0000 7f8fb3e00640 1 -- 172.21.15.103:0/2415567004 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fac1a1860 con 0x7f8fac075540 2024-09-11T01:07:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.476+0000 7f8faa000640 1 -- 172.21.15.103:0/2415567004 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8fa000ee90 con 0x7f8fac075540 2024-09-11T01:07:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.476+0000 7f8fb3e00640 1 -- 172.21.15.103:0/2415567004 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fac1a7f20 con 0x7f8fac075540 2024-09-11T01:07:31.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.476+0000 7f8faa000640 1 -- 172.21.15.103:0/2415567004 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0010690 con 0x7f8fac075540 2024-09-11T01:07:31.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.477+0000 7f8fb3e00640 1 -- 172.21.15.103:0/2415567004 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fac076a50 con 0x7f8fac075540 2024-09-11T01:07:31.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.479+0000 7f8faa000640 1 -- 172.21.15.103:0/2415567004 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f8fa0010830 con 0x7f8fac075540 2024-09-11T01:07:31.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.481+0000 7f8faa000640 1 --2- 172.21.15.103:0/2415567004 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8f940b53f0 0x7f8f940b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:31.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.481+0000 7f8faa000640 1 -- 172.21.15.103:0/2415567004 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f8fa00e68d0 con 0x7f8fac075540 2024-09-11T01:07:31.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.481+0000 7f8fb0a00640 1 --2- 172.21.15.103:0/2415567004 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8f940b53f0 0x7f8f940b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:31.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.482+0000 7f8fb0a00640 1 --2- 172.21.15.103:0/2415567004 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8f940b53f0 0x7f8f940b78b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8f98031440 tx=0x7f8f98005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:31.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.482+0000 7f8faa000640 1 -- 172.21.15.103:0/2415567004 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8fa0056220 con 0x7f8fac075540 2024-09-11T01:07:31.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.710+0000 7f8fb3e00640 1 -- 172.21.15.103:0/2415567004 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8fac075920 con 0x7f8fac075540 2024-09-11T01:07:31.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:31 smithi103 ceph-mon[30562]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:07:31.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.711+0000 7f8faa000640 1 -- 172.21.15.103:0/2415567004 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8fac075920 con 0x7f8fac075540 2024-09-11T01:07:31.713 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:07:31.713 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T01:07:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.714+0000 7f8fb3e00640 1 -- 172.21.15.103:0/2415567004 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8f940b53f0 msgr2=0x7f8f940b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.714+0000 7f8fb3e00640 1 --2- 172.21.15.103:0/2415567004 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8f940b53f0 0x7f8f940b78b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8f98031440 tx=0x7f8f98005b50 comp rx=0 tx=0).stop 2024-09-11T01:07:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.714+0000 7f8fb3e00640 1 -- 172.21.15.103:0/2415567004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fac075540 msgr2=0x7f8fac19b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.714+0000 7f8fb3e00640 1 --2- 172.21.15.103:0/2415567004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fac075540 0x7f8fac19b4c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8fa000eb90 tx=0x7f8fa000c6a0 comp rx=0 tx=0).stop 2024-09-11T01:07:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.714+0000 7f8fb3e00640 1 -- 172.21.15.103:0/2415567004 shutdown_connections 2024-09-11T01:07:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.714+0000 7f8fb3e00640 1 --2- 172.21.15.103:0/2415567004 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8f940b53f0 0x7f8f940b78b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.714+0000 7f8fb3e00640 1 --2- 172.21.15.103:0/2415567004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8fac10f3e0 0x7f8fac1a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.714+0000 7f8fb3e00640 1 --2- 172.21.15.103:0/2415567004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fac075f40 0x7f8fac19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.714+0000 7f8fb3e00640 1 --2- 172.21.15.103:0/2415567004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8fac075540 0x7f8fac19b4c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:31.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.714+0000 7f8fb3e00640 1 -- 172.21.15.103:0/2415567004 >> 172.21.15.103:0/2415567004 conn(0x7f8fac0fe830 msgr2=0x7f8fac1115d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:31.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.714+0000 7f8fb3e00640 1 -- 172.21.15.103:0/2415567004 shutdown_connections 2024-09-11T01:07:31.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:31.714+0000 7f8fb3e00640 1 -- 172.21.15.103:0/2415567004 wait complete. 2024-09-11T01:07:31.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:31 smithi117 ceph-mon[35358]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:07:31.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:31 smithi183 ceph-mon[34992]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:07:32.499 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-11T01:07:32.499 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:07:32.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:32 smithi103 ceph-mon[30562]: pgmap v375: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:32.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:32 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2415567004' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-11T01:07:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:32 smithi117 ceph-mon[35358]: pgmap v375: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:32.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:32 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2415567004' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-11T01:07:32.874 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:32.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:32 smithi183 ceph-mon[34992]: pgmap v375: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:32.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:32 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2415567004' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-11T01:07:33.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.463+0000 7f1318a00640 1 -- 172.21.15.103:0/543149441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1314104df0 msgr2=0x7f13141051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:33.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.463+0000 7f1318a00640 1 --2- 172.21.15.103:0/543149441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1314104df0 0x7f13141051d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1304009ca0 tx=0x7f130402a8c0 comp rx=0 tx=0).stop 2024-09-11T01:07:33.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.463+0000 7f1318a00640 1 -- 172.21.15.103:0/543149441 shutdown_connections 2024-09-11T01:07:33.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.463+0000 7f1318a00640 1 --2- 172.21.15.103:0/543149441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f131410b180 0x7f1314111980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:33.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.463+0000 7f1318a00640 1 --2- 172.21.15.103:0/543149441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f131410a800 0x7f131410ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:33.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.463+0000 7f1318a00640 1 --2- 172.21.15.103:0/543149441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1314104df0 0x7f13141051d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:33.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.463+0000 7f1318a00640 1 -- 172.21.15.103:0/543149441 >> 172.21.15.103:0/543149441 conn(0x7f1314100840 msgr2=0x7f1314102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:33.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.463+0000 7f1318a00640 1 -- 172.21.15.103:0/543149441 shutdown_connections 2024-09-11T01:07:33.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.463+0000 7f1318a00640 1 -- 172.21.15.103:0/543149441 wait complete. 2024-09-11T01:07:33.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.464+0000 7f1318a00640 1 Processor -- start 2024-09-11T01:07:33.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.465+0000 7f1318a00640 1 -- start start 2024-09-11T01:07:33.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.465+0000 7f1318a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1314104df0 0x7f131419b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:33.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.465+0000 7f1318a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f131410a800 0x7f131419b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:33.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.465+0000 7f1318a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f131410b180 0x7f13141a0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:33.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.465+0000 7f1318a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1314114e90 con 0x7f1314104df0 2024-09-11T01:07:33.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.465+0000 7f1318a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1314114d10 con 0x7f131410a800 2024-09-11T01:07:33.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.465+0000 7f1318a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1314115010 con 0x7f131410b180 2024-09-11T01:07:33.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.465+0000 7f1313400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1314104df0 0x7f131419b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:33.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.465+0000 7f1313400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1314104df0 0x7f131419b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45696/0 (socket says 172.21.15.103:45696) 2024-09-11T01:07:33.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.465+0000 7f1313400640 1 -- 172.21.15.103:0/1693038922 learned_addr learned my addr 172.21.15.103:0/1693038922 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:33.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.465+0000 7f1312a00640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f131410a800 0x7f131419b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:33.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.465+0000 7f1313e00640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f131410b180 0x7f13141a0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:33.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.466+0000 7f1313400640 1 -- 172.21.15.103:0/1693038922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f131410b180 msgr2=0x7f13141a0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:33.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.466+0000 7f1313400640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f131410b180 0x7f13141a0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:33.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.466+0000 7f1313400640 1 -- 172.21.15.103:0/1693038922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f131410a800 msgr2=0x7f131419b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:33.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.466+0000 7f1313400640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f131410a800 0x7f131419b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:33.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.466+0000 7f1313400640 1 -- 172.21.15.103:0/1693038922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13141a1300 con 0x7f1314104df0 2024-09-11T01:07:33.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.466+0000 7f1312a00640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f131410a800 0x7f131419b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:33.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.466+0000 7f1313400640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1314104df0 0x7f131419b250 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1304005e30 tx=0x7f1304031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:33.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.466+0000 7f130be00640 1 -- 172.21.15.103:0/1693038922 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1304003b70 con 0x7f1314104df0 2024-09-11T01:07:33.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.467+0000 7f130be00640 1 -- 172.21.15.103:0/1693038922 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1304003d10 con 0x7f1314104df0 2024-09-11T01:07:33.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.467+0000 7f1318a00640 1 -- 172.21.15.103:0/1693038922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13141a1590 con 0x7f1314104df0 2024-09-11T01:07:33.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.467+0000 7f130be00640 1 -- 172.21.15.103:0/1693038922 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130402fa50 con 0x7f1314104df0 2024-09-11T01:07:33.471 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.467+0000 7f1318a00640 1 -- 172.21.15.103:0/1693038922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13141a7cb0 con 0x7f1314104df0 2024-09-11T01:07:33.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.468+0000 7f1318a00640 1 -- 172.21.15.103:0/1693038922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13141051d0 con 0x7f1314104df0 2024-09-11T01:07:33.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.470+0000 7f130be00640 1 -- 172.21.15.103:0/1693038922 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f130402fbf0 con 0x7f1314104df0 2024-09-11T01:07:33.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.471+0000 7f130be00640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f12f80b5490 0x7f12f80b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:33.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.471+0000 7f130be00640 1 -- 172.21.15.103:0/1693038922 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f1304107490 con 0x7f1314104df0 2024-09-11T01:07:33.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.472+0000 7f1312a00640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f12f80b5490 0x7f12f80b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:33.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.472+0000 7f1312a00640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f12f80b5490 0x7f12f80b7950 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f13141040b0 tx=0x7f1300005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:33.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.475+0000 7f130be00640 1 -- 172.21.15.103:0/1693038922 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f13040cdde0 con 0x7f1314104df0 2024-09-11T01:07:33.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.722+0000 7f1318a00640 1 -- 172.21.15.103:0/1693038922 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f131402e5c0 con 0x7f1314104df0 2024-09-11T01:07:33.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.723+0000 7f130be00640 1 -- 172.21.15.103:0/1693038922 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11930 (secure 0 0 0) 0x7f13040cd6e0 con 0x7f1314104df0 2024-09-11T01:07:33.725 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:07:33.725 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-09-11T01:06:22:641923+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:06:22.629934+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24619,24629,24665]},"id":1}]} 2024-09-11T01:07:33.725 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-09-11T01:07:33.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.726+0000 7f1318a00640 1 -- 172.21.15.103:0/1693038922 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f12f80b5490 msgr2=0x7f12f80b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:33.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.726+0000 7f1318a00640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f12f80b5490 0x7f12f80b7950 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f13141040b0 tx=0x7f1300005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:33.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.726+0000 7f1318a00640 1 -- 172.21.15.103:0/1693038922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1314104df0 msgr2=0x7f131419b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:33.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.726+0000 7f1318a00640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1314104df0 0x7f131419b250 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1304005e30 tx=0x7f1304031840 comp rx=0 tx=0).stop 2024-09-11T01:07:33.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.726+0000 7f1318a00640 1 -- 172.21.15.103:0/1693038922 shutdown_connections 2024-09-11T01:07:33.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.726+0000 7f1318a00640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f12f80b5490 0x7f12f80b7950 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:33.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.726+0000 7f1318a00640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f131410b180 0x7f13141a0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:33.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.726+0000 7f1318a00640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f131410a800 0x7f131419b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:33.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.726+0000 7f1318a00640 1 --2- 172.21.15.103:0/1693038922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1314104df0 0x7f131419b250 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:33.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.726+0000 7f1318a00640 1 -- 172.21.15.103:0/1693038922 >> 172.21.15.103:0/1693038922 conn(0x7f1314100840 msgr2=0x7f1314106db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:33.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.726+0000 7f1318a00640 1 -- 172.21.15.103:0/1693038922 shutdown_connections 2024-09-11T01:07:33.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:33.726+0000 7f1318a00640 1 -- 172.21.15.103:0/1693038922 wait complete. 2024-09-11T01:07:34.614 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:07:34.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:34 smithi103 ceph-mon[30562]: pgmap v376: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:34.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:07:34.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:34 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1693038922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:07:34.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:34.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:34 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:34.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:34 smithi117 ceph-mon[35358]: pgmap v376: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:34.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:07:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:34 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1693038922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:07:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:34.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:34 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:34 smithi183 ceph-mon[34992]: pgmap v376: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:34.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:07:34.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:34 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1693038922' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:07:34.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:34.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:34 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:35.555 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:36.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.207+0000 7f514f000640 1 -- 172.21.15.103:0/1668393462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5148108030 msgr2=0x7f514810f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:36.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.207+0000 7f514f000640 1 --2- 172.21.15.103:0/1668393462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5148108030 0x7f514810f920 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5140009ca0 tx=0x7f514002a8c0 comp rx=0 tx=0).stop 2024-09-11T01:07:36.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.208+0000 7f514f000640 1 -- 172.21.15.103:0/1668393462 shutdown_connections 2024-09-11T01:07:36.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.208+0000 7f514f000640 1 --2- 172.21.15.103:0/1668393462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5148108030 0x7f514810f920 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:36.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.208+0000 7f514f000640 1 --2- 172.21.15.103:0/1668393462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f51481076b0 0x7f5148107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:36.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.208+0000 7f514f000640 1 --2- 172.21.15.103:0/1668393462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5148100d30 0x7f5148101110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:36.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.208+0000 7f514f000640 1 -- 172.21.15.103:0/1668393462 >> 172.21.15.103:0/1668393462 conn(0x7f51480fca20 msgr2=0x7f51480fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:36.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.208+0000 7f514f000640 1 -- 172.21.15.103:0/1668393462 shutdown_connections 2024-09-11T01:07:36.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.208+0000 7f514f000640 1 -- 172.21.15.103:0/1668393462 wait complete. 2024-09-11T01:07:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.209+0000 7f514f000640 1 Processor -- start 2024-09-11T01:07:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.209+0000 7f514f000640 1 -- start start 2024-09-11T01:07:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.209+0000 7f514f000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5148100d30 0x7f514819b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.209+0000 7f514f000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51481076b0 0x7f514819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:36.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.209+0000 7f514f000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5148108030 0x7f51481a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.209+0000 7f514f000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5148112de0 con 0x7f51481076b0 2024-09-11T01:07:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.209+0000 7f514f000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5148112c60 con 0x7f5148108030 2024-09-11T01:07:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.209+0000 7f514f000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5148112f60 con 0x7f5148100d30 2024-09-11T01:07:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.210+0000 7f5147400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51481076b0 0x7f514819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.210+0000 7f5147400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51481076b0 0x7f514819b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45720/0 (socket says 172.21.15.103:45720) 2024-09-11T01:07:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.210+0000 7f5147400640 1 -- 172.21.15.103:0/2294622993 learned_addr learned my addr 172.21.15.103:0/2294622993 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.210+0000 7f5147e00640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5148100d30 0x7f514819b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.210+0000 7f514d000640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5148108030 0x7f51481a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.210+0000 7f5147e00640 1 -- 172.21.15.103:0/2294622993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5148108030 msgr2=0x7f51481a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.210+0000 7f5147e00640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5148108030 0x7f51481a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.210+0000 7f5147e00640 1 -- 172.21.15.103:0/2294622993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51481076b0 msgr2=0x7f514819b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.210+0000 7f5147e00640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51481076b0 0x7f514819b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:36.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.210+0000 7f5147e00640 1 -- 172.21.15.103:0/2294622993 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51481a1510 con 0x7f5148100d30 2024-09-11T01:07:36.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.210+0000 7f514d000640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5148108030 0x7f51481a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:07:36.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.210+0000 7f5147400640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51481076b0 0x7f514819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:36.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.210+0000 7f5147e00640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5148100d30 0x7f514819b460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f513800e9f0 tx=0x7f513800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:36.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.211+0000 7f5144c00640 1 -- 172.21.15.103:0/2294622993 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513800ccc0 con 0x7f5148100d30 2024-09-11T01:07:36.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.211+0000 7f5144c00640 1 -- 172.21.15.103:0/2294622993 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51380108e0 con 0x7f5148100d30 2024-09-11T01:07:36.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.211+0000 7f5144c00640 1 -- 172.21.15.103:0/2294622993 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5138018880 con 0x7f5148100d30 2024-09-11T01:07:36.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.211+0000 7f514f000640 1 -- 172.21.15.103:0/2294622993 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51481a1800 con 0x7f5148100d30 2024-09-11T01:07:36.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.211+0000 7f514f000640 1 -- 172.21.15.103:0/2294622993 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51481a8090 con 0x7f5148100d30 2024-09-11T01:07:36.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.212+0000 7f514f000640 1 -- 172.21.15.103:0/2294622993 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5148101e50 con 0x7f5148100d30 2024-09-11T01:07:36.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.214+0000 7f5144c00640 1 -- 172.21.15.103:0/2294622993 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f5138010430 con 0x7f5148100d30 2024-09-11T01:07:36.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.215+0000 7f5144c00640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f512c0b53f0 0x7f512c0b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:36.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.216+0000 7f5144c00640 1 -- 172.21.15.103:0/2294622993 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f51380e64d0 con 0x7f5148100d30 2024-09-11T01:07:36.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.216+0000 7f5147400640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f512c0b53f0 0x7f512c0b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:36.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.216+0000 7f5147400640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f512c0b53f0 0x7f512c0b78b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f514810fdd0 tx=0x7f5134005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:36.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.219+0000 7f5144c00640 1 -- 172.21.15.103:0/2294622993 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f51380ace20 con 0x7f5148100d30 2024-09-11T01:07:36.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:36.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:36.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:36.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:36 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:36.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:36 smithi117 ceph-mon[35358]: pgmap v377: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:36.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:36.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:36.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:36.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:36 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:36.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:36 smithi183 ceph-mon[34992]: pgmap v377: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:36.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.462+0000 7f514f000640 1 -- 172.21.15.103:0/2294622993 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f514819c590 con 0x7f5148100d30 2024-09-11T01:07:36.464 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:36.464 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:36.464 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:36.464 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:36 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:36.464 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:36 smithi103 ceph-mon[30562]: pgmap v377: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:36.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.463+0000 7f5144c00640 1 -- 172.21.15.103:0/2294622993 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11930 (secure 0 0 0) 0x7f51380a6e20 con 0x7f5148100d30 2024-09-11T01:07:36.465 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:07:36.465 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-09-11T01:06:22:641923+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:06:22.629934+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24619,24629,24665]},"id":1}]} 2024-09-11T01:07:36.465 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-09-11T01:07:36.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.465+0000 7f514f000640 1 -- 172.21.15.103:0/2294622993 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f512c0b53f0 msgr2=0x7f512c0b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:36.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.465+0000 7f514f000640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f512c0b53f0 0x7f512c0b78b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f514810fdd0 tx=0x7f5134005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:36.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.465+0000 7f514f000640 1 -- 172.21.15.103:0/2294622993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5148100d30 msgr2=0x7f514819b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:36.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.465+0000 7f514f000640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5148100d30 0x7f514819b460 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f513800e9f0 tx=0x7f513800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:07:36.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.466+0000 7f514f000640 1 -- 172.21.15.103:0/2294622993 shutdown_connections 2024-09-11T01:07:36.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.466+0000 7f514f000640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f512c0b53f0 0x7f512c0b78b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:36.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.466+0000 7f514f000640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5148108030 0x7f51481a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:36.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.466+0000 7f514f000640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51481076b0 0x7f514819b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:36.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.466+0000 7f514f000640 1 --2- 172.21.15.103:0/2294622993 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5148100d30 0x7f514819b460 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:36.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.466+0000 7f514f000640 1 -- 172.21.15.103:0/2294622993 >> 172.21.15.103:0/2294622993 conn(0x7f51480fca20 msgr2=0x7f514810dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:36.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.466+0000 7f514f000640 1 -- 172.21.15.103:0/2294622993 shutdown_connections 2024-09-11T01:07:36.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:36.466+0000 7f514f000640 1 -- 172.21.15.103:0/2294622993 wait complete. 2024-09-11T01:07:37.249 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T01:07:37.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:37 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2294622993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:07:37.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:37 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2294622993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:07:37.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:37 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2294622993' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:07:37.647 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.227+0000 7fe1b4800640 1 -- 172.21.15.103:0/3326016631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1ac10f3b0 msgr2=0x7fe1ac1117a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.227+0000 7fe1b4800640 1 --2- 172.21.15.103:0/3326016631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1ac10f3b0 0x7fe1ac1117a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009ca0 tx=0x7fe1a802a8c0 comp rx=0 tx=0).stop 2024-09-11T01:07:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.227+0000 7fe1b4800640 1 -- 172.21.15.103:0/3326016631 shutdown_connections 2024-09-11T01:07:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.227+0000 7fe1b4800640 1 --2- 172.21.15.103:0/3326016631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1ac10f3b0 0x7fe1ac1117a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.227+0000 7fe1b4800640 1 --2- 172.21.15.103:0/3326016631 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1ac075de0 0x7fe1ac10ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.227+0000 7fe1b4800640 1 --2- 172.21.15.103:0/3326016631 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac0754c0 0x7fe1ac0758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.227+0000 7fe1b4800640 1 -- 172.21.15.103:0/3326016631 >> 172.21.15.103:0/3326016631 conn(0x7fe1ac0fe810 msgr2=0x7fe1ac100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.227+0000 7fe1b4800640 1 -- 172.21.15.103:0/3326016631 shutdown_connections 2024-09-11T01:07:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.227+0000 7fe1b4800640 1 -- 172.21.15.103:0/3326016631 wait complete. 2024-09-11T01:07:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.228+0000 7fe1b4800640 1 Processor -- start 2024-09-11T01:07:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.228+0000 7fe1b4800640 1 -- start start 2024-09-11T01:07:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.228+0000 7fe1b4800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac0754c0 0x7fe1ac19b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b4800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1ac075de0 0x7fe1ac19b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b4800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1ac10f3b0 0x7fe1ac1a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b4800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac114f70 con 0x7fe1ac075de0 2024-09-11T01:07:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b4800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac114df0 con 0x7fe1ac0754c0 2024-09-11T01:07:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b4800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac1150f0 con 0x7fe1ac10f3b0 2024-09-11T01:07:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1ac075de0 0x7fe1ac19b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b1400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1ac075de0 0x7fe1ac19b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45742/0 (socket says 172.21.15.103:45742) 2024-09-11T01:07:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b1400640 1 -- 172.21.15.103:0/1677475500 learned_addr learned my addr 172.21.15.103:0/1677475500 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b1e00640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac0754c0 0x7fe1ac19b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b2800640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1ac10f3b0 0x7fe1ac1a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b1400640 1 -- 172.21.15.103:0/1677475500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1ac10f3b0 msgr2=0x7fe1ac1a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b1400640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1ac10f3b0 0x7fe1ac1a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b1400640 1 -- 172.21.15.103:0/1677475500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac0754c0 msgr2=0x7fe1ac19b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b1400640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac0754c0 0x7fe1ac19b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b1400640 1 -- 172.21.15.103:0/1677475500 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ac1a1530 con 0x7fe1ac075de0 2024-09-11T01:07:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.229+0000 7fe1b2800640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1ac10f3b0 0x7fe1ac1a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:07:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.230+0000 7fe1b1400640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1ac075de0 0x7fe1ac19b9c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00e9f0 tx=0x7fe19c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.230+0000 7fe1a6a00640 1 -- 172.21.15.103:0/1677475500 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c00cd80 con 0x7fe1ac075de0 2024-09-11T01:07:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.230+0000 7fe1a6a00640 1 -- 172.21.15.103:0/1677475500 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe19c0054d0 con 0x7fe1ac075de0 2024-09-11T01:07:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.230+0000 7fe1b4800640 1 -- 172.21.15.103:0/1677475500 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1ac1a1820 con 0x7fe1ac075de0 2024-09-11T01:07:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.230+0000 7fe1a6a00640 1 -- 172.21.15.103:0/1677475500 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c010690 con 0x7fe1ac075de0 2024-09-11T01:07:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.230+0000 7fe1b4800640 1 -- 172.21.15.103:0/1677475500 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1ac1a7ee0 con 0x7fe1ac075de0 2024-09-11T01:07:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.231+0000 7fe1b4800640 1 -- 172.21.15.103:0/1677475500 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1ac0758a0 con 0x7fe1ac075de0 2024-09-11T01:07:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.233+0000 7fe1a6a00640 1 -- 172.21.15.103:0/1677475500 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7fe19c004e90 con 0x7fe1ac075de0 2024-09-11T01:07:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.235+0000 7fe1a6a00640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe1940b5370 0x7fe1940b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.235+0000 7fe1a6a00640 1 -- 172.21.15.103:0/1677475500 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fe19c0e65e0 con 0x7fe1ac075de0 2024-09-11T01:07:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.235+0000 7fe1b1e00640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe1940b5370 0x7fe1940b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.236+0000 7fe1b1e00640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe1940b5370 0x7fe1940b7830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0005d00 tx=0x7fe1a000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:38.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.239+0000 7fe1a6a00640 1 -- 172.21.15.103:0/1677475500 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe19c0acf30 con 0x7fe1ac075de0 2024-09-11T01:07:38.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.434+0000 7fe1b4800640 1 -- 172.21.15.103:0/1677475500 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1ac1a8240 con 0x7fe1ac075de0 2024-09-11T01:07:38.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.436+0000 7fe1a6a00640 1 -- 172.21.15.103:0/1677475500 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24984 (secure 0 0 0) 0x7fe19c0ac830 con 0x7fe1ac075de0 2024-09-11T01:07:38.438 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:07:38.438 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","created":"2024-09-11T00:56:46.242882+0000","modified":"2024-09-11T01:06:41.586918+0000","last_up_change":"2024-09-11T01:04:34.895368+0000","last_in_change":"2024-09-11T01:04:11.663436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:00:33.745338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T01:05:27.486014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T01:05:29.797513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T01:05:38.956635+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1b3e4222-43fd-4af0-bf97-3ba1000221b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6803","nonce":1867193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6805","nonce":1867193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6809","nonce":1867193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6807","nonce":1867193874}]},"public_addr":"172.21.15.103:6803/1867193874","cluster_addr":"172.21.15.103:6805/1867193874","heartbeat_back_addr":"172.21.15.103:6809/1867193874","heartbeat_front_addr":"172.21.15.103:6807/1867193874","state":["exists","up"]},{"osd":1,"uuid":"9a2b40da-7361-4c4f-a9dc-a769b427a0fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6801","nonce":2629532556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6803","nonce":2629532556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6807","nonce":2629532556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6805","nonce":2629532556}]},"public_addr":"172.21.15.117:6801/2629532556","cluster_addr":"172.21.15.117:6803/2629532556","heartbeat_back_addr":"172.21.15.117:6807/2629532556","heartbeat_front_addr":"172.21.15.117:6805/2629532556","state":["exists","up"]},{"osd":2,"uuid":"5db919c1-90a7-4ba7-acf3-89eeb77ae131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6801","nonce":3208966770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6803","nonce":3208966770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6807","nonce":3208966770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6805","nonce":3208966770}]},"public_addr":"172.21.15.183:6801/3208966770","cluster_addr":"172.21.15.183:6803/3208966770","heartbeat_back_addr":"172.21.15.183:6807/3208966770","heartbeat_front_addr":"172.21.15.183:6805/3208966770","state":["exists","up"]},{"osd":3,"uuid":"bdc465f2-06a5-4667-9651-4e168700d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6811","nonce":2238128162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6813","nonce":2238128162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6817","nonce":2238128162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6815","nonce":2238128162}]},"public_addr":"172.21.15.103:6811/2238128162","cluster_addr":"172.21.15.103:6813/2238128162","heartbeat_back_addr":"172.21.15.103:6817/2238128162","heartbeat_front_addr":"172.21.15.103:6815/2238128162","state":["exists","up"]},{"osd":4,"uuid":"be86a5d2-5e86-4bf4-8464-9dff7a801e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6809","nonce":2368878504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6811","nonce":2368878504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6815","nonce":2368878504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6813","nonce":2368878504}]},"public_addr":"172.21.15.117:6809/2368878504","cluster_addr":"172.21.15.117:6811/2368878504","heartbeat_back_addr":"172.21.15.117:6815/2368878504","heartbeat_front_addr":"172.21.15.117:6813/2368878504","state":["exists","up"]},{"osd":5,"uuid":"090b20ec-d9ff-4e10-ad9f-52ab41dbf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6809","nonce":1668069547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6811","nonce":1668069547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6815","nonce":1668069547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6813","nonce":1668069547}]},"public_addr":"172.21.15.183:6809/1668069547","cluster_addr":"172.21.15.183:6811/1668069547","heartbeat_back_addr":"172.21.15.183:6815/1668069547","heartbeat_front_addr":"172.21.15.183:6813/1668069547","state":["exists","up"]},{"osd":6,"uuid":"19abe982-3522-40f9-a628-ddaef462cdb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6819","nonce":4203476972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6821","nonce":4203476972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6825","nonce":4203476972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6823","nonce":4203476972}]},"public_addr":"172.21.15.103:6819/4203476972","cluster_addr":"172.21.15.103:6821/4203476972","heartbeat_back_addr":"172.21.15.103:6825/4203476972","heartbeat_front_addr":"172.21.15.103:6823/4203476972","state":["exists","up"]},{"osd":7,"uuid":"e875ff09-805a-40ff-9d6a-dd2607ce3432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6817","nonce":1207680713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6819","nonce":1207680713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6823","nonce":1207680713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6821","nonce":1207680713}]},"public_addr":"172.21.15.117:6817/1207680713","cluster_addr":"172.21.15.117:6819/1207680713","heartbeat_back_addr":"172.21.15.117:6823/1207680713","heartbeat_front_addr":"172.21.15.117:6821/1207680713","state":["exists","up"]},{"osd":8,"uuid":"2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6817","nonce":2935820593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6819","nonce":2935820593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6823","nonce":2935820593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6821","nonce":2935820593}]},"public_addr":"172.21.15.183:6817/2935820593","cluster_addr":"172.21.15.183:6819/2935820593","heartbeat_back_addr":"172.21.15.183:6823/2935820593","heartbeat_front_addr":"172.21.15.183:6821/2935820593","state":["exists","up"]},{"osd":9,"uuid":"c36d17d2-0bc8-4322-a998-9c8eff970e58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6827","nonce":2104855877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6829","nonce":2104855877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6833","nonce":2104855877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6831","nonce":2104855877}]},"public_addr":"172.21.15.103:6827/2104855877","cluster_addr":"172.21.15.103:6829/2104855877","heartbeat_back_addr":"172.21.15.103:6833/2104855877","heartbeat_front_addr":"172.21.15.103:6831/2104855877","state":["exists","up"]},{"osd":10,"uuid":"e71bc5f7-a829-43cf-a10b-b2444da1d773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6825","nonce":3792981873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6827","nonce":3792981873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6831","nonce":3792981873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6829","nonce":3792981873}]},"public_addr":"172.21.15.117:6825/3792981873","cluster_addr":"172.21.15.117:6827/3792981873","heartbeat_back_addr":"172.21.15.117:6831/3792981873","heartbeat_front_addr":"172.21.15.117:6829/3792981873","state":["exists","up"]},{"osd":11,"uuid":"8f36697f-4d18-4efa-bf14-d68a13464958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6825","nonce":1250387289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6827","nonce":1250387289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6831","nonce":1250387289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6829","nonce":1250387289}]},"public_addr":"172.21.15.183:6825/1250387289","cluster_addr":"172.21.15.183:6827/1250387289","heartbeat_back_addr":"172.21.15.183:6831/1250387289","heartbeat_front_addr":"172.21.15.183:6829/1250387289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:59:39.916330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:06.042858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:30.703648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:59.493376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:25.190299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:50.480326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:20.815441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:46.398318+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:11.499922+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:41.895096+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:08.411538+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:32.943466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/366890372":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6800/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2372812363":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2844264136":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/2046654364":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6801/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/211510947":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6801/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6800/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/189409602":"2024-09-12T00:57:11.412015+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:07:38.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.438+0000 7fe1b4800640 1 -- 172.21.15.103:0/1677475500 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe1940b5370 msgr2=0x7fe1940b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:38.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.438+0000 7fe1b4800640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe1940b5370 0x7fe1940b7830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0005d00 tx=0x7fe1a000b410 comp rx=0 tx=0).stop 2024-09-11T01:07:38.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.438+0000 7fe1b4800640 1 -- 172.21.15.103:0/1677475500 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1ac075de0 msgr2=0x7fe1ac19b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:38.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.438+0000 7fe1b4800640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1ac075de0 0x7fe1ac19b9c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe19c00e9f0 tx=0x7fe19c00edf0 comp rx=0 tx=0).stop 2024-09-11T01:07:38.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.438+0000 7fe1b4800640 1 -- 172.21.15.103:0/1677475500 shutdown_connections 2024-09-11T01:07:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.438+0000 7fe1b4800640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe1940b5370 0x7fe1940b7830 secure :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe1a0005d00 tx=0x7fe1a000b410 comp rx=0 tx=0).stop 2024-09-11T01:07:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.438+0000 7fe1b4800640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe1ac10f3b0 0x7fe1ac1a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.438+0000 7fe1b4800640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe1ac075de0 0x7fe1ac19b9c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.438+0000 7fe1b4800640 1 --2- 172.21.15.103:0/1677475500 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe1ac0754c0 0x7fe1ac19b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.438+0000 7fe1b4800640 1 -- 172.21.15.103:0/1677475500 >> 172.21.15.103:0/1677475500 conn(0x7fe1ac0fe810 msgr2=0x7fe1ac111590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.439+0000 7fe1b4800640 1 -- 172.21.15.103:0/1677475500 shutdown_connections 2024-09-11T01:07:38.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:38.439+0000 7fe1b4800640 1 -- 172.21.15.103:0/1677475500 wait complete. 2024-09-11T01:07:38.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:38.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:38.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:38 smithi103 ceph-mon[30562]: pgmap v378: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:38.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:07:38.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:07:38.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:38.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:38 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1677475500' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:07:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:38 smithi117 ceph-mon[35358]: pgmap v378: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:07:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:07:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:38 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1677475500' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:07:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:38 smithi183 ceph-mon[34992]: pgmap v378: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:07:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:07:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:07:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:38 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1677475500' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:07:39.279 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:07:39.647 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:40.472 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.311+0000 7f07ca800640 1 -- 172.21.15.103:0/445051356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07c4104fa0 msgr2=0x7f07c4105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:40.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.311+0000 7f07ca800640 1 --2- 172.21.15.103:0/445051356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07c4104fa0 0x7f07c4105380 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f07b4009900 tx=0x7f07b402a410 comp rx=0 tx=0).stop 2024-09-11T01:07:40.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.311+0000 7f07ca800640 1 -- 172.21.15.103:0/445051356 shutdown_connections 2024-09-11T01:07:40.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.311+0000 7f07ca800640 1 --2- 172.21.15.103:0/445051356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07c410b330 0x7f07c4111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:40.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.311+0000 7f07ca800640 1 --2- 172.21.15.103:0/445051356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c410a9b0 0x7f07c410adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:40.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.311+0000 7f07ca800640 1 --2- 172.21.15.103:0/445051356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07c4104fa0 0x7f07c4105380 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:40.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.311+0000 7f07ca800640 1 -- 172.21.15.103:0/445051356 >> 172.21.15.103:0/445051356 conn(0x7f07c4100a50 msgr2=0x7f07c4102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:40.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.311+0000 7f07ca800640 1 -- 172.21.15.103:0/445051356 shutdown_connections 2024-09-11T01:07:40.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.311+0000 7f07ca800640 1 -- 172.21.15.103:0/445051356 wait complete. 2024-09-11T01:07:40.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.312+0000 7f07ca800640 1 Processor -- start 2024-09-11T01:07:40.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.312+0000 7f07ca800640 1 -- start start 2024-09-11T01:07:40.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.312+0000 7f07ca800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07c4104fa0 0x7f07c419b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:40.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.312+0000 7f07ca800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c410a9b0 0x7f07c419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:40.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.312+0000 7f07ca800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07c410b330 0x7f07c41a0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:40.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.312+0000 7f07ca800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f07c4114f60 con 0x7f07c410b330 2024-09-11T01:07:40.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.312+0000 7f07ca800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f07c4114de0 con 0x7f07c4104fa0 2024-09-11T01:07:40.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.312+0000 7f07ca800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f07c41150e0 con 0x7f07c410a9b0 2024-09-11T01:07:40.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.313+0000 7f07c3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07c410b330 0x7f07c41a0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:40.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.313+0000 7f07c3400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07c4104fa0 0x7f07c419b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:40.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.313+0000 7f07c3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07c410b330 0x7f07c41a0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56604/0 (socket says 172.21.15.103:56604) 2024-09-11T01:07:40.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.313+0000 7f07c3400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07c4104fa0 0x7f07c419b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:40162/0 (socket says 172.21.15.103:40162) 2024-09-11T01:07:40.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.313+0000 7f07c3e00640 1 -- 172.21.15.103:0/3576079809 learned_addr learned my addr 172.21.15.103:0/3576079809 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:40.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.313+0000 7f07c2a00640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c410a9b0 0x7f07c419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:40.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.313+0000 7f07c3400640 1 -- 172.21.15.103:0/3576079809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c410a9b0 msgr2=0x7f07c419ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:40.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.313+0000 7f07c3400640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c410a9b0 0x7f07c419ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:40.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.313+0000 7f07c3400640 1 -- 172.21.15.103:0/3576079809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07c410b330 msgr2=0x7f07c41a0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:40.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.313+0000 7f07c3400640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07c410b330 0x7f07c41a0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:40.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.313+0000 7f07c3400640 1 -- 172.21.15.103:0/3576079809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c41a1600 con 0x7f07c4104fa0 2024-09-11T01:07:40.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.313+0000 7f07c3e00640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07c410b330 0x7f07c41a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:40.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.313+0000 7f07c2a00640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c410a9b0 0x7f07c419ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:40.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.313+0000 7f07c3400640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07c4104fa0 0x7f07c419b550 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f07b4006010 tx=0x7f07b4004060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:40.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.314+0000 7f07bbe00640 1 -- 172.21.15.103:0/3576079809 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b403f070 con 0x7f07c4104fa0 2024-09-11T01:07:40.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.314+0000 7f07ca800640 1 -- 172.21.15.103:0/3576079809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c41a1890 con 0x7f07c4104fa0 2024-09-11T01:07:40.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.314+0000 7f07ca800640 1 -- 172.21.15.103:0/3576079809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c41a7fb0 con 0x7f07c4104fa0 2024-09-11T01:07:40.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.314+0000 7f07bbe00640 1 -- 172.21.15.103:0/3576079809 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07b4003ca0 con 0x7f07c4104fa0 2024-09-11T01:07:40.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.314+0000 7f07bbe00640 1 -- 172.21.15.103:0/3576079809 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b4048060 con 0x7f07c4104fa0 2024-09-11T01:07:40.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.315+0000 7f07ca800640 1 -- 172.21.15.103:0/3576079809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a40052c0 con 0x7f07c4104fa0 2024-09-11T01:07:40.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.317+0000 7f07bbe00640 1 -- 172.21.15.103:0/3576079809 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7f07b404b060 con 0x7f07c4104fa0 2024-09-11T01:07:40.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.319+0000 7f07bbe00640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f07a80b53f0 0x7f07a80b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:40.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.319+0000 7f07bbe00640 1 -- 172.21.15.103:0/3576079809 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f07b4105ff0 con 0x7f07c4104fa0 2024-09-11T01:07:40.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.319+0000 7f07c2a00640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f07a80b53f0 0x7f07a80b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:40.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.320+0000 7f07c2a00640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f07a80b53f0 0x7f07a80b78b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f07c4108440 tx=0x7f07b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:40.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.321+0000 7f07bbe00640 1 -- 172.21.15.103:0/3576079809 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f07b40cc310 con 0x7f07c4104fa0 2024-09-11T01:07:40.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.541+0000 7f07ca800640 1 -- 172.21.15.103:0/3576079809 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07a40055b0 con 0x7f07c4104fa0 2024-09-11T01:07:40.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.542+0000 7f07bbe00640 1 -- 172.21.15.103:0/3576079809 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11930 (secure 0 0 0) 0x7f07b40d0d40 con 0x7f07c4104fa0 2024-09-11T01:07:40.544 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:07:40.544 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-09-11T01:06:22:641923+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:06:22.629934+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24619,24629,24665]},"id":1}]} 2024-09-11T01:07:40.544 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-09-11T01:07:40.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.545+0000 7f07ca800640 1 -- 172.21.15.103:0/3576079809 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f07a80b53f0 msgr2=0x7f07a80b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:40.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.545+0000 7f07ca800640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f07a80b53f0 0x7f07a80b78b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f07c4108440 tx=0x7f07b0005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:40.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.545+0000 7f07ca800640 1 -- 172.21.15.103:0/3576079809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07c4104fa0 msgr2=0x7f07c419b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:40.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.545+0000 7f07ca800640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07c4104fa0 0x7f07c419b550 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f07b4006010 tx=0x7f07b4004060 comp rx=0 tx=0).stop 2024-09-11T01:07:40.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.545+0000 7f07ca800640 1 -- 172.21.15.103:0/3576079809 shutdown_connections 2024-09-11T01:07:40.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.545+0000 7f07ca800640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f07a80b53f0 0x7f07a80b78b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:40.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.545+0000 7f07ca800640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f07c410b330 0x7f07c41a0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:40.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.545+0000 7f07ca800640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f07c410a9b0 0x7f07c419ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:40.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.545+0000 7f07ca800640 1 --2- 172.21.15.103:0/3576079809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f07c4104fa0 0x7f07c419b550 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:40.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.545+0000 7f07ca800640 1 -- 172.21.15.103:0/3576079809 >> 172.21.15.103:0/3576079809 conn(0x7f07c4100a50 msgr2=0x7f07c4102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:40.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.545+0000 7f07ca800640 1 -- 172.21.15.103:0/3576079809 shutdown_connections 2024-09-11T01:07:40.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:40.545+0000 7f07ca800640 1 -- 172.21.15.103:0/3576079809 wait complete. 2024-09-11T01:07:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:40 smithi103 ceph-mon[30562]: pgmap v379: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:40 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3576079809' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:07:40.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:40 smithi117 ceph-mon[35358]: pgmap v379: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:40.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:40 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3576079809' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:07:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:40 smithi183 ceph-mon[34992]: pgmap v379: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:07:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:40 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3576079809' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:07:41.330 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T01:05:32.767364+0000', 'modified': '2024-09-11T01:06:22.629934+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24665, 'mds_1': 24629, 'mds_2': 24619}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24595': {'gid': 24595, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.183:6835/2084396200', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6834', 'nonce': 2084396200}, {'type': 'v1', 'addr': '172.21.15.183:6835', 'nonce': 2084396200}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24602': {'gid': 24602, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6835/3506900188', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 3506900188}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 3506900188}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24607': {'gid': 24607, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.183:6837/1863510967', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6836', 'nonce': 1863510967}, {'type': 'v1', 'addr': '172.21.15.183:6837', 'nonce': 1863510967}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24619': {'gid': 24619, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.183:6839/1006805616', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6838', 'nonce': 1006805616}, {'type': 'v1', 'addr': '172.21.15.183:6839', 'nonce': 1006805616}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24629': {'gid': 24629, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.117:6837/294794871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6836', 'nonce': 294794871}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 294794871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24665': {'gid': 24665, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.117:6839/1820809235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6838', 'nonce': 1820809235}, {'type': 'v1', 'addr': '172.21.15.117:6839', 'nonce': 1820809235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24665, 'qdb_cluster': [24619, 24629, 24665]} 2024-09-11T01:07:41.331 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-11T01:07:41.331 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T01:07:41.702 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:42.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.330+0000 7fcb51000640 1 -- 172.21.15.103:0/2054152915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb4c1087d0 msgr2=0x7fcb4c108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:42.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.330+0000 7fcb51000640 1 --2- 172.21.15.103:0/2054152915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb4c1087d0 0x7fcb4c108c10 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009900 tx=0x7fcb3802a410 comp rx=0 tx=0).stop 2024-09-11T01:07:42.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.330+0000 7fcb51000640 1 -- 172.21.15.103:0/2054152915 shutdown_connections 2024-09-11T01:07:42.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.330+0000 7fcb51000640 1 --2- 172.21.15.103:0/2054152915 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb4c109150 0x7fcb4c10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.330+0000 7fcb51000640 1 --2- 172.21.15.103:0/2054152915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb4c1087d0 0x7fcb4c108c10 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.330+0000 7fcb51000640 1 --2- 172.21.15.103:0/2054152915 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb4c102dc0 0x7fcb4c1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.330+0000 7fcb51000640 1 -- 172.21.15.103:0/2054152915 >> 172.21.15.103:0/2054152915 conn(0x7fcb4c0fe830 msgr2=0x7fcb4c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.330+0000 7fcb51000640 1 -- 172.21.15.103:0/2054152915 shutdown_connections 2024-09-11T01:07:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.330+0000 7fcb51000640 1 -- 172.21.15.103:0/2054152915 wait complete. 2024-09-11T01:07:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.331+0000 7fcb51000640 1 Processor -- start 2024-09-11T01:07:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.331+0000 7fcb51000640 1 -- start start 2024-09-11T01:07:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.331+0000 7fcb51000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb4c102dc0 0x7fcb4c19b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.331+0000 7fcb51000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb4c1087d0 0x7fcb4c19ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.331+0000 7fcb51000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb4c109150 0x7fcb4c1a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.331+0000 7fcb51000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c112dd0 con 0x7fcb4c1087d0 2024-09-11T01:07:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.331+0000 7fcb51000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c112c50 con 0x7fcb4c109150 2024-09-11T01:07:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.331+0000 7fcb51000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c112f50 con 0x7fcb4c102dc0 2024-09-11T01:07:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.332+0000 7fcb49400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb4c1087d0 0x7fcb4c19ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.332+0000 7fcb49400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb4c1087d0 0x7fcb4c19ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56620/0 (socket says 172.21.15.103:56620) 2024-09-11T01:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.332+0000 7fcb49400640 1 -- 172.21.15.103:0/1428572828 learned_addr learned my addr 172.21.15.103:0/1428572828 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.332+0000 7fcb4a800640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb4c109150 0x7fcb4c1a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.332+0000 7fcb49e00640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb4c102dc0 0x7fcb4c19b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.332+0000 7fcb49400640 1 -- 172.21.15.103:0/1428572828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb4c102dc0 msgr2=0x7fcb4c19b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.332+0000 7fcb49400640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb4c102dc0 0x7fcb4c19b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.332+0000 7fcb49400640 1 -- 172.21.15.103:0/1428572828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb4c109150 msgr2=0x7fcb4c1a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.332+0000 7fcb49400640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb4c109150 0x7fcb4c1a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.332+0000 7fcb49400640 1 -- 172.21.15.103:0/1428572828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c1a15f0 con 0x7fcb4c1087d0 2024-09-11T01:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.332+0000 7fcb4a800640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb4c109150 0x7fcb4c1a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.332+0000 7fcb49400640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb4c1087d0 0x7fcb4c19ba80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcb38005940 tx=0x7fcb380040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.333+0000 7fcb42a00640 1 -- 172.21.15.103:0/1428572828 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3803f030 con 0x7fcb4c1087d0 2024-09-11T01:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.333+0000 7fcb42a00640 1 -- 172.21.15.103:0/1428572828 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb380044c0 con 0x7fcb4c1087d0 2024-09-11T01:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.333+0000 7fcb42a00640 1 -- 172.21.15.103:0/1428572828 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38035070 con 0x7fcb4c1087d0 2024-09-11T01:07:42.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.333+0000 7fcb51000640 1 -- 172.21.15.103:0/1428572828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4c1a1880 con 0x7fcb4c1087d0 2024-09-11T01:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.333+0000 7fcb51000640 1 -- 172.21.15.103:0/1428572828 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4c1a7fa0 con 0x7fcb4c1087d0 2024-09-11T01:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.337+0000 7fcb53a01740 1 Processor -- start 2024-09-11T01:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.337+0000 7fcb53a01740 1 -- start start 2024-09-11T01:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.338+0000 7fcb53a01740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0240 0x55b6506e0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.338+0000 7fcb53a01740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506e0b60 0x55b6506ec5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.338+0000 7fcb53a01740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506ecaf0 0x55b6506eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.338+0000 7fcb42a00640 1 -- 172.21.15.103:0/1428572828 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 153302+0+0 (secure 0 0 0) 0x7fcb3803b9f0 con 0x7fcb4c1087d0 2024-09-11T01:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.338+0000 7fcb53a01740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b650657d50 con 0x55b6506ecaf0 2024-09-11T01:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.338+0000 7fcb53a01740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b650647180 con 0x55b6506e0b60 2024-09-11T01:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.338+0000 7fcb53a01740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b65064af90 con 0x55b6506e0240 2024-09-11T01:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.338+0000 7fcb49400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506ecaf0 0x55b6506eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.338+0000 7fcb49e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506e0b60 0x55b6506ec5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.338+0000 7fcb4a800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0240 0x55b6506e0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.338+0000 7fcb49400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506ecaf0 0x55b6506eeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56622/0 (socket says 172.21.15.103:56622) 2024-09-11T01:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.338+0000 7fcb49400640 1 -- 172.21.15.103:0/891125318 learned_addr learned my addr 172.21.15.103:0/891125318 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.338+0000 7fcb49400640 1 -- 172.21.15.103:0/891125318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0240 msgr2=0x55b6506e0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.338+0000 7fcb49400640 1 --2- 172.21.15.103:0/891125318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0240 0x55b6506e0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.339+0000 7fcb49400640 1 -- 172.21.15.103:0/891125318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506e0b60 msgr2=0x55b6506ec5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.339+0000 7fcb49400640 1 --2- 172.21.15.103:0/891125318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506e0b60 0x55b6506ec5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.339+0000 7fcb49400640 1 -- 172.21.15.103:0/891125318 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b650611a70 con 0x55b6506ecaf0 2024-09-11T01:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.339+0000 7fcb49e00640 1 --2- 172.21.15.103:0/891125318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506e0b60 0x55b6506ec5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.339+0000 7fcb49400640 1 --2- 172.21.15.103:0/891125318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506ecaf0 0x55b6506eeee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcb3810cc20 tx=0x7fcb3810cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9b2bde0c4e9d59 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.339+0000 7fcb37400640 1 -- 172.21.15.103:0/891125318 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38115070 con 0x55b6506ecaf0 2024-09-11T01:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.339+0000 7fcb37400640 1 -- 172.21.15.103:0/891125318 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb38108580 con 0x55b6506ecaf0 2024-09-11T01:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.339+0000 7fcb37400640 1 -- 172.21.15.103:0/891125318 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3810eb10 con 0x55b6506ecaf0 2024-09-11T01:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.340+0000 7fcb53a01740 1 -- 172.21.15.103:0/891125318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506ecaf0 msgr2=0x55b6506eeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.340+0000 7fcb53a01740 1 --2- 172.21.15.103:0/891125318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506ecaf0 0x55b6506eeee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcb3810cc20 tx=0x7fcb3810cd10 comp rx=0 tx=0).stop 2024-09-11T01:07:42.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.340+0000 7fcb42a00640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcb300b53f0 0x7fcb300b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.340+0000 7fcb53a01740 1 -- 172.21.15.103:0/891125318 shutdown_connections 2024-09-11T01:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.340+0000 7fcb53a01740 1 --2- 172.21.15.103:0/891125318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506ecaf0 0x55b6506eeee0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.340+0000 7fcb53a01740 1 --2- 172.21.15.103:0/891125318 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506e0b60 0x55b6506ec5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.340+0000 7fcb53a01740 1 --2- 172.21.15.103:0/891125318 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0240 0x55b6506e0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.340+0000 7fcb53a01740 1 -- 172.21.15.103:0/891125318 >> 172.21.15.103:0/891125318 conn(0x55b6506de020 msgr2=0x55b6506df210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.340+0000 7fcb42a00640 1 -- 172.21.15.103:0/1428572828 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fcb381066c0 con 0x7fcb4c1087d0 2024-09-11T01:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.340+0000 7fcb53a01740 1 -- 172.21.15.103:0/891125318 shutdown_connections 2024-09-11T01:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.341+0000 7fcb4a800640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcb300b53f0 0x7fcb300b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.341+0000 7fcb53a01740 1 -- 172.21.15.103:0/891125318 wait complete. 2024-09-11T01:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.341+0000 7fcb53a01740 1 -- start start 2024-09-11T01:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.341+0000 7fcb4a800640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcb300b53f0 0x7fcb300b78b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009fd0 tx=0x7fcb44009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.341+0000 7fcb53a01740 1 Processor -- start 2024-09-11T01:07:42.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.342+0000 7fcb53a01740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0240 0x55b6506e9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.342+0000 7fcb53a01740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0b60 0x55b6506e9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.342+0000 7fcb53a01740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506ecaf0 0x55b6506ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.342+0000 7fcb53a01740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b6504a85f0 con 0x55b6506e0b60 2024-09-11T01:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.342+0000 7fcb53a01740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b6505e2460 con 0x55b6506ecaf0 2024-09-11T01:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.342+0000 7fcb53a01740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b6506ef560 con 0x55b6506e0240 2024-09-11T01:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.342+0000 7fcb53a01740 10 client.0 _ll_register_callbacks cb 0x55b6505f2210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.342+0000 7fcb49400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0b60 0x55b6506e9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.342+0000 7fcb4a800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506ecaf0 0x55b6506ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.342+0000 7fcb49400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0b60 0x55b6506e9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56634/0 (socket says 172.21.15.103:56634) 2024-09-11T01:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.342+0000 7fcb49400640 1 -- 172.21.15.103:0/575388439 learned_addr learned my addr 172.21.15.103:0/575388439 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.342+0000 7fcb49e00640 1 --2- 172.21.15.103:0/575388439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0240 0x55b6506e9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.343+0000 7fcb49400640 1 -- 172.21.15.103:0/575388439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0240 msgr2=0x55b6506e9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.343+0000 7fcb49400640 1 --2- 172.21.15.103:0/575388439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0240 0x55b6506e9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.343+0000 7fcb49400640 1 -- 172.21.15.103:0/575388439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506ecaf0 msgr2=0x55b6506ea4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.343+0000 7fcb49400640 1 --2- 172.21.15.103:0/575388439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506ecaf0 0x55b6506ea4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.343+0000 7fcb49400640 1 -- 172.21.15.103:0/575388439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6503a5540 con 0x55b6506e0b60 2024-09-11T01:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.343+0000 7fcb49400640 1 --2- 172.21.15.103:0/575388439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0b60 0x55b6506e9f80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcb380c8f90 tx=0x7fcb3803b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e1bd4f1f21dab0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.343+0000 7fcb2be00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.343+0000 7fcb2be00640 1 -- 172.21.15.103:0/575388439 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38049070 con 0x55b6506e0b60 2024-09-11T01:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.343+0000 7fcb2be00640 1 -- 172.21.15.103:0/575388439 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fcb38106370 con 0x55b6506e0b60 2024-09-11T01:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.343+0000 7fcb53a01740 1 -- 172.21.15.103:0/575388439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b6505e4a70 con 0x55b6506e0b60 2024-09-11T01:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.343+0000 7fcb2be00640 1 -- 172.21.15.103:0/575388439 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcb38115070 con 0x55b6506e0b60 2024-09-11T01:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.343+0000 7fcb53a01740 10 client.15099 fetch_fsmap learned FSMap version 25 2024-09-11T01:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.343+0000 7fcb53a01740 1 -- 172.21.15.103:0/575388439 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b6505ff6f0 con 0x55b6506e0b60 2024-09-11T01:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.344+0000 7fcb2be00640 1 -- 172.21.15.103:0/575388439 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55b6505e4a70 con 0x55b6506e0b60 2024-09-11T01:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.344+0000 7fcb2be00640 1 -- 172.21.15.103:0/575388439 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fcb380ef040 con 0x55b6506e0b60 2024-09-11T01:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.344+0000 7fcb53a01740 10 client.15099 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T01:07:42.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.344+0000 7fcb53a01740 10 client.15099 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T01:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.344+0000 7fcb53a01740 20 client.15099 populate_metadata read hostname 'smithi103' 2024-09-11T01:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.344+0000 7fcb53a01740 1 --2- 172.21.15.103:0/575388439 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x55b6506fd300 0x55b6506fe770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.344+0000 7fcb53a01740 4 client.15099 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.344+0000 7fcb53a01740 1 -- 172.21.15.103:0/575388439 --> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b650659ca0 con 0x55b6506fd300 2024-09-11T01:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.345+0000 7fcb49e00640 1 --2- 172.21.15.103:0/575388439 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x55b6506fd300 0x55b6506fe770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.345+0000 7fcb49e00640 1 --2- 172.21.15.103:0/575388439 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x55b6506fd300 0x55b6506fe770 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=40b34267eecd7161 server_cookie=c72974524884f27b in_seq=0 out_seq=0 2024-09-11T01:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.345+0000 7fcb2be00640 10 client.15099 ms_handle_connect on v2:172.21.15.183:6838/1006805616 2024-09-11T01:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb2be00640 1 -- 172.21.15.103:0/575388439 <== mds.2 v2:172.21.15.183:6838/1006805616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b650659ca0 con 0x55b6506fd300 2024-09-11T01:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb2be00640 10 client.15099 handle_command_reply: tid=0 2024-09-11T01:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb53a01740 1 client.15099 shutdown 2024-09-11T01:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb53a01740 1 -- 172.21.15.103:0/575388439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0b60 msgr2=0x55b6506e9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb53a01740 1 --2- 172.21.15.103:0/575388439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0b60 0x55b6506e9f80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcb380c8f90 tx=0x7fcb3803b460 comp rx=0 tx=0).stop 2024-09-11T01:07:42.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb53a01740 1 -- 172.21.15.103:0/575388439 shutdown_connections 2024-09-11T01:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb53a01740 1 --2- 172.21.15.103:0/575388439 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x55b6506fd300 0x55b6506fe770 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb53a01740 1 --2- 172.21.15.103:0/575388439 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506ecaf0 0x55b6506ea4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb53a01740 1 --2- 172.21.15.103:0/575388439 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0b60 0x55b6506e9f80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb53a01740 1 --2- 172.21.15.103:0/575388439 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0240 0x55b6506e9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb2be00640 0 client.15099 ms_handle_reset on v2:172.21.15.183:6838/1006805616 2024-09-11T01:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb53a01740 1 -- 172.21.15.103:0/575388439 >> 172.21.15.103:0/575388439 conn(0x55b6506de020 msgr2=0x55b6506e3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb53a01740 1 -- 172.21.15.103:0/575388439 shutdown_connections 2024-09-11T01:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb53a01740 1 -- 172.21.15.103:0/575388439 wait complete. 2024-09-11T01:07:42.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.346+0000 7fcb53a01740 20 client.15099 trim_cache size 0 max 16384 2024-09-11T01:07:42.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.366+0000 7fcb53a01740 1 Processor -- start 2024-09-11T01:07:42.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb53a01740 1 -- start start 2024-09-11T01:07:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb53a01740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0240 0x55b6506fc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb53a01740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0b60 0x55b6506e82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb53a01740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506ecaf0 0x55b6506e8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb53a01740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b6506fcab0 con 0x55b6506e0240 2024-09-11T01:07:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb53a01740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b6506fd180 con 0x55b6506ecaf0 2024-09-11T01:07:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb53a01740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b6506fd850 con 0x55b6506e0b60 2024-09-11T01:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb49400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0b60 0x55b6506e82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb49e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0240 0x55b6506fc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb49400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0b60 0x55b6506e82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:39418/0 (socket says 172.21.15.103:39418) 2024-09-11T01:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb49400640 1 -- 172.21.15.103:0/701543360 learned_addr learned my addr 172.21.15.103:0/701543360 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb4a800640 1 --2- 172.21.15.103:0/701543360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506ecaf0 0x55b6506e8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb49400640 1 -- 172.21.15.103:0/701543360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506ecaf0 msgr2=0x55b6506e8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb49400640 1 --2- 172.21.15.103:0/701543360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506ecaf0 0x55b6506e8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.367+0000 7fcb49400640 1 -- 172.21.15.103:0/701543360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0240 msgr2=0x55b6506fc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.368+0000 7fcb49400640 1 --2- 172.21.15.103:0/701543360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0240 0x55b6506fc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.368+0000 7fcb49400640 1 -- 172.21.15.103:0/701543360 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6506e7f40 con 0x55b6506e0b60 2024-09-11T01:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.368+0000 7fcb4a800640 1 --2- 172.21.15.103:0/701543360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506ecaf0 0x55b6506e8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:07:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.368+0000 7fcb49400640 1 --2- 172.21.15.103:0/701543360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0b60 0x55b6506e82c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcb380c8920 tx=0x7fcb3803b4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d88c24e24f6c68d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:42.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.368+0000 7fcb36a00640 1 -- 172.21.15.103:0/701543360 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb38049030 con 0x55b6506e0b60 2024-09-11T01:07:42.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.368+0000 7fcb36a00640 1 -- 172.21.15.103:0/701543360 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb380cc4d0 con 0x55b6506e0b60 2024-09-11T01:07:42.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.368+0000 7fcb36a00640 1 -- 172.21.15.103:0/701543360 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb380cc9c0 con 0x55b6506e0b60 2024-09-11T01:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.369+0000 7fcb53a01740 1 -- 172.21.15.103:0/701543360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0b60 msgr2=0x55b6506e82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.369+0000 7fcb53a01740 1 --2- 172.21.15.103:0/701543360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0b60 0x55b6506e82c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcb380c8920 tx=0x7fcb3803b4d0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.369+0000 7fcb53a01740 1 -- 172.21.15.103:0/701543360 shutdown_connections 2024-09-11T01:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.369+0000 7fcb53a01740 1 --2- 172.21.15.103:0/701543360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506ecaf0 0x55b6506e8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.369+0000 7fcb53a01740 1 --2- 172.21.15.103:0/701543360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506e0b60 0x55b6506e82c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.369+0000 7fcb53a01740 1 --2- 172.21.15.103:0/701543360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0240 0x55b6506fc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.369+0000 7fcb53a01740 1 -- 172.21.15.103:0/701543360 >> 172.21.15.103:0/701543360 conn(0x55b6506de020 msgr2=0x55b6506df0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.369+0000 7fcb53a01740 1 -- 172.21.15.103:0/701543360 shutdown_connections 2024-09-11T01:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.369+0000 7fcb53a01740 1 -- 172.21.15.103:0/701543360 wait complete. 2024-09-11T01:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.369+0000 7fcb53a01740 1 -- start start 2024-09-11T01:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.370+0000 7fcb53a01740 1 Processor -- start 2024-09-11T01:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.370+0000 7fcb53a01740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0240 0x55b650701270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.370+0000 7fcb53a01740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506e0b60 0x55b6507017b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.370+0000 7fcb53a01740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506ecaf0 0x55b6507066e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.370+0000 7fcb53a01740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b6506fe5f0 con 0x55b6506e0240 2024-09-11T01:07:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.370+0000 7fcb53a01740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b6506fdf20 con 0x55b6506e0b60 2024-09-11T01:07:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.370+0000 7fcb53a01740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b6506fecc0 con 0x55b6506ecaf0 2024-09-11T01:07:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.370+0000 7fcb53a01740 10 client.0 _ll_register_callbacks cb 0x7fcb3810ca70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:07:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.370+0000 7fcb49e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0240 0x55b650701270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.370+0000 7fcb49e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0240 0x55b650701270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56650/0 (socket says 172.21.15.103:56650) 2024-09-11T01:07:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.370+0000 7fcb49e00640 1 -- 172.21.15.103:0/2121953665 learned_addr learned my addr 172.21.15.103:0/2121953665 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.370+0000 7fcb4a800640 1 --2- 172.21.15.103:0/2121953665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506ecaf0 0x55b6507066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.371+0000 7fcb49400640 1 --2- 172.21.15.103:0/2121953665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506e0b60 0x55b6507017b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.371+0000 7fcb49e00640 1 -- 172.21.15.103:0/2121953665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506ecaf0 msgr2=0x55b6507066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.371+0000 7fcb49e00640 1 --2- 172.21.15.103:0/2121953665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506ecaf0 0x55b6507066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.371+0000 7fcb49e00640 1 -- 172.21.15.103:0/2121953665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506e0b60 msgr2=0x55b6507017b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:42.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.371+0000 7fcb49e00640 1 --2- 172.21.15.103:0/2121953665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506e0b60 0x55b6507017b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.371+0000 7fcb49e00640 1 -- 172.21.15.103:0/2121953665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b650706cf0 con 0x55b6506e0240 2024-09-11T01:07:42.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.371+0000 7fcb49e00640 1 --2- 172.21.15.103:0/2121953665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0240 0x55b650701270 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c000c00 tx=0x7fcb3c010b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f339cedae39eaed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:42.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.371+0000 7fcb2be00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:07:42.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.371+0000 7fcb2be00640 1 -- 172.21.15.103:0/2121953665 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c005220 con 0x55b6506e0240 2024-09-11T01:07:42.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.371+0000 7fcb53a01740 1 -- 172.21.15.103:0/2121953665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb380cc4d0 con 0x55b6506e0240 2024-09-11T01:07:42.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.371+0000 7fcb2be00640 1 -- 172.21.15.103:0/2121953665 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fcb3c0053c0 con 0x55b6506e0240 2024-09-11T01:07:42.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.372+0000 7fcb2be00640 1 -- 172.21.15.103:0/2121953665 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fcb3c0055c0 con 0x55b6506e0240 2024-09-11T01:07:42.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.372+0000 7fcb53a01740 10 client.15105 fetch_fsmap learned FSMap version 25 2024-09-11T01:07:42.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.372+0000 7fcb53a01740 1 -- 172.21.15.103:0/2121953665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55b650772d20 con 0x55b6506e0240 2024-09-11T01:07:42.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.372+0000 7fcb2be00640 1 -- 172.21.15.103:0/2121953665 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb380cc4d0 con 0x55b6506e0240 2024-09-11T01:07:42.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.372+0000 7fcb2be00640 1 -- 172.21.15.103:0/2121953665 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fcb3c004bf0 con 0x55b6506e0240 2024-09-11T01:07:42.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.372+0000 7fcb53a01740 10 client.15105 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.372+0000 7fcb53a01740 10 client.15105 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.372+0000 7fcb53a01740 20 client.15105 populate_metadata read hostname 'smithi103' 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.372+0000 7fcb53a01740 1 --2- 172.21.15.103:0/2121953665 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x55b6507778a0 0x55b6507765b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.372+0000 7fcb53a01740 4 client.15105 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.372+0000 7fcb53a01740 1 -- 172.21.15.103:0/2121953665 --> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] -- command(tid 0: {"prefix": "status"}) -- 0x55b650655750 con 0x55b6507778a0 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.373+0000 7fcb49400640 1 --2- 172.21.15.103:0/2121953665 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x55b6507778a0 0x55b6507765b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.373+0000 7fcb49400640 1 --2- 172.21.15.103:0/2121953665 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x55b6507778a0 0x55b6507765b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3572b23f248a98e server_cookie=ccfbf330ae498045 in_seq=0 out_seq=0 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.373+0000 7fcb2be00640 10 client.15105 ms_handle_connect on v2:172.21.15.183:6838/1006805616 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.373+0000 7fcb2be00640 1 -- 172.21.15.103:0/2121953665 <== mds.2 v2:172.21.15.183:6838/1006805616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55b650655750 con 0x55b6507778a0 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.373+0000 7fcb2be00640 10 client.15105 handle_command_reply: tid=0 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.373+0000 7fcb53a01740 1 client.15105 shutdown 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.373+0000 7fcb53a01740 1 -- 172.21.15.103:0/2121953665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0240 msgr2=0x55b650701270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.373+0000 7fcb53a01740 1 --2- 172.21.15.103:0/2121953665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0240 0x55b650701270 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c000c00 tx=0x7fcb3c010b10 comp rx=0 tx=0).stop 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.373+0000 7fcb53a01740 1 -- 172.21.15.103:0/2121953665 shutdown_connections 2024-09-11T01:07:42.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.373+0000 7fcb53a01740 1 --2- 172.21.15.103:0/2121953665 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x55b6507778a0 0x55b6507765b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.373+0000 7fcb53a01740 1 --2- 172.21.15.103:0/2121953665 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b6506ecaf0 0x55b6507066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.373+0000 7fcb53a01740 1 --2- 172.21.15.103:0/2121953665 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b6506e0b60 0x55b6507017b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.373+0000 7fcb53a01740 1 --2- 172.21.15.103:0/2121953665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6506e0240 0x55b650701270 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.373+0000 7fcb53a01740 1 -- 172.21.15.103:0/2121953665 >> 172.21.15.103:0/2121953665 conn(0x55b6506de020 msgr2=0x55b6506f7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:42.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.374+0000 7fcb2be00640 0 client.15105 ms_handle_reset on v2:172.21.15.183:6838/1006805616 2024-09-11T01:07:42.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.374+0000 7fcb53a01740 1 -- 172.21.15.103:0/2121953665 shutdown_connections 2024-09-11T01:07:42.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.374+0000 7fcb53a01740 1 -- 172.21.15.103:0/2121953665 wait complete. 2024-09-11T01:07:42.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.374+0000 7fcb53a01740 20 client.15105 trim_cache size 0 max 16384 2024-09-11T01:07:42.379 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:07:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "917288bc-6fd8-11ef-bcea-c7b262605968", 2024-09-11T01:07:42.379 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-09-11T01:07:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24619, 2024-09-11T01:07:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-11T01:07:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-11T01:07:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-11T01:07:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 82.737509235000005, 2024-09-11T01:07:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 25, 2024-09-11T01:07:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-09-11T01:07:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 87, 2024-09-11T01:07:42.380 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 152.22271398300001 2024-09-11T01:07:42.380 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:07:42.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.374+0000 7fcb51000640 1 -- 172.21.15.103:0/1428572828 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcb300b53f0 msgr2=0x7fcb300b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:42.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.374+0000 7fcb51000640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcb300b53f0 0x7fcb300b78b0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009fd0 tx=0x7fcb44009500 comp rx=0 tx=0).stop 2024-09-11T01:07:42.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.374+0000 7fcb51000640 1 -- 172.21.15.103:0/1428572828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb4c1087d0 msgr2=0x7fcb4c19ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:42.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.374+0000 7fcb51000640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb4c1087d0 0x7fcb4c19ba80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fcb38005940 tx=0x7fcb380040c0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.375+0000 7fcb51000640 1 -- 172.21.15.103:0/1428572828 shutdown_connections 2024-09-11T01:07:42.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.375+0000 7fcb51000640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcb300b53f0 0x7fcb300b78b0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.375+0000 7fcb51000640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb4c109150 0x7fcb4c1a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.375+0000 7fcb51000640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcb4c1087d0 0x7fcb4c19ba80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.375+0000 7fcb51000640 1 --2- 172.21.15.103:0/1428572828 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcb4c102dc0 0x7fcb4c19b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:42.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.375+0000 7fcb51000640 1 -- 172.21.15.103:0/1428572828 >> 172.21.15.103:0/1428572828 conn(0x7fcb4c0fe830 msgr2=0x7fcb4c105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:42.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.375+0000 7fcb51000640 1 -- 172.21.15.103:0/1428572828 shutdown_connections 2024-09-11T01:07:42.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:42.375+0000 7fcb51000640 1 -- 172.21.15.103:0/1428572828 wait complete. 2024-09-11T01:07:42.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:42 smithi117 ceph-mon[35358]: pgmap v380: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:42.889 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:42 smithi103 ceph-mon[30562]: pgmap v380: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:42.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:42 smithi183 ceph-mon[34992]: pgmap v380: 129 pgs: 129 active+clean; 644 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:07:43.197 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-11T01:07:43.581 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:43.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:43 smithi117 ceph-mon[35358]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-11T01:07:43.913 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:43 smithi103 ceph-mon[30562]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-11T01:07:43.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:43 smithi183 ceph-mon[34992]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-09-11T01:07:44.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.165+0000 7fe6cb000640 1 -- 172.21.15.103:0/653102312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6c4108610 msgr2=0x7fe6c4108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:44.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.165+0000 7fe6cb000640 1 --2- 172.21.15.103:0/653102312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6c4108610 0x7fe6c4108a50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0009900 tx=0x7fe6b002a410 comp rx=0 tx=0).stop 2024-09-11T01:07:44.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.165+0000 7fe6cb000640 1 -- 172.21.15.103:0/653102312 shutdown_connections 2024-09-11T01:07:44.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.165+0000 7fe6cb000640 1 --2- 172.21.15.103:0/653102312 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6c4108f90 0x7fe6c410f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.165+0000 7fe6cb000640 1 --2- 172.21.15.103:0/653102312 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6c4108610 0x7fe6c4108a50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.165+0000 7fe6cb000640 1 --2- 172.21.15.103:0/653102312 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6c4102c00 0x7fe6c4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.165+0000 7fe6cb000640 1 -- 172.21.15.103:0/653102312 >> 172.21.15.103:0/653102312 conn(0x7fe6c40fe6d0 msgr2=0x7fe6c4100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:44.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.165+0000 7fe6cb000640 1 -- 172.21.15.103:0/653102312 shutdown_connections 2024-09-11T01:07:44.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.165+0000 7fe6cb000640 1 -- 172.21.15.103:0/653102312 wait complete. 2024-09-11T01:07:44.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.167+0000 7fe6cb000640 1 Processor -- start 2024-09-11T01:07:44.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.167+0000 7fe6cb000640 1 -- start start 2024-09-11T01:07:44.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.167+0000 7fe6cb000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6c4102c00 0x7fe6c419b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.167+0000 7fe6cb000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6c4108610 0x7fe6c419b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.167+0000 7fe6cb000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6c4108f90 0x7fe6c41a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.167+0000 7fe6cb000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c4112be0 con 0x7fe6c4108610 2024-09-11T01:07:44.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.167+0000 7fe6cb000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c4112a60 con 0x7fe6c4102c00 2024-09-11T01:07:44.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.167+0000 7fe6cb000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c4112d60 con 0x7fe6c4108f90 2024-09-11T01:07:44.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.168+0000 7fe6c9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6c4108610 0x7fe6c419b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.168+0000 7fe6c9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6c4108610 0x7fe6c419b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56660/0 (socket says 172.21.15.103:56660) 2024-09-11T01:07:44.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.168+0000 7fe6c9200640 1 -- 172.21.15.103:0/2261298765 learned_addr learned my addr 172.21.15.103:0/2261298765 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:44.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.168+0000 7fe6c9c00640 1 --2- 172.21.15.103:0/2261298765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6c4102c00 0x7fe6c419b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.168+0000 7fe6ca600640 1 --2- 172.21.15.103:0/2261298765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6c4108f90 0x7fe6c41a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.168+0000 7fe6c9c00640 1 -- 172.21.15.103:0/2261298765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6c4108f90 msgr2=0x7fe6c41a0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:44.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.168+0000 7fe6c9c00640 1 --2- 172.21.15.103:0/2261298765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6c4108f90 0x7fe6c41a0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.168+0000 7fe6c9c00640 1 -- 172.21.15.103:0/2261298765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6c4108610 msgr2=0x7fe6c419b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:44.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.168+0000 7fe6c9c00640 1 --2- 172.21.15.103:0/2261298765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6c4108610 0x7fe6c419b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.168+0000 7fe6c9c00640 1 -- 172.21.15.103:0/2261298765 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c41a1310 con 0x7fe6c4102c00 2024-09-11T01:07:44.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.169+0000 7fe6c9c00640 1 --2- 172.21.15.103:0/2261298765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6c4102c00 0x7fe6c419b260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800e9f0 tx=0x7fe6b800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:44.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.169+0000 7fe6c2000640 1 -- 172.21.15.103:0/2261298765 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b800ccc0 con 0x7fe6c4102c00 2024-09-11T01:07:44.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.169+0000 7fe6cb000640 1 -- 172.21.15.103:0/2261298765 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c41a1600 con 0x7fe6c4102c00 2024-09-11T01:07:44.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.169+0000 7fe6c2000640 1 -- 172.21.15.103:0/2261298765 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6b80108e0 con 0x7fe6c4102c00 2024-09-11T01:07:44.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.169+0000 7fe6c2000640 1 -- 172.21.15.103:0/2261298765 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8018880 con 0x7fe6c4102c00 2024-09-11T01:07:44.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.169+0000 7fe6cb000640 1 -- 172.21.15.103:0/2261298765 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c41a7e90 con 0x7fe6c4102c00 2024-09-11T01:07:44.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.173+0000 7fe6ced22740 1 Processor -- start 2024-09-11T01:07:44.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.173+0000 7fe6c2000640 1 -- 172.21.15.103:0/2261298765 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7fe6b8010430 con 0x7fe6c4102c00 2024-09-11T01:07:44.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.173+0000 7fe6ced22740 1 -- start start 2024-09-11T01:07:44.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.173+0000 7fe6ced22740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d5802597e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.173+0000 7fe6ced22740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580259d20 0x55d580265770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.173+0000 7fe6ced22740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580265cb0 0x55d5802680a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.173+0000 7fe6ced22740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d5801d0d50 con 0x55d580265cb0 2024-09-11T01:07:44.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.173+0000 7fe6ced22740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d5801c0180 con 0x55d580259400 2024-09-11T01:07:44.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.173+0000 7fe6ced22740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d5801c3f90 con 0x55d580259d20 2024-09-11T01:07:44.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.174+0000 7fe6ca600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d5802597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.174+0000 7fe6ca600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d5802597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:40236/0 (socket says 172.21.15.103:40236) 2024-09-11T01:07:44.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.174+0000 7fe6ca600640 1 -- 172.21.15.103:0/4051925073 learned_addr learned my addr 172.21.15.103:0/4051925073 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:44.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.174+0000 7fe6c9200640 1 --2- 172.21.15.103:0/4051925073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580265cb0 0x55d5802680a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.174+0000 7fe6c9c00640 1 --2- 172.21.15.103:0/4051925073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580259d20 0x55d580265770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.174+0000 7fe6ca600640 1 -- 172.21.15.103:0/4051925073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580259d20 msgr2=0x55d580265770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:44.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.174+0000 7fe6ca600640 1 --2- 172.21.15.103:0/4051925073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580259d20 0x55d580265770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.174+0000 7fe6ca600640 1 -- 172.21.15.103:0/4051925073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580265cb0 msgr2=0x55d5802680a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:44.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.174+0000 7fe6ca600640 1 --2- 172.21.15.103:0/4051925073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580265cb0 0x55d5802680a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.177 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.174+0000 7fe6ca600640 1 -- 172.21.15.103:0/4051925073 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d58018aa70 con 0x55d580259400 2024-09-11T01:07:44.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.174+0000 7fe6ca600640 1 --2- 172.21.15.103:0/4051925073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d5802597e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009fd0 tx=0x7fe6bc0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a68fb791b07d3c99 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:44.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.175+0000 7fe6b6a00640 1 -- 172.21.15.103:0/4051925073 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc004d20 con 0x55d580259400 2024-09-11T01:07:44.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.175+0000 7fe6b6a00640 1 -- 172.21.15.103:0/4051925073 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6bc004050 con 0x55d580259400 2024-09-11T01:07:44.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.175+0000 7fe6b6a00640 1 -- 172.21.15.103:0/4051925073 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc005280 con 0x55d580259400 2024-09-11T01:07:44.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.175+0000 7fe6c2000640 1 --2- 172.21.15.103:0/2261298765 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe6ac0b5390 0x7fe6ac0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.175+0000 7fe6ced22740 1 -- 172.21.15.103:0/4051925073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 msgr2=0x55d5802597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:44.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.175+0000 7fe6ced22740 1 --2- 172.21.15.103:0/4051925073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d5802597e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009fd0 tx=0x7fe6bc0118d0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.175+0000 7fe6c9c00640 1 --2- 172.21.15.103:0/2261298765 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe6ac0b5390 0x7fe6ac0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.175+0000 7fe6c2000640 1 -- 172.21.15.103:0/2261298765 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fe6b80e62a0 con 0x7fe6c4102c00 2024-09-11T01:07:44.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.175+0000 7fe6ced22740 1 -- 172.21.15.103:0/4051925073 shutdown_connections 2024-09-11T01:07:44.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.175+0000 7fe6ced22740 1 --2- 172.21.15.103:0/4051925073 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580265cb0 0x55d5802680a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.175+0000 7fe6ced22740 1 --2- 172.21.15.103:0/4051925073 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580259d20 0x55d580265770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.175+0000 7fe6ced22740 1 --2- 172.21.15.103:0/4051925073 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d5802597e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.176+0000 7fe6ced22740 1 -- 172.21.15.103:0/4051925073 >> 172.21.15.103:0/4051925073 conn(0x55d580257230 msgr2=0x55d5802583d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:44.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.176+0000 7fe6ced22740 1 -- 172.21.15.103:0/4051925073 shutdown_connections 2024-09-11T01:07:44.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.176+0000 7fe6ced22740 1 -- 172.21.15.103:0/4051925073 wait complete. 2024-09-11T01:07:44.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.176+0000 7fe6c9c00640 1 --2- 172.21.15.103:0/2261298765 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe6ac0b5390 0x7fe6ac0b7850 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80e39f0 tx=0x7fe6b8009700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:44.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.176+0000 7fe6ced22740 1 -- start start 2024-09-11T01:07:44.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.177+0000 7fe6ced22740 1 Processor -- start 2024-09-11T01:07:44.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.177+0000 7fe6ced22740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d580265770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.177+0000 7fe6ced22740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580259d20 0x55d580262c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.177+0000 7fe6ced22740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580265cb0 0x55d580263390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.177+0000 7fe6ced22740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d5800215f0 con 0x55d580259d20 2024-09-11T01:07:44.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.177+0000 7fe6ced22740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d58015b460 con 0x55d580259400 2024-09-11T01:07:44.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.177+0000 7fe6ced22740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d580268a00 con 0x55d580265cb0 2024-09-11T01:07:44.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.177+0000 7fe6ced22740 10 client.0 _ll_register_callbacks cb 0x55d58016b210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:07:44.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.177+0000 7fe6c9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580259d20 0x55d580262c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.177+0000 7fe6ca600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580265cb0 0x55d580263390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.177+0000 7fe6ca600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580265cb0 0x55d580263390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:39470/0 (socket says 172.21.15.103:39470) 2024-09-11T01:07:44.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.178+0000 7fe6ca600640 1 -- 172.21.15.103:0/439403877 learned_addr learned my addr 172.21.15.103:0/439403877 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:44.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.177+0000 7fe6c9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580259d20 0x55d580262c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56672/0 (socket says 172.21.15.103:56672) 2024-09-11T01:07:44.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.178+0000 7fe6ca600640 1 --2- 172.21.15.103:0/439403877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d580265770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.178+0000 7fe6ca600640 1 -- 172.21.15.103:0/439403877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 msgr2=0x55d580265770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:44.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.178+0000 7fe6ca600640 1 --2- 172.21.15.103:0/439403877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d580265770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.178+0000 7fe6ca600640 1 -- 172.21.15.103:0/439403877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580259d20 msgr2=0x55d580262c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:44.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.178+0000 7fe6ca600640 1 --2- 172.21.15.103:0/439403877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580259d20 0x55d580262c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.178+0000 7fe6ca600640 1 -- 172.21.15.103:0/439403877 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d57ff1e540 con 0x55d580265cb0 2024-09-11T01:07:44.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.178+0000 7fe6c9200640 1 --2- 172.21.15.103:0/439403877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580259d20 0x55d580262c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:44.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.178+0000 7fe6ca600640 1 --2- 172.21.15.103:0/439403877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580265cb0 0x55d580263390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc004920 tx=0x7fe6bc009be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e75f0048fe9f2f91 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:44.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.178+0000 7fe6ab400640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:07:44.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.178+0000 7fe6ab400640 1 -- 172.21.15.103:0/439403877 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc02d060 con 0x55d580265cb0 2024-09-11T01:07:44.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.179+0000 7fe6ab400640 1 -- 172.21.15.103:0/439403877 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fe6bc004a40 con 0x55d580265cb0 2024-09-11T01:07:44.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.179+0000 7fe6ced22740 1 -- 172.21.15.103:0/439403877 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d58015da70 con 0x55d580265cb0 2024-09-11T01:07:44.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.179+0000 7fe6ab400640 1 -- 172.21.15.103:0/439403877 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe6bc004510 con 0x55d580265cb0 2024-09-11T01:07:44.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.179+0000 7fe6ced22740 10 client.25105 fetch_fsmap learned FSMap version 25 2024-09-11T01:07:44.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.179+0000 7fe6ced22740 1 -- 172.21.15.103:0/439403877 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d5801786f0 con 0x55d580265cb0 2024-09-11T01:07:44.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.179+0000 7fe6ab400640 1 -- 172.21.15.103:0/439403877 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d58015da70 con 0x55d580265cb0 2024-09-11T01:07:44.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.179+0000 7fe6ab400640 1 -- 172.21.15.103:0/439403877 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe6bc00f4e0 con 0x55d580265cb0 2024-09-11T01:07:44.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.179+0000 7fe6ced22740 10 client.25105 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T01:07:44.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.179+0000 7fe6ced22740 10 client.25105 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T01:07:44.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.179+0000 7fe6ced22740 20 client.25105 populate_metadata read hostname 'smithi103' 2024-09-11T01:07:44.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.180+0000 7fe6ced22740 1 --2- 172.21.15.103:0/439403877 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55d580276710 0x55d580277b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.180+0000 7fe6ced22740 4 client.25105 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:07:44.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.180+0000 7fe6ced22740 1 -- 172.21.15.103:0/439403877 --> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5801d2ca0 con 0x55d580276710 2024-09-11T01:07:44.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.180+0000 7fe6c9200640 1 --2- 172.21.15.103:0/439403877 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55d580276710 0x55d580277b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.181+0000 7fe6c9200640 1 --2- 172.21.15.103:0/439403877 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55d580276710 0x55d580277b80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a029df4a39601ade server_cookie=3b9f9911e77735a9 in_seq=0 out_seq=0 2024-09-11T01:07:44.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.181+0000 7fe6ab400640 10 client.25105 ms_handle_connect on v2:172.21.15.117:6836/294794871 2024-09-11T01:07:44.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ab400640 1 -- 172.21.15.103:0/439403877 <== mds.1 v2:172.21.15.117:6836/294794871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d5801d2ca0 con 0x55d580276710 2024-09-11T01:07:44.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ab400640 10 client.25105 handle_command_reply: tid=0 2024-09-11T01:07:44.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ced22740 1 client.25105 shutdown 2024-09-11T01:07:44.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ced22740 1 -- 172.21.15.103:0/439403877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580265cb0 msgr2=0x55d580263390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:44.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ced22740 1 --2- 172.21.15.103:0/439403877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580265cb0 0x55d580263390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc004920 tx=0x7fe6bc009be0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ced22740 1 -- 172.21.15.103:0/439403877 shutdown_connections 2024-09-11T01:07:44.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ced22740 1 --2- 172.21.15.103:0/439403877 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55d580276710 0x55d580277b80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ced22740 1 --2- 172.21.15.103:0/439403877 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580265cb0 0x55d580263390 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ced22740 1 --2- 172.21.15.103:0/439403877 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580259d20 0x55d580262c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ced22740 1 --2- 172.21.15.103:0/439403877 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d580265770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ced22740 1 -- 172.21.15.103:0/439403877 >> 172.21.15.103:0/439403877 conn(0x55d580257230 msgr2=0x55d58025cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:44.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ab400640 0 client.25105 ms_handle_reset on v2:172.21.15.117:6836/294794871 2024-09-11T01:07:44.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ced22740 1 -- 172.21.15.103:0/439403877 shutdown_connections 2024-09-11T01:07:44.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ced22740 1 -- 172.21.15.103:0/439403877 wait complete. 2024-09-11T01:07:44.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.182+0000 7fe6ced22740 20 client.25105 trim_cache size 0 max 16384 2024-09-11T01:07:44.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.201+0000 7fe6ced22740 1 Processor -- start 2024-09-11T01:07:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.201+0000 7fe6ced22740 1 -- start start 2024-09-11T01:07:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.201+0000 7fe6ced22740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d580276040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.201+0000 7fe6ced22740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580259d20 0x55d5802774b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.201+0000 7fe6ced22740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580265cb0 0x55d580263310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.201+0000 7fe6ced22740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d580275ec0 con 0x55d580259d20 2024-09-11T01:07:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.201+0000 7fe6ced22740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d580276590 con 0x55d580259400 2024-09-11T01:07:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.201+0000 7fe6ced22740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d580276c60 con 0x55d580265cb0 2024-09-11T01:07:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.202+0000 7fe6c9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580259d20 0x55d5802774b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.202+0000 7fe6c9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580259d20 0x55d5802774b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56680/0 (socket says 172.21.15.103:56680) 2024-09-11T01:07:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.202+0000 7fe6c9200640 1 -- 172.21.15.103:0/3313827350 learned_addr learned my addr 172.21.15.103:0/3313827350 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:44.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.202+0000 7fe6ca600640 1 --2- 172.21.15.103:0/3313827350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d580276040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.202+0000 7fe6ca600640 1 --2- 172.21.15.103:0/3313827350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580265cb0 0x55d580263310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.202+0000 7fe6c9200640 1 -- 172.21.15.103:0/3313827350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580265cb0 msgr2=0x55d580263310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:44.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.202+0000 7fe6c9200640 1 --2- 172.21.15.103:0/3313827350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580265cb0 0x55d580263310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.202+0000 7fe6c9200640 1 -- 172.21.15.103:0/3313827350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 msgr2=0x55d580276040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:44.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.202+0000 7fe6c9200640 1 --2- 172.21.15.103:0/3313827350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d580276040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.202+0000 7fe6c9200640 1 -- 172.21.15.103:0/3313827350 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d580257cb0 con 0x55d580259d20 2024-09-11T01:07:44.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.202+0000 7fe6ca600640 1 --2- 172.21.15.103:0/3313827350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d580276040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:07:44.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.202+0000 7fe6c9200640 1 --2- 172.21.15.103:0/3313827350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580259d20 0x55d5802774b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0006010 tx=0x7fe6b00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc49d7deb6ebb50 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:44.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.203+0000 7fe6b6000640 1 -- 172.21.15.103:0/3313827350 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b004a070 con 0x55d580259d20 2024-09-11T01:07:44.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.203+0000 7fe6b6000640 1 -- 172.21.15.103:0/3313827350 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6b0031950 con 0x55d580259d20 2024-09-11T01:07:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.203+0000 7fe6b6000640 1 -- 172.21.15.103:0/3313827350 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0035040 con 0x55d580259d20 2024-09-11T01:07:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.203+0000 7fe6ced22740 1 -- 172.21.15.103:0/3313827350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580259d20 msgr2=0x55d5802774b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.203+0000 7fe6ced22740 1 --2- 172.21.15.103:0/3313827350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580259d20 0x55d5802774b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0006010 tx=0x7fe6b00058d0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.203+0000 7fe6ced22740 1 -- 172.21.15.103:0/3313827350 shutdown_connections 2024-09-11T01:07:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.203+0000 7fe6ced22740 1 --2- 172.21.15.103:0/3313827350 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580265cb0 0x55d580263310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.203+0000 7fe6ced22740 1 --2- 172.21.15.103:0/3313827350 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580259d20 0x55d5802774b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.203+0000 7fe6ced22740 1 --2- 172.21.15.103:0/3313827350 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d580276040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.203+0000 7fe6ced22740 1 -- 172.21.15.103:0/3313827350 >> 172.21.15.103:0/3313827350 conn(0x55d580257230 msgr2=0x55d580261440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.203+0000 7fe6ced22740 1 -- 172.21.15.103:0/3313827350 shutdown_connections 2024-09-11T01:07:44.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.203+0000 7fe6ced22740 1 -- 172.21.15.103:0/3313827350 wait complete. 2024-09-11T01:07:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.204+0000 7fe6ced22740 1 -- start start 2024-09-11T01:07:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.204+0000 7fe6ced22740 1 Processor -- start 2024-09-11T01:07:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.204+0000 7fe6ced22740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d580280150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.204+0000 7fe6ced22740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580259d20 0x55d5802806d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.204+0000 7fe6ced22740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580265cb0 0x55d580279e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.204+0000 7fe6ced22740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d580277a00 con 0x55d580265cb0 2024-09-11T01:07:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.204+0000 7fe6ced22740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d580277330 con 0x55d580259400 2024-09-11T01:07:44.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.204+0000 7fe6ced22740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d5802780d0 con 0x55d580259d20 2024-09-11T01:07:44.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.204+0000 7fe6ced22740 10 client.0 _ll_register_callbacks cb 0x7fe6bc003da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:07:44.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.205+0000 7fe6ca600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580265cb0 0x55d580279e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.205+0000 7fe6c9200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580259d20 0x55d5802806d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.205+0000 7fe6c9200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580259d20 0x55d5802806d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:39502/0 (socket says 172.21.15.103:39502) 2024-09-11T01:07:44.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.205+0000 7fe6c9200640 1 -- 172.21.15.103:0/4164851096 learned_addr learned my addr 172.21.15.103:0/4164851096 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:44.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.205+0000 7fe6ca600640 1 --2- 172.21.15.103:0/4164851096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d580280150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.205+0000 7fe6c9200640 1 -- 172.21.15.103:0/4164851096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 msgr2=0x55d580280150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:44.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.205+0000 7fe6c9200640 1 --2- 172.21.15.103:0/4164851096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d580280150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.205+0000 7fe6c9200640 1 -- 172.21.15.103:0/4164851096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580265cb0 msgr2=0x55d580279e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:44.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.205+0000 7fe6c9200640 1 --2- 172.21.15.103:0/4164851096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580265cb0 0x55d580279e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.205+0000 7fe6c9200640 1 -- 172.21.15.103:0/4164851096 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d58027a6c0 con 0x55d580259d20 2024-09-11T01:07:44.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.205+0000 7fe6c9200640 1 --2- 172.21.15.103:0/4164851096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580259d20 0x55d5802806d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0031440 tx=0x7fe6b0005600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5736781695339a0f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:44.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.205+0000 7fe6ab400640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:07:44.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.206+0000 7fe6ab400640 1 -- 172.21.15.103:0/4164851096 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6b0055070 con 0x55d580259d20 2024-09-11T01:07:44.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.206+0000 7fe6ab400640 1 -- 172.21.15.103:0/4164851096 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fe6b00316a0 con 0x55d580259d20 2024-09-11T01:07:44.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.206+0000 7fe6ced22740 1 -- 172.21.15.103:0/4164851096 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d5801ce750 con 0x55d580259d20 2024-09-11T01:07:44.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.206+0000 7fe6ab400640 1 -- 172.21.15.103:0/4164851096 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe6b0061050 con 0x55d580259d20 2024-09-11T01:07:44.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.206+0000 7fe6ced22740 10 client.25111 fetch_fsmap learned FSMap version 25 2024-09-11T01:07:44.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.206+0000 7fe6ced22740 1 -- 172.21.15.103:0/4164851096 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55d58027fa00 con 0x55d580259d20 2024-09-11T01:07:44.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.206+0000 7fe6ab400640 1 -- 172.21.15.103:0/4164851096 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55d5801ce750 con 0x55d580259d20 2024-09-11T01:07:44.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.206+0000 7fe6ab400640 1 -- 172.21.15.103:0/4164851096 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7fe6b003d720 con 0x55d580259d20 2024-09-11T01:07:44.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.207+0000 7fe6ced22740 10 client.25111 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T01:07:44.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.207+0000 7fe6ced22740 10 client.25111 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T01:07:44.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.207+0000 7fe6ced22740 20 client.25111 populate_metadata read hostname 'smithi103' 2024-09-11T01:07:44.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.207+0000 7fe6ced22740 1 --2- 172.21.15.103:0/4164851096 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55d5802e7320 0x55d5802e6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:44.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.207+0000 7fe6ced22740 4 client.25111 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T01:07:44.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.207+0000 7fe6ced22740 1 -- 172.21.15.103:0/4164851096 --> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] -- command(tid 0: {"prefix": "status"}) -- 0x55d5801cbb80 con 0x55d5802e7320 2024-09-11T01:07:44.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.207+0000 7fe6ca600640 1 --2- 172.21.15.103:0/4164851096 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55d5802e7320 0x55d5802e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:44.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.207+0000 7fe6ca600640 1 --2- 172.21.15.103:0/4164851096 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55d5802e7320 0x55d5802e6030 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c59a6603a0d8a2b1 server_cookie=d5df42851196b550 in_seq=0 out_seq=0 2024-09-11T01:07:44.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.207+0000 7fe6ab400640 10 client.25111 ms_handle_connect on v2:172.21.15.117:6836/294794871 2024-09-11T01:07:44.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ab400640 1 -- 172.21.15.103:0/4164851096 <== mds.1 v2:172.21.15.117:6836/294794871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d5801cbb80 con 0x55d5802e7320 2024-09-11T01:07:44.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ab400640 10 client.25111 handle_command_reply: tid=0 2024-09-11T01:07:44.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ced22740 1 client.25111 shutdown 2024-09-11T01:07:44.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ced22740 1 -- 172.21.15.103:0/4164851096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580259d20 msgr2=0x55d5802806d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:44.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ced22740 1 --2- 172.21.15.103:0/4164851096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580259d20 0x55d5802806d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe6b0031440 tx=0x7fe6b0005600 comp rx=0 tx=0).stop 2024-09-11T01:07:44.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ced22740 1 -- 172.21.15.103:0/4164851096 shutdown_connections 2024-09-11T01:07:44.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ced22740 1 --2- 172.21.15.103:0/4164851096 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55d5802e7320 0x55d5802e6030 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ced22740 1 --2- 172.21.15.103:0/4164851096 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d580265cb0 0x55d580279e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ced22740 1 --2- 172.21.15.103:0/4164851096 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d580259d20 0x55d5802806d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ced22740 1 --2- 172.21.15.103:0/4164851096 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d580259400 0x55d580280150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ced22740 1 -- 172.21.15.103:0/4164851096 >> 172.21.15.103:0/4164851096 conn(0x55d580257230 msgr2=0x55d580258280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:44.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ab400640 0 client.25111 ms_handle_reset on v2:172.21.15.117:6836/294794871 2024-09-11T01:07:44.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ced22740 1 -- 172.21.15.103:0/4164851096 shutdown_connections 2024-09-11T01:07:44.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ced22740 1 -- 172.21.15.103:0/4164851096 wait complete. 2024-09-11T01:07:44.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.208+0000 7fe6ced22740 20 client.25111 trim_cache size 0 max 16384 2024-09-11T01:07:44.215 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:07:44.216 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "917288bc-6fd8-11ef-bcea-c7b262605968", 2024-09-11T01:07:44.216 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-09-11T01:07:44.216 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24629, 2024-09-11T01:07:44.216 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-11T01:07:44.216 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-11T01:07:44.216 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-11T01:07:44.216 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 85.588256721999997, 2024-09-11T01:07:44.216 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 25, 2024-09-11T01:07:44.216 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-09-11T01:07:44.216 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 87, 2024-09-11T01:07:44.216 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 156.70815658199999 2024-09-11T01:07:44.216 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:07:44.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.209+0000 7fe6cb000640 1 -- 172.21.15.103:0/2261298765 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe6ac0b5390 msgr2=0x7fe6ac0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:44.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.209+0000 7fe6cb000640 1 --2- 172.21.15.103:0/2261298765 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe6ac0b5390 0x7fe6ac0b7850 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe6b80e39f0 tx=0x7fe6b8009700 comp rx=0 tx=0).stop 2024-09-11T01:07:44.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.209+0000 7fe6cb000640 1 -- 172.21.15.103:0/2261298765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6c4102c00 msgr2=0x7fe6c419b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:44.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.209+0000 7fe6cb000640 1 --2- 172.21.15.103:0/2261298765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6c4102c00 0x7fe6c419b260 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800e9f0 tx=0x7fe6b800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.209+0000 7fe6cb000640 1 -- 172.21.15.103:0/2261298765 shutdown_connections 2024-09-11T01:07:44.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.209+0000 7fe6cb000640 1 --2- 172.21.15.103:0/2261298765 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe6ac0b5390 0x7fe6ac0b7850 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.209+0000 7fe6cb000640 1 --2- 172.21.15.103:0/2261298765 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe6c4108f90 0x7fe6c41a0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.209+0000 7fe6cb000640 1 --2- 172.21.15.103:0/2261298765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6c4108610 0x7fe6c419b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.209+0000 7fe6cb000640 1 --2- 172.21.15.103:0/2261298765 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe6c4102c00 0x7fe6c419b260 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:44.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.209+0000 7fe6cb000640 1 -- 172.21.15.103:0/2261298765 >> 172.21.15.103:0/2261298765 conn(0x7fe6c40fe6d0 msgr2=0x7fe6c4105bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:44.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.209+0000 7fe6cb000640 1 -- 172.21.15.103:0/2261298765 shutdown_connections 2024-09-11T01:07:44.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:44.209+0000 7fe6cb000640 1 -- 172.21.15.103:0/2261298765 wait complete. 2024-09-11T01:07:44.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:44 smithi103 ceph-mon[30562]: pgmap v381: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:07:44.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:44 smithi117 ceph-mon[35358]: pgmap v381: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:07:44.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:44 smithi183 ceph-mon[34992]: pgmap v381: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:07:45.006 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T01:07:45.373 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:45.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.933+0000 7f885f200640 1 -- 172.21.15.103:0/3392398268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f886010b180 msgr2=0x7f8860111980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:45.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.933+0000 7f885f200640 1 --2- 172.21.15.103:0/3392398268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f886010b180 0x7f8860111980 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8858009900 tx=0x7f885802a3f0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.933+0000 7f885f200640 1 -- 172.21.15.103:0/3392398268 shutdown_connections 2024-09-11T01:07:45.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.933+0000 7f885f200640 1 --2- 172.21.15.103:0/3392398268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f886010b180 0x7f8860111980 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.933+0000 7f885f200640 1 --2- 172.21.15.103:0/3392398268 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f886010a800 0x7f886010ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.933+0000 7f885f200640 1 --2- 172.21.15.103:0/3392398268 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8860104df0 0x7f88601051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.933+0000 7f885f200640 1 -- 172.21.15.103:0/3392398268 >> 172.21.15.103:0/3392398268 conn(0x7f8860100840 msgr2=0x7f8860102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:45.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.933+0000 7f885f200640 1 -- 172.21.15.103:0/3392398268 shutdown_connections 2024-09-11T01:07:45.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.933+0000 7f885f200640 1 -- 172.21.15.103:0/3392398268 wait complete. 2024-09-11T01:07:45.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.934+0000 7f885f200640 1 Processor -- start 2024-09-11T01:07:45.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.934+0000 7f885f200640 1 -- start start 2024-09-11T01:07:45.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.934+0000 7f885f200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8860104df0 0x7f886019b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.934+0000 7f885f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f886010a800 0x7f886019b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885f200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886010b180 0x7f88601a0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8860114e50 con 0x7f886010a800 2024-09-11T01:07:45.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885f200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8860114cd0 con 0x7f886010b180 2024-09-11T01:07:45.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885f200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8860114fd0 con 0x7f8860104df0 2024-09-11T01:07:45.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f886010a800 0x7f886019b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f886010a800 0x7f886019b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56710/0 (socket says 172.21.15.103:56710) 2024-09-11T01:07:45.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885d400640 1 -- 172.21.15.103:0/4234693550 learned_addr learned my addr 172.21.15.103:0/4234693550 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:45.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885de00640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8860104df0 0x7f886019b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885e800640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886010b180 0x7f88601a0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885d400640 1 -- 172.21.15.103:0/4234693550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8860104df0 msgr2=0x7f886019b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:45.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885d400640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8860104df0 0x7f886019b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885d400640 1 -- 172.21.15.103:0/4234693550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886010b180 msgr2=0x7f88601a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:45.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885d400640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886010b180 0x7f88601a0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885d400640 1 -- 172.21.15.103:0/4234693550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88601a1350 con 0x7f886010a800 2024-09-11T01:07:45.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.935+0000 7f885e800640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886010b180 0x7f88601a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:45.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.936+0000 7f885d400640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f886010a800 0x7f886019b7e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f884c00e9f0 tx=0x7f884c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:45.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.936+0000 7f8856a00640 1 -- 172.21.15.103:0/4234693550 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c00cd80 con 0x7f886010a800 2024-09-11T01:07:45.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.936+0000 7f8856a00640 1 -- 172.21.15.103:0/4234693550 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f884c0054d0 con 0x7f886010a800 2024-09-11T01:07:45.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.936+0000 7f8856a00640 1 -- 172.21.15.103:0/4234693550 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c010690 con 0x7f886010a800 2024-09-11T01:07:45.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.936+0000 7f885f200640 1 -- 172.21.15.103:0/4234693550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88601a1640 con 0x7f886010a800 2024-09-11T01:07:45.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.936+0000 7f885f200640 1 -- 172.21.15.103:0/4234693550 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88601a7d00 con 0x7f886010a800 2024-09-11T01:07:45.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.939+0000 7f88677dc740 1 Processor -- start 2024-09-11T01:07:45.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.939+0000 7f88677dc740 1 -- start start 2024-09-11T01:07:45.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.939+0000 7f8856a00640 1 -- 172.21.15.103:0/4234693550 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7f884c004e90 con 0x7f886010a800 2024-09-11T01:07:45.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f88677dc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcef400 0x55f05dcef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f88677dc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 0x55f05dcfb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f88677dc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcfbcb0 0x55f05dcfe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f88677dc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f05dc66d50 con 0x55f05dcef400 2024-09-11T01:07:45.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f88677dc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f05dc56180 con 0x55f05dcefd20 2024-09-11T01:07:45.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f88677dc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f05dc59f90 con 0x55f05dcfbcb0 2024-09-11T01:07:45.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f885e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcef400 0x55f05dcef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f885e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcef400 0x55f05dcef7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56716/0 (socket says 172.21.15.103:56716) 2024-09-11T01:07:45.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f885de00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 0x55f05dcfb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f885e800640 1 -- 172.21.15.103:0/3593643913 learned_addr learned my addr 172.21.15.103:0/3593643913 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:45.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f885d400640 1 --2- 172.21.15.103:0/3593643913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcfbcb0 0x55f05dcfe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f885e800640 1 -- 172.21.15.103:0/3593643913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcfbcb0 msgr2=0x55f05dcfe0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:45.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f885e800640 1 --2- 172.21.15.103:0/3593643913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcfbcb0 0x55f05dcfe0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f885e800640 1 -- 172.21.15.103:0/3593643913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 msgr2=0x55f05dcfb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:45.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.940+0000 7f885e800640 1 --2- 172.21.15.103:0/3593643913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 0x55f05dcfb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.941+0000 7f885e800640 1 -- 172.21.15.103:0/3593643913 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f05dc20a70 con 0x55f05dcef400 2024-09-11T01:07:45.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.941+0000 7f885e800640 1 --2- 172.21.15.103:0/3593643913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcef400 0x55f05dcef7e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8858009900 tx=0x7f8858004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7af09f8aab61695 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:45.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.941+0000 7f884b000640 1 -- 172.21.15.103:0/3593643913 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858035040 con 0x55f05dcef400 2024-09-11T01:07:45.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.941+0000 7f884b000640 1 -- 172.21.15.103:0/3593643913 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88580047a0 con 0x55f05dcef400 2024-09-11T01:07:45.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.941+0000 7f884b000640 1 -- 172.21.15.103:0/3593643913 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858003920 con 0x55f05dcef400 2024-09-11T01:07:45.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.941+0000 7f8856a00640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f88440b5410 0x7f88440b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.942+0000 7f8856a00640 1 -- 172.21.15.103:0/4234693550 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f884c0e62c0 con 0x7f886010a800 2024-09-11T01:07:45.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.942+0000 7f885de00640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f88440b5410 0x7f88440b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.942+0000 7f88677dc740 1 -- 172.21.15.103:0/3593643913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcef400 msgr2=0x55f05dcef7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:45.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.942+0000 7f88677dc740 1 --2- 172.21.15.103:0/3593643913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcef400 0x55f05dcef7e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8858009900 tx=0x7f8858004430 comp rx=0 tx=0).stop 2024-09-11T01:07:45.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.942+0000 7f88677dc740 1 -- 172.21.15.103:0/3593643913 shutdown_connections 2024-09-11T01:07:45.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.942+0000 7f88677dc740 1 --2- 172.21.15.103:0/3593643913 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcfbcb0 0x55f05dcfe0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.942+0000 7f88677dc740 1 --2- 172.21.15.103:0/3593643913 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 0x55f05dcfb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.942+0000 7f88677dc740 1 --2- 172.21.15.103:0/3593643913 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcef400 0x55f05dcef7e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.942+0000 7f885de00640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f88440b5410 0x7f88440b78d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55f05dcf2580 tx=0x7f8850009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:45.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.942+0000 7f88677dc740 1 -- 172.21.15.103:0/3593643913 >> 172.21.15.103:0/3593643913 conn(0x55f05dced230 msgr2=0x55f05dcee3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:45.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.942+0000 7f88677dc740 1 -- 172.21.15.103:0/3593643913 shutdown_connections 2024-09-11T01:07:45.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.942+0000 7f88677dc740 1 -- 172.21.15.103:0/3593643913 wait complete. 2024-09-11T01:07:45.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.943+0000 7f88677dc740 1 -- start start 2024-09-11T01:07:45.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.943+0000 7f88677dc740 1 Processor -- start 2024-09-11T01:07:45.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f88677dc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 0x55f05dcf8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f88677dc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 0x55f05dcf91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f88677dc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcfbcb0 0x55f05dcf96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f88677dc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f05dab75f0 con 0x55f05dcfbcb0 2024-09-11T01:07:45.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f88677dc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f05dbf1460 con 0x55f05dcefd20 2024-09-11T01:07:45.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f88677dc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f05dcfe9a0 con 0x55f05dcef400 2024-09-11T01:07:45.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f88677dc740 10 client.0 _ll_register_callbacks cb 0x55f05dc01210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:07:45.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f885e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcfbcb0 0x55f05dcf96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f885e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcfbcb0 0x55f05dcf96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56732/0 (socket says 172.21.15.103:56732) 2024-09-11T01:07:45.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f885e800640 1 -- 172.21.15.103:0/912522535 learned_addr learned my addr 172.21.15.103:0/912522535 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:45.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f885d400640 1 --2- 172.21.15.103:0/912522535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 0x55f05dcf91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f885de00640 1 --2- 172.21.15.103:0/912522535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 0x55f05dcf8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f885e800640 1 -- 172.21.15.103:0/912522535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 msgr2=0x55f05dcf8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:45.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f885e800640 1 --2- 172.21.15.103:0/912522535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 0x55f05dcf8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f885e800640 1 -- 172.21.15.103:0/912522535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 msgr2=0x55f05dcf91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:45.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f885e800640 1 --2- 172.21.15.103:0/912522535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 0x55f05dcf91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.944+0000 7f885e800640 1 -- 172.21.15.103:0/912522535 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f05d9b4540 con 0x55f05dcfbcb0 2024-09-11T01:07:45.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.945+0000 7f885e800640 1 --2- 172.21.15.103:0/912522535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcfbcb0 0x55f05dcf96f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f885802a910 tx=0x7f8858003950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f675ffc7a02638a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:45.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.945+0000 7f883f400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:07:45.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.945+0000 7f883f400640 1 -- 172.21.15.103:0/912522535 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858035070 con 0x55f05dcfbcb0 2024-09-11T01:07:45.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.945+0000 7f883f400640 1 -- 172.21.15.103:0/912522535 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f8858003d80 con 0x55f05dcfbcb0 2024-09-11T01:07:45.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.945+0000 7f88677dc740 1 -- 172.21.15.103:0/912522535 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f05dbf3a70 con 0x55f05dcfbcb0 2024-09-11T01:07:45.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.945+0000 7f883f400640 1 -- 172.21.15.103:0/912522535 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8858005020 con 0x55f05dcfbcb0 2024-09-11T01:07:45.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.945+0000 7f88677dc740 10 client.15135 fetch_fsmap learned FSMap version 25 2024-09-11T01:07:45.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.945+0000 7f88677dc740 1 -- 172.21.15.103:0/912522535 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f05dc0e6f0 con 0x55f05dcfbcb0 2024-09-11T01:07:45.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.945+0000 7f883f400640 1 -- 172.21.15.103:0/912522535 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f05dbf3a70 con 0x55f05dcfbcb0 2024-09-11T01:07:45.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.946+0000 7f883f400640 1 -- 172.21.15.103:0/912522535 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f88580314a0 con 0x55f05dcfbcb0 2024-09-11T01:07:45.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.946+0000 7f88677dc740 10 client.15135 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T01:07:45.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.946+0000 7f88677dc740 10 client.15135 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T01:07:45.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.946+0000 7f88677dc740 20 client.15135 populate_metadata read hostname 'smithi103' 2024-09-11T01:07:45.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.946+0000 7f88677dc740 1 --2- 172.21.15.103:0/912522535 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f05dd0c530 0x55f05dd0d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.946+0000 7f88677dc740 4 client.15135 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:07:45.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.946+0000 7f88677dc740 1 -- 172.21.15.103:0/912522535 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f05dc68ca0 con 0x55f05dd0c530 2024-09-11T01:07:45.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.946+0000 7f885de00640 1 --2- 172.21.15.103:0/912522535 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f05dd0c530 0x55f05dd0d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.947+0000 7f885de00640 1 --2- 172.21.15.103:0/912522535 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f05dd0c530 0x55f05dd0d9a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84c912afc6b188fa server_cookie=cd445cb35136096e in_seq=0 out_seq=0 2024-09-11T01:07:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.947+0000 7f883f400640 10 client.15135 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:07:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f883f400640 1 -- 172.21.15.103:0/912522535 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f05dc68ca0 con 0x55f05dd0c530 2024-09-11T01:07:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f883f400640 10 client.15135 handle_command_reply: tid=0 2024-09-11T01:07:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f88677dc740 1 client.15135 shutdown 2024-09-11T01:07:45.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f88677dc740 1 -- 172.21.15.103:0/912522535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcfbcb0 msgr2=0x55f05dcf96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:45.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f88677dc740 1 --2- 172.21.15.103:0/912522535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcfbcb0 0x55f05dcf96f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f885802a910 tx=0x7f8858003950 comp rx=0 tx=0).stop 2024-09-11T01:07:45.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f88677dc740 1 -- 172.21.15.103:0/912522535 shutdown_connections 2024-09-11T01:07:45.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f88677dc740 1 --2- 172.21.15.103:0/912522535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcfbcb0 0x55f05dcf96f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f88677dc740 1 --2- 172.21.15.103:0/912522535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 0x55f05dcf91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f88677dc740 1 --2- 172.21.15.103:0/912522535 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f05dd0c530 0x55f05dd0d9a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f88677dc740 1 --2- 172.21.15.103:0/912522535 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 0x55f05dcf8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f88677dc740 1 -- 172.21.15.103:0/912522535 >> 172.21.15.103:0/912522535 conn(0x55f05dced230 msgr2=0x55f05dcf2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:45.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f883f400640 0 client.15135 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:07:45.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f88677dc740 1 -- 172.21.15.103:0/912522535 shutdown_connections 2024-09-11T01:07:45.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f88677dc740 1 -- 172.21.15.103:0/912522535 wait complete. 2024-09-11T01:07:45.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.948+0000 7f88677dc740 20 client.15135 trim_cache size 0 max 16384 2024-09-11T01:07:45.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.967+0000 7f88677dc740 1 Processor -- start 2024-09-11T01:07:45.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.967+0000 7f88677dc740 1 -- start start 2024-09-11T01:07:45.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f88677dc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 0x55f05dcf9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f88677dc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcefd20 0x55f05dd07370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f88677dc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcfbcb0 0x55f05dcf5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f88677dc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f05dd0bce0 con 0x55f05dcefd20 2024-09-11T01:07:45.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f88677dc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f05dd0c3b0 con 0x55f05dcfbcb0 2024-09-11T01:07:45.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f88677dc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f05dd0ca80 con 0x55f05dcef400 2024-09-11T01:07:45.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f885e800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcfbcb0 0x55f05dcf5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f885d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcefd20 0x55f05dd07370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f885e800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcfbcb0 0x55f05dcf5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:40312/0 (socket says 172.21.15.103:40312) 2024-09-11T01:07:45.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f885e800640 1 -- 172.21.15.103:0/2269441255 learned_addr learned my addr 172.21.15.103:0/2269441255 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:45.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f885de00640 1 --2- 172.21.15.103:0/2269441255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 0x55f05dcf9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f885e800640 1 -- 172.21.15.103:0/2269441255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 msgr2=0x55f05dcf9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f885e800640 1 --2- 172.21.15.103:0/2269441255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 0x55f05dcf9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f885e800640 1 -- 172.21.15.103:0/2269441255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcefd20 msgr2=0x55f05dd07370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f885e800640 1 --2- 172.21.15.103:0/2269441255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcefd20 0x55f05dd07370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.968+0000 7f885e800640 1 -- 172.21.15.103:0/2269441255 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f05dcedcb0 con 0x55f05dcfbcb0 2024-09-11T01:07:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.969+0000 7f885e800640 1 --2- 172.21.15.103:0/2269441255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcfbcb0 0x55f05dcf5e80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8858000c00 tx=0x7f885802a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=736a264aae48efaa server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.969+0000 7f884a600640 1 -- 172.21.15.103:0/2269441255 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8858035070 con 0x55f05dcfbcb0 2024-09-11T01:07:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.969+0000 7f884a600640 1 -- 172.21.15.103:0/2269441255 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8858004430 con 0x55f05dcfbcb0 2024-09-11T01:07:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.969+0000 7f884a600640 1 -- 172.21.15.103:0/2269441255 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88580054f0 con 0x55f05dcfbcb0 2024-09-11T01:07:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.969+0000 7f88677dc740 1 -- 172.21.15.103:0/2269441255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcfbcb0 msgr2=0x55f05dcf5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.969+0000 7f88677dc740 1 --2- 172.21.15.103:0/2269441255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcfbcb0 0x55f05dcf5e80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8858000c00 tx=0x7f885802a3f0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.969+0000 7f88677dc740 1 -- 172.21.15.103:0/2269441255 shutdown_connections 2024-09-11T01:07:45.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.969+0000 7f88677dc740 1 --2- 172.21.15.103:0/2269441255 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcfbcb0 0x55f05dcf5e80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.969+0000 7f88677dc740 1 --2- 172.21.15.103:0/2269441255 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcefd20 0x55f05dd07370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.969+0000 7f88677dc740 1 --2- 172.21.15.103:0/2269441255 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 0x55f05dcf9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.969+0000 7f88677dc740 1 -- 172.21.15.103:0/2269441255 >> 172.21.15.103:0/2269441255 conn(0x55f05dced230 msgr2=0x55f05dd06c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.970+0000 7f88677dc740 1 -- 172.21.15.103:0/2269441255 shutdown_connections 2024-09-11T01:07:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.970+0000 7f88677dc740 1 -- 172.21.15.103:0/2269441255 wait complete. 2024-09-11T01:07:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.970+0000 7f88677dc740 1 -- start start 2024-09-11T01:07:45.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.970+0000 7f88677dc740 1 Processor -- start 2024-09-11T01:07:45.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f88677dc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 0x55f05dd10030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f88677dc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 0x55f05dd10570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f88677dc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcfbcb0 0x55f05dd157c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f88677dc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f05dd0d820 con 0x55f05dcfbcb0 2024-09-11T01:07:45.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f88677dc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f05dd0d150 con 0x55f05dcefd20 2024-09-11T01:07:45.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f88677dc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f05dd0def0 con 0x55f05dcef400 2024-09-11T01:07:45.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f88677dc740 10 client.0 _ll_register_callbacks cb 0x7f8858009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:07:45.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f885de00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 0x55f05dd10030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f885d400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 0x55f05dd10570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f885e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcfbcb0 0x55f05dd157c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f885de00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 0x55f05dd10030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:39562/0 (socket says 172.21.15.103:39562) 2024-09-11T01:07:45.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f885de00640 1 -- 172.21.15.103:0/3929941890 learned_addr learned my addr 172.21.15.103:0/3929941890 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:45.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f885de00640 1 -- 172.21.15.103:0/3929941890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 msgr2=0x55f05dd10570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:45.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f885de00640 1 --2- 172.21.15.103:0/3929941890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 0x55f05dd10570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f885de00640 1 -- 172.21.15.103:0/3929941890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcfbcb0 msgr2=0x55f05dd157c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:07:45.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f885de00640 1 --2- 172.21.15.103:0/3929941890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcfbcb0 0x55f05dd157c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f885de00640 1 -- 172.21.15.103:0/3929941890 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f05dd15d00 con 0x55f05dcef400 2024-09-11T01:07:45.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f885d400640 1 --2- 172.21.15.103:0/3929941890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 0x55f05dd10570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:45.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.971+0000 7f885e800640 1 --2- 172.21.15.103:0/3929941890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcfbcb0 0x55f05dd157c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:45.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.972+0000 7f885de00640 1 --2- 172.21.15.103:0/3929941890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 0x55f05dd10030 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55f05dcfbbf0 tx=0x7f8850004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=272b212964707df9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:45.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.972+0000 7f883f400640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:07:45.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.972+0000 7f883f400640 1 -- 172.21.15.103:0/3929941890 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850004740 con 0x55f05dcef400 2024-09-11T01:07:45.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.972+0000 7f88677dc740 1 -- 172.21.15.103:0/3929941890 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8858004430 con 0x55f05dcef400 2024-09-11T01:07:45.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.972+0000 7f883f400640 1 -- 172.21.15.103:0/3929941890 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f8850004b20 con 0x55f05dcef400 2024-09-11T01:07:45.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.972+0000 7f883f400640 1 -- 172.21.15.103:0/3929941890 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8850004d20 con 0x55f05dcef400 2024-09-11T01:07:45.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.972+0000 7f88677dc740 10 client.25129 fetch_fsmap learned FSMap version 25 2024-09-11T01:07:45.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.972+0000 7f88677dc740 1 -- 172.21.15.103:0/3929941890 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55f05dd81ef0 con 0x55f05dcef400 2024-09-11T01:07:45.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.973+0000 7f883f400640 1 -- 172.21.15.103:0/3929941890 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8858004430 con 0x55f05dcef400 2024-09-11T01:07:45.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.973+0000 7f883f400640 1 -- 172.21.15.103:0/3929941890 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f88500050b0 con 0x55f05dcef400 2024-09-11T01:07:45.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.973+0000 7f88677dc740 10 client.25129 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T01:07:45.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.973+0000 7f88677dc740 10 client.25129 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T01:07:45.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.973+0000 7f88677dc740 20 client.25129 populate_metadata read hostname 'smithi103' 2024-09-11T01:07:45.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.973+0000 7f88677dc740 1 --2- 172.21.15.103:0/3929941890 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f05dd86b20 0x55f05dd85830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:45.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.973+0000 7f88677dc740 4 client.25129 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T01:07:45.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.973+0000 7f88677dc740 1 -- 172.21.15.103:0/3929941890 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "status"}) -- 0x55f05dc64750 con 0x55f05dd86b20 2024-09-11T01:07:45.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.973+0000 7f885d400640 1 --2- 172.21.15.103:0/3929941890 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f05dd86b20 0x55f05dd85830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:45.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f883f400640 10 client.25129 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:07:45.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f885d400640 1 --2- 172.21.15.103:0/3929941890 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f05dd86b20 0x55f05dd85830 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe2e290a185c1366 server_cookie=803be0d8355fd584 in_seq=0 out_seq=0 2024-09-11T01:07:45.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f883f400640 1 -- 172.21.15.103:0/3929941890 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f05dc64750 con 0x55f05dd86b20 2024-09-11T01:07:45.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f883f400640 10 client.25129 handle_command_reply: tid=0 2024-09-11T01:07:45.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f88677dc740 1 client.25129 shutdown 2024-09-11T01:07:45.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f88677dc740 1 -- 172.21.15.103:0/3929941890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 msgr2=0x55f05dd10030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:45.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f88677dc740 1 --2- 172.21.15.103:0/3929941890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 0x55f05dd10030 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55f05dcfbbf0 tx=0x7f8850004a40 comp rx=0 tx=0).stop 2024-09-11T01:07:45.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f88677dc740 1 -- 172.21.15.103:0/3929941890 shutdown_connections 2024-09-11T01:07:45.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f88677dc740 1 --2- 172.21.15.103:0/3929941890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f05dcfbcb0 0x55f05dd157c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f88677dc740 1 --2- 172.21.15.103:0/3929941890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f05dcefd20 0x55f05dd10570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f88677dc740 1 --2- 172.21.15.103:0/3929941890 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f05dd86b20 0x55f05dd85830 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f88677dc740 1 --2- 172.21.15.103:0/3929941890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f05dcef400 0x55f05dd10030 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f88677dc740 1 -- 172.21.15.103:0/3929941890 >> 172.21.15.103:0/3929941890 conn(0x55f05dced230 msgr2=0x55f05dd07480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:45.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f883f400640 0 client.25129 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:07:45.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f88677dc740 1 -- 172.21.15.103:0/3929941890 shutdown_connections 2024-09-11T01:07:45.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f88677dc740 1 -- 172.21.15.103:0/3929941890 wait complete. 2024-09-11T01:07:45.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.974+0000 7f88677dc740 20 client.25129 trim_cache size 0 max 16384 2024-09-11T01:07:45.980 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:07:45.980 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "917288bc-6fd8-11ef-bcea-c7b262605968", 2024-09-11T01:07:45.980 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-11T01:07:45.980 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24665, 2024-09-11T01:07:45.980 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-11T01:07:45.981 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-11T01:07:45.981 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-11T01:07:45.981 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 132.29918317100001, 2024-09-11T01:07:45.981 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 25, 2024-09-11T01:07:45.981 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-09-11T01:07:45.981 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 87, 2024-09-11T01:07:45.981 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 146.12758237899999 2024-09-11T01:07:45.981 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:07:45.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.975+0000 7f885f200640 1 -- 172.21.15.103:0/4234693550 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f88440b5410 msgr2=0x7f88440b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:45.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.975+0000 7f885f200640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f88440b5410 0x7f88440b78d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55f05dcf2580 tx=0x7f8850009500 comp rx=0 tx=0).stop 2024-09-11T01:07:45.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.975+0000 7f885f200640 1 -- 172.21.15.103:0/4234693550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f886010a800 msgr2=0x7f886019b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:45.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.975+0000 7f885f200640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f886010a800 0x7f886019b7e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f884c00e9f0 tx=0x7f884c00edf0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.975+0000 7f885f200640 1 -- 172.21.15.103:0/4234693550 shutdown_connections 2024-09-11T01:07:45.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.975+0000 7f885f200640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f88440b5410 0x7f88440b78d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.975+0000 7f885f200640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f886010b180 0x7f88601a0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.975+0000 7f885f200640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f886010a800 0x7f886019b7e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.975+0000 7f885f200640 1 --2- 172.21.15.103:0/4234693550 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8860104df0 0x7f886019b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:45.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.975+0000 7f885f200640 1 -- 172.21.15.103:0/4234693550 >> 172.21.15.103:0/4234693550 conn(0x7f8860100840 msgr2=0x7f8860108e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:45.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.975+0000 7f885f200640 1 -- 172.21.15.103:0/4234693550 shutdown_connections 2024-09-11T01:07:45.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:45.975+0000 7f885f200640 1 -- 172.21.15.103:0/4234693550 wait complete. 2024-09-11T01:07:46.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:46 smithi103 ceph-mon[30562]: pgmap v382: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T01:07:46.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:46 smithi183 ceph-mon[34992]: pgmap v382: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T01:07:46.951 INFO:tasks.cephadm:Setup complete, yielding 2024-09-11T01:07:46.951 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T01:07:46.960 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T01:07:46.961 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch status' 2024-09-11T01:07:47.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:46 smithi117 ceph-mon[35358]: pgmap v382: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T01:07:47.328 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:47.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:47 smithi103 ceph-mon[30562]: pgmap v383: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-11T01:07:47.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.954+0000 7f3cdaa00640 1 -- 172.21.15.103:0/227325825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd41043b0 msgr2=0x7f3cd410ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:47.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.954+0000 7f3cdaa00640 1 --2- 172.21.15.103:0/227325825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd41043b0 0x7f3cd410ad30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009930 tx=0x7f3ccc02a420 comp rx=0 tx=0).stop 2024-09-11T01:07:47.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.954+0000 7f3cdaa00640 1 -- 172.21.15.103:0/227325825 shutdown_connections 2024-09-11T01:07:47.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.954+0000 7f3cdaa00640 1 --2- 172.21.15.103:0/227325825 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd41043b0 0x7f3cd410ad30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:47.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.954+0000 7f3cdaa00640 1 --2- 172.21.15.103:0/227325825 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cd41039f0 0x7f3cd4103e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:47.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.954+0000 7f3cdaa00640 1 --2- 172.21.15.103:0/227325825 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cd4102890 0x7f3cd4102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:47.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.954+0000 7f3cdaa00640 1 -- 172.21.15.103:0/227325825 >> 172.21.15.103:0/227325825 conn(0x7f3cd40fe180 msgr2=0x7f3cd41005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:47.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.954+0000 7f3cdaa00640 1 -- 172.21.15.103:0/227325825 shutdown_connections 2024-09-11T01:07:47.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.954+0000 7f3cdaa00640 1 -- 172.21.15.103:0/227325825 wait complete. 2024-09-11T01:07:47.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.955+0000 7f3cdaa00640 1 Processor -- start 2024-09-11T01:07:47.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.955+0000 7f3cdaa00640 1 -- start start 2024-09-11T01:07:47.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.955+0000 7f3cdaa00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cd4102890 0x7f3cd419ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:47.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.955+0000 7f3cdaa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cd41039f0 0x7f3cd419b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:47.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.955+0000 7f3cdaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd41043b0 0x7f3cd419bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.955+0000 7f3cdaa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd410e560 con 0x7f3cd41043b0 2024-09-11T01:07:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.955+0000 7f3cdaa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd410e3e0 con 0x7f3cd41039f0 2024-09-11T01:07:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.955+0000 7f3cdaa00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd410e6e0 con 0x7f3cd4102890 2024-09-11T01:07:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.956+0000 7f3cd9600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cd4102890 0x7f3cd419ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.956+0000 7f3cd9600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cd4102890 0x7f3cd419ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:39584/0 (socket says 172.21.15.103:39584) 2024-09-11T01:07:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.956+0000 7f3cd8c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cd41039f0 0x7f3cd419b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.956+0000 7f3cda000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd41043b0 0x7f3cd419bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.956+0000 7f3cd9600640 1 -- 172.21.15.103:0/3717650882 learned_addr learned my addr 172.21.15.103:0/3717650882 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.956+0000 7f3cd9600640 1 -- 172.21.15.103:0/3717650882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cd41039f0 msgr2=0x7f3cd419b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.956+0000 7f3cd9600640 1 --2- 172.21.15.103:0/3717650882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cd41039f0 0x7f3cd419b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.956+0000 7f3cd9600640 1 -- 172.21.15.103:0/3717650882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd41043b0 msgr2=0x7f3cd419bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.956+0000 7f3cd9600640 1 --2- 172.21.15.103:0/3717650882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd41043b0 0x7f3cd419bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.956+0000 7f3cd9600640 1 -- 172.21.15.103:0/3717650882 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd419c870 con 0x7f3cd4102890 2024-09-11T01:07:47.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.956+0000 7f3cda000640 1 --2- 172.21.15.103:0/3717650882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd41043b0 0x7f3cd419bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.956+0000 7f3cd8c00640 1 --2- 172.21.15.103:0/3717650882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cd41039f0 0x7f3cd419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.957+0000 7f3cd9600640 1 --2- 172.21.15.103:0/3717650882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cd4102890 0x7f3cd419ad40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800ebc0 tx=0x7f3cc800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.957+0000 7f3cd2000640 1 -- 172.21.15.103:0/3717650882 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8010630 con 0x7f3cd4102890 2024-09-11T01:07:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.957+0000 7f3cd2000640 1 -- 172.21.15.103:0/3717650882 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cc8010c80 con 0x7f3cd4102890 2024-09-11T01:07:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.957+0000 7f3cdaa00640 1 -- 172.21.15.103:0/3717650882 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd419cb60 con 0x7f3cd4102890 2024-09-11T01:07:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.957+0000 7f3cd2000640 1 -- 172.21.15.103:0/3717650882 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8018b60 con 0x7f3cd4102890 2024-09-11T01:07:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.957+0000 7f3cdaa00640 1 -- 172.21.15.103:0/3717650882 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd41a3240 con 0x7f3cd4102890 2024-09-11T01:07:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.958+0000 7f3cdaa00640 1 -- 172.21.15.103:0/3717650882 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd41a3410 con 0x7f3cd4102890 2024-09-11T01:07:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.960+0000 7f3cd2000640 1 -- 172.21.15.103:0/3717650882 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7f3cc80107d0 con 0x7f3cd4102890 2024-09-11T01:07:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.962+0000 7f3cd2000640 1 --2- 172.21.15.103:0/3717650882 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3cbc0b5390 0x7f3cbc0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.962+0000 7f3cd2000640 1 -- 172.21.15.103:0/3717650882 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f3cc80e6aa0 con 0x7f3cd4102890 2024-09-11T01:07:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.962+0000 7f3cd8c00640 1 --2- 172.21.15.103:0/3717650882 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3cbc0b5390 0x7f3cbc0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:47.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.963+0000 7f3cd8c00640 1 --2- 172.21.15.103:0/3717650882 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3cbc0b5390 0x7f3cbc0b7850 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009fc0 tx=0x7f3cc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:47.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:47.964+0000 7f3cd2000640 1 -- 172.21.15.103:0/3717650882 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f3cc80acf00 con 0x7f3cd4102890 2024-09-11T01:07:48.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:47 smithi117 ceph-mon[35358]: pgmap v383: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-11T01:07:48.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:48.166+0000 7f3cdaa00640 1 -- 172.21.15.103:0/3717650882 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f3cd4076390 con 0x7f3cbc0b5390 2024-09-11T01:07:48.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:47 smithi183 ceph-mon[34992]: pgmap v383: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-11T01:07:48.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:48.168+0000 7f3cd2000640 1 -- 172.21.15.103:0/3717650882 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f3cd4076390 con 0x7f3cbc0b5390 2024-09-11T01:07:48.169 INFO:teuthology.orchestra.run.smithi103.stdout:Backend: cephadm 2024-09-11T01:07:48.170 INFO:teuthology.orchestra.run.smithi103.stdout:Available: Yes 2024-09-11T01:07:48.170 INFO:teuthology.orchestra.run.smithi103.stdout:Paused: No 2024-09-11T01:07:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:48.170+0000 7f3cdaa00640 1 -- 172.21.15.103:0/3717650882 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3cbc0b5390 msgr2=0x7f3cbc0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:48.170+0000 7f3cdaa00640 1 --2- 172.21.15.103:0/3717650882 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3cbc0b5390 0x7f3cbc0b7850 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009fc0 tx=0x7f3cc0005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:48.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:48.170+0000 7f3cdaa00640 1 -- 172.21.15.103:0/3717650882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cd4102890 msgr2=0x7f3cd419ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:48.170+0000 7f3cdaa00640 1 --2- 172.21.15.103:0/3717650882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cd4102890 0x7f3cd419ad40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800ebc0 tx=0x7f3cc800c6a0 comp rx=0 tx=0).stop 2024-09-11T01:07:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:48.171+0000 7f3cdaa00640 1 -- 172.21.15.103:0/3717650882 shutdown_connections 2024-09-11T01:07:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:48.171+0000 7f3cdaa00640 1 --2- 172.21.15.103:0/3717650882 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3cbc0b5390 0x7f3cbc0b7850 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:48.171+0000 7f3cdaa00640 1 --2- 172.21.15.103:0/3717650882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cd41043b0 0x7f3cd419bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:48.171+0000 7f3cdaa00640 1 --2- 172.21.15.103:0/3717650882 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cd41039f0 0x7f3cd419b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:48.171+0000 7f3cdaa00640 1 --2- 172.21.15.103:0/3717650882 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cd4102890 0x7f3cd419ad40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:48.171+0000 7f3cdaa00640 1 -- 172.21.15.103:0/3717650882 >> 172.21.15.103:0/3717650882 conn(0x7f3cd40fe180 msgr2=0x7f3cd41000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:48.171+0000 7f3cdaa00640 1 -- 172.21.15.103:0/3717650882 shutdown_connections 2024-09-11T01:07:48.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:48.171+0000 7f3cdaa00640 1 -- 172.21.15.103:0/3717650882 wait complete. 2024-09-11T01:07:48.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:48 smithi103 ceph-mon[30562]: from='client.25135 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:48.967 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-11T01:07:49.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:48 smithi117 ceph-mon[35358]: from='client.25135 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:49.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:48 smithi183 ceph-mon[34992]: from='client.25135 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:49.334 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:49.723 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:49 smithi103 ceph-mon[30562]: pgmap v384: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T01:07:49.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.985+0000 7fabdc600640 1 -- 172.21.15.103:0/3699336067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd4077a10 msgr2=0x7fabd4077e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:49.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.985+0000 7fabdc600640 1 --2- 172.21.15.103:0/3699336067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd4077a10 0x7fabd4077e10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fabc8009900 tx=0x7fabc802a3f0 comp rx=0 tx=0).stop 2024-09-11T01:07:49.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.985+0000 7fabdc600640 1 -- 172.21.15.103:0/3699336067 shutdown_connections 2024-09-11T01:07:49.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.985+0000 7fabdc600640 1 --2- 172.21.15.103:0/3699336067 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd4079530 0x7fabd4079e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:49.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.985+0000 7fabdc600640 1 --2- 172.21.15.103:0/3699336067 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabd4078b70 0x7fabd4078ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:49.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.985+0000 7fabdc600640 1 --2- 172.21.15.103:0/3699336067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd4077a10 0x7fabd4077e10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:49.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.985+0000 7fabdc600640 1 -- 172.21.15.103:0/3699336067 >> 172.21.15.103:0/3699336067 conn(0x7fabd4100550 msgr2=0x7fabd4102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:49.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.985+0000 7fabdc600640 1 -- 172.21.15.103:0/3699336067 shutdown_connections 2024-09-11T01:07:49.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.985+0000 7fabdc600640 1 -- 172.21.15.103:0/3699336067 wait complete. 2024-09-11T01:07:49.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.986+0000 7fabdc600640 1 Processor -- start 2024-09-11T01:07:49.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.986+0000 7fabdc600640 1 -- start start 2024-09-11T01:07:49.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.986+0000 7fabdc600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd4077a10 0x7fabd419f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:49.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.986+0000 7fabdc600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabd4078b70 0x7fabd419fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:49.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.986+0000 7fabdc600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd4079530 0x7fabd41a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:49.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.986+0000 7fabdc600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fabd4114d20 con 0x7fabd4077a10 2024-09-11T01:07:49.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.986+0000 7fabdc600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fabd4114ba0 con 0x7fabd4078b70 2024-09-11T01:07:49.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.986+0000 7fabdc600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fabd4114ea0 con 0x7fabd4079530 2024-09-11T01:07:49.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.987+0000 7fabd9c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd4077a10 0x7fabd419f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:49.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.987+0000 7fabd9c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd4077a10 0x7fabd419f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40036/0 (socket says 172.21.15.103:40036) 2024-09-11T01:07:49.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.987+0000 7fabd9c00640 1 -- 172.21.15.103:0/3845758251 learned_addr learned my addr 172.21.15.103:0/3845758251 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:49.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.987+0000 7fabd9200640 1 --2- 172.21.15.103:0/3845758251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabd4078b70 0x7fabd419fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:49.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.987+0000 7fabda600640 1 --2- 172.21.15.103:0/3845758251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd4079530 0x7fabd41a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:49.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.987+0000 7fabd9c00640 1 -- 172.21.15.103:0/3845758251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd4079530 msgr2=0x7fabd41a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:49.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.987+0000 7fabd9c00640 1 --2- 172.21.15.103:0/3845758251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd4079530 0x7fabd41a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:49.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.987+0000 7fabd9c00640 1 -- 172.21.15.103:0/3845758251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabd4078b70 msgr2=0x7fabd419fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:49.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.987+0000 7fabd9c00640 1 --2- 172.21.15.103:0/3845758251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabd4078b70 0x7fabd419fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:49.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.987+0000 7fabd9c00640 1 -- 172.21.15.103:0/3845758251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd41a0f50 con 0x7fabd4077a10 2024-09-11T01:07:49.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.987+0000 7fabd9c00640 1 --2- 172.21.15.103:0/3845758251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd4077a10 0x7fabd419f420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fabc8005ab0 tx=0x7fabc8003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:49.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.988+0000 7fabd2000640 1 -- 172.21.15.103:0/3845758251 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc803f070 con 0x7fabd4077a10 2024-09-11T01:07:49.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.988+0000 7fabd2000640 1 -- 172.21.15.103:0/3845758251 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fabc8031c50 con 0x7fabd4077a10 2024-09-11T01:07:49.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.988+0000 7fabdc600640 1 -- 172.21.15.103:0/3845758251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd41a11e0 con 0x7fabd4077a10 2024-09-11T01:07:49.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.988+0000 7fabd2000640 1 -- 172.21.15.103:0/3845758251 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc8035030 con 0x7fabd4077a10 2024-09-11T01:07:49.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.988+0000 7fabdc600640 1 -- 172.21.15.103:0/3845758251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd41a7920 con 0x7fabd4077a10 2024-09-11T01:07:49.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.989+0000 7fabdc600640 1 -- 172.21.15.103:0/3845758251 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd4078ff0 con 0x7fabd4077a10 2024-09-11T01:07:49.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.991+0000 7fabd2000640 1 -- 172.21.15.103:0/3845758251 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7fabc803b4f0 con 0x7fabd4077a10 2024-09-11T01:07:49.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.992+0000 7fabd2000640 1 --2- 172.21.15.103:0/3845758251 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fabbc0b5360 0x7fabbc0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:49.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.993+0000 7fabd2000640 1 -- 172.21.15.103:0/3845758251 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fabc8106a50 con 0x7fabd4077a10 2024-09-11T01:07:49.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.993+0000 7fabd9200640 1 --2- 172.21.15.103:0/3845758251 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fabbc0b5360 0x7fabbc0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:49.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.994+0000 7fabd9200640 1 --2- 172.21.15.103:0/3845758251 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fabbc0b5360 0x7fabbc0b7820 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009bd0 tx=0x7fabc0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:49.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:49.997+0000 7fabd2000640 1 -- 172.21.15.103:0/3845758251 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fabc80cceb0 con 0x7fabd4077a10 2024-09-11T01:07:50.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:49 smithi117 ceph-mon[35358]: pgmap v384: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T01:07:50.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:49 smithi183 ceph-mon[34992]: pgmap v384: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T01:07:50.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:50.191+0000 7fabdc600640 1 -- 172.21.15.103:0/3845758251 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fabd4063650 con 0x7fabbc0b5360 2024-09-11T01:07:50.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:50.203+0000 7fabd2000640 1 -- 172.21.15.103:0/3845758251 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7fabd4063650 con 0x7fabbc0b5360 2024-09-11T01:07:50.206 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-11T01:07:50.206 INFO:teuthology.orchestra.run.smithi103.stdout:mds.a smithi103 running (2m) 12s ago 2m 13.3M - 19.3.0-4854-g8f219c47 589dd18248e4 8a9d96eff071 2024-09-11T01:07:50.206 INFO:teuthology.orchestra.run.smithi103.stdout:mds.b smithi117 running (2m) 15s ago 2m 26.7M - 19.3.0-4854-g8f219c47 589dd18248e4 5b9ffb307d24 2024-09-11T01:07:50.206 INFO:teuthology.orchestra.run.smithi103.stdout:mds.c smithi183 running (2m) 15s ago 2m 20.2M - 19.3.0-4854-g8f219c47 589dd18248e4 adefb5b2ca3f 2024-09-11T01:07:50.207 INFO:teuthology.orchestra.run.smithi103.stdout:mds.d smithi103 running (2m) 12s ago 2m 13.4M - 19.3.0-4854-g8f219c47 589dd18248e4 4fab1b12de5f 2024-09-11T01:07:50.207 INFO:teuthology.orchestra.run.smithi103.stdout:mds.e smithi117 running (2m) 15s ago 2m 19.0M - 19.3.0-4854-g8f219c47 589dd18248e4 4421820a92d1 2024-09-11T01:07:50.207 INFO:teuthology.orchestra.run.smithi103.stdout:mds.f smithi183 running (2m) 15s ago 2m 20.4M - 19.3.0-4854-g8f219c47 589dd18248e4 8cc09629b9d1 2024-09-11T01:07:50.207 INFO:teuthology.orchestra.run.smithi103.stdout:mds.g smithi103 running (2m) 12s ago 2m 13.3M - 19.3.0-4854-g8f219c47 589dd18248e4 9cf641a7d7ac 2024-09-11T01:07:50.207 INFO:teuthology.orchestra.run.smithi103.stdout:mds.h smithi117 running (2m) 15s ago 2m 19.5M - 19.3.0-4854-g8f219c47 589dd18248e4 6add133a429a 2024-09-11T01:07:50.207 INFO:teuthology.orchestra.run.smithi103.stdout:mds.i smithi183 running (2m) 15s ago 2m 21.9M - 19.3.0-4854-g8f219c47 589dd18248e4 41a1d2a651bd 2024-09-11T01:07:50.207 INFO:teuthology.orchestra.run.smithi103.stdout:mds.j smithi103 running (2m) 12s ago 2m 13.4M - 19.3.0-4854-g8f219c47 589dd18248e4 a4e62f8d4046 2024-09-11T01:07:50.207 INFO:teuthology.orchestra.run.smithi103.stdout:mds.k smithi117 running (3m) 15s ago 3m 17.3M - 19.3.0-4854-g8f219c47 589dd18248e4 90b23bd49b2b 2024-09-11T01:07:50.207 INFO:teuthology.orchestra.run.smithi103.stdout:mds.l smithi183 running (3m) 15s ago 3m 15.1M - 19.3.0-4854-g8f219c47 589dd18248e4 dc6e39605062 2024-09-11T01:07:50.207 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.x smithi103 *:9283,8765 running (10m) 12s ago 10m 526M - 19.3.0-4854-g8f219c47 589dd18248e4 f460f1556e77 2024-09-11T01:07:50.207 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.y smithi117 *:8443,8765 running (9m) 15s ago 9m 459M - 19.3.0-4854-g8f219c47 589dd18248e4 fff15aaaeebd 2024-09-11T01:07:50.207 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.z smithi183 *:8443,8765 running (9m) 15s ago 9m 456M - 19.3.0-4854-g8f219c47 589dd18248e4 0fca92bf242e 2024-09-11T01:07:50.207 INFO:teuthology.orchestra.run.smithi103.stdout:mon.a smithi103 running (10m) 12s ago 11m 51.6M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 9ef09c26e51e 2024-09-11T01:07:50.208 INFO:teuthology.orchestra.run.smithi103.stdout:mon.b smithi117 running (9m) 15s ago 9m 43.1M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 27fec113e201 2024-09-11T01:07:50.208 INFO:teuthology.orchestra.run.smithi103.stdout:mon.c smithi183 running (9m) 15s ago 9m 43.6M 2048M 19.3.0-4854-g8f219c47 589dd18248e4 379c184a15d3 2024-09-11T01:07:50.208 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (8m) 12s ago 8m 52.3M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 1d19dde10ef3 2024-09-11T01:07:50.208 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi117 running (7m) 15s ago 7m 53.7M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 cd8a1df76a8f 2024-09-11T01:07:50.208 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi183 running (7m) 15s ago 7m 47.0M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 94b252792824 2024-09-11T01:07:50.208 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi103 running (6m) 12s ago 6m 51.2M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 0d243a2fc2c7 2024-09-11T01:07:50.208 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi117 running (6m) 15s ago 6m 52.2M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 df5ed8cca470 2024-09-11T01:07:50.208 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi183 running (6m) 15s ago 6m 45.8M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 9c4fe80551ff 2024-09-11T01:07:50.208 INFO:teuthology.orchestra.run.smithi103.stdout:osd.6 smithi103 running (5m) 12s ago 5m 41.2M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 3cd3f5f00439 2024-09-11T01:07:50.208 INFO:teuthology.orchestra.run.smithi103.stdout:osd.7 smithi117 running (5m) 15s ago 5m 53.5M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 0c23d47d6687 2024-09-11T01:07:50.208 INFO:teuthology.orchestra.run.smithi103.stdout:osd.8 smithi183 running (4m) 15s ago 4m 43.9M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 88e852390928 2024-09-11T01:07:50.208 INFO:teuthology.orchestra.run.smithi103.stdout:osd.9 smithi103 running (4m) 12s ago 4m 50.0M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 d8cb9fe390f1 2024-09-11T01:07:50.208 INFO:teuthology.orchestra.run.smithi103.stdout:osd.10 smithi117 running (3m) 15s ago 3m 44.8M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 cfc822145279 2024-09-11T01:07:50.208 INFO:teuthology.orchestra.run.smithi103.stdout:osd.11 smithi183 running (3m) 15s ago 3m 50.5M 4272M 19.3.0-4854-g8f219c47 589dd18248e4 c4206e04fd76 2024-09-11T01:07:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:50.206+0000 7fabdc600640 1 -- 172.21.15.103:0/3845758251 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fabbc0b5360 msgr2=0x7fabbc0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:50.206+0000 7fabdc600640 1 --2- 172.21.15.103:0/3845758251 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fabbc0b5360 0x7fabbc0b7820 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009bd0 tx=0x7fabc0005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:50.206+0000 7fabdc600640 1 -- 172.21.15.103:0/3845758251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd4077a10 msgr2=0x7fabd419f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:50.206+0000 7fabdc600640 1 --2- 172.21.15.103:0/3845758251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd4077a10 0x7fabd419f420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fabc8005ab0 tx=0x7fabc8003b90 comp rx=0 tx=0).stop 2024-09-11T01:07:50.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:50.206+0000 7fabdc600640 1 -- 172.21.15.103:0/3845758251 shutdown_connections 2024-09-11T01:07:50.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:50.206+0000 7fabdc600640 1 --2- 172.21.15.103:0/3845758251 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fabbc0b5360 0x7fabbc0b7820 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:50.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:50.206+0000 7fabdc600640 1 --2- 172.21.15.103:0/3845758251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fabd4079530 0x7fabd41a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:50.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:50.206+0000 7fabdc600640 1 --2- 172.21.15.103:0/3845758251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fabd4078b70 0x7fabd419fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:50.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:50.206+0000 7fabdc600640 1 --2- 172.21.15.103:0/3845758251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fabd4077a10 0x7fabd419f420 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:50.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:50.206+0000 7fabdc600640 1 -- 172.21.15.103:0/3845758251 >> 172.21.15.103:0/3845758251 conn(0x7fabd4100550 msgr2=0x7fabd4102100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:50.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:50.206+0000 7fabdc600640 1 -- 172.21.15.103:0/3845758251 shutdown_connections 2024-09-11T01:07:50.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:50.206+0000 7fabdc600640 1 -- 172.21.15.103:0/3845758251 wait complete. 2024-09-11T01:07:50.965 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:50 smithi103 ceph-mon[30562]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:51.003 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-11T01:07:51.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:50 smithi117 ceph-mon[35358]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:51.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:50 smithi183 ceph-mon[34992]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:51.370 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:51.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:51 smithi103 ceph-mon[30562]: pgmap v385: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T01:07:51.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.988+0000 7ffaa9200640 1 -- 172.21.15.103:0/2432543801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa4105dc0 msgr2=0x7ffaa4106240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:51.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.988+0000 7ffaa9200640 1 --2- 172.21.15.103:0/2432543801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa4105dc0 0x7ffaa4106240 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009930 tx=0x7ffa9002a420 comp rx=0 tx=0).stop 2024-09-11T01:07:51.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.988+0000 7ffaa9200640 1 -- 172.21.15.103:0/2432543801 shutdown_connections 2024-09-11T01:07:51.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.988+0000 7ffaa9200640 1 --2- 172.21.15.103:0/2432543801 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffaa4106780 0x7ffaa410d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:51.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.988+0000 7ffaa9200640 1 --2- 172.21.15.103:0/2432543801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa4105dc0 0x7ffaa4106240 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:51.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.988+0000 7ffaa9200640 1 --2- 172.21.15.103:0/2432543801 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaa4104c60 0x7ffaa4105060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:51.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.988+0000 7ffaa9200640 1 -- 172.21.15.103:0/2432543801 >> 172.21.15.103:0/2432543801 conn(0x7ffaa4100510 msgr2=0x7ffaa4102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:51.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.988+0000 7ffaa9200640 1 -- 172.21.15.103:0/2432543801 shutdown_connections 2024-09-11T01:07:51.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.988+0000 7ffaa9200640 1 -- 172.21.15.103:0/2432543801 wait complete. 2024-09-11T01:07:51.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.989+0000 7ffaa9200640 1 Processor -- start 2024-09-11T01:07:51.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.989+0000 7ffaa9200640 1 -- start start 2024-09-11T01:07:51.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.989+0000 7ffaa9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa4104c60 0x7ffaa419b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:51.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.989+0000 7ffaa9200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffaa4105dc0 0x7ffaa419b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:51.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.989+0000 7ffaa9200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaa4106780 0x7ffaa419c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:51.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.989+0000 7ffaa9200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa4110930 con 0x7ffaa4104c60 2024-09-11T01:07:51.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.990+0000 7ffaa9200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa41107b0 con 0x7ffaa4106780 2024-09-11T01:07:51.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.990+0000 7ffaa9200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffaa4110ab0 con 0x7ffaa4105dc0 2024-09-11T01:07:51.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.990+0000 7ffaa1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa4104c60 0x7ffaa419b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:51.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.990+0000 7ffaa1e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa4104c60 0x7ffaa419b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40056/0 (socket says 172.21.15.103:40056) 2024-09-11T01:07:51.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.990+0000 7ffaa1e00640 1 -- 172.21.15.103:0/4143916048 learned_addr learned my addr 172.21.15.103:0/4143916048 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:51.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.990+0000 7ffaa2800640 1 --2- 172.21.15.103:0/4143916048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaa4106780 0x7ffaa419c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:51.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.990+0000 7ffaa1400640 1 --2- 172.21.15.103:0/4143916048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffaa4105dc0 0x7ffaa419b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:51.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.990+0000 7ffaa1e00640 1 -- 172.21.15.103:0/4143916048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffaa4105dc0 msgr2=0x7ffaa419b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:51.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.990+0000 7ffaa1e00640 1 --2- 172.21.15.103:0/4143916048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffaa4105dc0 0x7ffaa419b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:51.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.990+0000 7ffaa1e00640 1 -- 172.21.15.103:0/4143916048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaa4106780 msgr2=0x7ffaa419c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:51.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.990+0000 7ffaa1e00640 1 --2- 172.21.15.103:0/4143916048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaa4106780 0x7ffaa419c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:51.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.990+0000 7ffaa1e00640 1 -- 172.21.15.103:0/4143916048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaa419cb60 con 0x7ffaa4104c60 2024-09-11T01:07:51.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.991+0000 7ffaa1e00640 1 --2- 172.21.15.103:0/4143916048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa4104c60 0x7ffaa419b030 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400e9f0 tx=0x7ffa9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:51.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.991+0000 7ffa9aa00640 1 -- 172.21.15.103:0/4143916048 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400cd80 con 0x7ffaa4104c60 2024-09-11T01:07:51.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.991+0000 7ffa9aa00640 1 -- 172.21.15.103:0/4143916048 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa940108e0 con 0x7ffaa4104c60 2024-09-11T01:07:51.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.991+0000 7ffaa9200640 1 -- 172.21.15.103:0/4143916048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaa419ce50 con 0x7ffaa4104c60 2024-09-11T01:07:51.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.991+0000 7ffa9aa00640 1 -- 172.21.15.103:0/4143916048 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa94018980 con 0x7ffaa4104c60 2024-09-11T01:07:51.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.991+0000 7ffaa9200640 1 -- 172.21.15.103:0/4143916048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaa41a3530 con 0x7ffaa4104c60 2024-09-11T01:07:51.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.992+0000 7ffaa9200640 1 -- 172.21.15.103:0/4143916048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaa410bfe0 con 0x7ffaa4104c60 2024-09-11T01:07:51.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.994+0000 7ffa9aa00640 1 -- 172.21.15.103:0/4143916048 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7ffa94010430 con 0x7ffaa4104c60 2024-09-11T01:07:51.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.995+0000 7ffa9aa00640 1 --2- 172.21.15.103:0/4143916048 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffa880b52e0 0x7ffa880b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:51.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.996+0000 7ffa9aa00640 1 -- 172.21.15.103:0/4143916048 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7ffa940e62d0 con 0x7ffaa4104c60 2024-09-11T01:07:51.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.996+0000 7ffaa1400640 1 --2- 172.21.15.103:0/4143916048 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffa880b52e0 0x7ffa880b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:51.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.996+0000 7ffaa1400640 1 --2- 172.21.15.103:0/4143916048 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffa880b52e0 0x7ffa880b77a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009900 tx=0x7ffa90031450 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:52.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:51.999+0000 7ffa9aa00640 1 -- 172.21.15.103:0/4143916048 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ffa940ac730 con 0x7ffaa4104c60 2024-09-11T01:07:52.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:51 smithi117 ceph-mon[35358]: pgmap v385: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T01:07:52.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:51 smithi183 ceph-mon[34992]: pgmap v385: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T01:07:52.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:52.190+0000 7ffaa9200640 1 -- 172.21.15.103:0/4143916048 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7ffaa4063590 con 0x7ffa880b52e0 2024-09-11T01:07:52.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:52.196+0000 7ffa9aa00640 1 -- 172.21.15.103:0/4143916048 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7ffaa4063590 con 0x7ffa880b52e0 2024-09-11T01:07:52.199 INFO:teuthology.orchestra.run.smithi103.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-11T01:07:52.199 INFO:teuthology.orchestra.run.smithi103.stdout:mds.all 12/12 17s ago 3m smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi117=b;smithi117=e;smithi117=h;smithi117=k;smithi183=c;smithi183=f;smithi183=i;smithi183=l;count:12 2024-09-11T01:07:52.199 INFO:teuthology.orchestra.run.smithi103.stdout:mgr 3/3 17s ago 9m smithi103=x;smithi117=y;smithi183=z;count:3 2024-09-11T01:07:52.199 INFO:teuthology.orchestra.run.smithi103.stdout:mon 3/3 17s ago 9m smithi103:172.21.15.103=a;smithi117:172.21.15.117=b;smithi183:172.21.15.183=c;count:3 2024-09-11T01:07:52.199 INFO:teuthology.orchestra.run.smithi103.stdout:osd 12 17s ago - 2024-09-11T01:07:52.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:52.198+0000 7ffaa9200640 1 -- 172.21.15.103:0/4143916048 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffa880b52e0 msgr2=0x7ffa880b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:52.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:52.198+0000 7ffaa9200640 1 --2- 172.21.15.103:0/4143916048 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffa880b52e0 0x7ffa880b77a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ffa90009900 tx=0x7ffa90031450 comp rx=0 tx=0).stop 2024-09-11T01:07:52.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:52.198+0000 7ffaa9200640 1 -- 172.21.15.103:0/4143916048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa4104c60 msgr2=0x7ffaa419b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:52.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:52.199+0000 7ffaa9200640 1 --2- 172.21.15.103:0/4143916048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa4104c60 0x7ffaa419b030 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ffa9400e9f0 tx=0x7ffa9400eeb0 comp rx=0 tx=0).stop 2024-09-11T01:07:52.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:52.199+0000 7ffaa9200640 1 -- 172.21.15.103:0/4143916048 shutdown_connections 2024-09-11T01:07:52.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:52.199+0000 7ffaa9200640 1 --2- 172.21.15.103:0/4143916048 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffa880b52e0 0x7ffa880b77a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:52.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:52.199+0000 7ffaa9200640 1 --2- 172.21.15.103:0/4143916048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffaa4106780 0x7ffaa419c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:52.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:52.199+0000 7ffaa9200640 1 --2- 172.21.15.103:0/4143916048 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffaa4105dc0 0x7ffaa419b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:52.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:52.199+0000 7ffaa9200640 1 --2- 172.21.15.103:0/4143916048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffaa4104c60 0x7ffaa419b030 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:52.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:52.199+0000 7ffaa9200640 1 -- 172.21.15.103:0/4143916048 >> 172.21.15.103:0/4143916048 conn(0x7ffaa4100510 msgr2=0x7ffaa41091b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:52.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:52.199+0000 7ffaa9200640 1 -- 172.21.15.103:0/4143916048 shutdown_connections 2024-09-11T01:07:52.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:52.199+0000 7ffaa9200640 1 -- 172.21.15.103:0/4143916048 wait complete. 2024-09-11T01:07:52.950 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:52 smithi103 ceph-mon[30562]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:52.987 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-11T01:07:53.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:52 smithi117 ceph-mon[35358]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:53.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:52 smithi183 ceph-mon[34992]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:53.358 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:53.749 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:53 smithi103 ceph-mon[30562]: pgmap v386: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T01:07:54.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.107+0000 7f4b69400640 1 -- 172.21.15.103:0/3415795451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64106760 msgr2=0x7f4b6410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.107+0000 7f4b69400640 1 --2- 172.21.15.103:0/3415795451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64106760 0x7f4b6410d0e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c009cd0 tx=0x7f4b5c02a8e0 comp rx=0 tx=0).stop 2024-09-11T01:07:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.108+0000 7f4b69400640 1 -- 172.21.15.103:0/3415795451 shutdown_connections 2024-09-11T01:07:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.108+0000 7f4b69400640 1 --2- 172.21.15.103:0/3415795451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64106760 0x7f4b6410d0e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.108+0000 7f4b69400640 1 --2- 172.21.15.103:0/3415795451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b64105da0 0x7f4b64106220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.108+0000 7f4b69400640 1 --2- 172.21.15.103:0/3415795451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b64104c40 0x7f4b64105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.108+0000 7f4b69400640 1 -- 172.21.15.103:0/3415795451 >> 172.21.15.103:0/3415795451 conn(0x7f4b64100550 msgr2=0x7f4b64102970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.108+0000 7f4b69400640 1 -- 172.21.15.103:0/3415795451 shutdown_connections 2024-09-11T01:07:54.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.108+0000 7f4b69400640 1 -- 172.21.15.103:0/3415795451 wait complete. 2024-09-11T01:07:54.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.109+0000 7f4b69400640 1 Processor -- start 2024-09-11T01:07:54.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.109+0000 7f4b69400640 1 -- start start 2024-09-11T01:07:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.109+0000 7f4b69400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b64104c40 0x7f4b6419b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.109+0000 7f4b69400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64105da0 0x7f4b6419b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.109+0000 7f4b69400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b64106760 0x7f4b6419c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.109+0000 7f4b69400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4b641108a0 con 0x7f4b64105da0 2024-09-11T01:07:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.109+0000 7f4b69400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4b64110720 con 0x7f4b64106760 2024-09-11T01:07:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.109+0000 7f4b69400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4b64110a20 con 0x7f4b64104c40 2024-09-11T01:07:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.109+0000 7f4b59e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64105da0 0x7f4b6419b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.109+0000 7f4b59e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64105da0 0x7f4b6419b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40074/0 (socket says 172.21.15.103:40074) 2024-09-11T01:07:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.109+0000 7f4b59e00640 1 -- 172.21.15.103:0/4119622476 learned_addr learned my addr 172.21.15.103:0/4119622476 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.110+0000 7f4b62800640 1 --2- 172.21.15.103:0/4119622476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b64104c40 0x7f4b6419b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.110+0000 7f4b63200640 1 --2- 172.21.15.103:0/4119622476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b64106760 0x7f4b6419c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.110+0000 7f4b59e00640 1 -- 172.21.15.103:0/4119622476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b64104c40 msgr2=0x7f4b6419b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:54.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.110+0000 7f4b59e00640 1 --2- 172.21.15.103:0/4119622476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b64104c40 0x7f4b6419b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:54.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.110+0000 7f4b59e00640 1 -- 172.21.15.103:0/4119622476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b64106760 msgr2=0x7f4b6419c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:54.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.110+0000 7f4b59e00640 1 --2- 172.21.15.103:0/4119622476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b64106760 0x7f4b6419c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:54.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.110+0000 7f4b59e00640 1 -- 172.21.15.103:0/4119622476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6419cb50 con 0x7f4b64105da0 2024-09-11T01:07:54.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.110+0000 7f4b59e00640 1 --2- 172.21.15.103:0/4119622476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64105da0 0x7f4b6419b670 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00e9f0 tx=0x7f4b4c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:54.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.110+0000 7f4b5be00640 1 -- 172.21.15.103:0/4119622476 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c00cd80 con 0x7f4b64105da0 2024-09-11T01:07:54.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.111+0000 7f4b69400640 1 -- 172.21.15.103:0/4119622476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6419ce40 con 0x7f4b64105da0 2024-09-11T01:07:54.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.111+0000 7f4b5be00640 1 -- 172.21.15.103:0/4119622476 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4b4c0108e0 con 0x7f4b64105da0 2024-09-11T01:07:54.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.111+0000 7f4b5be00640 1 -- 172.21.15.103:0/4119622476 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c018980 con 0x7f4b64105da0 2024-09-11T01:07:54.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.111+0000 7f4b69400640 1 -- 172.21.15.103:0/4119622476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b641a3520 con 0x7f4b64105da0 2024-09-11T01:07:54.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.112+0000 7f4b69400640 1 -- 172.21.15.103:0/4119622476 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b6410bf60 con 0x7f4b64105da0 2024-09-11T01:07:54.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.114+0000 7f4b5be00640 1 -- 172.21.15.103:0/4119622476 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7f4b4c010430 con 0x7f4b64105da0 2024-09-11T01:07:54.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.115+0000 7f4b5be00640 1 --2- 172.21.15.103:0/4119622476 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4b480b52e0 0x7f4b480b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:54.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.116+0000 7f4b5be00640 1 -- 172.21.15.103:0/4119622476 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f4b4c0e67e0 con 0x7f4b64105da0 2024-09-11T01:07:54.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.116+0000 7f4b62800640 1 --2- 172.21.15.103:0/4119622476 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4b480b52e0 0x7f4b480b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:54.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.116+0000 7f4b62800640 1 --2- 172.21.15.103:0/4119622476 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4b480b52e0 0x7f4b480b77a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009bd0 tx=0x7f4b54005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:54.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.118+0000 7f4b5be00640 1 -- 172.21.15.103:0/4119622476 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f4b4c0acc40 con 0x7f4b64105da0 2024-09-11T01:07:54.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:53 smithi117 ceph-mon[35358]: pgmap v386: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T01:07:54.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:53 smithi183 ceph-mon[34992]: pgmap v386: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 597 B/s wr, 7 op/s 2024-09-11T01:07:54.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.307+0000 7f4b69400640 1 -- 172.21.15.103:0/4119622476 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f4b64063590 con 0x7f4b480b52e0 2024-09-11T01:07:54.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.309+0000 7f4b5be00640 1 -- 172.21.15.103:0/4119622476 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f4b64063590 con 0x7f4b480b52e0 2024-09-11T01:07:54.312 INFO:teuthology.orchestra.run.smithi103.stdout:HOST ADDR LABELS STATUS 2024-09-11T01:07:54.312 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103 172.21.15.103 2024-09-11T01:07:54.312 INFO:teuthology.orchestra.run.smithi103.stdout:smithi117 172.21.15.117 2024-09-11T01:07:54.312 INFO:teuthology.orchestra.run.smithi103.stdout:smithi183 172.21.15.183 2024-09-11T01:07:54.312 INFO:teuthology.orchestra.run.smithi103.stdout:3 hosts in cluster 2024-09-11T01:07:54.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.312+0000 7f4b69400640 1 -- 172.21.15.103:0/4119622476 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4b480b52e0 msgr2=0x7f4b480b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:54.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.312+0000 7f4b69400640 1 --2- 172.21.15.103:0/4119622476 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4b480b52e0 0x7f4b480b77a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009bd0 tx=0x7f4b54005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:54.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.312+0000 7f4b69400640 1 -- 172.21.15.103:0/4119622476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64105da0 msgr2=0x7f4b6419b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:54.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.312+0000 7f4b69400640 1 --2- 172.21.15.103:0/4119622476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64105da0 0x7f4b6419b670 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c00e9f0 tx=0x7f4b4c00eeb0 comp rx=0 tx=0).stop 2024-09-11T01:07:54.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.312+0000 7f4b69400640 1 -- 172.21.15.103:0/4119622476 shutdown_connections 2024-09-11T01:07:54.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.312+0000 7f4b69400640 1 --2- 172.21.15.103:0/4119622476 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4b480b52e0 0x7f4b480b77a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:54.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.312+0000 7f4b69400640 1 --2- 172.21.15.103:0/4119622476 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4b64106760 0x7f4b6419c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:54.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.312+0000 7f4b69400640 1 --2- 172.21.15.103:0/4119622476 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4b64105da0 0x7f4b6419b670 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:54.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.312+0000 7f4b69400640 1 --2- 172.21.15.103:0/4119622476 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4b64104c40 0x7f4b6419b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:54.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.312+0000 7f4b69400640 1 -- 172.21.15.103:0/4119622476 >> 172.21.15.103:0/4119622476 conn(0x7f4b64100550 msgr2=0x7f4b64109130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:54.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.312+0000 7f4b69400640 1 -- 172.21.15.103:0/4119622476 shutdown_connections 2024-09-11T01:07:54.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:54.312+0000 7f4b69400640 1 -- 172.21.15.103:0/4119622476 wait complete. 2024-09-11T01:07:55.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:54 smithi103 ceph-mon[30562]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:55.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:54 smithi117 ceph-mon[35358]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:55.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:54 smithi183 ceph-mon[34992]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:55.179 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-11T01:07:55.549 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:55.997 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:55 smithi103 ceph-mon[30562]: pgmap v387: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-11T01:07:56.024 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:55 smithi117 ceph-mon[35358]: pgmap v387: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-11T01:07:56.070 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:55 smithi183 ceph-mon[34992]: pgmap v387: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 341 B/s wr, 6 op/s 2024-09-11T01:07:56.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.107+0000 7f6453400640 1 -- 172.21.15.103:0/4263132077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f644c105da0 msgr2=0x7f644c106220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:56.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.107+0000 7f6453400640 1 --2- 172.21.15.103:0/4263132077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f644c105da0 0x7f644c106220 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6438009930 tx=0x7f643802a420 comp rx=0 tx=0).stop 2024-09-11T01:07:56.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.107+0000 7f6453400640 1 -- 172.21.15.103:0/4263132077 shutdown_connections 2024-09-11T01:07:56.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.107+0000 7f6453400640 1 --2- 172.21.15.103:0/4263132077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f644c106760 0x7f644c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:56.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.107+0000 7f6453400640 1 --2- 172.21.15.103:0/4263132077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f644c105da0 0x7f644c106220 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:56.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.107+0000 7f6453400640 1 --2- 172.21.15.103:0/4263132077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f644c104c40 0x7f644c105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:56.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.107+0000 7f6453400640 1 -- 172.21.15.103:0/4263132077 >> 172.21.15.103:0/4263132077 conn(0x7f644c100510 msgr2=0x7f644c102950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:56.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.107+0000 7f6453400640 1 -- 172.21.15.103:0/4263132077 shutdown_connections 2024-09-11T01:07:56.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.107+0000 7f6453400640 1 -- 172.21.15.103:0/4263132077 wait complete. 2024-09-11T01:07:56.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.108+0000 7f6453400640 1 Processor -- start 2024-09-11T01:07:56.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.108+0000 7f6453400640 1 -- start start 2024-09-11T01:07:56.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.108+0000 7f6453400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f644c104c40 0x7f644c19aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:56.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.108+0000 7f6453400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f644c105da0 0x7f644c19b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:56.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.108+0000 7f6453400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f644c106760 0x7f644c19c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:56.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.108+0000 7f6453400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f644c1108c0 con 0x7f644c106760 2024-09-11T01:07:56.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.108+0000 7f6453400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f644c110740 con 0x7f644c105da0 2024-09-11T01:07:56.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.108+0000 7f6453400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f644c110a40 con 0x7f644c104c40 2024-09-11T01:07:56.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.109+0000 7f6451400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f644c106760 0x7f644c19c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:56.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.109+0000 7f644be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f644c105da0 0x7f644c19b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:56.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.109+0000 7f6451400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f644c106760 0x7f644c19c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40086/0 (socket says 172.21.15.103:40086) 2024-09-11T01:07:56.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.109+0000 7f6451400640 1 -- 172.21.15.103:0/2770055614 learned_addr learned my addr 172.21.15.103:0/2770055614 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:56.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.109+0000 7f644be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f644c105da0 0x7f644c19b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:36732/0 (socket says 172.21.15.103:36732) 2024-09-11T01:07:56.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.109+0000 7f6450a00640 1 --2- 172.21.15.103:0/2770055614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f644c104c40 0x7f644c19aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:56.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.109+0000 7f6451400640 1 -- 172.21.15.103:0/2770055614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f644c104c40 msgr2=0x7f644c19aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:56.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.109+0000 7f6451400640 1 --2- 172.21.15.103:0/2770055614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f644c104c40 0x7f644c19aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:56.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.109+0000 7f6451400640 1 -- 172.21.15.103:0/2770055614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f644c105da0 msgr2=0x7f644c19b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:56.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.109+0000 7f6451400640 1 --2- 172.21.15.103:0/2770055614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f644c105da0 0x7f644c19b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:56.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.109+0000 7f6451400640 1 -- 172.21.15.103:0/2770055614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c19cb20 con 0x7f644c106760 2024-09-11T01:07:56.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.109+0000 7f6450a00640 1 --2- 172.21.15.103:0/2770055614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f644c104c40 0x7f644c19aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:07:56.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.109+0000 7f6451400640 1 --2- 172.21.15.103:0/2770055614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f644c106760 0x7f644c19c280 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f644400eb10 tx=0x7f644400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:56.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.110+0000 7f6449600640 1 -- 172.21.15.103:0/2770055614 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444004b20 con 0x7f644c106760 2024-09-11T01:07:56.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.110+0000 7f6453400640 1 -- 172.21.15.103:0/2770055614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c19ce10 con 0x7f644c106760 2024-09-11T01:07:56.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.110+0000 7f6449600640 1 -- 172.21.15.103:0/2770055614 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6444004cc0 con 0x7f644c106760 2024-09-11T01:07:56.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.110+0000 7f6453400640 1 -- 172.21.15.103:0/2770055614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c1a34f0 con 0x7f644c106760 2024-09-11T01:07:56.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.110+0000 7f6449600640 1 -- 172.21.15.103:0/2770055614 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444018630 con 0x7f644c106760 2024-09-11T01:07:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.111+0000 7f6453400640 1 -- 172.21.15.103:0/2770055614 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644c10bfc0 con 0x7f644c106760 2024-09-11T01:07:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.113+0000 7f6449600640 1 -- 172.21.15.103:0/2770055614 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7f6444005000 con 0x7f644c106760 2024-09-11T01:07:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.114+0000 7f6449600640 1 --2- 172.21.15.103:0/2770055614 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f64340b52e0 0x7f64340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.115+0000 7f6449600640 1 -- 172.21.15.103:0/2770055614 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f64440e6690 con 0x7f644c106760 2024-09-11T01:07:56.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.115+0000 7f6450a00640 1 --2- 172.21.15.103:0/2770055614 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f64340b52e0 0x7f64340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:56.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.115+0000 7f6450a00640 1 --2- 172.21.15.103:0/2770055614 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f64340b52e0 0x7f64340b77a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f64400095f0 tx=0x7f6440005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:56.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.118+0000 7f6449600640 1 -- 172.21.15.103:0/2770055614 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f64440ad140 con 0x7f644c106760 2024-09-11T01:07:56.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.309+0000 7f6453400640 1 -- 172.21.15.103:0/2770055614 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f644c063590 con 0x7f64340b52e0 2024-09-11T01:07:56.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.311+0000 7f6449600640 1 -- 172.21.15.103:0/2770055614 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f644c063590 con 0x7f64340b52e0 2024-09-11T01:07:56.314 INFO:teuthology.orchestra.run.smithi103.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-11T01:07:56.314 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-09-11T01:07:56.314 INFO:teuthology.orchestra.run.smithi103.stdout:smithi117 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400V6400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-11T01:07:56.315 INFO:teuthology.orchestra.run.smithi103.stdout:smithi183 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500QJ400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-11T01:07:56.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.314+0000 7f6453400640 1 -- 172.21.15.103:0/2770055614 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f64340b52e0 msgr2=0x7f64340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:56.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.314+0000 7f6453400640 1 --2- 172.21.15.103:0/2770055614 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f64340b52e0 0x7f64340b77a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f64400095f0 tx=0x7f6440005f90 comp rx=0 tx=0).stop 2024-09-11T01:07:56.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.314+0000 7f6453400640 1 -- 172.21.15.103:0/2770055614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f644c106760 msgr2=0x7f644c19c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:56.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.314+0000 7f6453400640 1 --2- 172.21.15.103:0/2770055614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f644c106760 0x7f644c19c280 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f644400eb10 tx=0x7f644400c2d0 comp rx=0 tx=0).stop 2024-09-11T01:07:56.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.314+0000 7f6453400640 1 -- 172.21.15.103:0/2770055614 shutdown_connections 2024-09-11T01:07:56.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.314+0000 7f6453400640 1 --2- 172.21.15.103:0/2770055614 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f64340b52e0 0x7f64340b77a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:56.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.314+0000 7f6453400640 1 --2- 172.21.15.103:0/2770055614 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f644c106760 0x7f644c19c280 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:56.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.314+0000 7f6453400640 1 --2- 172.21.15.103:0/2770055614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f644c105da0 0x7f644c19b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:56.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.314+0000 7f6453400640 1 --2- 172.21.15.103:0/2770055614 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f644c104c40 0x7f644c19aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:56.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.314+0000 7f6453400640 1 -- 172.21.15.103:0/2770055614 >> 172.21.15.103:0/2770055614 conn(0x7f644c100510 msgr2=0x7f644c109190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:56.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.314+0000 7f6453400640 1 -- 172.21.15.103:0/2770055614 shutdown_connections 2024-09-11T01:07:56.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:56.314+0000 7f6453400640 1 -- 172.21.15.103:0/2770055614 wait complete. 2024-09-11T01:07:56.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:56 smithi103 ceph-mon[30562]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:57.101 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-11T01:07:57.110 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T01:07:57.110 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-11T01:07:57.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:56 smithi117 ceph-mon[35358]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:57.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:56 smithi183 ceph-mon[34992]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:07:57.506 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:07:58.015 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:57 smithi103 ceph-mon[30562]: pgmap v388: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:58.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:57 smithi117 ceph-mon[35358]: pgmap v388: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:58.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.125+0000 7f600f600640 1 -- 172.21.15.103:0/3054304374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6008076f80 msgr2=0x7f60080755e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:58.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.125+0000 7f600f600640 1 --2- 172.21.15.103:0/3054304374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6008076f80 0x7f60080755e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc009900 tx=0x7f5ffc02a3f0 comp rx=0 tx=0).stop 2024-09-11T01:07:58.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.125+0000 7f600f600640 1 -- 172.21.15.103:0/3054304374 shutdown_connections 2024-09-11T01:07:58.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.125+0000 7f600f600640 1 --2- 172.21.15.103:0/3054304374 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6008106550 0x7f6008111210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:58.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.125+0000 7f600f600640 1 --2- 172.21.15.103:0/3054304374 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6008075b20 0x7f6008075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:58.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.125+0000 7f600f600640 1 --2- 172.21.15.103:0/3054304374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6008076f80 0x7f60080755e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.125+0000 7f600f600640 1 -- 172.21.15.103:0/3054304374 >> 172.21.15.103:0/3054304374 conn(0x7f60080fe320 msgr2=0x7f6008100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.125+0000 7f600f600640 1 -- 172.21.15.103:0/3054304374 shutdown_connections 2024-09-11T01:07:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.125+0000 7f600f600640 1 -- 172.21.15.103:0/3054304374 wait complete. 2024-09-11T01:07:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.126+0000 7f600f600640 1 Processor -- start 2024-09-11T01:07:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.127+0000 7f600f600640 1 -- start start 2024-09-11T01:07:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.127+0000 7f600f600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6008075b20 0x7f600819f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.127+0000 7f600f600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6008076f80 0x7f600819faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.127+0000 7f600f600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60081a06e0 0x7f60081a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.127+0000 7f600f600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6008114cc0 con 0x7f6008075b20 2024-09-11T01:07:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.127+0000 7f600f600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6008114b40 con 0x7f60081a06e0 2024-09-11T01:07:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.127+0000 7f600f600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6008114e40 con 0x7f6008076f80 2024-09-11T01:07:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.127+0000 7f6007e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6008076f80 0x7f600819faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:58.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.127+0000 7f6007e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6008076f80 0x7f600819faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:55640/0 (socket says 172.21.15.103:55640) 2024-09-11T01:07:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.127+0000 7f6007e00640 1 -- 172.21.15.103:0/2333796376 learned_addr learned my addr 172.21.15.103:0/2333796376 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:07:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.127+0000 7f600cc00640 1 --2- 172.21.15.103:0/2333796376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6008075b20 0x7f600819f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.127+0000 7f600d600640 1 --2- 172.21.15.103:0/2333796376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60081a06e0 0x7f60081a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.128+0000 7f6007e00640 1 -- 172.21.15.103:0/2333796376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60081a06e0 msgr2=0x7f60081a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.128+0000 7f6007e00640 1 --2- 172.21.15.103:0/2333796376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60081a06e0 0x7f60081a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.128+0000 7f6007e00640 1 -- 172.21.15.103:0/2333796376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6008075b20 msgr2=0x7f600819f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.128+0000 7f6007e00640 1 --2- 172.21.15.103:0/2333796376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6008075b20 0x7f600819f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.128+0000 7f6007e00640 1 -- 172.21.15.103:0/2333796376 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60081a1360 con 0x7f6008076f80 2024-09-11T01:07:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.128+0000 7f6007e00640 1 --2- 172.21.15.103:0/2333796376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6008076f80 0x7f600819faa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400e9f0 tx=0x7f5ff400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.128+0000 7f6005600640 1 -- 172.21.15.103:0/2333796376 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff400ccc0 con 0x7f6008076f80 2024-09-11T01:07:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.128+0000 7f600f600640 1 -- 172.21.15.103:0/2333796376 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60081a7780 con 0x7f6008076f80 2024-09-11T01:07:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.128+0000 7f6005600640 1 -- 172.21.15.103:0/2333796376 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ff400ce60 con 0x7f6008076f80 2024-09-11T01:07:58.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.128+0000 7f6005600640 1 -- 172.21.15.103:0/2333796376 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4010430 con 0x7f6008076f80 2024-09-11T01:07:58.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.128+0000 7f600f600640 1 -- 172.21.15.103:0/2333796376 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60081a7c30 con 0x7f6008076f80 2024-09-11T01:07:58.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.129+0000 7f600f600640 1 -- 172.21.15.103:0/2333796376 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6008075fa0 con 0x7f6008076f80 2024-09-11T01:07:58.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.132+0000 7f6005600640 1 -- 172.21.15.103:0/2333796376 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7f5ff40046c0 con 0x7f6008076f80 2024-09-11T01:07:58.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.134+0000 7f6005600640 1 --2- 172.21.15.103:0/2333796376 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5ff00b52e0 0x7f5ff00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:07:58.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.134+0000 7f6005600640 1 -- 172.21.15.103:0/2333796376 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5ff40e6580 con 0x7f6008076f80 2024-09-11T01:07:58.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.134+0000 7f600cc00640 1 --2- 172.21.15.103:0/2333796376 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5ff00b52e0 0x7f5ff00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:07:58.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.135+0000 7f600cc00640 1 --2- 172.21.15.103:0/2333796376 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5ff00b52e0 0x7f5ff00b77a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc000c00 tx=0x7f5ffc0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:07:58.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.135+0000 7f6005600640 1 -- 172.21.15.103:0/2333796376 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5ff4056220 con 0x7f6008076f80 2024-09-11T01:07:58.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:57 smithi183 ceph-mon[34992]: pgmap v388: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:07:58.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.356+0000 7f600f600640 1 -- 172.21.15.103:0/2333796376 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f60081a7ef0 con 0x7f6008076f80 2024-09-11T01:07:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.356+0000 7f6005600640 1 -- 172.21.15.103:0/2333796376 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3100 (secure 0 0 0) 0x7f5ff40ad030 con 0x7f6008076f80 2024-09-11T01:07:58.359 INFO:teuthology.orchestra.run.smithi103.stdout:e25 2024-09-11T01:07:58.359 INFO:teuthology.orchestra.run.smithi103.stdout:btime 2024-09-11T01:06:22:641923+0000 2024-09-11T01:07:58.359 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-11T01:07:58.360 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T01:07:58.360 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-09-11T01:07:58.360 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:07:58.360 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-09-11T01:07:58.360 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-09-11T01:07:58.360 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 25 2024-09-11T01:07:58.360 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-11T01:07:58.360 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-11T01:05:32.767364+0000 2024-09-11T01:07:58.360 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-11T01:06:22.629934+0000 2024-09-11T01:07:58.360 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-09-11T01:07:58.360 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-09-11T01:07:58.360 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 300 2024-09-11T01:07:58.360 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-09-11T01:07:58.361 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-09-11T01:07:58.361 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-09-11T01:07:58.361 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-09-11T01:07:58.361 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-09-11T01:07:58.361 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-09-11T01:07:58.361 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-11T01:07:58.361 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 3 2024-09-11T01:07:58.361 INFO:teuthology.orchestra.run.smithi103.stdout:in 0,1,2 2024-09-11T01:07:58.361 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=24665,1=24629,2=24619} 2024-09-11T01:07:58.361 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-09-11T01:07:58.361 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-09-11T01:07:58.361 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-09-11T01:07:58.361 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3,4] 2024-09-11T01:07:58.361 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-09-11T01:07:58.362 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-09-11T01:07:58.362 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-09-11T01:07:58.362 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-09-11T01:07:58.362 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 0 2024-09-11T01:07:58.362 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 24665 members: 24619,24629,24665 2024-09-11T01:07:58.362 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b{0:24665} state up:active seq 5 addr [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T01:07:58.362 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c{0:24607} state up:standby-replay seq 1 addr [v2:172.21.15.183:6836/1863510967,v1:172.21.15.183:6837/1863510967] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T01:07:58.362 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.h{1:24629} state up:active seq 19 addr [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T01:07:58.362 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.e{1:24602} state up:standby-replay seq 1 addr [v2:172.21.15.117:6834/3506900188,v1:172.21.15.117:6835/3506900188] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T01:07:58.362 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.i{2:24619} state up:active seq 19 addr [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T01:07:58.362 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.f{2:24595} state up:standby-replay seq 1 addr [v2:172.21.15.183:6834/2084396200,v1:172.21.15.183:6835/2084396200] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T01:07:58.362 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:07:58.362 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:07:58.363 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-09-11T01:07:58.363 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:07:58.363 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d{-1:14598} state up:standby seq 1 addr [v2:172.21.15.103:6836/556566266,v1:172.21.15.103:6837/556566266] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T01:07:58.363 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.g{-1:14637} state up:standby seq 1 addr [v2:172.21.15.103:6838/83536310,v1:172.21.15.103:6839/83536310] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T01:07:58.363 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a{-1:14643} state up:standby seq 1 addr [v2:172.21.15.103:6840/4189792187,v1:172.21.15.103:6841/4189792187] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T01:07:58.363 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.l{-1:24556} state up:standby seq 1 addr [v2:172.21.15.183:6832/3089120088,v1:172.21.15.183:6833/3089120088] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T01:07:58.363 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.k{-1:24572} state up:standby seq 1 addr [v2:172.21.15.117:6832/3818376861,v1:172.21.15.117:6833/3818376861] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T01:07:58.363 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.j{-1:24584} state up:standby seq 1 addr [v2:172.21.15.103:6834/1479863011,v1:172.21.15.103:6835/1479863011] compat {c=[1],r=[1],i=[1fff]}] 2024-09-11T01:07:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-09-11T01:07:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.359+0000 7f600f600640 1 -- 172.21.15.103:0/2333796376 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5ff00b52e0 msgr2=0x7f5ff00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.359+0000 7f600f600640 1 --2- 172.21.15.103:0/2333796376 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5ff00b52e0 0x7f5ff00b77a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc000c00 tx=0x7f5ffc0314a0 comp rx=0 tx=0).stop 2024-09-11T01:07:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.359+0000 7f600f600640 1 -- 172.21.15.103:0/2333796376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6008076f80 msgr2=0x7f600819faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:07:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.359+0000 7f600f600640 1 --2- 172.21.15.103:0/2333796376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6008076f80 0x7f600819faa0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400e9f0 tx=0x7f5ff400edf0 comp rx=0 tx=0).stop 2024-09-11T01:07:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.359+0000 7f600f600640 1 -- 172.21.15.103:0/2333796376 shutdown_connections 2024-09-11T01:07:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.359+0000 7f600f600640 1 --2- 172.21.15.103:0/2333796376 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5ff00b52e0 0x7f5ff00b77a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.359+0000 7f600f600640 1 --2- 172.21.15.103:0/2333796376 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f60081a06e0 0x7f60081a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.359+0000 7f600f600640 1 --2- 172.21.15.103:0/2333796376 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6008076f80 0x7f600819faa0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:58.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.359+0000 7f600f600640 1 --2- 172.21.15.103:0/2333796376 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6008075b20 0x7f600819f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:07:58.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.359+0000 7f600f600640 1 -- 172.21.15.103:0/2333796376 >> 172.21.15.103:0/2333796376 conn(0x7f60080fe320 msgr2=0x7f6008100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:07:58.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.359+0000 7f600f600640 1 -- 172.21.15.103:0/2333796376 shutdown_connections 2024-09-11T01:07:58.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:07:58.359+0000 7f600f600640 1 -- 172.21.15.103:0/2333796376 wait complete. 2024-09-11T01:07:59.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:58 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2333796376' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T01:07:59.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:58 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2333796376' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T01:07:59.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:58 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2333796376' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-11T01:07:59.217 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-11T01:07:59.587 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:00.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:07:59 smithi103 ceph-mon[30562]: pgmap v389: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:08:00.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:07:59 smithi117 ceph-mon[35358]: pgmap v389: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:08:00.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:07:59 smithi183 ceph-mon[34992]: pgmap v389: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:08:00.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.228+0000 7f9ddc000640 1 -- 172.21.15.103:0/328389890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dd4102a30 msgr2=0x7f9dd4102e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:00.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.228+0000 7f9ddc000640 1 --2- 172.21.15.103:0/328389890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dd4102a30 0x7f9dd4102e30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8009960 tx=0x7f9dc802a460 comp rx=0 tx=0).stop 2024-09-11T01:08:00.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.228+0000 7f9ddc000640 1 -- 172.21.15.103:0/328389890 shutdown_connections 2024-09-11T01:08:00.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.228+0000 7f9ddc000640 1 --2- 172.21.15.103:0/328389890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dd4104550 0x7f9dd410aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:00.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.228+0000 7f9ddc000640 1 --2- 172.21.15.103:0/328389890 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4103b90 0x7f9dd4104010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:00.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.228+0000 7f9ddc000640 1 --2- 172.21.15.103:0/328389890 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dd4102a30 0x7f9dd4102e30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:00.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.228+0000 7f9ddc000640 1 -- 172.21.15.103:0/328389890 >> 172.21.15.103:0/328389890 conn(0x7f9dd40fe320 msgr2=0x7f9dd4100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:00.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.228+0000 7f9ddc000640 1 -- 172.21.15.103:0/328389890 shutdown_connections 2024-09-11T01:08:00.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.228+0000 7f9ddc000640 1 -- 172.21.15.103:0/328389890 wait complete. 2024-09-11T01:08:00.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.229+0000 7f9ddc000640 1 Processor -- start 2024-09-11T01:08:00.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.229+0000 7f9ddc000640 1 -- start start 2024-09-11T01:08:00.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.229+0000 7f9ddc000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4102a30 0x7f9dd419b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:00.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.229+0000 7f9ddc000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dd4103b90 0x7f9dd419b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:00.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.229+0000 7f9ddc000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dd4104550 0x7f9dd419c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:00.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.229+0000 7f9ddc000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd410e6b0 con 0x7f9dd4102a30 2024-09-11T01:08:00.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.229+0000 7f9ddc000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd410e530 con 0x7f9dd4104550 2024-09-11T01:08:00.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.229+0000 7f9ddc000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd410e830 con 0x7f9dd4103b90 2024-09-11T01:08:00.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.230+0000 7f9dd9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4102a30 0x7f9dd419b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:00.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.230+0000 7f9dd8c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dd4103b90 0x7f9dd419b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:00.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.230+0000 7f9dd8c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dd4103b90 0x7f9dd419b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:36604/0 (socket says 172.21.15.103:36604) 2024-09-11T01:08:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.230+0000 7f9dd8c00640 1 -- 172.21.15.103:0/3996499099 learned_addr learned my addr 172.21.15.103:0/3996499099 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.230+0000 7f9dda000640 1 --2- 172.21.15.103:0/3996499099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dd4104550 0x7f9dd419c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.230+0000 7f9dd8c00640 1 -- 172.21.15.103:0/3996499099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dd4104550 msgr2=0x7f9dd419c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.230+0000 7f9dd8c00640 1 --2- 172.21.15.103:0/3996499099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dd4104550 0x7f9dd419c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.230+0000 7f9dd8c00640 1 -- 172.21.15.103:0/3996499099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4102a30 msgr2=0x7f9dd419b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.230+0000 7f9dd8c00640 1 --2- 172.21.15.103:0/3996499099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4102a30 0x7f9dd419b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.230+0000 7f9dd8c00640 1 -- 172.21.15.103:0/3996499099 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd419cbe0 con 0x7f9dd4103b90 2024-09-11T01:08:00.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.230+0000 7f9dd8c00640 1 --2- 172.21.15.103:0/3996499099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dd4103b90 0x7f9dd419b700 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000e9f0 tx=0x7f9dc000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:00.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.231+0000 7f9dd2000640 1 -- 172.21.15.103:0/3996499099 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc000cd80 con 0x7f9dd4103b90 2024-09-11T01:08:00.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.231+0000 7f9ddc000640 1 -- 172.21.15.103:0/3996499099 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd419ced0 con 0x7f9dd4103b90 2024-09-11T01:08:00.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.231+0000 7f9dd2000640 1 -- 172.21.15.103:0/3996499099 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9dc00108e0 con 0x7f9dd4103b90 2024-09-11T01:08:00.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.231+0000 7f9dd2000640 1 -- 172.21.15.103:0/3996499099 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc0018980 con 0x7f9dd4103b90 2024-09-11T01:08:00.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.231+0000 7f9ddc000640 1 -- 172.21.15.103:0/3996499099 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd41a35b0 con 0x7f9dd4103b90 2024-09-11T01:08:00.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.232+0000 7f9ddc000640 1 -- 172.21.15.103:0/3996499099 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd41a3780 con 0x7f9dd4103b90 2024-09-11T01:08:00.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.234+0000 7f9dd2000640 1 -- 172.21.15.103:0/3996499099 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7f9dc0010430 con 0x7f9dd4103b90 2024-09-11T01:08:00.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.236+0000 7f9dd2000640 1 --2- 172.21.15.103:0/3996499099 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9dbc0b52e0 0x7f9dbc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:00.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.236+0000 7f9dd2000640 1 -- 172.21.15.103:0/3996499099 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f9dc00e67e0 con 0x7f9dd4103b90 2024-09-11T01:08:00.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.236+0000 7f9dd9600640 1 --2- 172.21.15.103:0/3996499099 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9dbc0b52e0 0x7f9dbc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:00.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.237+0000 7f9dd9600640 1 --2- 172.21.15.103:0/3996499099 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9dbc0b52e0 0x7f9dbc0b77a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80057c0 tx=0x7f9dc8005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:00.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.238+0000 7f9dd2000640 1 -- 172.21.15.103:0/3996499099 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9dc00acc40 con 0x7f9dd4103b90 2024-09-11T01:08:00.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.426+0000 7f9ddc000640 1 -- 172.21.15.103:0/3996499099 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f9dd41a3950 con 0x7f9dd4103b90 2024-09-11T01:08:00.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.427+0000 7f9dd2000640 1 -- 172.21.15.103:0/3996499099 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v89) ==== 56+0+5716 (secure 0 0 0) 0x7f9dc00b1670 con 0x7f9dd4103b90 2024-09-11T01:08:00.430 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 89 2024-09-11T01:08:00.430 INFO:teuthology.orchestra.run.smithi103.stdout:fsid 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T01:08:00.430 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-09-11T00:56:46.242882+0000 2024-09-11T01:08:00.430 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-09-11T01:06:41.586918+0000 2024-09-11T01:08:00.430 INFO:teuthology.orchestra.run.smithi103.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T01:08:00.430 INFO:teuthology.orchestra.run.smithi103.stdout:crush_version 27 2024-09-11T01:08:00.430 INFO:teuthology.orchestra.run.smithi103.stdout:full_ratio 0.95 2024-09-11T01:08:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:backfillfull_ratio 0.9 2024-09-11T01:08:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:nearfull_ratio 0.85 2024-09-11T01:08:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:require_min_compat_client luminous 2024-09-11T01:08:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:min_compat_client luminous 2024-09-11T01:08:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:require_osd_release squid 2024-09-11T01:08:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:stretch_mode_enabled false 2024-09-11T01:08:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 23 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-11T01:08:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-11T01:08:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-11T01:08:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 87 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-11T01:08:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:max_osd 12 2024-09-11T01:08:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6802/1867193874,v1:172.21.15.103:6803/1867193874] [v2:172.21.15.103:6804/1867193874,v1:172.21.15.103:6805/1867193874] exists,up 1b3e4222-43fd-4af0-bf97-3ba1000221b7 2024-09-11T01:08:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6800/2629532556,v1:172.21.15.117:6801/2629532556] [v2:172.21.15.117:6802/2629532556,v1:172.21.15.117:6803/2629532556] exists,up 9a2b40da-7361-4c4f-a9dc-a769b427a0fc 2024-09-11T01:08:00.431 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 up in weight 1 up_from 18 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6800/3208966770,v1:172.21.15.183:6801/3208966770] [v2:172.21.15.183:6802/3208966770,v1:172.21.15.183:6803/3208966770] exists,up 5db919c1-90a7-4ba7-acf3-89eeb77ae131 2024-09-11T01:08:00.432 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 up in weight 1 up_from 26 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6810/2238128162,v1:172.21.15.103:6811/2238128162] [v2:172.21.15.103:6812/2238128162,v1:172.21.15.103:6813/2238128162] exists,up bdc465f2-06a5-4667-9651-4e168700d674 2024-09-11T01:08:00.432 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 up in weight 1 up_from 32 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6808/2368878504,v1:172.21.15.117:6809/2368878504] [v2:172.21.15.117:6810/2368878504,v1:172.21.15.117:6811/2368878504] exists,up be86a5d2-5e86-4bf4-8464-9dff7a801e4e 2024-09-11T01:08:00.432 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 up in weight 1 up_from 37 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6808/1668069547,v1:172.21.15.183:6809/1668069547] [v2:172.21.15.183:6810/1668069547,v1:172.21.15.183:6811/1668069547] exists,up 090b20ec-d9ff-4e10-ad9f-52ab41dbf148 2024-09-11T01:08:00.432 INFO:teuthology.orchestra.run.smithi103.stdout:osd.6 up in weight 1 up_from 43 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6818/4203476972,v1:172.21.15.103:6819/4203476972] [v2:172.21.15.103:6820/4203476972,v1:172.21.15.103:6821/4203476972] exists,up 19abe982-3522-40f9-a628-ddaef462cdb9 2024-09-11T01:08:00.432 INFO:teuthology.orchestra.run.smithi103.stdout:osd.7 up in weight 1 up_from 49 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6816/1207680713,v1:172.21.15.117:6817/1207680713] [v2:172.21.15.117:6818/1207680713,v1:172.21.15.117:6819/1207680713] exists,up e875ff09-805a-40ff-9d6a-dd2607ce3432 2024-09-11T01:08:00.432 INFO:teuthology.orchestra.run.smithi103.stdout:osd.8 up in weight 1 up_from 55 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6816/2935820593,v1:172.21.15.183:6817/2935820593] [v2:172.21.15.183:6818/2935820593,v1:172.21.15.183:6819/2935820593] exists,up 2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a 2024-09-11T01:08:00.432 INFO:teuthology.orchestra.run.smithi103.stdout:osd.9 up in weight 1 up_from 61 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6826/2104855877,v1:172.21.15.103:6827/2104855877] [v2:172.21.15.103:6828/2104855877,v1:172.21.15.103:6829/2104855877] exists,up c36d17d2-0bc8-4322-a998-9c8eff970e58 2024-09-11T01:08:00.432 INFO:teuthology.orchestra.run.smithi103.stdout:osd.10 up in weight 1 up_from 66 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.117:6824/3792981873,v1:172.21.15.117:6825/3792981873] [v2:172.21.15.117:6826/3792981873,v1:172.21.15.117:6827/3792981873] exists,up e71bc5f7-a829-43cf-a10b-b2444da1d773 2024-09-11T01:08:00.432 INFO:teuthology.orchestra.run.smithi103.stdout:osd.11 up in weight 1 up_from 72 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.183:6824/1250387289,v1:172.21.15.183:6825/1250387289] [v2:172.21.15.183:6826/1250387289,v1:172.21.15.183:6827/1250387289] exists,up 8f36697f-4d18-4efa-bf14-d68a13464958 2024-09-11T01:08:00.432 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 2.10 [8,11] 2024-09-11T01:08:00.432 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 2.13 [2,11] 2024-09-11T01:08:00.432 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 2.14 [2,4] 2024-09-11T01:08:00.432 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.c [3,9] 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.e [4,8] 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.13 [4,9] 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.1a [5,7] 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.1b [5,9] 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.31 [4,6] 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 4.c [9,10] 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 4.14 [9,8] 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 4.1b [5,8] 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 4.1c [9,8] 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/366890372 expires 2024-09-12T00:57:39.411408+0000 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:6800/115727473 expires 2024-09-12T00:57:39.411408+0000 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/2372812363 expires 2024-09-12T00:57:39.411408+0000 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/2844264136 expires 2024-09-12T00:57:11.412015+0000 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/2046654364 expires 2024-09-12T00:57:39.411408+0000 2024-09-11T01:08:00.433 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:6801/115727473 expires 2024-09-12T00:57:39.411408+0000 2024-09-11T01:08:00.434 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/211510947 expires 2024-09-12T00:57:11.412015+0000 2024-09-11T01:08:00.434 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:6801/2110498702 expires 2024-09-12T00:57:11.412015+0000 2024-09-11T01:08:00.434 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:6800/2110498702 expires 2024-09-12T00:57:11.412015+0000 2024-09-11T01:08:00.434 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/189409602 expires 2024-09-12T00:57:11.412015+0000 2024-09-11T01:08:00.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.431+0000 7f9ddc000640 1 -- 172.21.15.103:0/3996499099 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9dbc0b52e0 msgr2=0x7f9dbc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:00.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.431+0000 7f9ddc000640 1 --2- 172.21.15.103:0/3996499099 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9dbc0b52e0 0x7f9dbc0b77a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80057c0 tx=0x7f9dc8005d50 comp rx=0 tx=0).stop 2024-09-11T01:08:00.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.431+0000 7f9ddc000640 1 -- 172.21.15.103:0/3996499099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dd4103b90 msgr2=0x7f9dd419b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:00.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.431+0000 7f9ddc000640 1 --2- 172.21.15.103:0/3996499099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dd4103b90 0x7f9dd419b700 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000e9f0 tx=0x7f9dc000eeb0 comp rx=0 tx=0).stop 2024-09-11T01:08:00.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.431+0000 7f9ddc000640 1 -- 172.21.15.103:0/3996499099 shutdown_connections 2024-09-11T01:08:00.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.431+0000 7f9ddc000640 1 --2- 172.21.15.103:0/3996499099 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9dbc0b52e0 0x7f9dbc0b77a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:00.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.431+0000 7f9ddc000640 1 --2- 172.21.15.103:0/3996499099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9dd4104550 0x7f9dd419c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:00.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.431+0000 7f9ddc000640 1 --2- 172.21.15.103:0/3996499099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9dd4103b90 0x7f9dd419b700 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:00.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.431+0000 7f9ddc000640 1 --2- 172.21.15.103:0/3996499099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9dd4102a30 0x7f9dd419b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:00.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.431+0000 7f9ddc000640 1 -- 172.21.15.103:0/3996499099 >> 172.21.15.103:0/3996499099 conn(0x7f9dd40fe320 msgr2=0x7f9dd4109320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:00.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.431+0000 7f9ddc000640 1 -- 172.21.15.103:0/3996499099 shutdown_connections 2024-09-11T01:08:00.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:00.431+0000 7f9ddc000640 1 -- 172.21.15.103:0/3996499099 wait complete. 2024-09-11T01:08:01.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:00 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3996499099' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-11T01:08:01.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:00 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3996499099' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-11T01:08:01.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:00 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3996499099' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-11T01:08:01.218 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-11T01:08:01.233 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:08:01.605 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:02.004 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:01 smithi103 ceph-mon[30562]: pgmap v390: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:08:02.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:01 smithi117 ceph-mon[35358]: pgmap v390: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:08:02.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:01 smithi183 ceph-mon[34992]: pgmap v390: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:08:02.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.241+0000 7f0a2ba00640 1 -- 172.21.15.103:0/2946439541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a2410a9b0 msgr2=0x7f0a2410adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:02.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.241+0000 7f0a2ba00640 1 --2- 172.21.15.103:0/2946439541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a2410a9b0 0x7f0a2410adf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009900 tx=0x7f0a0c02a3f0 comp rx=0 tx=0).stop 2024-09-11T01:08:02.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.241+0000 7f0a2ba00640 1 -- 172.21.15.103:0/2946439541 shutdown_connections 2024-09-11T01:08:02.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.241+0000 7f0a2ba00640 1 --2- 172.21.15.103:0/2946439541 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2410b330 0x7f0a24111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:02.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.241+0000 7f0a2ba00640 1 --2- 172.21.15.103:0/2946439541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a2410a9b0 0x7f0a2410adf0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:02.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.241+0000 7f0a2ba00640 1 --2- 172.21.15.103:0/2946439541 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a24104fa0 0x7f0a24105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:02.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.241+0000 7f0a2ba00640 1 -- 172.21.15.103:0/2946439541 >> 172.21.15.103:0/2946439541 conn(0x7f0a24100a50 msgr2=0x7f0a24102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:02.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.241+0000 7f0a2ba00640 1 -- 172.21.15.103:0/2946439541 shutdown_connections 2024-09-11T01:08:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.241+0000 7f0a2ba00640 1 -- 172.21.15.103:0/2946439541 wait complete. 2024-09-11T01:08:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.242+0000 7f0a2ba00640 1 Processor -- start 2024-09-11T01:08:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.243+0000 7f0a2ba00640 1 -- start start 2024-09-11T01:08:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.243+0000 7f0a2ba00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a24104fa0 0x7f0a2419b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.243+0000 7f0a2ba00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a2410a9b0 0x7f0a2419b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.243+0000 7f0a2ba00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2410b330 0x7f0a241a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.243+0000 7f0a2ba00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0a24114f50 con 0x7f0a2410a9b0 2024-09-11T01:08:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.243+0000 7f0a2ba00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f0a24114dd0 con 0x7f0a2410b330 2024-09-11T01:08:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.243+0000 7f0a2ba00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f0a241150d0 con 0x7f0a24104fa0 2024-09-11T01:08:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.243+0000 7f0a29000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a24104fa0 0x7f0a2419b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.243+0000 7f0a1be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a2410a9b0 0x7f0a2419b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.243+0000 7f0a29000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a24104fa0 0x7f0a2419b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:36628/0 (socket says 172.21.15.103:36628) 2024-09-11T01:08:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.244+0000 7f0a29000640 1 -- 172.21.15.103:0/3089530725 learned_addr learned my addr 172.21.15.103:0/3089530725 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.244+0000 7f0a29a00640 1 --2- 172.21.15.103:0/3089530725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2410b330 0x7f0a241a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.244+0000 7f0a29000640 1 -- 172.21.15.103:0/3089530725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2410b330 msgr2=0x7f0a241a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.244+0000 7f0a29000640 1 --2- 172.21.15.103:0/3089530725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2410b330 0x7f0a241a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.244+0000 7f0a29000640 1 -- 172.21.15.103:0/3089530725 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a2410a9b0 msgr2=0x7f0a2419b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.244+0000 7f0a29000640 1 --2- 172.21.15.103:0/3089530725 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a2410a9b0 0x7f0a2419b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.244+0000 7f0a29000640 1 -- 172.21.15.103:0/3089530725 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a241a1520 con 0x7f0a24104fa0 2024-09-11T01:08:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.244+0000 7f0a29a00640 1 --2- 172.21.15.103:0/3089530725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2410b330 0x7f0a241a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.244+0000 7f0a29000640 1 --2- 172.21.15.103:0/3089530725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a24104fa0 0x7f0a2419b470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400e9f0 tx=0x7f0a1400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.244+0000 7f0a22000640 1 -- 172.21.15.103:0/3089530725 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a1400cd80 con 0x7f0a24104fa0 2024-09-11T01:08:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.244+0000 7f0a2ba00640 1 -- 172.21.15.103:0/3089530725 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a241a1810 con 0x7f0a24104fa0 2024-09-11T01:08:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.244+0000 7f0a22000640 1 -- 172.21.15.103:0/3089530725 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a140054d0 con 0x7f0a24104fa0 2024-09-11T01:08:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.245+0000 7f0a22000640 1 -- 172.21.15.103:0/3089530725 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a14010690 con 0x7f0a24104fa0 2024-09-11T01:08:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.245+0000 7f0a2ba00640 1 -- 172.21.15.103:0/3089530725 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a241a7ed0 con 0x7f0a24104fa0 2024-09-11T01:08:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.246+0000 7f0a2ba00640 1 -- 172.21.15.103:0/3089530725 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a24105380 con 0x7f0a24104fa0 2024-09-11T01:08:02.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.248+0000 7f0a22000640 1 -- 172.21.15.103:0/3089530725 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7f0a14004e30 con 0x7f0a24104fa0 2024-09-11T01:08:02.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.249+0000 7f0a22000640 1 --2- 172.21.15.103:0/3089530725 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0a080b52e0 0x7f0a080b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:02.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.249+0000 7f0a22000640 1 -- 172.21.15.103:0/3089530725 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f0a140e6540 con 0x7f0a24104fa0 2024-09-11T01:08:02.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.250+0000 7f0a1be00640 1 --2- 172.21.15.103:0/3089530725 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0a080b52e0 0x7f0a080b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:02.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.250+0000 7f0a1be00640 1 --2- 172.21.15.103:0/3089530725 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0a080b52e0 0x7f0a080b77a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c031440 tx=0x7f0a0c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:02.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.251+0000 7f0a22000640 1 -- 172.21.15.103:0/3089530725 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f0a140ad050 con 0x7f0a24104fa0 2024-09-11T01:08:02.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.470+0000 7f0a2ba00640 1 -- 172.21.15.103:0/3089530725 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0a2402e5c0 con 0x7f0a24104fa0 2024-09-11T01:08:02.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.471+0000 7f0a22000640 1 -- 172.21.15.103:0/3089530725 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11930 (secure 0 0 0) 0x7f0a140ac950 con 0x7f0a24104fa0 2024-09-11T01:08:02.474 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:08:02.475 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-09-11T01:06:22:641923+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:06:22.629934+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24619,24629,24665]},"id":1}]} 2024-09-11T01:08:02.475 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-09-11T01:08:02.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.474+0000 7f0a2ba00640 1 -- 172.21.15.103:0/3089530725 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0a080b52e0 msgr2=0x7f0a080b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:02.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.474+0000 7f0a2ba00640 1 --2- 172.21.15.103:0/3089530725 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0a080b52e0 0x7f0a080b77a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c031440 tx=0x7f0a0c005b50 comp rx=0 tx=0).stop 2024-09-11T01:08:02.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.474+0000 7f0a2ba00640 1 -- 172.21.15.103:0/3089530725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a24104fa0 msgr2=0x7f0a2419b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:02.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.474+0000 7f0a2ba00640 1 --2- 172.21.15.103:0/3089530725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a24104fa0 0x7f0a2419b470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0a1400e9f0 tx=0x7f0a1400edf0 comp rx=0 tx=0).stop 2024-09-11T01:08:02.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.474+0000 7f0a2ba00640 1 -- 172.21.15.103:0/3089530725 shutdown_connections 2024-09-11T01:08:02.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.474+0000 7f0a2ba00640 1 --2- 172.21.15.103:0/3089530725 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f0a080b52e0 0x7f0a080b77a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:02.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.474+0000 7f0a2ba00640 1 --2- 172.21.15.103:0/3089530725 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0a2410b330 0x7f0a241a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:02.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.474+0000 7f0a2ba00640 1 --2- 172.21.15.103:0/3089530725 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0a2410a9b0 0x7f0a2419b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:02.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.474+0000 7f0a2ba00640 1 --2- 172.21.15.103:0/3089530725 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f0a24104fa0 0x7f0a2419b470 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:02.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.474+0000 7f0a2ba00640 1 -- 172.21.15.103:0/3089530725 >> 172.21.15.103:0/3089530725 conn(0x7f0a24100a50 msgr2=0x7f0a24102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:02.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.474+0000 7f0a2ba00640 1 -- 172.21.15.103:0/3089530725 shutdown_connections 2024-09-11T01:08:02.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:02.474+0000 7f0a2ba00640 1 -- 172.21.15.103:0/3089530725 wait complete. 2024-09-11T01:08:03.081 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:02 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3089530725' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:03.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:02 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3089530725' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:03.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:02 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3089530725' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:03.255 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:08:03.626 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:04.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:03 smithi103 ceph-mon[30562]: pgmap v391: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:08:04.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:03 smithi117 ceph-mon[35358]: pgmap v391: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:08:04.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:03 smithi183 ceph-mon[34992]: pgmap v391: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:08:04.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.240+0000 7fa059000640 1 -- 172.21.15.103:0/3535952787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa054075540 msgr2=0x7fa054075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:04.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.240+0000 7fa059000640 1 --2- 172.21.15.103:0/3535952787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa054075540 0x7fa054075920 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa044009900 tx=0x7fa04402a3f0 comp rx=0 tx=0).stop 2024-09-11T01:08:04.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.240+0000 7fa059000640 1 -- 172.21.15.103:0/3535952787 shutdown_connections 2024-09-11T01:08:04.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.240+0000 7fa059000640 1 --2- 172.21.15.103:0/3535952787 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa05410f3e0 0x7fa0541117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:04.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.240+0000 7fa059000640 1 --2- 172.21.15.103:0/3535952787 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa054075f40 0x7fa05410ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:04.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.240+0000 7fa059000640 1 --2- 172.21.15.103:0/3535952787 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa054075540 0x7fa054075920 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:04.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.240+0000 7fa059000640 1 -- 172.21.15.103:0/3535952787 >> 172.21.15.103:0/3535952787 conn(0x7fa0540fe7f0 msgr2=0x7fa054100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:04.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.241+0000 7fa059000640 1 -- 172.21.15.103:0/3535952787 shutdown_connections 2024-09-11T01:08:04.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.241+0000 7fa059000640 1 -- 172.21.15.103:0/3535952787 wait complete. 2024-09-11T01:08:04.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.241+0000 7fa059000640 1 Processor -- start 2024-09-11T01:08:04.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.242+0000 7fa059000640 1 -- start start 2024-09-11T01:08:04.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.242+0000 7fa059000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa054075540 0x7fa05419b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:04.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.242+0000 7fa059000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa054075f40 0x7fa05419ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:04.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.242+0000 7fa059000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa05410f3e0 0x7fa0541a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:04.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.242+0000 7fa059000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa054114fd0 con 0x7fa05410f3e0 2024-09-11T01:08:04.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.242+0000 7fa059000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa054114e50 con 0x7fa054075f40 2024-09-11T01:08:04.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.242+0000 7fa059000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa054115150 con 0x7fa054075540 2024-09-11T01:08:04.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.242+0000 7fa052800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa05410f3e0 0x7fa0541a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:04.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.242+0000 7fa052800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa05410f3e0 0x7fa0541a0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52886/0 (socket says 172.21.15.103:52886) 2024-09-11T01:08:04.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.242+0000 7fa052800640 1 -- 172.21.15.103:0/3497776580 learned_addr learned my addr 172.21.15.103:0/3497776580 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:04.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.242+0000 7fa04be00640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa054075f40 0x7fa05419ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:04.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.242+0000 7fa051e00640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa054075540 0x7fa05419b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:04.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.243+0000 7fa052800640 1 -- 172.21.15.103:0/3497776580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa054075540 msgr2=0x7fa05419b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:04.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.243+0000 7fa052800640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa054075540 0x7fa05419b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:04.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.243+0000 7fa052800640 1 -- 172.21.15.103:0/3497776580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa054075f40 msgr2=0x7fa05419ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:04.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.243+0000 7fa052800640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa054075f40 0x7fa05419ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:04.247 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.243+0000 7fa052800640 1 -- 172.21.15.103:0/3497776580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0541a1570 con 0x7fa05410f3e0 2024-09-11T01:08:04.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.243+0000 7fa04be00640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa054075f40 0x7fa05419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:04.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.243+0000 7fa052800640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa05410f3e0 0x7fa0541a0da0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00eb40 tx=0x7fa04c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:04.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.243+0000 7fa04aa00640 1 -- 172.21.15.103:0/3497776580 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c004b20 con 0x7fa05410f3e0 2024-09-11T01:08:04.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.243+0000 7fa04aa00640 1 -- 172.21.15.103:0/3497776580 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa04c004cc0 con 0x7fa05410f3e0 2024-09-11T01:08:04.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.243+0000 7fa059000640 1 -- 172.21.15.103:0/3497776580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0541a1860 con 0x7fa05410f3e0 2024-09-11T01:08:04.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.243+0000 7fa04aa00640 1 -- 172.21.15.103:0/3497776580 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c010720 con 0x7fa05410f3e0 2024-09-11T01:08:04.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.244+0000 7fa059000640 1 -- 172.21.15.103:0/3497776580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0541a7f20 con 0x7fa05410f3e0 2024-09-11T01:08:04.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.245+0000 7fa059000640 1 -- 172.21.15.103:0/3497776580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa054075920 con 0x7fa05410f3e0 2024-09-11T01:08:04.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.247+0000 7fa04aa00640 1 -- 172.21.15.103:0/3497776580 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7fa04c005560 con 0x7fa05410f3e0 2024-09-11T01:08:04.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.248+0000 7fa04aa00640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0380b52e0 0x7fa0380b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:04.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.248+0000 7fa04aa00640 1 -- 172.21.15.103:0/3497776580 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fa04c0e6740 con 0x7fa05410f3e0 2024-09-11T01:08:04.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.249+0000 7fa051e00640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0380b52e0 0x7fa0380b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:04.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.249+0000 7fa051e00640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0380b52e0 0x7fa0380b77a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa044005ab0 tx=0x7fa044005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:04.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.250+0000 7fa04aa00640 1 -- 172.21.15.103:0/3497776580 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa04c0ad1f0 con 0x7fa05410f3e0 2024-09-11T01:08:04.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.471+0000 7fa059000640 1 -- 172.21.15.103:0/3497776580 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0541a82c0 con 0x7fa05410f3e0 2024-09-11T01:08:04.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.472+0000 7fa04aa00640 1 -- 172.21.15.103:0/3497776580 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11930 (secure 0 0 0) 0x7fa04c0acaf0 con 0x7fa05410f3e0 2024-09-11T01:08:04.475 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:08:04.475 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-09-11T01:06:22:641923+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:06:22.629934+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24619,24629,24665]},"id":1}]} 2024-09-11T01:08:04.475 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-09-11T01:08:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.475+0000 7fa059000640 1 -- 172.21.15.103:0/3497776580 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0380b52e0 msgr2=0x7fa0380b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.475+0000 7fa059000640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0380b52e0 0x7fa0380b77a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa044005ab0 tx=0x7fa044005a20 comp rx=0 tx=0).stop 2024-09-11T01:08:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.475+0000 7fa059000640 1 -- 172.21.15.103:0/3497776580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa05410f3e0 msgr2=0x7fa0541a0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.475+0000 7fa059000640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa05410f3e0 0x7fa0541a0da0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00eb40 tx=0x7fa04c00c2d0 comp rx=0 tx=0).stop 2024-09-11T01:08:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.475+0000 7fa059000640 1 -- 172.21.15.103:0/3497776580 shutdown_connections 2024-09-11T01:08:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.475+0000 7fa059000640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa0380b52e0 0x7fa0380b77a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.475+0000 7fa059000640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa05410f3e0 0x7fa0541a0da0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.475+0000 7fa059000640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa054075f40 0x7fa05419ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.475+0000 7fa059000640 1 --2- 172.21.15.103:0/3497776580 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa054075540 0x7fa05419b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.475+0000 7fa059000640 1 -- 172.21.15.103:0/3497776580 >> 172.21.15.103:0/3497776580 conn(0x7fa0540fe7f0 msgr2=0x7fa0541115e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:04.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.475+0000 7fa059000640 1 -- 172.21.15.103:0/3497776580 shutdown_connections 2024-09-11T01:08:04.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:04.475+0000 7fa059000640 1 -- 172.21.15.103:0/3497776580 wait complete. 2024-09-11T01:08:05.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:04 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3497776580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:05.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:04 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3497776580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:05.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:04 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3497776580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:05.179 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T01:08:05.547 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:06.053 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:05 smithi103 ceph-mon[30562]: pgmap v392: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:08:06.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:05 smithi117 ceph-mon[35358]: pgmap v392: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:08:06.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.159+0000 7f2df9400640 1 -- 172.21.15.103:0/203355531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4113960 msgr2=0x7f2df4115d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:06.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.159+0000 7f2df9400640 1 --2- 172.21.15.103:0/203355531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4113960 0x7f2df4115d50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2dec009900 tx=0x7f2dec02a410 comp rx=0 tx=0).stop 2024-09-11T01:08:06.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.159+0000 7f2df9400640 1 -- 172.21.15.103:0/203355531 shutdown_connections 2024-09-11T01:08:06.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.159+0000 7f2df9400640 1 --2- 172.21.15.103:0/203355531 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4113960 0x7f2df4115d50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:06.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.159+0000 7f2df9400640 1 --2- 172.21.15.103:0/203355531 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2df4075e60 0x7f2df4113420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:06.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.159+0000 7f2df9400640 1 --2- 172.21.15.103:0/203355531 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2df4075540 0x7f2df4075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:06.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.159+0000 7f2df9400640 1 -- 172.21.15.103:0/203355531 >> 172.21.15.103:0/203355531 conn(0x7f2df40fe6d0 msgr2=0x7f2df4100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:06.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.159+0000 7f2df9400640 1 -- 172.21.15.103:0/203355531 shutdown_connections 2024-09-11T01:08:06.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.159+0000 7f2df9400640 1 -- 172.21.15.103:0/203355531 wait complete. 2024-09-11T01:08:06.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.160+0000 7f2df9400640 1 Processor -- start 2024-09-11T01:08:06.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.160+0000 7f2df9400640 1 -- start start 2024-09-11T01:08:06.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.161+0000 7f2df9400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2df4075540 0x7f2df419f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:06.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.161+0000 7f2df9400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2df4075e60 0x7f2df419fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.161+0000 7f2df9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4113960 0x7f2df41a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.161+0000 7f2df9400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2df4119220 con 0x7f2df4113960 2024-09-11T01:08:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.161+0000 7f2df9400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2df41190a0 con 0x7f2df4075540 2024-09-11T01:08:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.161+0000 7f2df9400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2df41193a0 con 0x7f2df4075e60 2024-09-11T01:08:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.161+0000 7f2df3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2df4075540 0x7f2df419f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.161+0000 7f2df3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2df4075540 0x7f2df419f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:55626/0 (socket says 172.21.15.103:55626) 2024-09-11T01:08:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.161+0000 7f2df3e00640 1 -- 172.21.15.103:0/1716953024 learned_addr learned my addr 172.21.15.103:0/1716953024 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.161+0000 7f2deb400640 1 --2- 172.21.15.103:0/1716953024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2df4075e60 0x7f2df419fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.161+0000 7f2df8a00640 1 --2- 172.21.15.103:0/1716953024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4113960 0x7f2df41a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.161+0000 7f2df3e00640 1 -- 172.21.15.103:0/1716953024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2df4075e60 msgr2=0x7f2df419fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.162+0000 7f2df3e00640 1 --2- 172.21.15.103:0/1716953024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2df4075e60 0x7f2df419fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.162+0000 7f2df3e00640 1 -- 172.21.15.103:0/1716953024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4113960 msgr2=0x7f2df41a4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:06.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.162+0000 7f2df3e00640 1 --2- 172.21.15.103:0/1716953024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4113960 0x7f2df41a4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:06.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.162+0000 7f2df3e00640 1 -- 172.21.15.103:0/1716953024 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df41a56a0 con 0x7f2df4075540 2024-09-11T01:08:06.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.162+0000 7f2df3e00640 1 --2- 172.21.15.103:0/1716953024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2df4075540 0x7f2df419f5f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2de400ebc0 tx=0x7f2de400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:06.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.162+0000 7f2df1600640 1 -- 172.21.15.103:0/1716953024 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de4010630 con 0x7f2df4075540 2024-09-11T01:08:06.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.162+0000 7f2df9400640 1 -- 172.21.15.103:0/1716953024 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df41a5990 con 0x7f2df4075540 2024-09-11T01:08:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.162+0000 7f2df1600640 1 -- 172.21.15.103:0/1716953024 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2de4010c80 con 0x7f2df4075540 2024-09-11T01:08:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.162+0000 7f2df1600640 1 -- 172.21.15.103:0/1716953024 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de4018b60 con 0x7f2df4075540 2024-09-11T01:08:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.162+0000 7f2df9400640 1 -- 172.21.15.103:0/1716953024 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df41ac220 con 0x7f2df4075540 2024-09-11T01:08:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.163+0000 7f2df9400640 1 -- 172.21.15.103:0/1716953024 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2df4075920 con 0x7f2df4075540 2024-09-11T01:08:06.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.166+0000 7f2df1600640 1 -- 172.21.15.103:0/1716953024 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7f2de40107d0 con 0x7f2df4075540 2024-09-11T01:08:06.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:05 smithi183 ceph-mon[34992]: pgmap v392: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:08:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.167+0000 7f2df1600640 1 --2- 172.21.15.103:0/1716953024 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2dd80b5410 0x7f2dd80b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:06.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.167+0000 7f2df1600640 1 -- 172.21.15.103:0/1716953024 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f2de40e6a20 con 0x7f2df4075540 2024-09-11T01:08:06.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.167+0000 7f2deb400640 1 --2- 172.21.15.103:0/1716953024 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2dd80b5410 0x7f2dd80b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:06.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.168+0000 7f2deb400640 1 --2- 172.21.15.103:0/1716953024 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2dd80b5410 0x7f2dd80b78d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2df4115e00 tx=0x7f2ddc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:06.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.169+0000 7f2df1600640 1 -- 172.21.15.103:0/1716953024 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2de40ace80 con 0x7f2df4075540 2024-09-11T01:08:06.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.354+0000 7f2df9400640 1 -- 172.21.15.103:0/1716953024 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2df41ac3f0 con 0x7f2df4075540 2024-09-11T01:08:06.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.355+0000 7f2df1600640 1 -- 172.21.15.103:0/1716953024 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24984 (secure 0 0 0) 0x7f2de40b18b0 con 0x7f2df4075540 2024-09-11T01:08:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:08:06.359 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","created":"2024-09-11T00:56:46.242882+0000","modified":"2024-09-11T01:06:41.586918+0000","last_up_change":"2024-09-11T01:04:34.895368+0000","last_in_change":"2024-09-11T01:04:11.663436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:00:33.745338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T01:05:27.486014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T01:05:29.797513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T01:05:38.956635+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1b3e4222-43fd-4af0-bf97-3ba1000221b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6803","nonce":1867193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6805","nonce":1867193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6809","nonce":1867193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6807","nonce":1867193874}]},"public_addr":"172.21.15.103:6803/1867193874","cluster_addr":"172.21.15.103:6805/1867193874","heartbeat_back_addr":"172.21.15.103:6809/1867193874","heartbeat_front_addr":"172.21.15.103:6807/1867193874","state":["exists","up"]},{"osd":1,"uuid":"9a2b40da-7361-4c4f-a9dc-a769b427a0fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6801","nonce":2629532556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6803","nonce":2629532556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6807","nonce":2629532556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6805","nonce":2629532556}]},"public_addr":"172.21.15.117:6801/2629532556","cluster_addr":"172.21.15.117:6803/2629532556","heartbeat_back_addr":"172.21.15.117:6807/2629532556","heartbeat_front_addr":"172.21.15.117:6805/2629532556","state":["exists","up"]},{"osd":2,"uuid":"5db919c1-90a7-4ba7-acf3-89eeb77ae131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6801","nonce":3208966770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6803","nonce":3208966770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6807","nonce":3208966770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6805","nonce":3208966770}]},"public_addr":"172.21.15.183:6801/3208966770","cluster_addr":"172.21.15.183:6803/3208966770","heartbeat_back_addr":"172.21.15.183:6807/3208966770","heartbeat_front_addr":"172.21.15.183:6805/3208966770","state":["exists","up"]},{"osd":3,"uuid":"bdc465f2-06a5-4667-9651-4e168700d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6811","nonce":2238128162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6813","nonce":2238128162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6817","nonce":2238128162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6815","nonce":2238128162}]},"public_addr":"172.21.15.103:6811/2238128162","cluster_addr":"172.21.15.103:6813/2238128162","heartbeat_back_addr":"172.21.15.103:6817/2238128162","heartbeat_front_addr":"172.21.15.103:6815/2238128162","state":["exists","up"]},{"osd":4,"uuid":"be86a5d2-5e86-4bf4-8464-9dff7a801e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6809","nonce":2368878504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6811","nonce":2368878504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6815","nonce":2368878504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6813","nonce":2368878504}]},"public_addr":"172.21.15.117:6809/2368878504","cluster_addr":"172.21.15.117:6811/2368878504","heartbeat_back_addr":"172.21.15.117:6815/2368878504","heartbeat_front_addr":"172.21.15.117:6813/2368878504","state":["exists","up"]},{"osd":5,"uuid":"090b20ec-d9ff-4e10-ad9f-52ab41dbf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6809","nonce":1668069547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6811","nonce":1668069547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6815","nonce":1668069547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6813","nonce":1668069547}]},"public_addr":"172.21.15.183:6809/1668069547","cluster_addr":"172.21.15.183:6811/1668069547","heartbeat_back_addr":"172.21.15.183:6815/1668069547","heartbeat_front_addr":"172.21.15.183:6813/1668069547","state":["exists","up"]},{"osd":6,"uuid":"19abe982-3522-40f9-a628-ddaef462cdb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6819","nonce":4203476972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6821","nonce":4203476972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6825","nonce":4203476972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6823","nonce":4203476972}]},"public_addr":"172.21.15.103:6819/4203476972","cluster_addr":"172.21.15.103:6821/4203476972","heartbeat_back_addr":"172.21.15.103:6825/4203476972","heartbeat_front_addr":"172.21.15.103:6823/4203476972","state":["exists","up"]},{"osd":7,"uuid":"e875ff09-805a-40ff-9d6a-dd2607ce3432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6817","nonce":1207680713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6819","nonce":1207680713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6823","nonce":1207680713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6821","nonce":1207680713}]},"public_addr":"172.21.15.117:6817/1207680713","cluster_addr":"172.21.15.117:6819/1207680713","heartbeat_back_addr":"172.21.15.117:6823/1207680713","heartbeat_front_addr":"172.21.15.117:6821/1207680713","state":["exists","up"]},{"osd":8,"uuid":"2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6817","nonce":2935820593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6819","nonce":2935820593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6823","nonce":2935820593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6821","nonce":2935820593}]},"public_addr":"172.21.15.183:6817/2935820593","cluster_addr":"172.21.15.183:6819/2935820593","heartbeat_back_addr":"172.21.15.183:6823/2935820593","heartbeat_front_addr":"172.21.15.183:6821/2935820593","state":["exists","up"]},{"osd":9,"uuid":"c36d17d2-0bc8-4322-a998-9c8eff970e58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6827","nonce":2104855877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6829","nonce":2104855877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6833","nonce":2104855877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6831","nonce":2104855877}]},"public_addr":"172.21.15.103:6827/2104855877","cluster_addr":"172.21.15.103:6829/2104855877","heartbeat_back_addr":"172.21.15.103:6833/2104855877","heartbeat_front_addr":"172.21.15.103:6831/2104855877","state":["exists","up"]},{"osd":10,"uuid":"e71bc5f7-a829-43cf-a10b-b2444da1d773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6825","nonce":3792981873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6827","nonce":3792981873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6831","nonce":3792981873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6829","nonce":3792981873}]},"public_addr":"172.21.15.117:6825/3792981873","cluster_addr":"172.21.15.117:6827/3792981873","heartbeat_back_addr":"172.21.15.117:6831/3792981873","heartbeat_front_addr":"172.21.15.117:6829/3792981873","state":["exists","up"]},{"osd":11,"uuid":"8f36697f-4d18-4efa-bf14-d68a13464958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6825","nonce":1250387289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6827","nonce":1250387289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6831","nonce":1250387289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6829","nonce":1250387289}]},"public_addr":"172.21.15.183:6825/1250387289","cluster_addr":"172.21.15.183:6827/1250387289","heartbeat_back_addr":"172.21.15.183:6831/1250387289","heartbeat_front_addr":"172.21.15.183:6829/1250387289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:59:39.916330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:06.042858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:30.703648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:59.493376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:25.190299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:50.480326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:20.815441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:46.398318+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:11.499922+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:41.895096+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:08.411538+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:32.943466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/366890372":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6800/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2372812363":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2844264136":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/2046654364":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6801/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/211510947":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6801/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6800/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/189409602":"2024-09-12T00:57:11.412015+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:08:06.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.358+0000 7f2df9400640 1 -- 172.21.15.103:0/1716953024 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2dd80b5410 msgr2=0x7f2dd80b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:06.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.358+0000 7f2df9400640 1 --2- 172.21.15.103:0/1716953024 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2dd80b5410 0x7f2dd80b78d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2df4115e00 tx=0x7f2ddc005f90 comp rx=0 tx=0).stop 2024-09-11T01:08:06.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.358+0000 7f2df9400640 1 -- 172.21.15.103:0/1716953024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2df4075540 msgr2=0x7f2df419f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:06.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.358+0000 7f2df9400640 1 --2- 172.21.15.103:0/1716953024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2df4075540 0x7f2df419f5f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2de400ebc0 tx=0x7f2de400c6a0 comp rx=0 tx=0).stop 2024-09-11T01:08:06.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.358+0000 7f2df9400640 1 -- 172.21.15.103:0/1716953024 shutdown_connections 2024-09-11T01:08:06.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.358+0000 7f2df9400640 1 --2- 172.21.15.103:0/1716953024 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2dd80b5410 0x7f2dd80b78d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:06.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.358+0000 7f2df9400640 1 --2- 172.21.15.103:0/1716953024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2df4113960 0x7f2df41a4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:06.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.358+0000 7f2df9400640 1 --2- 172.21.15.103:0/1716953024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2df4075e60 0x7f2df419fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:06.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.358+0000 7f2df9400640 1 --2- 172.21.15.103:0/1716953024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2df4075540 0x7f2df419f5f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:06.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.358+0000 7f2df9400640 1 -- 172.21.15.103:0/1716953024 >> 172.21.15.103:0/1716953024 conn(0x7f2df40fe6d0 msgr2=0x7f2df40ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:06.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.358+0000 7f2df9400640 1 -- 172.21.15.103:0/1716953024 shutdown_connections 2024-09-11T01:08:06.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:06.358+0000 7f2df9400640 1 -- 172.21.15.103:0/1716953024 wait complete. 2024-09-11T01:08:07.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:06 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1716953024' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:08:07.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:06 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1716953024' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:08:07.130 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T01:05:32.767364+0000', 'modified': '2024-09-11T01:06:22.629934+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24665, 'mds_1': 24629, 'mds_2': 24619}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24595': {'gid': 24595, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.183:6835/2084396200', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6834', 'nonce': 2084396200}, {'type': 'v1', 'addr': '172.21.15.183:6835', 'nonce': 2084396200}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24602': {'gid': 24602, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6835/3506900188', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 3506900188}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 3506900188}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24607': {'gid': 24607, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.183:6837/1863510967', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6836', 'nonce': 1863510967}, {'type': 'v1', 'addr': '172.21.15.183:6837', 'nonce': 1863510967}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24619': {'gid': 24619, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.183:6839/1006805616', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6838', 'nonce': 1006805616}, {'type': 'v1', 'addr': '172.21.15.183:6839', 'nonce': 1006805616}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24629': {'gid': 24629, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.117:6837/294794871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6836', 'nonce': 294794871}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 294794871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24665': {'gid': 24665, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.117:6839/1820809235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6838', 'nonce': 1820809235}, {'type': 'v1', 'addr': '172.21.15.117:6839', 'nonce': 1820809235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24665, 'qdb_cluster': [24619, 24629, 24665]} 2024-09-11T01:08:07.130 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-11T01:08:07.130 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T01:08:07.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:06 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1716953024' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:08:07.500 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:07.954 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:07 smithi103 ceph-mon[30562]: pgmap v393: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:08:08.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.061+0000 7f516c200640 1 -- 172.21.15.103:0/1612152291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5164113980 msgr2=0x7f5164115d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:08.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.061+0000 7f516c200640 1 --2- 172.21.15.103:0/1612152291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5164113980 0x7f5164115d70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f515c009ca0 tx=0x7f515c02a8c0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.062+0000 7f516c200640 1 -- 172.21.15.103:0/1612152291 shutdown_connections 2024-09-11T01:08:08.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.062+0000 7f516c200640 1 --2- 172.21.15.103:0/1612152291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5164113980 0x7f5164115d70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.062+0000 7f516c200640 1 --2- 172.21.15.103:0/1612152291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5164077ff0 0x7f5164113440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.062+0000 7f516c200640 1 --2- 172.21.15.103:0/1612152291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f51640776d0 0x7f5164077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.062+0000 7f516c200640 1 -- 172.21.15.103:0/1612152291 >> 172.21.15.103:0/1612152291 conn(0x7f5164100a00 msgr2=0x7f5164102e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:08.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.062+0000 7f516c200640 1 -- 172.21.15.103:0/1612152291 shutdown_connections 2024-09-11T01:08:08.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.062+0000 7f516c200640 1 -- 172.21.15.103:0/1612152291 wait complete. 2024-09-11T01:08:08.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.063+0000 7f516c200640 1 Processor -- start 2024-09-11T01:08:08.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.063+0000 7f516c200640 1 -- start start 2024-09-11T01:08:08.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.063+0000 7f516c200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51640776d0 0x7f516419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.063+0000 7f516c200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5164077ff0 0x7f516419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.063+0000 7f516c200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5164113980 0x7f51641a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.063+0000 7f516c200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5164119360 con 0x7f51640776d0 2024-09-11T01:08:08.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.063+0000 7f516c200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f51641191e0 con 0x7f5164077ff0 2024-09-11T01:08:08.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.063+0000 7f516c200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51641194e0 con 0x7f5164113980 2024-09-11T01:08:08.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.064+0000 7f5169800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51640776d0 0x7f516419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.064+0000 7f5169800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51640776d0 0x7f516419f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52906/0 (socket says 172.21.15.103:52906) 2024-09-11T01:08:08.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.064+0000 7f5169800640 1 -- 172.21.15.103:0/4250468676 learned_addr learned my addr 172.21.15.103:0/4250468676 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:08.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.064+0000 7f516a200640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5164113980 0x7f51641a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.064+0000 7f5168e00640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5164077ff0 0x7f516419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.064+0000 7f5169800640 1 -- 172.21.15.103:0/4250468676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5164113980 msgr2=0x7f51641a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:08.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.064+0000 7f5169800640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5164113980 0x7f51641a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.064+0000 7f5169800640 1 -- 172.21.15.103:0/4250468676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5164077ff0 msgr2=0x7f516419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:08.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.064+0000 7f5169800640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5164077ff0 0x7f516419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.064+0000 7f5169800640 1 -- 172.21.15.103:0/4250468676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51641a5900 con 0x7f51640776d0 2024-09-11T01:08:08.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.064+0000 7f5168e00640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5164077ff0 0x7f516419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:08:08.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.064+0000 7f5169800640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51640776d0 0x7f516419f850 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f515800e9f0 tx=0x7f515800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:08.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.065+0000 7f5162000640 1 -- 172.21.15.103:0/4250468676 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515800cd80 con 0x7f51640776d0 2024-09-11T01:08:08.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.065+0000 7f5162000640 1 -- 172.21.15.103:0/4250468676 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51580108e0 con 0x7f51640776d0 2024-09-11T01:08:08.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.065+0000 7f5162000640 1 -- 172.21.15.103:0/4250468676 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5158018980 con 0x7f51640776d0 2024-09-11T01:08:08.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.065+0000 7f516c200640 1 -- 172.21.15.103:0/4250468676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51641a5bf0 con 0x7f51640776d0 2024-09-11T01:08:08.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.065+0000 7f516c200640 1 -- 172.21.15.103:0/4250468676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51641ac2b0 con 0x7f51640776d0 2024-09-11T01:08:08.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.068+0000 7f516edcb740 1 Processor -- start 2024-09-11T01:08:08.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.068+0000 7f516edcb740 1 -- start start 2024-09-11T01:08:08.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.068+0000 7f5162000640 1 -- 172.21.15.103:0/4250468676 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7f5158010430 con 0x7f51640776d0 2024-09-11T01:08:08.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.068+0000 7f516edcb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52240 0x558dd8d52620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.068+0000 7f516edcb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52b60 0x558dd8d5e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.068+0000 7f516edcb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 0x558dd8d60ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.068+0000 7f516edcb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558dd8cc9d50 con 0x558dd8d52240 2024-09-11T01:08:08.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.068+0000 7f516edcb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558dd8cb9180 con 0x558dd8d5eaf0 2024-09-11T01:08:08.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.068+0000 7f516edcb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558dd8cbcf90 con 0x558dd8d52b60 2024-09-11T01:08:08.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.068+0000 7f516a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52240 0x558dd8d52620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.068+0000 7f516a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52240 0x558dd8d52620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52922/0 (socket says 172.21.15.103:52922) 2024-09-11T01:08:08.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.068+0000 7f516a200640 1 -- 172.21.15.103:0/357318153 learned_addr learned my addr 172.21.15.103:0/357318153 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:08.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.069+0000 7f5169800640 1 --2- 172.21.15.103:0/357318153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52b60 0x558dd8d5e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.069+0000 7f5168e00640 1 --2- 172.21.15.103:0/357318153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 0x558dd8d60ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.069+0000 7f516a200640 1 -- 172.21.15.103:0/357318153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52b60 msgr2=0x558dd8d5e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:08.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.069+0000 7f516a200640 1 --2- 172.21.15.103:0/357318153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52b60 0x558dd8d5e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.069+0000 7f516a200640 1 -- 172.21.15.103:0/357318153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 msgr2=0x558dd8d60ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:08.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.069+0000 7f516a200640 1 --2- 172.21.15.103:0/357318153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 0x558dd8d60ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.069+0000 7f516a200640 1 -- 172.21.15.103:0/357318153 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dd8c83a70 con 0x558dd8d52240 2024-09-11T01:08:08.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.069+0000 7f5169800640 1 --2- 172.21.15.103:0/357318153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52b60 0x558dd8d5e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:08:08.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.069+0000 7f5168e00640 1 --2- 172.21.15.103:0/357318153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 0x558dd8d60ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:08:08.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.069+0000 7f516a200640 1 --2- 172.21.15.103:0/357318153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52240 0x558dd8d52620 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f515c009410 tx=0x7f515c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d4a3dc7751872e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:08.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.070+0000 7f5156a00640 1 -- 172.21.15.103:0/357318153 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515c031cf0 con 0x558dd8d52240 2024-09-11T01:08:08.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.070+0000 7f5156a00640 1 -- 172.21.15.103:0/357318153 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f515c036070 con 0x558dd8d52240 2024-09-11T01:08:08.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.070+0000 7f5156a00640 1 -- 172.21.15.103:0/357318153 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515c004240 con 0x558dd8d52240 2024-09-11T01:08:08.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.070+0000 7f5162000640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f514c0b52e0 0x7f514c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.070+0000 7f516edcb740 1 -- 172.21.15.103:0/357318153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52240 msgr2=0x558dd8d52620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.070+0000 7f516edcb740 1 --2- 172.21.15.103:0/357318153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52240 0x558dd8d52620 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f515c009410 tx=0x7f515c005ef0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.071+0000 7f5162000640 1 -- 172.21.15.103:0/4250468676 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f51580e6380 con 0x7f51640776d0 2024-09-11T01:08:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.071+0000 7f5169800640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f514c0b52e0 0x7f514c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.071+0000 7f516edcb740 1 -- 172.21.15.103:0/357318153 shutdown_connections 2024-09-11T01:08:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.071+0000 7f516edcb740 1 --2- 172.21.15.103:0/357318153 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 0x558dd8d60ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.071+0000 7f516edcb740 1 --2- 172.21.15.103:0/357318153 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52b60 0x558dd8d5e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.071+0000 7f516edcb740 1 --2- 172.21.15.103:0/357318153 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52240 0x558dd8d52620 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.071+0000 7f516edcb740 1 -- 172.21.15.103:0/357318153 >> 172.21.15.103:0/357318153 conn(0x558dd8d50020 msgr2=0x558dd8d51210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.071+0000 7f516edcb740 1 -- 172.21.15.103:0/357318153 shutdown_connections 2024-09-11T01:08:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.071+0000 7f516edcb740 1 -- 172.21.15.103:0/357318153 wait complete. 2024-09-11T01:08:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.072+0000 7f5169800640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f514c0b52e0 0x7f514c0b77a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f51580ac6c0 tx=0x7f5158000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:08.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.072+0000 7f516edcb740 1 -- start start 2024-09-11T01:08:08.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.072+0000 7f516edcb740 1 Processor -- start 2024-09-11T01:08:08.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.072+0000 7f516edcb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52240 0x558dd8d5bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.072+0000 7f516edcb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52b60 0x558dd8d5c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.072+0000 7f516edcb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 0x558dd8d5c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.072+0000 7f516edcb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558dd8b1a5f0 con 0x558dd8d52b60 2024-09-11T01:08:08.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.072+0000 7f516edcb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558dd8c54460 con 0x558dd8d5eaf0 2024-09-11T01:08:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.072+0000 7f516edcb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558dd8d61660 con 0x558dd8d52240 2024-09-11T01:08:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.072+0000 7f516edcb740 10 client.0 _ll_register_callbacks cb 0x558dd8c64210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.073+0000 7f5168e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52b60 0x558dd8d5c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.073+0000 7f5168e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52b60 0x558dd8d5c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52928/0 (socket says 172.21.15.103:52928) 2024-09-11T01:08:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.073+0000 7f5168e00640 1 -- 172.21.15.103:0/3414643409 learned_addr learned my addr 172.21.15.103:0/3414643409 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.073+0000 7f516a200640 1 --2- 172.21.15.103:0/3414643409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52240 0x558dd8d5bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.073+0000 7f516a200640 1 --2- 172.21.15.103:0/3414643409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 0x558dd8d5c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.073+0000 7f5168e00640 1 -- 172.21.15.103:0/3414643409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52240 msgr2=0x558dd8d5bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.073+0000 7f5168e00640 1 --2- 172.21.15.103:0/3414643409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52240 0x558dd8d5bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.073+0000 7f5168e00640 1 -- 172.21.15.103:0/3414643409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 msgr2=0x558dd8d5c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.073+0000 7f5168e00640 1 --2- 172.21.15.103:0/3414643409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 0x558dd8d5c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.073+0000 7f5168e00640 1 -- 172.21.15.103:0/3414643409 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dd8a17540 con 0x558dd8d52b60 2024-09-11T01:08:08.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.074+0000 7f5168e00640 1 --2- 172.21.15.103:0/3414643409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52b60 0x558dd8d5c020 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5150013710 tx=0x7f5150013bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d943876cdbd55bdb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.074+0000 7f514b400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:08:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.074+0000 7f514b400640 1 -- 172.21.15.103:0/3414643409 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150020060 con 0x558dd8d52b60 2024-09-11T01:08:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.074+0000 7f516edcb740 1 -- 172.21.15.103:0/3414643409 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558dd8c56a70 con 0x558dd8d52b60 2024-09-11T01:08:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.074+0000 7f514b400640 1 -- 172.21.15.103:0/3414643409 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5150011dd0 con 0x558dd8d52b60 2024-09-11T01:08:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.074+0000 7f514b400640 1 -- 172.21.15.103:0/3414643409 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5150027050 con 0x558dd8d52b60 2024-09-11T01:08:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.074+0000 7f516edcb740 10 client.15213 fetch_fsmap learned FSMap version 25 2024-09-11T01:08:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.074+0000 7f516edcb740 1 -- 172.21.15.103:0/3414643409 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558dd8c716f0 con 0x558dd8d52b60 2024-09-11T01:08:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.074+0000 7f514b400640 1 -- 172.21.15.103:0/3414643409 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558dd8c56a70 con 0x558dd8d52b60 2024-09-11T01:08:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.075+0000 7f514b400640 1 -- 172.21.15.103:0/3414643409 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f515001a030 con 0x558dd8d52b60 2024-09-11T01:08:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.075+0000 7f516edcb740 10 client.15213 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T01:08:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.075+0000 7f516edcb740 10 client.15213 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T01:08:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.075+0000 7f516edcb740 20 client.15213 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:08.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.075+0000 7f516edcb740 1 --2- 172.21.15.103:0/3414643409 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x558dd8d6f740 0x558dd8d70bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.075+0000 7f516edcb740 4 client.15213 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:08:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.075+0000 7f516edcb740 1 -- 172.21.15.103:0/3414643409 --> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558dd8ccbca0 con 0x558dd8d6f740 2024-09-11T01:08:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.075+0000 7f516a200640 1 --2- 172.21.15.103:0/3414643409 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x558dd8d6f740 0x558dd8d70bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.076+0000 7f516a200640 1 --2- 172.21.15.103:0/3414643409 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x558dd8d6f740 0x558dd8d70bb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a03433c305bce9 server_cookie=4f1ab5c408bd2e65 in_seq=0 out_seq=0 2024-09-11T01:08:08.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.076+0000 7f514b400640 10 client.15213 ms_handle_connect on v2:172.21.15.183:6838/1006805616 2024-09-11T01:08:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.076+0000 7f514b400640 1 -- 172.21.15.103:0/3414643409 <== mds.2 v2:172.21.15.183:6838/1006805616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558dd8ccbca0 con 0x558dd8d6f740 2024-09-11T01:08:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.076+0000 7f514b400640 10 client.15213 handle_command_reply: tid=0 2024-09-11T01:08:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.077+0000 7f516edcb740 1 client.15213 shutdown 2024-09-11T01:08:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.077+0000 7f516edcb740 1 -- 172.21.15.103:0/3414643409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52b60 msgr2=0x558dd8d5c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.077+0000 7f516edcb740 1 --2- 172.21.15.103:0/3414643409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52b60 0x558dd8d5c020 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5150013710 tx=0x7f5150013bd0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.077+0000 7f516edcb740 1 -- 172.21.15.103:0/3414643409 shutdown_connections 2024-09-11T01:08:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.077+0000 7f516edcb740 1 --2- 172.21.15.103:0/3414643409 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x558dd8d6f740 0x558dd8d70bb0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.077+0000 7f516edcb740 1 --2- 172.21.15.103:0/3414643409 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 0x558dd8d5c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.077+0000 7f516edcb740 1 --2- 172.21.15.103:0/3414643409 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52b60 0x558dd8d5c020 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.077+0000 7f514b400640 0 client.15213 ms_handle_reset on v2:172.21.15.183:6838/1006805616 2024-09-11T01:08:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.077+0000 7f516edcb740 1 --2- 172.21.15.103:0/3414643409 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52240 0x558dd8d5bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.077+0000 7f516edcb740 1 -- 172.21.15.103:0/3414643409 >> 172.21.15.103:0/3414643409 conn(0x558dd8d50020 msgr2=0x558dd8d55c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.077+0000 7f516edcb740 1 -- 172.21.15.103:0/3414643409 shutdown_connections 2024-09-11T01:08:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.077+0000 7f516edcb740 1 -- 172.21.15.103:0/3414643409 wait complete. 2024-09-11T01:08:08.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.077+0000 7f516edcb740 20 client.15213 trim_cache size 0 max 16384 2024-09-11T01:08:08.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.096+0000 7f516edcb740 1 Processor -- start 2024-09-11T01:08:08.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.096+0000 7f516edcb740 1 -- start start 2024-09-11T01:08:08.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.096+0000 7f516edcb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d52240 0x558dd8d70bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.096+0000 7f516edcb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52b60 0x558dd8d56400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.096+0000 7f516edcb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d5eaf0 0x558dd8d5a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.096+0000 7f516edcb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558dd8d6eef0 con 0x558dd8d52b60 2024-09-11T01:08:08.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.096+0000 7f516edcb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558dd8d6f5c0 con 0x558dd8d52240 2024-09-11T01:08:08.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.096+0000 7f516edcb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558dd8d6fc90 con 0x558dd8d5eaf0 2024-09-11T01:08:08.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.096+0000 7f5168e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52b60 0x558dd8d56400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.096+0000 7f5168e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52b60 0x558dd8d56400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52932/0 (socket says 172.21.15.103:52932) 2024-09-11T01:08:08.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.096+0000 7f5168e00640 1 -- 172.21.15.103:0/3640129466 learned_addr learned my addr 172.21.15.103:0/3640129466 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:08.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.097+0000 7f516a200640 1 --2- 172.21.15.103:0/3640129466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d52240 0x558dd8d70bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.097+0000 7f516a200640 1 --2- 172.21.15.103:0/3640129466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d5eaf0 0x558dd8d5a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.097+0000 7f5168e00640 1 -- 172.21.15.103:0/3640129466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d5eaf0 msgr2=0x558dd8d5a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:08.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.097+0000 7f5168e00640 1 --2- 172.21.15.103:0/3640129466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d5eaf0 0x558dd8d5a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.097+0000 7f5168e00640 1 -- 172.21.15.103:0/3640129466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d52240 msgr2=0x558dd8d70bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:08.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.097+0000 7f5168e00640 1 --2- 172.21.15.103:0/3640129466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d52240 0x558dd8d70bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.097+0000 7f5168e00640 1 -- 172.21.15.103:0/3640129466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558dd8d6d1e0 con 0x558dd8d52b60 2024-09-11T01:08:08.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.097+0000 7f516a200640 1 --2- 172.21.15.103:0/3640129466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d52240 0x558dd8d70bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:08:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.097+0000 7f5168e00640 1 --2- 172.21.15.103:0/3640129466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52b60 0x558dd8d56400 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f515000e690 tx=0x7f5150009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12574d3579bf066e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.097+0000 7f5156000640 1 -- 172.21.15.103:0/3640129466 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150030070 con 0x558dd8d52b60 2024-09-11T01:08:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.097+0000 7f5156000640 1 -- 172.21.15.103:0/3640129466 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5150011dd0 con 0x558dd8d52b60 2024-09-11T01:08:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.097+0000 7f5156000640 1 -- 172.21.15.103:0/3640129466 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150004660 con 0x558dd8d52b60 2024-09-11T01:08:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.098+0000 7f516edcb740 1 -- 172.21.15.103:0/3640129466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52b60 msgr2=0x558dd8d56400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.098+0000 7f516edcb740 1 --2- 172.21.15.103:0/3640129466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52b60 0x558dd8d56400 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f515000e690 tx=0x7f5150009630 comp rx=0 tx=0).stop 2024-09-11T01:08:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.098+0000 7f516edcb740 1 -- 172.21.15.103:0/3640129466 shutdown_connections 2024-09-11T01:08:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.098+0000 7f516edcb740 1 --2- 172.21.15.103:0/3640129466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d5eaf0 0x558dd8d5a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.098+0000 7f516edcb740 1 --2- 172.21.15.103:0/3640129466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52b60 0x558dd8d56400 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.098+0000 7f516edcb740 1 --2- 172.21.15.103:0/3640129466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d52240 0x558dd8d70bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.098+0000 7f516edcb740 1 -- 172.21.15.103:0/3640129466 >> 172.21.15.103:0/3640129466 conn(0x558dd8d50020 msgr2=0x558dd8d56d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.098+0000 7f516edcb740 1 -- 172.21.15.103:0/3640129466 shutdown_connections 2024-09-11T01:08:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.098+0000 7f516edcb740 1 -- 172.21.15.103:0/3640129466 wait complete. 2024-09-11T01:08:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.099+0000 7f516edcb740 1 -- start start 2024-09-11T01:08:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.099+0000 7f516edcb740 1 Processor -- start 2024-09-11T01:08:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.099+0000 7f516edcb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52240 0x558dd8d72e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.099+0000 7f516edcb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52b60 0x558dd8d73360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.099+0000 7f516edcb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 0x558dd8d738a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.099+0000 7f516edcb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558dd8d70a30 con 0x558dd8d52240 2024-09-11T01:08:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.099+0000 7f516edcb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558dd8d70360 con 0x558dd8d5eaf0 2024-09-11T01:08:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.099+0000 7f516edcb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558dd8d71100 con 0x558dd8d52b60 2024-09-11T01:08:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.099+0000 7f516edcb740 10 client.0 _ll_register_callbacks cb 0x7f5150009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.100+0000 7f516a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52240 0x558dd8d72e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.100+0000 7f5168e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52b60 0x558dd8d73360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.100+0000 7f5168e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52b60 0x558dd8d73360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:36716/0 (socket says 172.21.15.103:36716) 2024-09-11T01:08:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.100+0000 7f5168e00640 1 -- 172.21.15.103:0/3649276941 learned_addr learned my addr 172.21.15.103:0/3649276941 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.100+0000 7f516a200640 1 --2- 172.21.15.103:0/3649276941 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 0x558dd8d738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.100+0000 7f5168e00640 1 -- 172.21.15.103:0/3649276941 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 msgr2=0x558dd8d738a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.100+0000 7f5168e00640 1 --2- 172.21.15.103:0/3649276941 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 0x558dd8d738a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.100+0000 7f5168e00640 1 -- 172.21.15.103:0/3649276941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52240 msgr2=0x558dd8d72e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.100+0000 7f5168e00640 1 --2- 172.21.15.103:0/3649276941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52240 0x558dd8d72e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.100+0000 7f5168e00640 1 -- 172.21.15.103:0/3649276941 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558dd8d78660 con 0x558dd8d52b60 2024-09-11T01:08:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.100+0000 7f516a200640 1 --2- 172.21.15.103:0/3649276941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52240 0x558dd8d72e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.100+0000 7f5168e00640 1 --2- 172.21.15.103:0/3649276941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52b60 0x558dd8d73360 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f515000ebd0 tx=0x7f515000e550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4333bb7ce5e63304 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:08.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.100+0000 7f514b400640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:08:08.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.101+0000 7f514b400640 1 -- 172.21.15.103:0/3649276941 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150030070 con 0x558dd8d52b60 2024-09-11T01:08:08.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.101+0000 7f516edcb740 1 -- 172.21.15.103:0/3649276941 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5150011dd0 con 0x558dd8d52b60 2024-09-11T01:08:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.101+0000 7f514b400640 1 -- 172.21.15.103:0/3649276941 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5150005030 con 0x558dd8d52b60 2024-09-11T01:08:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.101+0000 7f514b400640 1 -- 172.21.15.103:0/3649276941 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f515003b050 con 0x558dd8d52b60 2024-09-11T01:08:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.101+0000 7f516edcb740 10 client.25207 fetch_fsmap learned FSMap version 25 2024-09-11T01:08:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.101+0000 7f516edcb740 1 -- 172.21.15.103:0/3649276941 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558dd8ddc420 con 0x558dd8d52b60 2024-09-11T01:08:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.101+0000 7f514b400640 1 -- 172.21.15.103:0/3649276941 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5150011dd0 con 0x558dd8d52b60 2024-09-11T01:08:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.102+0000 7f514b400640 1 -- 172.21.15.103:0/3649276941 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f515001a070 con 0x558dd8d52b60 2024-09-11T01:08:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.102+0000 7f516edcb740 10 client.25207 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T01:08:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.102+0000 7f516edcb740 10 client.25207 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T01:08:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.102+0000 7f516edcb740 20 client.25207 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.102+0000 7f516edcb740 1 --2- 172.21.15.103:0/3649276941 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x558dd8de0c70 0x558dd8ddf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.102+0000 7f516edcb740 4 client.25207 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T01:08:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.102+0000 7f516edcb740 1 -- 172.21.15.103:0/3649276941 --> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] -- command(tid 0: {"prefix": "status"}) -- 0x558dd8cc7750 con 0x558dd8de0c70 2024-09-11T01:08:08.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.102+0000 7f516a200640 1 --2- 172.21.15.103:0/3649276941 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x558dd8de0c70 0x558dd8ddf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:08.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f516a200640 1 --2- 172.21.15.103:0/3649276941 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x558dd8de0c70 0x558dd8ddf980 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=349d77e949e1df44 server_cookie=ac14a82750078f9f in_seq=0 out_seq=0 2024-09-11T01:08:08.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f514b400640 10 client.25207 ms_handle_connect on v2:172.21.15.183:6838/1006805616 2024-09-11T01:08:08.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f514b400640 1 -- 172.21.15.103:0/3649276941 <== mds.2 v2:172.21.15.183:6838/1006805616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558dd8cc7750 con 0x558dd8de0c70 2024-09-11T01:08:08.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f514b400640 10 client.25207 handle_command_reply: tid=0 2024-09-11T01:08:08.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f516edcb740 1 client.25207 shutdown 2024-09-11T01:08:08.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f516edcb740 1 -- 172.21.15.103:0/3649276941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52b60 msgr2=0x558dd8d73360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:08.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f516edcb740 1 --2- 172.21.15.103:0/3649276941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52b60 0x558dd8d73360 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f515000ebd0 tx=0x7f515000e550 comp rx=0 tx=0).stop 2024-09-11T01:08:08.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f516edcb740 1 -- 172.21.15.103:0/3649276941 shutdown_connections 2024-09-11T01:08:08.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f516edcb740 1 --2- 172.21.15.103:0/3649276941 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x558dd8de0c70 0x558dd8ddf980 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f514b400640 0 client.25207 ms_handle_reset on v2:172.21.15.183:6838/1006805616 2024-09-11T01:08:08.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f516edcb740 1 --2- 172.21.15.103:0/3649276941 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558dd8d5eaf0 0x558dd8d738a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f516edcb740 1 --2- 172.21.15.103:0/3649276941 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558dd8d52b60 0x558dd8d73360 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f516edcb740 1 --2- 172.21.15.103:0/3649276941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558dd8d52240 0x558dd8d72e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f516edcb740 1 -- 172.21.15.103:0/3649276941 >> 172.21.15.103:0/3649276941 conn(0x558dd8d50020 msgr2=0x558dd8d59f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:08.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.103+0000 7f516edcb740 1 -- 172.21.15.103:0/3649276941 shutdown_connections 2024-09-11T01:08:08.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.104+0000 7f516edcb740 1 -- 172.21.15.103:0/3649276941 wait complete. 2024-09-11T01:08:08.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.104+0000 7f516edcb740 20 client.25207 trim_cache size 0 max 16384 2024-09-11T01:08:08.110 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:08:08.110 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "917288bc-6fd8-11ef-bcea-c7b262605968", 2024-09-11T01:08:08.110 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-09-11T01:08:08.110 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24619, 2024-09-11T01:08:08.110 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-11T01:08:08.110 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-11T01:08:08.110 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-11T01:08:08.111 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 108.46819684099999, 2024-09-11T01:08:08.111 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 25, 2024-09-11T01:08:08.111 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-09-11T01:08:08.111 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 87, 2024-09-11T01:08:08.111 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 177.953401934 2024-09-11T01:08:08.111 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:08:08.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.104+0000 7f516c200640 1 -- 172.21.15.103:0/4250468676 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f514c0b52e0 msgr2=0x7f514c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:08.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.104+0000 7f516c200640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f514c0b52e0 0x7f514c0b77a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f51580ac6c0 tx=0x7f5158000bc0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.104+0000 7f516c200640 1 -- 172.21.15.103:0/4250468676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51640776d0 msgr2=0x7f516419f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:08.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.104+0000 7f516c200640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51640776d0 0x7f516419f850 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f515800e9f0 tx=0x7f515800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.104+0000 7f516c200640 1 -- 172.21.15.103:0/4250468676 shutdown_connections 2024-09-11T01:08:08.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.104+0000 7f516c200640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f514c0b52e0 0x7f514c0b77a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.104+0000 7f516c200640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5164113980 0x7f51641a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.104+0000 7f516c200640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5164077ff0 0x7f516419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.104+0000 7f516c200640 1 --2- 172.21.15.103:0/4250468676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51640776d0 0x7f516419f850 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:08.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.104+0000 7f516c200640 1 -- 172.21.15.103:0/4250468676 >> 172.21.15.103:0/4250468676 conn(0x7f5164100a00 msgr2=0x7f5164102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:08.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.105+0000 7f516c200640 1 -- 172.21.15.103:0/4250468676 shutdown_connections 2024-09-11T01:08:08.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:08.105+0000 7f516c200640 1 -- 172.21.15.103:0/4250468676 wait complete. 2024-09-11T01:08:08.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:07 smithi117 ceph-mon[35358]: pgmap v393: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:08:08.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:07 smithi183 ceph-mon[34992]: pgmap v393: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:08:09.025 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-11T01:08:09.395 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.990+0000 7f7aa6200640 1 -- 172.21.15.103:0/4126878413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa01093d0 msgr2=0x7f7aa01097b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.990+0000 7f7aa6200640 1 --2- 172.21.15.103:0/4126878413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa01093d0 0x7f7aa01097b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009860 tx=0x7f7a9002a340 comp rx=0 tx=0).stop 2024-09-11T01:08:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.990+0000 7f7aa6200640 1 -- 172.21.15.103:0/4126878413 shutdown_connections 2024-09-11T01:08:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.990+0000 7f7aa6200640 1 --2- 172.21.15.103:0/4126878413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa010f760 0x7f7aa0115f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.990+0000 7f7aa6200640 1 --2- 172.21.15.103:0/4126878413 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa010ede0 0x7f7aa010f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.990+0000 7f7aa6200640 1 --2- 172.21.15.103:0/4126878413 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa01093d0 0x7f7aa01097b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.990+0000 7f7aa6200640 1 -- 172.21.15.103:0/4126878413 >> 172.21.15.103:0/4126878413 conn(0x7f7aa0078a40 msgr2=0x7f7aa007ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.990+0000 7f7aa6200640 1 -- 172.21.15.103:0/4126878413 shutdown_connections 2024-09-11T01:08:09.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.990+0000 7f7aa6200640 1 -- 172.21.15.103:0/4126878413 wait complete. 2024-09-11T01:08:09.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.991+0000 7f7aa6200640 1 Processor -- start 2024-09-11T01:08:09.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.991+0000 7f7aa6200640 1 -- start start 2024-09-11T01:08:09.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.992+0000 7f7aa6200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa01093d0 0x7f7aa019f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:09.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.992+0000 7f7aa6200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa010ede0 0x7f7aa019fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:09.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.992+0000 7f7aa6200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa010f760 0x7f7aa01a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:09.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.992+0000 7f7aa6200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa0119390 con 0x7f7aa010f760 2024-09-11T01:08:09.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.992+0000 7f7aa6200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa0119210 con 0x7f7aa01093d0 2024-09-11T01:08:09.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.992+0000 7f7aa6200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa0119510 con 0x7f7aa010ede0 2024-09-11T01:08:09.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.992+0000 7f7a9fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa010f760 0x7f7aa01a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:09.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.992+0000 7f7a97e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa010ede0 0x7f7aa019fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:09.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.992+0000 7f7a9f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa01093d0 0x7f7aa019f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:09.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.992+0000 7f7a97e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa010ede0 0x7f7aa019fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:34858/0 (socket says 172.21.15.103:34858) 2024-09-11T01:08:09.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.992+0000 7f7a97e00640 1 -- 172.21.15.103:0/1867773525 learned_addr learned my addr 172.21.15.103:0/1867773525 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:09.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.992+0000 7f7a9fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa010f760 0x7f7aa01a5180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45416/0 (socket says 172.21.15.103:45416) 2024-09-11T01:08:09.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.993+0000 7f7a97e00640 1 -- 172.21.15.103:0/1867773525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa01093d0 msgr2=0x7f7aa019f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:09.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.993+0000 7f7a97e00640 1 --2- 172.21.15.103:0/1867773525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa01093d0 0x7f7aa019f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:09.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.993+0000 7f7a97e00640 1 -- 172.21.15.103:0/1867773525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa010f760 msgr2=0x7f7aa01a5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:09.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.993+0000 7f7a97e00640 1 --2- 172.21.15.103:0/1867773525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa010f760 0x7f7aa01a5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:09.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.993+0000 7f7a97e00640 1 -- 172.21.15.103:0/1867773525 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa01a5950 con 0x7f7aa010ede0 2024-09-11T01:08:09.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.993+0000 7f7a9fe00640 1 --2- 172.21.15.103:0/1867773525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa010f760 0x7f7aa01a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:09.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.993+0000 7f7a97e00640 1 --2- 172.21.15.103:0/1867773525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa010ede0 0x7f7aa019fde0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800e9f0 tx=0x7f7a8800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:09.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.993+0000 7f7a9cc00640 1 -- 172.21.15.103:0/1867773525 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8800cd80 con 0x7f7aa010ede0 2024-09-11T01:08:09.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.993+0000 7f7a9cc00640 1 -- 172.21.15.103:0/1867773525 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a880054d0 con 0x7f7aa010ede0 2024-09-11T01:08:09.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.993+0000 7f7aa6200640 1 -- 172.21.15.103:0/1867773525 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa01a5c40 con 0x7f7aa010ede0 2024-09-11T01:08:09.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.993+0000 7f7a9cc00640 1 -- 172.21.15.103:0/1867773525 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a88010690 con 0x7f7aa010ede0 2024-09-11T01:08:09.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.993+0000 7f7aa6200640 1 -- 172.21.15.103:0/1867773525 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa01ac300 con 0x7f7aa010ede0 2024-09-11T01:08:09.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.996+0000 7f7aa8c90740 1 Processor -- start 2024-09-11T01:08:09.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.996+0000 7f7aa8c90740 1 -- start start 2024-09-11T01:08:10.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7aa8c90740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28240 0x55ac46b28620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7aa8c90740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28b60 0x55ac46b345b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7aa8c90740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b34af0 0x55ac46b36ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7aa8c90740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ac46a9fd50 con 0x55ac46b28b60 2024-09-11T01:08:10.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7aa8c90740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ac46a8f180 con 0x55ac46b28240 2024-09-11T01:08:10.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7aa8c90740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ac46a92f90 con 0x55ac46b34af0 2024-09-11T01:08:10.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7a9f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28b60 0x55ac46b345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:10.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7a9f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28b60 0x55ac46b345b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45422/0 (socket says 172.21.15.103:45422) 2024-09-11T01:08:10.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7a9f400640 1 -- 172.21.15.103:0/2101031265 learned_addr learned my addr 172.21.15.103:0/2101031265 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:10.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7a9fe00640 1 --2- 172.21.15.103:0/2101031265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28240 0x55ac46b28620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:10.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7a9cc00640 1 -- 172.21.15.103:0/1867773525 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7f7a88004e90 con 0x7f7aa010ede0 2024-09-11T01:08:10.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7a9fe00640 1 -- 172.21.15.103:0/2101031265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b34af0 msgr2=0x55ac46b36ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:10.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7a9fe00640 1 --2- 172.21.15.103:0/2101031265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b34af0 0x55ac46b36ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7a9fe00640 1 -- 172.21.15.103:0/2101031265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28b60 msgr2=0x55ac46b345b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:10.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7a9fe00640 1 --2- 172.21.15.103:0/2101031265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28b60 0x55ac46b345b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7a9fe00640 1 -- 172.21.15.103:0/2101031265 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac46a59a70 con 0x55ac46b28240 2024-09-11T01:08:10.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.997+0000 7f7a9f400640 1 --2- 172.21.15.103:0/2101031265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28b60 0x55ac46b345b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:10.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.998+0000 7f7a9fe00640 1 --2- 172.21.15.103:0/2101031265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28240 0x55ac46b28620 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009fc0 tx=0x7f7a9800ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1a01d0c47299519 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.998+0000 7f7a8fe00640 1 -- 172.21.15.103:0/2101031265 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9801d070 con 0x55ac46b28240 2024-09-11T01:08:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.998+0000 7f7a8fe00640 1 -- 172.21.15.103:0/2101031265 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a98003e20 con 0x55ac46b28240 2024-09-11T01:08:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.998+0000 7f7a8fe00640 1 -- 172.21.15.103:0/2101031265 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98004620 con 0x55ac46b28240 2024-09-11T01:08:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.999+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2101031265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28240 msgr2=0x55ac46b28620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.999+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2101031265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28240 0x55ac46b28620 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009fc0 tx=0x7f7a9800ec30 comp rx=0 tx=0).stop 2024-09-11T01:08:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.999+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2101031265 shutdown_connections 2024-09-11T01:08:10.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.999+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2101031265 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b34af0 0x55ac46b36ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.999+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2101031265 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28b60 0x55ac46b345b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.999+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2101031265 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28240 0x55ac46b28620 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.999+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2101031265 >> 172.21.15.103:0/2101031265 conn(0x55ac46b26020 msgr2=0x55ac46b27210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:10.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.999+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2101031265 shutdown_connections 2024-09-11T01:08:10.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.999+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2101031265 wait complete. 2024-09-11T01:08:10.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:09.999+0000 7f7aa8c90740 1 -- start start 2024-09-11T01:08:10.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.000+0000 7f7a9cc00640 1 --2- 172.21.15.103:0/1867773525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7a840b5270 0x7f7a840b7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.000+0000 7f7aa8c90740 1 Processor -- start 2024-09-11T01:08:10.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.000+0000 7f7a9cc00640 1 -- 172.21.15.103:0/1867773525 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f7a880e63c0 con 0x7f7aa010ede0 2024-09-11T01:08:10.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.000+0000 7f7a9fe00640 1 --2- 172.21.15.103:0/1867773525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7a840b5270 0x7f7a840b7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:10.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.000+0000 7f7aa8c90740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28240 0x55ac46b31ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.000+0000 7f7aa8c90740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b28b60 0x55ac46b31ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.000+0000 7f7aa8c90740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b34af0 0x55ac46b32530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.000+0000 7f7aa8c90740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ac468f05f0 con 0x55ac46b34af0 2024-09-11T01:08:10.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.000+0000 7f7aa8c90740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ac46a2a460 con 0x55ac46b28240 2024-09-11T01:08:10.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.000+0000 7f7aa8c90740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ac46b37840 con 0x55ac46b28b60 2024-09-11T01:08:10.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.000+0000 7f7aa8c90740 10 client.0 _ll_register_callbacks cb 0x55ac46a3a210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:10.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.001+0000 7f7a9fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b34af0 0x55ac46b32530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:10.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.001+0000 7f7a9f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28240 0x55ac46b31ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:10.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.001+0000 7f7a9f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28240 0x55ac46b31ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:51380/0 (socket says 172.21.15.103:51380) 2024-09-11T01:08:10.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.001+0000 7f7a9f400640 1 -- 172.21.15.103:0/2955173759 learned_addr learned my addr 172.21.15.103:0/2955173759 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:10.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.001+0000 7f7a97e00640 1 --2- 172.21.15.103:0/2955173759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b28b60 0x55ac46b31ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.001+0000 7f7a9f400640 1 -- 172.21.15.103:0/2955173759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b28b60 msgr2=0x55ac46b31ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.001+0000 7f7a9f400640 1 --2- 172.21.15.103:0/2955173759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b28b60 0x55ac46b31ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.001+0000 7f7a9f400640 1 -- 172.21.15.103:0/2955173759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b34af0 msgr2=0x55ac46b32530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.001+0000 7f7a9f400640 1 --2- 172.21.15.103:0/2955173759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b34af0 0x55ac46b32530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.001+0000 7f7a9f400640 1 -- 172.21.15.103:0/2955173759 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac467ed540 con 0x55ac46b28240 2024-09-11T01:08:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.001+0000 7f7a9fe00640 1 --2- 172.21.15.103:0/1867773525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7a840b5270 0x7f7a840b7730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009e00 tx=0x7f7a980097e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.001+0000 7f7a9f400640 1 --2- 172.21.15.103:0/2955173759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28240 0x55ac46b31ab0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a90035040 tx=0x7f7a90004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8afd33cb3eb433ca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.001+0000 7f7a8cc00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:08:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.002+0000 7f7a8cc00640 1 -- 172.21.15.103:0/2955173759 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90041070 con 0x55ac46b28240 2024-09-11T01:08:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.002+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2955173759 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ac46a2ca70 con 0x55ac46b28240 2024-09-11T01:08:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.002+0000 7f7a8cc00640 1 -- 172.21.15.103:0/2955173759 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f7a90030450 con 0x55ac46b28240 2024-09-11T01:08:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.002+0000 7f7a8cc00640 1 -- 172.21.15.103:0/2955173759 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7a9004d050 con 0x55ac46b28240 2024-09-11T01:08:10.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.002+0000 7f7aa8c90740 10 client.25238 fetch_fsmap learned FSMap version 25 2024-09-11T01:08:10.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.002+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2955173759 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ac46a476f0 con 0x55ac46b28240 2024-09-11T01:08:10.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.002+0000 7f7a8cc00640 1 -- 172.21.15.103:0/2955173759 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ac46a2ca70 con 0x55ac46b28240 2024-09-11T01:08:10.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.003+0000 7f7a8cc00640 1 -- 172.21.15.103:0/2955173759 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7a9003d450 con 0x55ac46b28240 2024-09-11T01:08:10.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.003+0000 7f7aa8c90740 10 client.25238 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T01:08:10.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.003+0000 7f7aa8c90740 10 client.25238 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T01:08:10.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.003+0000 7f7aa8c90740 20 client.25238 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:10.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.003+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2955173759 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55ac46b457b0 0x55ac46b46c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.003+0000 7f7aa8c90740 4 client.25238 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:08:10.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.003+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2955173759 --> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac46aa1ca0 con 0x55ac46b457b0 2024-09-11T01:08:10.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.003+0000 7f7a97e00640 1 --2- 172.21.15.103:0/2955173759 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55ac46b457b0 0x55ac46b46c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:10.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.004+0000 7f7a97e00640 1 --2- 172.21.15.103:0/2955173759 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55ac46b457b0 0x55ac46b46c20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a8b8073ef0eca00 server_cookie=3d3476e10a00421e in_seq=0 out_seq=0 2024-09-11T01:08:10.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.004+0000 7f7a8cc00640 10 client.25238 ms_handle_connect on v2:172.21.15.117:6836/294794871 2024-09-11T01:08:10.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.004+0000 7f7a8cc00640 1 -- 172.21.15.103:0/2955173759 <== mds.1 v2:172.21.15.117:6836/294794871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac46aa1ca0 con 0x55ac46b457b0 2024-09-11T01:08:10.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.004+0000 7f7a8cc00640 10 client.25238 handle_command_reply: tid=0 2024-09-11T01:08:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.005+0000 7f7aa8c90740 1 client.25238 shutdown 2024-09-11T01:08:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.005+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2955173759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28240 msgr2=0x55ac46b31ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.005+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2955173759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28240 0x55ac46b31ab0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a90035040 tx=0x7f7a90004270 comp rx=0 tx=0).stop 2024-09-11T01:08:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.005+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2955173759 shutdown_connections 2024-09-11T01:08:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.005+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2955173759 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55ac46b457b0 0x55ac46b46c20 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.005+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2955173759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b34af0 0x55ac46b32530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.005+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2955173759 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b28b60 0x55ac46b31ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.005+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2955173759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28240 0x55ac46b31ab0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.005+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2955173759 >> 172.21.15.103:0/2955173759 conn(0x55ac46b26020 msgr2=0x55ac46b2bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.005+0000 7f7a8cc00640 0 client.25238 ms_handle_reset on v2:172.21.15.117:6836/294794871 2024-09-11T01:08:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.005+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2955173759 shutdown_connections 2024-09-11T01:08:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.005+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2955173759 wait complete. 2024-09-11T01:08:10.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.005+0000 7f7aa8c90740 20 client.25238 trim_cache size 0 max 16384 2024-09-11T01:08:10.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.024+0000 7f7aa8c90740 1 Processor -- start 2024-09-11T01:08:10.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.024+0000 7f7aa8c90740 1 -- start start 2024-09-11T01:08:10.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.024+0000 7f7aa8c90740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28240 0x55ac46b46c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.024+0000 7f7aa8c90740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28b60 0x55ac46b446c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.024+0000 7f7aa8c90740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b34af0 0x55ac46b32870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.024+0000 7f7aa8c90740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ac46b44f60 con 0x55ac46b28240 2024-09-11T01:08:10.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.024+0000 7f7aa8c90740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ac46b45630 con 0x55ac46b28b60 2024-09-11T01:08:10.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.024+0000 7f7aa8c90740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ac46b45d00 con 0x55ac46b34af0 2024-09-11T01:08:10.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.024+0000 7f7a9f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28240 0x55ac46b46c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:10.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.024+0000 7f7a9f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28240 0x55ac46b46c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45444/0 (socket says 172.21.15.103:45444) 2024-09-11T01:08:10.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.024+0000 7f7a9f400640 1 -- 172.21.15.103:0/2243447199 learned_addr learned my addr 172.21.15.103:0/2243447199 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:10.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.025+0000 7f7a9fe00640 1 --2- 172.21.15.103:0/2243447199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b34af0 0x55ac46b32870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:10.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.025+0000 7f7a97e00640 1 --2- 172.21.15.103:0/2243447199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28b60 0x55ac46b446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.025+0000 7f7a9f400640 1 -- 172.21.15.103:0/2243447199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b34af0 msgr2=0x55ac46b32870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.025+0000 7f7a9f400640 1 --2- 172.21.15.103:0/2243447199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b34af0 0x55ac46b32870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.025+0000 7f7a9f400640 1 -- 172.21.15.103:0/2243447199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28b60 msgr2=0x55ac46b446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.025+0000 7f7a9f400640 1 --2- 172.21.15.103:0/2243447199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28b60 0x55ac46b446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.025+0000 7f7a9f400640 1 -- 172.21.15.103:0/2243447199 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac46b25e50 con 0x55ac46b28240 2024-09-11T01:08:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.025+0000 7f7a9f400640 1 --2- 172.21.15.103:0/2243447199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28240 0x55ac46b46c20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7a900303f0 tx=0x7f7a90000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631efc0781ee5e96 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.025+0000 7f7a8f400640 1 -- 172.21.15.103:0/2243447199 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90000e60 con 0x55ac46b28240 2024-09-11T01:08:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.025+0000 7f7a8f400640 1 -- 172.21.15.103:0/2243447199 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a90030900 con 0x55ac46b28240 2024-09-11T01:08:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.025+0000 7f7a8f400640 1 -- 172.21.15.103:0/2243447199 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90041040 con 0x55ac46b28240 2024-09-11T01:08:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.026+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2243447199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28240 msgr2=0x55ac46b46c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.026+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2243447199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28240 0x55ac46b46c20 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7a900303f0 tx=0x7f7a90000bc0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.026+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2243447199 shutdown_connections 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.026+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2243447199 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b34af0 0x55ac46b32870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.026+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2243447199 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28b60 0x55ac46b446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.026+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2243447199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28240 0x55ac46b46c20 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.026+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2243447199 >> 172.21.15.103:0/2243447199 conn(0x55ac46b26020 msgr2=0x55ac46b2cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.026+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2243447199 shutdown_connections 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.026+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2243447199 wait complete. 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.027+0000 7f7aa8c90740 1 -- start start 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.027+0000 7f7aa8c90740 1 Processor -- start 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.027+0000 7f7aa8c90740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28240 0x55ac46b49690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.027+0000 7f7aa8c90740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28b60 0x55ac46b49bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.027+0000 7f7aa8c90740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b34af0 0x55ac46b4ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.027+0000 7f7aa8c90740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ac46b46aa0 con 0x55ac46b28240 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.027+0000 7f7aa8c90740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ac46b463d0 con 0x55ac46b28b60 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.027+0000 7f7aa8c90740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ac46b47170 con 0x55ac46b34af0 2024-09-11T01:08:10.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.027+0000 7f7aa8c90740 10 client.0 _ll_register_callbacks cb 0x7f7a90030f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:10.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.028+0000 7f7a9f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28240 0x55ac46b49690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:10.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.028+0000 7f7a9f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28240 0x55ac46b49690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45452/0 (socket says 172.21.15.103:45452) 2024-09-11T01:08:10.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.028+0000 7f7a9f400640 1 -- 172.21.15.103:0/2301858954 learned_addr learned my addr 172.21.15.103:0/2301858954 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:10.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.028+0000 7f7a97e00640 1 --2- 172.21.15.103:0/2301858954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28b60 0x55ac46b49bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:10.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.028+0000 7f7a9fe00640 1 --2- 172.21.15.103:0/2301858954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b34af0 0x55ac46b4ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:10.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.028+0000 7f7a9f400640 1 -- 172.21.15.103:0/2301858954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b34af0 msgr2=0x55ac46b4ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:10.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.028+0000 7f7a9f400640 1 --2- 172.21.15.103:0/2301858954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b34af0 0x55ac46b4ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.028+0000 7f7a9f400640 1 -- 172.21.15.103:0/2301858954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28b60 msgr2=0x55ac46b49bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:10.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.028+0000 7f7a9f400640 1 --2- 172.21.15.103:0/2301858954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28b60 0x55ac46b49bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.028+0000 7f7a9f400640 1 -- 172.21.15.103:0/2301858954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac46b2c820 con 0x55ac46b28240 2024-09-11T01:08:10.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.028+0000 7f7a9f400640 1 --2- 172.21.15.103:0/2301858954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28240 0x55ac46b49690 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7a9003d940 tx=0x7f7a90005d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c581ceda85e4e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:10.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.028+0000 7f7a8cc00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:08:10.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.029+0000 7f7a8cc00640 1 -- 172.21.15.103:0/2301858954 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a90041070 con 0x55ac46b28240 2024-09-11T01:08:10.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.029+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2301858954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a90030900 con 0x55ac46b28240 2024-09-11T01:08:10.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.029+0000 7f7a8cc00640 1 -- 172.21.15.103:0/2301858954 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f7a90004450 con 0x55ac46b28240 2024-09-11T01:08:10.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.029+0000 7f7a8cc00640 1 -- 172.21.15.103:0/2301858954 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7a90060050 con 0x55ac46b28240 2024-09-11T01:08:10.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.029+0000 7f7aa8c90740 10 client.15237 fetch_fsmap learned FSMap version 25 2024-09-11T01:08:10.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.029+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2301858954 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ac46b34290 con 0x55ac46b28240 2024-09-11T01:08:10.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.029+0000 7f7a8cc00640 1 -- 172.21.15.103:0/2301858954 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7a90030900 con 0x55ac46b28240 2024-09-11T01:08:10.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.029+0000 7f7a8cc00640 1 -- 172.21.15.103:0/2301858954 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7a900046c0 con 0x55ac46b28240 2024-09-11T01:08:10.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.029+0000 7f7aa8c90740 10 client.15237 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T01:08:10.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.030+0000 7f7aa8c90740 10 client.15237 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T01:08:10.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.030+0000 7f7aa8c90740 20 client.15237 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:10.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.030+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2301858954 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55ac46bb6fa0 0x55ac46bb5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:10.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.030+0000 7f7aa8c90740 4 client.15237 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T01:08:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.030+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2301858954 --> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] -- command(tid 0: {"prefix": "status"}) -- 0x55ac46a9d750 con 0x55ac46bb6fa0 2024-09-11T01:08:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.030+0000 7f7a97e00640 1 --2- 172.21.15.103:0/2301858954 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55ac46bb6fa0 0x55ac46bb5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.030+0000 7f7a97e00640 1 --2- 172.21.15.103:0/2301858954 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55ac46bb6fa0 0x55ac46bb5cb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=71a7b4e1ac0b6a82 server_cookie=b25ca638f7db859 in_seq=0 out_seq=0 2024-09-11T01:08:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.030+0000 7f7a8cc00640 10 client.15237 ms_handle_connect on v2:172.21.15.117:6836/294794871 2024-09-11T01:08:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7a8cc00640 1 -- 172.21.15.103:0/2301858954 <== mds.1 v2:172.21.15.117:6836/294794871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ac46a9d750 con 0x55ac46bb6fa0 2024-09-11T01:08:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7a8cc00640 10 client.15237 handle_command_reply: tid=0 2024-09-11T01:08:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7aa8c90740 1 client.15237 shutdown 2024-09-11T01:08:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2301858954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28240 msgr2=0x55ac46b49690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2301858954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28240 0x55ac46b49690 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7a9003d940 tx=0x7f7a90005d70 comp rx=0 tx=0).stop 2024-09-11T01:08:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2301858954 shutdown_connections 2024-09-11T01:08:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2301858954 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55ac46bb6fa0 0x55ac46bb5cb0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2301858954 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac46b34af0 0x55ac46b4ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2301858954 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac46b28b60 0x55ac46b49bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7aa8c90740 1 --2- 172.21.15.103:0/2301858954 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac46b28240 0x55ac46b49690 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2301858954 >> 172.21.15.103:0/2301858954 conn(0x55ac46b26020 msgr2=0x55ac46b2ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:10.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7a8cc00640 0 client.15237 ms_handle_reset on v2:172.21.15.117:6836/294794871 2024-09-11T01:08:10.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2301858954 shutdown_connections 2024-09-11T01:08:10.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7aa8c90740 1 -- 172.21.15.103:0/2301858954 wait complete. 2024-09-11T01:08:10.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.031+0000 7f7aa8c90740 20 client.15237 trim_cache size 0 max 16384 2024-09-11T01:08:10.038 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:08:10.038 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "917288bc-6fd8-11ef-bcea-c7b262605968", 2024-09-11T01:08:10.038 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-09-11T01:08:10.038 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24629, 2024-09-11T01:08:10.038 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-11T01:08:10.038 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-11T01:08:10.038 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-11T01:08:10.038 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 111.41216689700001, 2024-09-11T01:08:10.039 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 25, 2024-09-11T01:08:10.039 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-09-11T01:08:10.039 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 87, 2024-09-11T01:08:10.039 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 182.532066372 2024-09-11T01:08:10.039 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:08:10.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.032+0000 7f7aa6200640 1 -- 172.21.15.103:0/1867773525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7a840b5270 msgr2=0x7f7a840b7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:10.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.032+0000 7f7aa6200640 1 --2- 172.21.15.103:0/1867773525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7a840b5270 0x7f7a840b7730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7a98009e00 tx=0x7f7a980097e0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.032+0000 7f7aa6200640 1 -- 172.21.15.103:0/1867773525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa010ede0 msgr2=0x7f7aa019fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:10.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.032+0000 7f7aa6200640 1 --2- 172.21.15.103:0/1867773525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa010ede0 0x7f7aa019fde0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a8800e9f0 tx=0x7f7a8800edf0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.032+0000 7f7aa6200640 1 -- 172.21.15.103:0/1867773525 shutdown_connections 2024-09-11T01:08:10.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.032+0000 7f7aa6200640 1 --2- 172.21.15.103:0/1867773525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7a840b5270 0x7f7a840b7730 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.032+0000 7f7aa6200640 1 --2- 172.21.15.103:0/1867773525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa010f760 0x7f7aa01a5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.032+0000 7f7aa6200640 1 --2- 172.21.15.103:0/1867773525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7aa010ede0 0x7f7aa019fde0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.032+0000 7f7aa6200640 1 --2- 172.21.15.103:0/1867773525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7aa01093d0 0x7f7aa019f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:10.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.032+0000 7f7aa6200640 1 -- 172.21.15.103:0/1867773525 >> 172.21.15.103:0/1867773525 conn(0x7f7aa0078a40 msgr2=0x7f7aa007ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:10.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.032+0000 7f7aa6200640 1 -- 172.21.15.103:0/1867773525 shutdown_connections 2024-09-11T01:08:10.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:10.032+0000 7f7aa6200640 1 -- 172.21.15.103:0/1867773525 wait complete. 2024-09-11T01:08:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:10 smithi103 ceph-mon[30562]: pgmap v394: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:08:10.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:10 smithi117 ceph-mon[35358]: pgmap v394: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:08:10.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:10 smithi183 ceph-mon[34992]: pgmap v394: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:08:10.951 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T01:08:11.317 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:11.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.950+0000 7f61e2400640 1 -- 172.21.15.103:0/2799435253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61dc1087d0 msgr2=0x7f61dc108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:11.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.950+0000 7f61e2400640 1 --2- 172.21.15.103:0/2799435253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61dc1087d0 0x7f61dc108c10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f61c8009900 tx=0x7f61c802a410 comp rx=0 tx=0).stop 2024-09-11T01:08:11.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.950+0000 7f61e2400640 1 -- 172.21.15.103:0/2799435253 shutdown_connections 2024-09-11T01:08:11.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.950+0000 7f61e2400640 1 --2- 172.21.15.103:0/2799435253 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61dc109150 0x7f61dc10f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.950+0000 7f61e2400640 1 --2- 172.21.15.103:0/2799435253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61dc1087d0 0x7f61dc108c10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.950+0000 7f61e2400640 1 --2- 172.21.15.103:0/2799435253 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61dc102dc0 0x7f61dc1031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.950+0000 7f61e2400640 1 -- 172.21.15.103:0/2799435253 >> 172.21.15.103:0/2799435253 conn(0x7f61dc0fe830 msgr2=0x7f61dc100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.950+0000 7f61e2400640 1 -- 172.21.15.103:0/2799435253 shutdown_connections 2024-09-11T01:08:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.950+0000 7f61e2400640 1 -- 172.21.15.103:0/2799435253 wait complete. 2024-09-11T01:08:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.951+0000 7f61e2400640 1 Processor -- start 2024-09-11T01:08:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.951+0000 7f61e2400640 1 -- start start 2024-09-11T01:08:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.952+0000 7f61e2400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61dc102dc0 0x7f61dc0754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.952+0000 7f61e2400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61dc1087d0 0x7f61dc0759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.952+0000 7f61e2400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61dc109150 0x7f61dc075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.952+0000 7f61e2400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc112e60 con 0x7f61dc109150 2024-09-11T01:08:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.952+0000 7f61e2400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc112ce0 con 0x7f61dc1087d0 2024-09-11T01:08:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.952+0000 7f61e2400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f61dc112fe0 con 0x7f61dc102dc0 2024-09-11T01:08:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.952+0000 7f61dbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61dc109150 0x7f61dc075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:11.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.952+0000 7f61db400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61dc102dc0 0x7f61dc0754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.952+0000 7f61daa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61dc1087d0 0x7f61dc0759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.952+0000 7f61dbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61dc109150 0x7f61dc075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45474/0 (socket says 172.21.15.103:45474) 2024-09-11T01:08:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.952+0000 7f61db400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61dc102dc0 0x7f61dc0754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:34894/0 (socket says 172.21.15.103:34894) 2024-09-11T01:08:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.952+0000 7f61dbe00640 1 -- 172.21.15.103:0/4237241916 learned_addr learned my addr 172.21.15.103:0/4237241916 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.952+0000 7f61db400640 1 -- 172.21.15.103:0/4237241916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61dc1087d0 msgr2=0x7f61dc0759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.952+0000 7f61db400640 1 --2- 172.21.15.103:0/4237241916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61dc1087d0 0x7f61dc0759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.953+0000 7f61db400640 1 -- 172.21.15.103:0/4237241916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61dc109150 msgr2=0x7f61dc075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.953+0000 7f61db400640 1 --2- 172.21.15.103:0/4237241916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61dc109150 0x7f61dc075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.953+0000 7f61db400640 1 -- 172.21.15.103:0/4237241916 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61dc1a76d0 con 0x7f61dc102dc0 2024-09-11T01:08:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.953+0000 7f61dbe00640 1 --2- 172.21.15.103:0/4237241916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61dc109150 0x7f61dc075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.953+0000 7f61db400640 1 --2- 172.21.15.103:0/4237241916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61dc102dc0 0x7f61dc0754a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00e9f0 tx=0x7f61cc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.953+0000 7f61d3e00640 1 -- 172.21.15.103:0/4237241916 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc00ccc0 con 0x7f61dc102dc0 2024-09-11T01:08:11.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.953+0000 7f61e2400640 1 -- 172.21.15.103:0/4237241916 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61dc1a79c0 con 0x7f61dc102dc0 2024-09-11T01:08:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.953+0000 7f61d3e00640 1 -- 172.21.15.103:0/4237241916 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61cc0108e0 con 0x7f61dc102dc0 2024-09-11T01:08:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.953+0000 7f61d3e00640 1 -- 172.21.15.103:0/4237241916 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc018880 con 0x7f61dc102dc0 2024-09-11T01:08:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.953+0000 7f61e2400640 1 -- 172.21.15.103:0/4237241916 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61dc1a7f20 con 0x7f61dc102dc0 2024-09-11T01:08:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.956+0000 7f61e4e7a740 1 Processor -- start 2024-09-11T01:08:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.956+0000 7f61e4e7a740 1 -- start start 2024-09-11T01:08:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.957+0000 7f61e4e7a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260be9240 0x55c260be9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.957+0000 7f61e4e7a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9b60 0x55c260bf55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.957+0000 7f61e4e7a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260bf5af0 0x55c260bf7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.957+0000 7f61e4e7a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c260b60d50 con 0x55c260be9b60 2024-09-11T01:08:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.957+0000 7f61e4e7a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c260b50180 con 0x55c260bf5af0 2024-09-11T01:08:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.957+0000 7f61e4e7a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c260b53f90 con 0x55c260be9240 2024-09-11T01:08:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.957+0000 7f61daa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260bf5af0 0x55c260bf7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.957+0000 7f61dbe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260be9240 0x55c260be9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:11.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.957+0000 7f61daa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260bf5af0 0x55c260bf7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:51444/0 (socket says 172.21.15.103:51444) 2024-09-11T01:08:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.957+0000 7f61dbe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260be9240 0x55c260be9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:34900/0 (socket says 172.21.15.103:34900) 2024-09-11T01:08:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.957+0000 7f61daa00640 1 -- 172.21.15.103:0/3509398564 learned_addr learned my addr 172.21.15.103:0/3509398564 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.957+0000 7f61d3e00640 1 -- 172.21.15.103:0/4237241916 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7f61cc010430 con 0x7f61dc102dc0 2024-09-11T01:08:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.957+0000 7f61dbe00640 1 -- 172.21.15.103:0/3509398564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260bf5af0 msgr2=0x55c260bf7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.958+0000 7f61dbe00640 1 --2- 172.21.15.103:0/3509398564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260bf5af0 0x55c260bf7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.958+0000 7f61dbe00640 1 -- 172.21.15.103:0/3509398564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9b60 msgr2=0x55c260bf55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.958+0000 7f61dbe00640 1 --2- 172.21.15.103:0/3509398564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9b60 0x55c260bf55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.958+0000 7f61dbe00640 1 -- 172.21.15.103:0/3509398564 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c260b1aa70 con 0x55c260be9240 2024-09-11T01:08:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.958+0000 7f61dbe00640 1 --2- 172.21.15.103:0/3509398564 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260be9240 0x55c260be9620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f61d40117e0 tx=0x7f61d4011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=242007d655456e36 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.958+0000 7f61d0c00640 1 -- 172.21.15.103:0/3509398564 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4011310 con 0x55c260be9240 2024-09-11T01:08:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.958+0000 7f61d0c00640 1 -- 172.21.15.103:0/3509398564 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61d400f9a0 con 0x55c260be9240 2024-09-11T01:08:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.958+0000 7f61d0c00640 1 -- 172.21.15.103:0/3509398564 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d40056d0 con 0x55c260be9240 2024-09-11T01:08:11.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.959+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3509398564 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260be9240 msgr2=0x55c260be9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.959+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/3509398564 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260be9240 0x55c260be9620 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f61d40117e0 tx=0x7f61d4011ca0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.959+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3509398564 shutdown_connections 2024-09-11T01:08:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.959+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/3509398564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260bf5af0 0x55c260bf7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.959+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/3509398564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9b60 0x55c260bf55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.959+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/3509398564 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260be9240 0x55c260be9620 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.959+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3509398564 >> 172.21.15.103:0/3509398564 conn(0x55c260be7020 msgr2=0x55c260be8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.959+0000 7f61d3e00640 1 --2- 172.21.15.103:0/4237241916 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f61c00b52e0 0x7f61c00b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.959+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3509398564 shutdown_connections 2024-09-11T01:08:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.959+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3509398564 wait complete. 2024-09-11T01:08:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.959+0000 7f61d3e00640 1 -- 172.21.15.103:0/4237241916 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f61cc0e6280 con 0x7f61dc102dc0 2024-09-11T01:08:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.959+0000 7f61dbe00640 1 --2- 172.21.15.103:0/4237241916 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f61c00b52e0 0x7f61c00b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.960+0000 7f61e4e7a740 1 -- start start 2024-09-11T01:08:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.960+0000 7f61e4e7a740 1 Processor -- start 2024-09-11T01:08:11.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.960+0000 7f61dbe00640 1 --2- 172.21.15.103:0/4237241916 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f61c00b52e0 0x7f61c00b77a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f61d4005330 tx=0x7f61d4009a30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.960+0000 7f61e4e7a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260be9240 0x55c260bf5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.960+0000 7f61e4e7a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9b60 0x55c260bf2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.960+0000 7f61e4e7a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260bf5af0 0x55c260bf3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.960+0000 7f61e4e7a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c2609b15f0 con 0x55c260bf5af0 2024-09-11T01:08:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.960+0000 7f61e4e7a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c260aeb460 con 0x55c260be9b60 2024-09-11T01:08:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.960+0000 7f61e4e7a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c260bf8840 con 0x55c260be9240 2024-09-11T01:08:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.960+0000 7f61e4e7a740 10 client.0 _ll_register_callbacks cb 0x55c260afb210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.961+0000 7f61db400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260be9240 0x55c260bf5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.961+0000 7f61dbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260bf5af0 0x55c260bf3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.961+0000 7f61db400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260be9240 0x55c260bf5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:34914/0 (socket says 172.21.15.103:34914) 2024-09-11T01:08:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.961+0000 7f61db400640 1 -- 172.21.15.103:0/1892748038 learned_addr learned my addr 172.21.15.103:0/1892748038 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.961+0000 7f61daa00640 1 --2- 172.21.15.103:0/1892748038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9b60 0x55c260bf2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:11.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.961+0000 7f61db400640 1 -- 172.21.15.103:0/1892748038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9b60 msgr2=0x55c260bf2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:11.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.961+0000 7f61db400640 1 --2- 172.21.15.103:0/1892748038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9b60 0x55c260bf2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.961+0000 7f61db400640 1 -- 172.21.15.103:0/1892748038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260bf5af0 msgr2=0x55c260bf3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:11.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.961+0000 7f61db400640 1 --2- 172.21.15.103:0/1892748038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260bf5af0 0x55c260bf3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.961+0000 7f61db400640 1 -- 172.21.15.103:0/1892748038 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2608ae540 con 0x55c260be9240 2024-09-11T01:08:11.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.961+0000 7f61db400640 1 --2- 172.21.15.103:0/1892748038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260be9240 0x55c260bf5590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0ac6d0 tx=0x7f61cc0ac150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be82aff171d240ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:11.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.961+0000 7f61c5600640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:08:11.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.961+0000 7f61c5600640 1 -- 172.21.15.103:0/1892748038 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0ac740 con 0x55c260be9240 2024-09-11T01:08:11.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.962+0000 7f61e4e7a740 1 -- 172.21.15.103:0/1892748038 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c260aeda70 con 0x55c260be9240 2024-09-11T01:08:11.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.962+0000 7f61c5600640 1 -- 172.21.15.103:0/1892748038 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f61cc0ab9a0 con 0x55c260be9240 2024-09-11T01:08:11.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.962+0000 7f61c5600640 1 -- 172.21.15.103:0/1892748038 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f61cc0b1170 con 0x55c260be9240 2024-09-11T01:08:11.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.962+0000 7f61e4e7a740 10 client.25234 fetch_fsmap learned FSMap version 25 2024-09-11T01:08:11.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.962+0000 7f61e4e7a740 1 -- 172.21.15.103:0/1892748038 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c260b086f0 con 0x55c260be9240 2024-09-11T01:08:11.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.962+0000 7f61c5600640 1 -- 172.21.15.103:0/1892748038 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55c260aeda70 con 0x55c260be9240 2024-09-11T01:08:11.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.962+0000 7f61c5600640 1 -- 172.21.15.103:0/1892748038 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f61cc0b2300 con 0x55c260be9240 2024-09-11T01:08:11.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.962+0000 7f61e4e7a740 10 client.25234 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T01:08:11.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.962+0000 7f61e4e7a740 10 client.25234 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T01:08:11.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.962+0000 7f61e4e7a740 20 client.25234 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:11.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.962+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/1892748038 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55c260c06660 0x55c260c07ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:11.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.962+0000 7f61e4e7a740 4 client.25234 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:08:11.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.962+0000 7f61e4e7a740 1 -- 172.21.15.103:0/1892748038 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c260b62ca0 con 0x55c260c06660 2024-09-11T01:08:11.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.963+0000 7f61daa00640 1 --2- 172.21.15.103:0/1892748038 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55c260c06660 0x55c260c07ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:11.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.963+0000 7f61daa00640 1 --2- 172.21.15.103:0/1892748038 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55c260c06660 0x55c260c07ad0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb11155f50e3dfc6 server_cookie=1ba27f792434639f in_seq=0 out_seq=0 2024-09-11T01:08:11.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.963+0000 7f61c5600640 10 client.25234 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:11.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.964+0000 7f61c5600640 1 -- 172.21.15.103:0/1892748038 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c260b62ca0 con 0x55c260c06660 2024-09-11T01:08:11.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.964+0000 7f61c5600640 10 client.25234 handle_command_reply: tid=0 2024-09-11T01:08:11.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.964+0000 7f61e4e7a740 1 client.25234 shutdown 2024-09-11T01:08:11.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.964+0000 7f61e4e7a740 1 -- 172.21.15.103:0/1892748038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260be9240 msgr2=0x55c260bf5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.964+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/1892748038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260be9240 0x55c260bf5590 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0ac6d0 tx=0x7f61cc0ac150 comp rx=0 tx=0).stop 2024-09-11T01:08:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.964+0000 7f61e4e7a740 1 -- 172.21.15.103:0/1892748038 shutdown_connections 2024-09-11T01:08:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.965+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/1892748038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260bf5af0 0x55c260bf3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.965+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/1892748038 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9b60 0x55c260bf2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.965+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/1892748038 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55c260c06660 0x55c260c07ad0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.965+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/1892748038 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260be9240 0x55c260bf5590 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.965+0000 7f61c5600640 0 client.25234 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.965+0000 7f61e4e7a740 1 -- 172.21.15.103:0/1892748038 >> 172.21.15.103:0/1892748038 conn(0x55c260be7020 msgr2=0x55c260becc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.965+0000 7f61e4e7a740 1 -- 172.21.15.103:0/1892748038 shutdown_connections 2024-09-11T01:08:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.965+0000 7f61e4e7a740 1 -- 172.21.15.103:0/1892748038 wait complete. 2024-09-11T01:08:11.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.965+0000 7f61e4e7a740 20 client.25234 trim_cache size 0 max 16384 2024-09-11T01:08:11.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.984+0000 7f61e4e7a740 1 Processor -- start 2024-09-11T01:08:11.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.984+0000 7f61e4e7a740 1 -- start start 2024-09-11T01:08:11.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.984+0000 7f61e4e7a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9240 0x55c260c05f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:11.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.984+0000 7f61e4e7a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9b60 0x55c260bed340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:11.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.984+0000 7f61e4e7a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260bf5af0 0x55c260c05610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:11.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.984+0000 7f61e4e7a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c260c05e10 con 0x55c260be9b60 2024-09-11T01:08:11.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.984+0000 7f61e4e7a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c260c064e0 con 0x55c260be9240 2024-09-11T01:08:11.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.984+0000 7f61e4e7a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c260c06bb0 con 0x55c260bf5af0 2024-09-11T01:08:11.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.985+0000 7f61daa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9b60 0x55c260bed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:11.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.985+0000 7f61daa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9b60 0x55c260bed340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45500/0 (socket says 172.21.15.103:45500) 2024-09-11T01:08:11.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.985+0000 7f61daa00640 1 -- 172.21.15.103:0/3139887133 learned_addr learned my addr 172.21.15.103:0/3139887133 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:11.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.985+0000 7f61db400640 1 --2- 172.21.15.103:0/3139887133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9240 0x55c260c05f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:11.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.985+0000 7f61dbe00640 1 --2- 172.21.15.103:0/3139887133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260bf5af0 0x55c260c05610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:11.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.985+0000 7f61db400640 1 -- 172.21.15.103:0/3139887133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260bf5af0 msgr2=0x55c260c05610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:11.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.985+0000 7f61db400640 1 --2- 172.21.15.103:0/3139887133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260bf5af0 0x55c260c05610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.985+0000 7f61db400640 1 -- 172.21.15.103:0/3139887133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9b60 msgr2=0x55c260bed340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:11.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.985+0000 7f61db400640 1 --2- 172.21.15.103:0/3139887133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9b60 0x55c260bed340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.985+0000 7f61db400640 1 -- 172.21.15.103:0/3139887133 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c260be9990 con 0x55c260be9240 2024-09-11T01:08:11.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.985+0000 7f61daa00640 1 --2- 172.21.15.103:0/3139887133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9b60 0x55c260bed340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:11.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.986+0000 7f61db400640 1 --2- 172.21.15.103:0/3139887133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9240 0x55c260c05f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0a8d10 tx=0x7f61cc0ac1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1e660422fdc4c56 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:11.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.986+0000 7f61c7e00640 1 -- 172.21.15.103:0/3139887133 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0b5c20 con 0x55c260be9240 2024-09-11T01:08:11.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.986+0000 7f61c7e00640 1 -- 172.21.15.103:0/3139887133 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61cc0b2300 con 0x55c260be9240 2024-09-11T01:08:11.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.986+0000 7f61c7e00640 1 -- 172.21.15.103:0/3139887133 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0a82f0 con 0x55c260be9240 2024-09-11T01:08:11.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.987+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3139887133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9240 msgr2=0x55c260c05f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:11.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.987+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/3139887133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9240 0x55c260c05f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0a8d10 tx=0x7f61cc0ac1c0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.987+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3139887133 shutdown_connections 2024-09-11T01:08:11.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.987+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/3139887133 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260bf5af0 0x55c260c05610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:11.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.987+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/3139887133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9b60 0x55c260bed340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:12.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.987+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/3139887133 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9240 0x55c260c05f90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:12.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.987+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3139887133 >> 172.21.15.103:0/3139887133 conn(0x55c260be7020 msgr2=0x55c260bf2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:12.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.987+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3139887133 shutdown_connections 2024-09-11T01:08:12.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.987+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3139887133 wait complete. 2024-09-11T01:08:12.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.987+0000 7f61e4e7a740 1 -- start start 2024-09-11T01:08:12.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.987+0000 7f61e4e7a740 1 Processor -- start 2024-09-11T01:08:12.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.988+0000 7f61e4e7a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9240 0x55c260c0fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:12.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.988+0000 7f61e4e7a740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9b60 0x55c260c10270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:12.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.988+0000 7f61e4e7a740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260bf5af0 0x55c260c0ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:12.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.988+0000 7f61e4e7a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c260c07950 con 0x55c260be9240 2024-09-11T01:08:12.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.988+0000 7f61e4e7a740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55c260c07280 con 0x55c260be9b60 2024-09-11T01:08:12.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.988+0000 7f61e4e7a740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55c260c08020 con 0x55c260bf5af0 2024-09-11T01:08:12.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.988+0000 7f61e4e7a740 10 client.0 _ll_register_callbacks cb 0x7f61cc0a8e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:12.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.988+0000 7f61db400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9240 0x55c260c0fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:12.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.988+0000 7f61db400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9240 0x55c260c0fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45514/0 (socket says 172.21.15.103:45514) 2024-09-11T01:08:12.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.988+0000 7f61db400640 1 -- 172.21.15.103:0/3528139099 learned_addr learned my addr 172.21.15.103:0/3528139099 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:12.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.988+0000 7f61daa00640 1 --2- 172.21.15.103:0/3528139099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9b60 0x55c260c10270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:12.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.988+0000 7f61dbe00640 1 --2- 172.21.15.103:0/3528139099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260bf5af0 0x55c260c0ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:12.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.989+0000 7f61db400640 1 -- 172.21.15.103:0/3528139099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260bf5af0 msgr2=0x55c260c0ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:12.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.989+0000 7f61db400640 1 --2- 172.21.15.103:0/3528139099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260bf5af0 0x55c260c0ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:12.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.989+0000 7f61db400640 1 -- 172.21.15.103:0/3528139099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9b60 msgr2=0x55c260c10270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:12.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.989+0000 7f61db400640 1 --2- 172.21.15.103:0/3528139099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9b60 0x55c260c10270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:12.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.989+0000 7f61db400640 1 -- 172.21.15.103:0/3528139099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c260c0b220 con 0x55c260be9240 2024-09-11T01:08:12.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.989+0000 7f61daa00640 1 --2- 172.21.15.103:0/3528139099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9b60 0x55c260c10270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:12.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.989+0000 7f61db400640 1 --2- 172.21.15.103:0/3528139099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9240 0x55c260c0fd30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f61cc000c00 tx=0x7f61cc00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370de3440550396d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:12.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.989+0000 7f61c5600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:08:12.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.989+0000 7f61c5600640 1 -- 172.21.15.103:0/3528139099 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0b5c20 con 0x55c260be9240 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.989+0000 7f61c5600640 1 -- 172.21.15.103:0/3528139099 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f61cc0a8090 con 0x55c260be9240 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.989+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3528139099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61cc0b2300 con 0x55c260be9240 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.990+0000 7f61c5600640 1 -- 172.21.15.103:0/3528139099 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f61cc0c7440 con 0x55c260be9240 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.990+0000 7f61e4e7a740 10 client.15252 fetch_fsmap learned FSMap version 25 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.990+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3528139099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55c260c736b0 con 0x55c260be9240 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.990+0000 7f61c5600640 1 -- 172.21.15.103:0/3528139099 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61cc0b2300 con 0x55c260be9240 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.990+0000 7f61c5600640 1 -- 172.21.15.103:0/3528139099 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f61cc0cfb00 con 0x55c260be9240 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.990+0000 7f61e4e7a740 10 client.15252 fetch_fsmap finished waiting for FSMap version 25 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.990+0000 7f61e4e7a740 10 client.15252 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.990+0000 7f61e4e7a740 20 client.15252 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.990+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/3528139099 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55c260c77d40 0x55c260c76a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.990+0000 7f61e4e7a740 4 client.15252 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.990+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3528139099 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "status"}) -- 0x55c260b5e750 con 0x55c260c77d40 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.991+0000 7f61daa00640 1 --2- 172.21.15.103:0/3528139099 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55c260c77d40 0x55c260c76a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:12.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.991+0000 7f61c5600640 10 client.15252 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:12.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.991+0000 7f61daa00640 1 --2- 172.21.15.103:0/3528139099 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55c260c77d40 0x55c260c76a50 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffd19deab66abf79 server_cookie=f7b8da8b3347dbd in_seq=0 out_seq=0 2024-09-11T01:08:12.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61c5600640 1 -- 172.21.15.103:0/3528139099 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c260b5e750 con 0x55c260c77d40 2024-09-11T01:08:12.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61c5600640 10 client.15252 handle_command_reply: tid=0 2024-09-11T01:08:12.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61e4e7a740 1 client.15252 shutdown 2024-09-11T01:08:12.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3528139099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9240 msgr2=0x55c260c0fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:12.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/3528139099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9240 0x55c260c0fd30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f61cc000c00 tx=0x7f61cc00cef0 comp rx=0 tx=0).stop 2024-09-11T01:08:12.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3528139099 shutdown_connections 2024-09-11T01:08:12.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/3528139099 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55c260c77d40 0x55c260c76a50 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:12.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/3528139099 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55c260bf5af0 0x55c260c0ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:12.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/3528139099 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55c260be9b60 0x55c260c10270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:12.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61e4e7a740 1 --2- 172.21.15.103:0/3528139099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c260be9240 0x55c260c0fd30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:12.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3528139099 >> 172.21.15.103:0/3528139099 conn(0x55c260be7020 msgr2=0x55c260c05610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:12.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61c5600640 0 client.15252 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:12.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3528139099 shutdown_connections 2024-09-11T01:08:12.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61e4e7a740 1 -- 172.21.15.103:0/3528139099 wait complete. 2024-09-11T01:08:12.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.992+0000 7f61e4e7a740 20 client.15252 trim_cache size 0 max 16384 2024-09-11T01:08:12.004 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:08:12.004 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "917288bc-6fd8-11ef-bcea-c7b262605968", 2024-09-11T01:08:12.004 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-11T01:08:12.004 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24665, 2024-09-11T01:08:12.004 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-11T01:08:12.004 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-11T01:08:12.004 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-11T01:08:12.005 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 158.31689877599999, 2024-09-11T01:08:12.005 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 25, 2024-09-11T01:08:12.005 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-09-11T01:08:12.005 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 87, 2024-09-11T01:08:12.005 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 172.14529663499999 2024-09-11T01:08:12.005 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:08:12.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.993+0000 7f61e2400640 1 -- 172.21.15.103:0/4237241916 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f61c00b52e0 msgr2=0x7f61c00b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.993+0000 7f61e2400640 1 --2- 172.21.15.103:0/4237241916 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f61c00b52e0 0x7f61c00b77a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f61d4005330 tx=0x7f61d4009a30 comp rx=0 tx=0).stop 2024-09-11T01:08:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.993+0000 7f61e2400640 1 -- 172.21.15.103:0/4237241916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61dc102dc0 msgr2=0x7f61dc0754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.993+0000 7f61e2400640 1 --2- 172.21.15.103:0/4237241916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61dc102dc0 0x7f61dc0754a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f61cc00e9f0 tx=0x7f61cc00eeb0 comp rx=0 tx=0).stop 2024-09-11T01:08:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.993+0000 7f61e2400640 1 -- 172.21.15.103:0/4237241916 shutdown_connections 2024-09-11T01:08:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.993+0000 7f61e2400640 1 --2- 172.21.15.103:0/4237241916 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f61c00b52e0 0x7f61c00b77a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.993+0000 7f61e2400640 1 --2- 172.21.15.103:0/4237241916 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61dc109150 0x7f61dc075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.993+0000 7f61e2400640 1 --2- 172.21.15.103:0/4237241916 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f61dc1087d0 0x7f61dc0759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.993+0000 7f61e2400640 1 --2- 172.21.15.103:0/4237241916 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f61dc102dc0 0x7f61dc0754a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.993+0000 7f61e2400640 1 -- 172.21.15.103:0/4237241916 >> 172.21.15.103:0/4237241916 conn(0x7f61dc0fe830 msgr2=0x7f61dc100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.993+0000 7f61e2400640 1 -- 172.21.15.103:0/4237241916 shutdown_connections 2024-09-11T01:08:12.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:11.993+0000 7f61e2400640 1 -- 172.21.15.103:0/4237241916 wait complete. 2024-09-11T01:08:12.692 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:12 smithi103 ceph-mon[30562]: pgmap v395: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:08:12.867 INFO:teuthology.run_tasks:Running task kclient... 2024-09-11T01:08:12.881 INFO:tasks.kclient:Mounting kernel clients... 2024-09-11T01:08:12.882 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-11T01:08:12.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:08:12.882 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-11T01:08:12.883 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:12 smithi117 ceph-mon[35358]: pgmap v395: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:08:12.918 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-11T01:08:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:12 smithi183 ceph-mon[34992]: pgmap v395: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:08:12.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:08:12.920 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-11T01:08:13.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:08:13.018 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-11T01:08:13.321 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=legacy', 'nowsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2024-09-11T01:08:13.321 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-11T01:08:13.321 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T01:08:13.321 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs ls 2024-09-11T01:08:13.694 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:14.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.362+0000 7fc326000640 1 -- 172.21.15.103:0/3731469352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc320075e00 msgr2=0x7fc32010ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:14.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.362+0000 7fc326000640 1 --2- 172.21.15.103:0/3731469352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc320075e00 0x7fc32010ecc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc308009900 tx=0x7fc30802a410 comp rx=0 tx=0).stop 2024-09-11T01:08:14.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.362+0000 7fc326000640 1 -- 172.21.15.103:0/3731469352 shutdown_connections 2024-09-11T01:08:14.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.362+0000 7fc326000640 1 --2- 172.21.15.103:0/3731469352 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc32010f200 0x7fc3201115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:14.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.362+0000 7fc326000640 1 --2- 172.21.15.103:0/3731469352 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc320075e00 0x7fc32010ecc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:14.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.362+0000 7fc326000640 1 --2- 172.21.15.103:0/3731469352 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc3200754e0 0x7fc3200758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:14.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.362+0000 7fc326000640 1 -- 172.21.15.103:0/3731469352 >> 172.21.15.103:0/3731469352 conn(0x7fc3200fe660 msgr2=0x7fc320100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:14.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.362+0000 7fc326000640 1 -- 172.21.15.103:0/3731469352 shutdown_connections 2024-09-11T01:08:14.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.362+0000 7fc326000640 1 -- 172.21.15.103:0/3731469352 wait complete. 2024-09-11T01:08:14.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.363+0000 7fc326000640 1 Processor -- start 2024-09-11T01:08:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.363+0000 7fc326000640 1 -- start start 2024-09-11T01:08:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.364+0000 7fc326000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3200754e0 0x7fc320102970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.364+0000 7fc326000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc320075e00 0x7fc320102eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.364+0000 7fc326000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc32010f200 0x7fc3201033f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.364+0000 7fc326000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc320114de0 con 0x7fc3200754e0 2024-09-11T01:08:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.364+0000 7fc326000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc320114c60 con 0x7fc320075e00 2024-09-11T01:08:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.364+0000 7fc326000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc320114f60 con 0x7fc32010f200 2024-09-11T01:08:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.364+0000 7fc324c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3200754e0 0x7fc320102970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:14.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.364+0000 7fc324c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3200754e0 0x7fc320102970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45526/0 (socket says 172.21.15.103:45526) 2024-09-11T01:08:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.364+0000 7fc324c00640 1 -- 172.21.15.103:0/1913578323 learned_addr learned my addr 172.21.15.103:0/1913578323 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.364+0000 7fc325600640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc32010f200 0x7fc3201033f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.364+0000 7fc317e00640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc320075e00 0x7fc320102eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.365+0000 7fc324c00640 1 -- 172.21.15.103:0/1913578323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc32010f200 msgr2=0x7fc3201033f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.365+0000 7fc324c00640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc32010f200 0x7fc3201033f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.365+0000 7fc324c00640 1 -- 172.21.15.103:0/1913578323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc320075e00 msgr2=0x7fc320102eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.365+0000 7fc324c00640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc320075e00 0x7fc320102eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.365+0000 7fc324c00640 1 -- 172.21.15.103:0/1913578323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3201ab840 con 0x7fc3200754e0 2024-09-11T01:08:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.365+0000 7fc325600640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc32010f200 0x7fc3201033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.365+0000 7fc324c00640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3200754e0 0x7fc320102970 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc31000d950 tx=0x7fc31000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.365+0000 7fc31e000640 1 -- 172.21.15.103:0/1913578323 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc310017030 con 0x7fc3200754e0 2024-09-11T01:08:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.365+0000 7fc31e000640 1 -- 172.21.15.103:0/1913578323 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc310004020 con 0x7fc3200754e0 2024-09-11T01:08:14.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.365+0000 7fc326000640 1 -- 172.21.15.103:0/1913578323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3201abb30 con 0x7fc3200754e0 2024-09-11T01:08:14.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.365+0000 7fc31e000640 1 -- 172.21.15.103:0/1913578323 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3100047a0 con 0x7fc3200754e0 2024-09-11T01:08:14.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.365+0000 7fc326000640 1 -- 172.21.15.103:0/1913578323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3201ac090 con 0x7fc3200754e0 2024-09-11T01:08:14.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.366+0000 7fc326000640 1 -- 172.21.15.103:0/1913578323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3200758c0 con 0x7fc3200754e0 2024-09-11T01:08:14.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.370+0000 7fc31e000640 1 -- 172.21.15.103:0/1913578323 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7fc310009a30 con 0x7fc3200754e0 2024-09-11T01:08:14.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.372+0000 7fc31e000640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc3040b5410 0x7fc3040b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:14.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.372+0000 7fc31e000640 1 -- 172.21.15.103:0/1913578323 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fc3100e5f90 con 0x7fc3200754e0 2024-09-11T01:08:14.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.372+0000 7fc317e00640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc3040b5410 0x7fc3040b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:14.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.373+0000 7fc317e00640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc3040b5410 0x7fc3040b78d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc308031440 tx=0x7fc308005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:14.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.374+0000 7fc31e000640 1 -- 172.21.15.103:0/1913578323 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fc3100acb20 con 0x7fc3200754e0 2024-09-11T01:08:14.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.597+0000 7fc326000640 1 -- 172.21.15.103:0/1913578323 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc320103c70 con 0x7fc3200754e0 2024-09-11T01:08:14.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.598+0000 7fc31e000640 1 -- 172.21.15.103:0/1913578323 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+88 (secure 0 0 0) 0x7fc320103c70 con 0x7fc3200754e0 2024-09-11T01:08:14.599 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-11T01:08:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.600+0000 7fc326000640 1 -- 172.21.15.103:0/1913578323 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc3040b5410 msgr2=0x7fc3040b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.600+0000 7fc326000640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc3040b5410 0x7fc3040b78d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc308031440 tx=0x7fc308005b50 comp rx=0 tx=0).stop 2024-09-11T01:08:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.600+0000 7fc326000640 1 -- 172.21.15.103:0/1913578323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3200754e0 msgr2=0x7fc320102970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.600+0000 7fc326000640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3200754e0 0x7fc320102970 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc31000d950 tx=0x7fc31000de10 comp rx=0 tx=0).stop 2024-09-11T01:08:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.600+0000 7fc326000640 1 -- 172.21.15.103:0/1913578323 shutdown_connections 2024-09-11T01:08:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.600+0000 7fc326000640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc3040b5410 0x7fc3040b78d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.600+0000 7fc326000640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc32010f200 0x7fc3201033f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.600+0000 7fc326000640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc320075e00 0x7fc320102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:14.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.600+0000 7fc326000640 1 --2- 172.21.15.103:0/1913578323 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc3200754e0 0x7fc320102970 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.600+0000 7fc326000640 1 -- 172.21.15.103:0/1913578323 >> 172.21.15.103:0/1913578323 conn(0x7fc3200fe660 msgr2=0x7fc3201113b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.600+0000 7fc326000640 1 -- 172.21.15.103:0/1913578323 shutdown_connections 2024-09-11T01:08:14.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:14.600+0000 7fc326000640 1 -- 172.21.15.103:0/1913578323 wait complete. 2024-09-11T01:08:14.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:14 smithi117 ceph-mon[35358]: pgmap v396: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:08:14.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:14 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1913578323' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-11T01:08:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:14 smithi183 ceph-mon[34992]: pgmap v396: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:08:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:14 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1913578323' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-11T01:08:14.983 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:14 smithi103 ceph-mon[30562]: pgmap v396: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:08:14.983 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:14 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1913578323' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-11T01:08:15.504 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-11T01:08:15.505 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-11T01:08:15.505 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-09-11T01:08:15.505 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-11T01:08:15.505 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-11T01:08:15.505 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-11T01:08:15.505 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-11T01:08:15.505 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-11T01:08:15.505 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-11T01:08:15.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:08:15.505 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-09-11T01:08:15.542 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-11T01:08:15.542 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-11T01:08:15.542 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-09-11T01:08:15.542 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-11T01:08:15.542 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-09-11T01:08:15.542 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-11T01:08:15.542 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T01:08:15.543 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-09-11T01:08:15.543 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-09-11T01:08:15.543 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T01:08:15.543 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-09-11T01:08:15.543 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-09-11T01:08:15.543 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-11T01:08:15.543 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-09-11T01:08:15.543 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-11T01:08:15.543 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-09-11T01:08:15.543 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-11T01:08:15.543 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42012sec preferred_lft 42012sec 2024-09-11T01:08:15.543 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link noprefixroute 2024-09-11T01:08:15.543 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-09-11T01:08:15.544 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-11T01:08:15.544 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T01:08:15.544 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-11T01:08:15.544 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-09-11T01:08:15.544 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-09-11T01:08:15.544 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-09-11T01:08:15.544 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-11T01:08:15.544 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-11T01:08:15.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T01:08:15.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:08:15.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:08:15.770 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-11T01:08:15.825 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-11T01:08:15.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:08:15.828 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-09-11T01:08:15.865 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-09-11T01:08:15.866 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-11T01:08:15.866 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-11T01:08:15.866 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-11T01:08:15.866 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-11T01:08:15.866 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T01:08:15.866 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-11T01:08:15.866 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-11T01:08:15.866 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-11T01:08:15.866 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-11T01:08:15.867 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-11T01:08:15.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T01:08:16.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:08:16.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:08:16.063 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-11T01:08:16.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:08:16.099 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-09-11T01:08:16.175 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T01:08:16.175 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-11T01:08:16.175 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T01:08:16.175 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-11T01:08:16.175 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-11T01:08:16.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T01:08:16.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:08:16.350 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-11T01:08:16.351 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T01:08:16.351 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-11T01:08:16.351 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-11T01:08:16.351 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-11T01:08:16.351 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-11T01:08:16.351 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-11T01:08:16.351 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-11T01:08:16.351 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-11T01:08:16.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T01:08:16.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:08:16.571 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-11T01:08:16.571 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-09-11T01:08:16.572 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-09-11T01:08:16.572 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-09-11T01:08:16.572 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-09-11T01:08:16.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T01:08:16.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:08:16.739 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T01:08:16.739 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-11T01:08:16.774 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-11T01:08:16.774 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-11T01:08:16.774 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-11T01:08:16.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:16 smithi103 ceph-mon[30562]: pgmap v397: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:08:16.849 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-11T01:08:16.849 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-11T01:08:16.849 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/e0e20cca-3ec1-4618-a976-c4d042eb9f6b 2024-09-11T01:08:16.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:08:16.850 DEBUG:teuthology.orchestra.run.smithi103:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/e0e20cca-3ec1-4618-a976-c4d042eb9f6b /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-11T01:08:16.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:16 smithi117 ceph-mon[35358]: pgmap v397: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:08:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:16 smithi183 ceph-mon[34992]: pgmap v397: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-11T01:08:16.977 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-11T01:08:16.977 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-09-11T01:08:16.977 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-11T01:08:17.601 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync 2024-09-11T01:08:17.601 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync". 2024-09-11T01:08:17.601 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-09-11T01:08:17.601 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.103:6789,172.21.15.117:6789,172.21.15.183:6789" 2024-09-11T01:08:17.601 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.103:6789,172.21.15.117:6789,172.21.15.183:6789:/volumes/qa/sv_1/e0e20cca-3ec1-4618-a976-c4d042eb9f6b 2024-09-11T01:08:17.601 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=legacy,nowsync,key=0,fsid=917288bc-6fd8-11ef-bcea-c7b262605968" will pass to kernel 2024-09-11T01:08:17.603 INFO:teuthology.orchestra.run.smithi103.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-11T01:08:17.604 INFO:teuthology.orchestra.run.smithi103.stdout: You just mounted a file system that supports labels which does not 2024-09-11T01:08:17.604 INFO:teuthology.orchestra.run.smithi103.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-11T01:08:17.604 INFO:teuthology.orchestra.run.smithi103.stdout: applications will generate AVC messages and not be allowed access to 2024-09-11T01:08:17.604 INFO:teuthology.orchestra.run.smithi103.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-11T01:08:17.607 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-11T01:08:17.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:08:17.607 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-11T01:08:17.671 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T01:08:17.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T01:08:17.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:08:17.762 INFO:teuthology.orchestra.run.smithi103.stdout:client15261 2024-09-11T01:08:17.762 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T01:08:17.762 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T01:08:17.799 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T01:08:17.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T01:08:17.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:08:17.929 INFO:teuthology.orchestra.run.smithi103.stdout:client15261 2024-09-11T01:08:17.930 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-11T01:08:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-11T01:08:18.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:08:18.020 INFO:teuthology.orchestra.run.smithi103.stdout:client15261 2024-09-11T01:08:18.020 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/917288bc-6fd8-11ef-bcea-c7b262605968.client15261/status') 2024-09-11T01:08:18.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-11T01:08:18.120 INFO:teuthology.orchestra.run.smithi103.stdout:instance: client.15261 (3)192.168.0.1:0/3625564965 2024-09-11T01:08:18.121 INFO:teuthology.orchestra.run.smithi103.stdout:blocklisted: false 2024-09-11T01:08:18.121 INFO:teuthology.orchestra.run.smithi103.stderr:0+1 records in 2024-09-11T01:08:18.121 INFO:teuthology.orchestra.run.smithi103.stderr:0+1 records out 2024-09-11T01:08:18.121 INFO:teuthology.orchestra.run.smithi103.stderr:70 bytes copied, 7.5657e-05 s, 925 kB/s 2024-09-11T01:08:18.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-11T01:08:18.131 INFO:teuthology.run_tasks:Running task exec... 2024-09-11T01:08:18.141 INFO:teuthology.task.exec:Executing custom commands... 2024-09-11T01:08:18.141 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T01:08:18.141 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-11T01:08:18.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.292+0000 7eff24e00640 1 -- 172.21.15.103:0/3776012399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff20102990 msgr2=0x7eff20102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:18.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.292+0000 7eff24e00640 1 --2- 172.21.15.103:0/3776012399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff20102990 0x7eff20102d90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7eff10009890 tx=0x7eff1002a370 comp rx=0 tx=0).stop 2024-09-11T01:08:18.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.292+0000 7eff24e00640 1 -- 172.21.15.103:0/3776012399 shutdown_connections 2024-09-11T01:08:18.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.292+0000 7eff24e00640 1 --2- 172.21.15.103:0/3776012399 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff201044a0 0x7eff2010ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:18.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.292+0000 7eff24e00640 1 --2- 172.21.15.103:0/3776012399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff20103ae0 0x7eff20103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:18.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.292+0000 7eff24e00640 1 --2- 172.21.15.103:0/3776012399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff20102990 0x7eff20102d90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:18.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.292+0000 7eff24e00640 1 -- 172.21.15.103:0/3776012399 >> 172.21.15.103:0/3776012399 conn(0x7eff200fe250 msgr2=0x7eff20100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:18.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.292+0000 7eff24e00640 1 -- 172.21.15.103:0/3776012399 shutdown_connections 2024-09-11T01:08:18.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.292+0000 7eff24e00640 1 -- 172.21.15.103:0/3776012399 wait complete. 2024-09-11T01:08:18.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.293+0000 7eff24e00640 1 Processor -- start 2024-09-11T01:08:18.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.293+0000 7eff24e00640 1 -- start start 2024-09-11T01:08:18.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.293+0000 7eff24e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff20102990 0x7eff2019afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:18.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.293+0000 7eff24e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff20103ae0 0x7eff2019b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:18.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.293+0000 7eff24e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff201044a0 0x7eff2019c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:18.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.293+0000 7eff24e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7eff2010e600 con 0x7eff20102990 2024-09-11T01:08:18.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.293+0000 7eff24e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7eff2010e480 con 0x7eff201044a0 2024-09-11T01:08:18.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.293+0000 7eff24e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7eff2010e780 con 0x7eff20103ae0 2024-09-11T01:08:18.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.294+0000 7eff1de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff20102990 0x7eff2019afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:18.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.294+0000 7eff1de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff20102990 0x7eff2019afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45542/0 (socket says 172.21.15.103:45542) 2024-09-11T01:08:18.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.294+0000 7eff1de00640 1 -- 172.21.15.103:0/722443735 learned_addr learned my addr 172.21.15.103:0/722443735 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:18.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.294+0000 7eff15400640 1 --2- 172.21.15.103:0/722443735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff20103ae0 0x7eff2019b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:18.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.294+0000 7eff1e800640 1 --2- 172.21.15.103:0/722443735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff201044a0 0x7eff2019c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:18.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.294+0000 7eff1de00640 1 -- 172.21.15.103:0/722443735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff20103ae0 msgr2=0x7eff2019b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:18.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.294+0000 7eff1de00640 1 --2- 172.21.15.103:0/722443735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff20103ae0 0x7eff2019b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:18.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.294+0000 7eff1de00640 1 -- 172.21.15.103:0/722443735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff201044a0 msgr2=0x7eff2019c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:18.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.294+0000 7eff1de00640 1 --2- 172.21.15.103:0/722443735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff201044a0 0x7eff2019c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:18.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.294+0000 7eff1de00640 1 -- 172.21.15.103:0/722443735 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2019cae0 con 0x7eff20102990 2024-09-11T01:08:18.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.294+0000 7eff1de00640 1 --2- 172.21.15.103:0/722443735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff20102990 0x7eff2019afa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7eff10030490 tx=0x7eff10030d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:18.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.295+0000 7eff17400640 1 -- 172.21.15.103:0/722443735 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10040020 con 0x7eff20102990 2024-09-11T01:08:18.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.295+0000 7eff17400640 1 -- 172.21.15.103:0/722443735 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff10038040 con 0x7eff20102990 2024-09-11T01:08:18.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.295+0000 7eff17400640 1 -- 172.21.15.103:0/722443735 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10037070 con 0x7eff20102990 2024-09-11T01:08:18.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.295+0000 7eff24e00640 1 -- 172.21.15.103:0/722443735 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2019cd70 con 0x7eff20102990 2024-09-11T01:08:18.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.295+0000 7eff24e00640 1 -- 172.21.15.103:0/722443735 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff201a32c0 con 0x7eff20102990 2024-09-11T01:08:18.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.296+0000 7eff24e00640 1 -- 172.21.15.103:0/722443735 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff201a3520 con 0x7eff20102990 2024-09-11T01:08:18.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.298+0000 7eff17400640 1 -- 172.21.15.103:0/722443735 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7eff10004050 con 0x7eff20102990 2024-09-11T01:08:18.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.299+0000 7eff17400640 1 --2- 172.21.15.103:0/722443735 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7eff040b5360 0x7eff040b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:18.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.299+0000 7eff17400640 1 -- 172.21.15.103:0/722443735 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7eff10105de0 con 0x7eff20102990 2024-09-11T01:08:18.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.300+0000 7eff15400640 1 --2- 172.21.15.103:0/722443735 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7eff040b5360 0x7eff040b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:18.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.300+0000 7eff15400640 1 --2- 172.21.15.103:0/722443735 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7eff040b5360 0x7eff040b7820 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7eff08005fd0 tx=0x7eff08009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:18.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.303+0000 7eff17400640 1 -- 172.21.15.103:0/722443735 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7eff1004a070 con 0x7eff20102990 2024-09-11T01:08:18.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.523+0000 7eff24e00640 1 -- 172.21.15.103:0/722443735 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7eff201a36f0 con 0x7eff20102990 2024-09-11T01:08:18.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.623+0000 7eff17400640 1 -- 172.21.15.103:0/722443735 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v26) ==== 118+0+0 (secure 0 0 0) 0x7eff100cc890 con 0x7eff20102990 2024-09-11T01:08:18.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.626+0000 7eff24e00640 1 -- 172.21.15.103:0/722443735 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7eff040b5360 msgr2=0x7eff040b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:18.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.626+0000 7eff24e00640 1 --2- 172.21.15.103:0/722443735 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7eff040b5360 0x7eff040b7820 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7eff08005fd0 tx=0x7eff08009260 comp rx=0 tx=0).stop 2024-09-11T01:08:18.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.626+0000 7eff24e00640 1 -- 172.21.15.103:0/722443735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff20102990 msgr2=0x7eff2019afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:18.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.626+0000 7eff24e00640 1 --2- 172.21.15.103:0/722443735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff20102990 0x7eff2019afa0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7eff10030490 tx=0x7eff10030d60 comp rx=0 tx=0).stop 2024-09-11T01:08:18.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.626+0000 7eff24e00640 1 -- 172.21.15.103:0/722443735 shutdown_connections 2024-09-11T01:08:18.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.626+0000 7eff24e00640 1 --2- 172.21.15.103:0/722443735 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7eff040b5360 0x7eff040b7820 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:18.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.626+0000 7eff24e00640 1 --2- 172.21.15.103:0/722443735 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7eff201044a0 0x7eff2019c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:18.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.626+0000 7eff24e00640 1 --2- 172.21.15.103:0/722443735 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7eff20103ae0 0x7eff2019b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:18.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.626+0000 7eff24e00640 1 --2- 172.21.15.103:0/722443735 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff20102990 0x7eff2019afa0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:18.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.626+0000 7eff24e00640 1 -- 172.21.15.103:0/722443735 >> 172.21.15.103:0/722443735 conn(0x7eff200fe250 msgr2=0x7eff20075380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:18.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.626+0000 7eff24e00640 1 -- 172.21.15.103:0/722443735 shutdown_connections 2024-09-11T01:08:18.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.626+0000 7eff24e00640 1 -- 172.21.15.103:0/722443735 wait complete. 2024-09-11T01:08:18.643 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-11T01:08:18.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.796+0000 7f54c3a00640 1 -- 172.21.15.103:0/3055399446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54bc104ba0 msgr2=0x7f54bc104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:18.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.796+0000 7f54c3a00640 1 --2- 172.21.15.103:0/3055399446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54bc104ba0 0x7f54bc104fa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009930 tx=0x7f54ac02a420 comp rx=0 tx=0).stop 2024-09-11T01:08:18.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.796+0000 7f54c3a00640 1 -- 172.21.15.103:0/3055399446 shutdown_connections 2024-09-11T01:08:18.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.796+0000 7f54c3a00640 1 --2- 172.21.15.103:0/3055399446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54bc1066b0 0x7f54bc10d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:18.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.796+0000 7f54c3a00640 1 --2- 172.21.15.103:0/3055399446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54bc105cf0 0x7f54bc106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:18.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.796+0000 7f54c3a00640 1 --2- 172.21.15.103:0/3055399446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54bc104ba0 0x7f54bc104fa0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:18.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.796+0000 7f54c3a00640 1 -- 172.21.15.103:0/3055399446 >> 172.21.15.103:0/3055399446 conn(0x7f54bc100460 msgr2=0x7f54bc102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:18.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.796+0000 7f54c3a00640 1 -- 172.21.15.103:0/3055399446 shutdown_connections 2024-09-11T01:08:18.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.796+0000 7f54c3a00640 1 -- 172.21.15.103:0/3055399446 wait complete. 2024-09-11T01:08:18.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.797+0000 7f54c3a00640 1 Processor -- start 2024-09-11T01:08:18.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.797+0000 7f54c3a00640 1 -- start start 2024-09-11T01:08:18.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c3a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54bc104ba0 0x7f54bc19af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:18.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c3a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54bc105cf0 0x7f54bc19b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:18.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c3a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54bc1066b0 0x7f54bc19c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:18.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c3a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc110810 con 0x7f54bc1066b0 2024-09-11T01:08:18.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c3a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc110690 con 0x7f54bc104ba0 2024-09-11T01:08:18.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c3a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc110990 con 0x7f54bc105cf0 2024-09-11T01:08:18.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54bc1066b0 0x7f54bc19c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:18.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c1000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54bc104ba0 0x7f54bc19af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:18.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54bbe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54bc105cf0 0x7f54bc19b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:18.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54bc1066b0 0x7f54bc19c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45560/0 (socket says 172.21.15.103:45560) 2024-09-11T01:08:18.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c1a00640 1 -- 172.21.15.103:0/3880362807 learned_addr learned my addr 172.21.15.103:0/3880362807 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:18.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c1a00640 1 -- 172.21.15.103:0/3880362807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54bc105cf0 msgr2=0x7f54bc19b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:18.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c1a00640 1 --2- 172.21.15.103:0/3880362807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54bc105cf0 0x7f54bc19b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:18.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c1a00640 1 -- 172.21.15.103:0/3880362807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54bc104ba0 msgr2=0x7f54bc19af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:18.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c1a00640 1 --2- 172.21.15.103:0/3880362807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54bc104ba0 0x7f54bc19af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:18.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54c1a00640 1 -- 172.21.15.103:0/3880362807 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc19cad0 con 0x7f54bc1066b0 2024-09-11T01:08:18.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.798+0000 7f54bbe00640 1 --2- 172.21.15.103:0/3880362807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54bc105cf0 0x7f54bc19b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:18.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.799+0000 7f54c1a00640 1 --2- 172.21.15.103:0/3880362807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54bc1066b0 0x7f54bc19c210 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f54b400eb10 tx=0x7f54b400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:18.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.799+0000 7f54b9600640 1 -- 172.21.15.103:0/3880362807 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4004b20 con 0x7f54bc1066b0 2024-09-11T01:08:18.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.799+0000 7f54b9600640 1 -- 172.21.15.103:0/3880362807 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54b4004cc0 con 0x7f54bc1066b0 2024-09-11T01:08:18.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.799+0000 7f54c3a00640 1 -- 172.21.15.103:0/3880362807 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54bc19cdc0 con 0x7f54bc1066b0 2024-09-11T01:08:18.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.799+0000 7f54b9600640 1 -- 172.21.15.103:0/3880362807 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4010670 con 0x7f54bc1066b0 2024-09-11T01:08:18.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.799+0000 7f54c3a00640 1 -- 172.21.15.103:0/3880362807 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54bc1a3490 con 0x7f54bc1066b0 2024-09-11T01:08:18.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.800+0000 7f54c3a00640 1 -- 172.21.15.103:0/3880362807 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54bc10bf10 con 0x7f54bc1066b0 2024-09-11T01:08:18.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.802+0000 7f54b9600640 1 -- 172.21.15.103:0/3880362807 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7f54b4005020 con 0x7f54bc1066b0 2024-09-11T01:08:18.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.804+0000 7f54b9600640 1 --2- 172.21.15.103:0/3880362807 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f54a00b5360 0x7f54a00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:18.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.804+0000 7f54b9600640 1 -- 172.21.15.103:0/3880362807 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f54b40e6450 con 0x7f54bc1066b0 2024-09-11T01:08:18.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.804+0000 7f54c1000640 1 --2- 172.21.15.103:0/3880362807 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f54a00b5360 0x7f54a00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:18.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.805+0000 7f54c1000640 1 --2- 172.21.15.103:0/3880362807 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f54a00b5360 0x7f54a00b7820 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54ac006010 tx=0x7f54ac0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:18.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:18.807+0000 7f54b9600640 1 -- 172.21.15.103:0/3880362807 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f54b40acf00 con 0x7f54bc1066b0 2024-09-11T01:08:18.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:18 smithi117 ceph-mon[35358]: pgmap v398: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:08:18.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:18 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/722443735' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-11T01:08:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:18 smithi183 ceph-mon[34992]: pgmap v398: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:08:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:18 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/722443735' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-11T01:08:19.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:19.017+0000 7f54c3a00640 1 -- 172.21.15.103:0/3880362807 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f54bc063630 con 0x7f54a00b5360 2024-09-11T01:08:19.026 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:18 smithi103 ceph-mon[30562]: pgmap v398: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:08:19.026 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:18 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/722443735' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} : dispatch 2024-09-11T01:08:19.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:19.036+0000 7f54b9600640 1 -- 172.21.15.103:0/3880362807 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f54bc063630 con 0x7f54a00b5360 2024-09-11T01:08:19.038 INFO:teuthology.orchestra.run.smithi103.stdout:{} 2024-09-11T01:08:19.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:19.038+0000 7f54c3a00640 1 -- 172.21.15.103:0/3880362807 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f54a00b5360 msgr2=0x7f54a00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:19.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:19.038+0000 7f54c3a00640 1 --2- 172.21.15.103:0/3880362807 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f54a00b5360 0x7f54a00b7820 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54ac006010 tx=0x7f54ac0314a0 comp rx=0 tx=0).stop 2024-09-11T01:08:19.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:19.038+0000 7f54c3a00640 1 -- 172.21.15.103:0/3880362807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54bc1066b0 msgr2=0x7f54bc19c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:19.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:19.038+0000 7f54c3a00640 1 --2- 172.21.15.103:0/3880362807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54bc1066b0 0x7f54bc19c210 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f54b400eb10 tx=0x7f54b400c2d0 comp rx=0 tx=0).stop 2024-09-11T01:08:19.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:19.039+0000 7f54c3a00640 1 -- 172.21.15.103:0/3880362807 shutdown_connections 2024-09-11T01:08:19.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:19.039+0000 7f54c3a00640 1 --2- 172.21.15.103:0/3880362807 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f54a00b5360 0x7f54a00b7820 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:19.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:19.039+0000 7f54c3a00640 1 --2- 172.21.15.103:0/3880362807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f54bc1066b0 0x7f54bc19c210 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:19.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:19.039+0000 7f54c3a00640 1 --2- 172.21.15.103:0/3880362807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f54bc105cf0 0x7f54bc19b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:19.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:19.039+0000 7f54c3a00640 1 --2- 172.21.15.103:0/3880362807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54bc104ba0 0x7f54bc19af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:19.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:19.039+0000 7f54c3a00640 1 -- 172.21.15.103:0/3880362807 >> 172.21.15.103:0/3880362807 conn(0x7f54bc100460 msgr2=0x7f54bc1090e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:19.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:19.039+0000 7f54c3a00640 1 -- 172.21.15.103:0/3880362807 shutdown_connections 2024-09-11T01:08:19.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:19.039+0000 7f54c3a00640 1 -- 172.21.15.103:0/3880362807 wait complete. 2024-09-11T01:08:19.056 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-11T01:08:19.067 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-11T01:08:19.075 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T01:08:19.075 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-11T01:08:19.079 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-11T01:08:19.091 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-11T01:08:19.091 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T01:08:19.332 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:08:19 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T01:08:19.023+0000 7f1fe8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T01:08:19.332 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:08:19 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T01:08:19.023+0000 7f1fe8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T01:08:19.332 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:08:19 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T01:08:19.023+0000 7f1fe8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T01:08:19.332 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:08:19 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T01:08:19.023+0000 7f1fe8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T01:08:19.332 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:08:19 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T01:08:19.023+0000 7f1fe8c00640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-11T01:08:19.464 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:19.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:19 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/722443735' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T01:08:19.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:19 smithi183 ceph-mon[34992]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:08:19.957 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:19 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/722443735' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T01:08:19.957 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:19 smithi103 ceph-mon[30562]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:08:20.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.065+0000 7f8b8e800640 1 -- 172.21.15.103:0/3426421655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b881087b0 msgr2=0x7f8b88108bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:20.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.065+0000 7f8b8e800640 1 --2- 172.21.15.103:0/3426421655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b881087b0 0x7f8b88108bf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009900 tx=0x7f8b7402a410 comp rx=0 tx=0).stop 2024-09-11T01:08:20.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.065+0000 7f8b8e800640 1 -- 172.21.15.103:0/3426421655 shutdown_connections 2024-09-11T01:08:20.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.065+0000 7f8b8e800640 1 --2- 172.21.15.103:0/3426421655 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b88109130 0x7f8b8810f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:20.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.065+0000 7f8b8e800640 1 --2- 172.21.15.103:0/3426421655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b881087b0 0x7f8b88108bf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:20.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.065+0000 7f8b8e800640 1 --2- 172.21.15.103:0/3426421655 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b88102da0 0x7f8b88103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:20.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.065+0000 7f8b8e800640 1 -- 172.21.15.103:0/3426421655 >> 172.21.15.103:0/3426421655 conn(0x7f8b880fe810 msgr2=0x7f8b88100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:20.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.065+0000 7f8b8e800640 1 -- 172.21.15.103:0/3426421655 shutdown_connections 2024-09-11T01:08:20.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.065+0000 7f8b8e800640 1 -- 172.21.15.103:0/3426421655 wait complete. 2024-09-11T01:08:20.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.066+0000 7f8b8e800640 1 Processor -- start 2024-09-11T01:08:20.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.066+0000 7f8b8e800640 1 -- start start 2024-09-11T01:08:20.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b8e800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b88102da0 0x7f8b8819b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:20.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b8e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b881087b0 0x7f8b8819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:20.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b8e800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b88109130 0x7f8b881a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:20.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b8e800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8b88112d80 con 0x7f8b881087b0 2024-09-11T01:08:20.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b8e800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8b88112c00 con 0x7f8b88102da0 2024-09-11T01:08:20.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b8e800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8b88112f00 con 0x7f8b88109130 2024-09-11T01:08:20.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b86a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b881087b0 0x7f8b8819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:20.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b86a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b881087b0 0x7f8b8819b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55574/0 (socket says 172.21.15.103:55574) 2024-09-11T01:08:20.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b86a00640 1 -- 172.21.15.103:0/1245310087 learned_addr learned my addr 172.21.15.103:0/1245310087 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:20.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b87400640 1 --2- 172.21.15.103:0/1245310087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b88102da0 0x7f8b8819b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:20.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b87e00640 1 --2- 172.21.15.103:0/1245310087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b88109130 0x7f8b881a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b87400640 1 -- 172.21.15.103:0/1245310087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b88109130 msgr2=0x7f8b881a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b87400640 1 --2- 172.21.15.103:0/1245310087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b88109130 0x7f8b881a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b87400640 1 -- 172.21.15.103:0/1245310087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b881087b0 msgr2=0x7f8b8819b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b87400640 1 --2- 172.21.15.103:0/1245310087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b881087b0 0x7f8b8819b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.067+0000 7f8b87400640 1 -- 172.21.15.103:0/1245310087 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b881a1560 con 0x7f8b88102da0 2024-09-11T01:08:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.068+0000 7f8b87400640 1 --2- 172.21.15.103:0/1245310087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b88102da0 0x7f8b8819b4b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800e9f0 tx=0x7f8b7800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.068+0000 7f8b7fe00640 1 -- 172.21.15.103:0/1245310087 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b7800ccc0 con 0x7f8b88102da0 2024-09-11T01:08:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.068+0000 7f8b8e800640 1 -- 172.21.15.103:0/1245310087 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b881a1850 con 0x7f8b88102da0 2024-09-11T01:08:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.069+0000 7f8b7fe00640 1 -- 172.21.15.103:0/1245310087 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b780108e0 con 0x7f8b88102da0 2024-09-11T01:08:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.069+0000 7f8b7fe00640 1 -- 172.21.15.103:0/1245310087 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78018880 con 0x7f8b88102da0 2024-09-11T01:08:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.069+0000 7f8b8e800640 1 -- 172.21.15.103:0/1245310087 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b881a80e0 con 0x7f8b88102da0 2024-09-11T01:08:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.070+0000 7f8b8e800640 1 -- 172.21.15.103:0/1245310087 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b88104050 con 0x7f8b88102da0 2024-09-11T01:08:20.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.072+0000 7f8b7fe00640 1 -- 172.21.15.103:0/1245310087 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 18) ==== 153251+0+0 (secure 0 0 0) 0x7f8b78010430 con 0x7f8b88102da0 2024-09-11T01:08:20.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.074+0000 7f8b7fe00640 1 --2- 172.21.15.103:0/1245310087 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8b6c0b5360 0x7f8b6c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:20.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.074+0000 7f8b7fe00640 1 -- 172.21.15.103:0/1245310087 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f8b780e6700 con 0x7f8b88102da0 2024-09-11T01:08:20.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.074+0000 7f8b86a00640 1 --2- 172.21.15.103:0/1245310087 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8b6c0b5360 0x7f8b6c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:20.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.075+0000 7f8b86a00640 1 --2- 172.21.15.103:0/1245310087 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8b6c0b5360 0x7f8b6c0b7820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8b74031440 tx=0x7f8b740058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:20.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.076+0000 7f8b7fe00640 1 -- 172.21.15.103:0/1245310087 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8b780acb60 con 0x7f8b88102da0 2024-09-11T01:08:20.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:19 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/722443735' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-11T01:08:20.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:19 smithi117 ceph-mon[35358]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:08:20.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.259+0000 7f8b8e800640 1 -- 172.21.15.103:0/1245310087 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8b88063590 con 0x7f8b6c0b5360 2024-09-11T01:08:20.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.265+0000 7f8b7fe00640 1 -- 172.21.15.103:0/1245310087 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340485 (secure 0 0 0) 0x7f8b88063590 con 0x7f8b6c0b5360 2024-09-11T01:08:20.271 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:08:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T01:08:20.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.270+0000 7f8b8e800640 1 -- 172.21.15.103:0/1245310087 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8b6c0b5360 msgr2=0x7f8b6c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:20.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.270+0000 7f8b8e800640 1 --2- 172.21.15.103:0/1245310087 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8b6c0b5360 0x7f8b6c0b7820 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8b74031440 tx=0x7f8b740058d0 comp rx=0 tx=0).stop 2024-09-11T01:08:20.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.270+0000 7f8b8e800640 1 -- 172.21.15.103:0/1245310087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b88102da0 msgr2=0x7f8b8819b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:20.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.270+0000 7f8b8e800640 1 --2- 172.21.15.103:0/1245310087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b88102da0 0x7f8b8819b4b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8b7800e9f0 tx=0x7f8b7800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:08:20.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.270+0000 7f8b8e800640 1 -- 172.21.15.103:0/1245310087 shutdown_connections 2024-09-11T01:08:20.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.270+0000 7f8b8e800640 1 --2- 172.21.15.103:0/1245310087 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8b6c0b5360 0x7f8b6c0b7820 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:20.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.270+0000 7f8b8e800640 1 --2- 172.21.15.103:0/1245310087 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8b88109130 0x7f8b881a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:20.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.270+0000 7f8b8e800640 1 --2- 172.21.15.103:0/1245310087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8b881087b0 0x7f8b8819b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:20.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.270+0000 7f8b8e800640 1 --2- 172.21.15.103:0/1245310087 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b88102da0 0x7f8b8819b4b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:20.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.270+0000 7f8b8e800640 1 -- 172.21.15.103:0/1245310087 >> 172.21.15.103:0/1245310087 conn(0x7f8b880fe810 msgr2=0x7f8b88105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:20.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.271+0000 7f8b8e800640 1 -- 172.21.15.103:0/1245310087 shutdown_connections 2024-09-11T01:08:20.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:20.271+0000 7f8b8e800640 1 -- 172.21.15.103:0/1245310087 wait complete. 2024-09-11T01:08:20.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:20 smithi183 ceph-mon[34992]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:08:20.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:20 smithi183 ceph-mon[34992]: pgmap v399: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-11T01:08:21.021 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:20 smithi103 ceph-mon[30562]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:08:21.021 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:20 smithi103 ceph-mon[30562]: pgmap v399: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-11T01:08:21.058 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":399,"stamp":"2024-09-11T01:08:19.553571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659661,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":804,"num_read_kb":500,"num_write":306,"num_write_kb":2279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2953603,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":748,"ondisk_log_size":748,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384000,"kb_used_data":13952,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557824,"statfs":{"total":1151940427776,"available":1151547211776,"internally_reserved":0,"allocated":14286848,"data_stored":8031207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003296"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598778+0000","last_change":"2024-09-11T01:05:28.553987+0000","last_active":"2024-09-11T01:06:41.598778+0000","last_peered":"2024-09-11T01:06:41.598778+0000","last_clean":"2024-09-11T01:06:41.598778+0000","last_became_active":"2024-09-11T01:05:28.553691+0000","last_became_peered":"2024-09-11T01:05:28.553691+0000","last_unstale":"2024-09-11T01:06:41.598778+0000","last_undegraded":"2024-09-11T01:06:41.598778+0000","last_fullsized":"2024-09-11T01:06:41.598778+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:50.407880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"89'5","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.761762+0000","last_change":"2024-09-11T01:05:31.677005+0000","last_active":"2024-09-11T01:07:39.761762+0000","last_peered":"2024-09-11T01:07:39.761762+0000","last_clean":"2024-09-11T01:07:39.761762+0000","last_became_active":"2024-09-11T01:05:31.676597+0000","last_became_peered":"2024-09-11T01:05:31.676597+0000","last_unstale":"2024-09-11T01:07:39.761762+0000","last_undegraded":"2024-09-11T01:07:39.761762+0000","last_fullsized":"2024-09-11T01:07:39.761762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:06.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594715+0000","last_change":"2024-09-11T01:05:40.975009+0000","last_active":"2024-09-11T01:06:41.594715+0000","last_peered":"2024-09-11T01:06:41.594715+0000","last_clean":"2024-09-11T01:06:41.594715+0000","last_became_active":"2024-09-11T01:05:40.974546+0000","last_became_peered":"2024-09-11T01:05:40.974546+0000","last_unstale":"2024-09-11T01:06:41.594715+0000","last_undegraded":"2024-09-11T01:06:41.594715+0000","last_fullsized":"2024-09-11T01:06:41.594715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:56.420262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.651381+0000","last_change":"2024-09-11T01:05:28.623367+0000","last_active":"2024-09-11T01:06:41.651381+0000","last_peered":"2024-09-11T01:06:41.651381+0000","last_clean":"2024-09-11T01:06:41.651381+0000","last_became_active":"2024-09-11T01:05:28.622990+0000","last_became_peered":"2024-09-11T01:05:28.622990+0000","last_unstale":"2024-09-11T01:06:41.651381+0000","last_undegraded":"2024-09-11T01:06:41.651381+0000","last_fullsized":"2024-09-11T01:06:41.651381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:35.022280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"89'6","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.770032+0000","last_change":"2024-09-11T01:05:31.693910+0000","last_active":"2024-09-11T01:07:39.770032+0000","last_peered":"2024-09-11T01:07:39.770032+0000","last_clean":"2024-09-11T01:07:39.770032+0000","last_became_active":"2024-09-11T01:05:31.692906+0000","last_became_peered":"2024-09-11T01:05:31.692906+0000","last_unstale":"2024-09-11T01:07:39.770032+0000","last_undegraded":"2024-09-11T01:07:39.770032+0000","last_fullsized":"2024-09-11T01:07:39.770032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:11.906323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595041+0000","last_change":"2024-09-11T01:05:40.975768+0000","last_active":"2024-09-11T01:06:41.595041+0000","last_peered":"2024-09-11T01:06:41.595041+0000","last_clean":"2024-09-11T01:06:41.595041+0000","last_became_active":"2024-09-11T01:05:40.974721+0000","last_became_peered":"2024-09-11T01:05:40.974721+0000","last_unstale":"2024-09-11T01:06:41.595041+0000","last_undegraded":"2024-09-11T01:06:41.595041+0000","last_fullsized":"2024-09-11T01:06:41.595041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:27.475531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599080+0000","last_change":"2024-09-11T01:05:28.558980+0000","last_active":"2024-09-11T01:06:41.599080+0000","last_peered":"2024-09-11T01:06:41.599080+0000","last_clean":"2024-09-11T01:06:41.599080+0000","last_became_active":"2024-09-11T01:05:28.558617+0000","last_became_peered":"2024-09-11T01:05:28.558617+0000","last_unstale":"2024-09-11T01:06:41.599080+0000","last_undegraded":"2024-09-11T01:06:41.599080+0000","last_fullsized":"2024-09-11T01:06:41.599080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:13.659175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764701+0000","last_change":"2024-09-11T01:05:31.664705+0000","last_active":"2024-09-11T01:07:39.764701+0000","last_peered":"2024-09-11T01:07:39.764701+0000","last_clean":"2024-09-11T01:07:39.764701+0000","last_became_active":"2024-09-11T01:05:31.664328+0000","last_became_peered":"2024-09-11T01:05:31.664328+0000","last_unstale":"2024-09-11T01:07:39.764701+0000","last_undegraded":"2024-09-11T01:07:39.764701+0000","last_fullsized":"2024-09-11T01:07:39.764701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:20.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.652585+0000","last_change":"2024-09-11T01:06:41.652143+0000","last_active":"2024-09-11T01:06:41.652585+0000","last_peered":"2024-09-11T01:06:41.652585+0000","last_clean":"2024-09-11T01:06:41.652585+0000","last_became_active":"2024-09-11T01:06:41.651661+0000","last_became_peered":"2024-09-11T01:06:41.651661+0000","last_unstale":"2024-09-11T01:06:41.652585+0000","last_undegraded":"2024-09-11T01:06:41.652585+0000","last_fullsized":"2024-09-11T01:06:41.652585+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:03.377915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,8],"acting":[4,3,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599695+0000","last_change":"2024-09-11T01:05:28.555081+0000","last_active":"2024-09-11T01:06:41.599695+0000","last_peered":"2024-09-11T01:06:41.599695+0000","last_clean":"2024-09-11T01:06:41.599695+0000","last_became_active":"2024-09-11T01:05:28.554562+0000","last_became_peered":"2024-09-11T01:05:28.554562+0000","last_unstale":"2024-09-11T01:06:41.599695+0000","last_undegraded":"2024-09-11T01:06:41.599695+0000","last_fullsized":"2024-09-11T01:06:41.599695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:23.922285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"89'15","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.758235+0000","last_change":"2024-09-11T01:05:31.680442+0000","last_active":"2024-09-11T01:07:39.758235+0000","last_peered":"2024-09-11T01:07:39.758235+0000","last_clean":"2024-09-11T01:07:39.758235+0000","last_became_active":"2024-09-11T01:05:31.680107+0000","last_became_peered":"2024-09-11T01:05:31.680107+0000","last_unstale":"2024-09-11T01:07:39.758235+0000","last_undegraded":"2024-09-11T01:07:39.758235+0000","last_fullsized":"2024-09-11T01:07:39.758235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:16:02.853855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595209+0000","last_change":"2024-09-11T01:05:40.969365+0000","last_active":"2024-09-11T01:06:41.595209+0000","last_peered":"2024-09-11T01:06:41.595209+0000","last_clean":"2024-09-11T01:06:41.595209+0000","last_became_active":"2024-09-11T01:05:40.969005+0000","last_became_peered":"2024-09-11T01:05:40.969005+0000","last_unstale":"2024-09-11T01:06:41.595209+0000","last_undegraded":"2024-09-11T01:06:41.595209+0000","last_fullsized":"2024-09-11T01:06:41.595209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:42.942848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'5","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765784+0000","last_change":"2024-09-11T01:05:31.676943+0000","last_active":"2024-09-11T01:07:39.765784+0000","last_peered":"2024-09-11T01:07:39.765784+0000","last_clean":"2024-09-11T01:07:39.765784+0000","last_became_active":"2024-09-11T01:05:31.676584+0000","last_became_peered":"2024-09-11T01:05:31.676584+0000","last_unstale":"2024-09-11T01:07:39.765784+0000","last_undegraded":"2024-09-11T01:07:39.765784+0000","last_fullsized":"2024-09-11T01:07:39.765784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:08.288439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599214+0000","last_change":"2024-09-11T01:05:28.559196+0000","last_active":"2024-09-11T01:06:41.599214+0000","last_peered":"2024-09-11T01:06:41.599214+0000","last_clean":"2024-09-11T01:06:41.599214+0000","last_became_active":"2024-09-11T01:05:28.558746+0000","last_became_peered":"2024-09-11T01:05:28.558746+0000","last_unstale":"2024-09-11T01:06:41.599214+0000","last_undegraded":"2024-09-11T01:06:41.599214+0000","last_fullsized":"2024-09-11T01:06:41.599214+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:32.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595676+0000","last_change":"2024-09-11T01:05:40.963609+0000","last_active":"2024-09-11T01:06:41.595676+0000","last_peered":"2024-09-11T01:06:41.595676+0000","last_clean":"2024-09-11T01:06:41.595676+0000","last_became_active":"2024-09-11T01:05:40.963088+0000","last_became_peered":"2024-09-11T01:05:40.963088+0000","last_unstale":"2024-09-11T01:06:41.595676+0000","last_undegraded":"2024-09-11T01:06:41.595676+0000","last_fullsized":"2024-09-11T01:06:41.595676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:27.135362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.770097+0000","last_change":"2024-09-11T01:05:31.681258+0000","last_active":"2024-09-11T01:07:39.770097+0000","last_peered":"2024-09-11T01:07:39.770097+0000","last_clean":"2024-09-11T01:07:39.770097+0000","last_became_active":"2024-09-11T01:05:31.680946+0000","last_became_peered":"2024-09-11T01:05:31.680946+0000","last_unstale":"2024-09-11T01:07:39.770097+0000","last_undegraded":"2024-09-11T01:07:39.770097+0000","last_fullsized":"2024-09-11T01:07:39.770097+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:42.047250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:38.596334+0000","last_change":"2024-09-11T01:05:28.554651+0000","last_active":"2024-09-11T01:07:38.596334+0000","last_peered":"2024-09-11T01:07:38.596334+0000","last_clean":"2024-09-11T01:07:38.596334+0000","last_became_active":"2024-09-11T01:05:28.554279+0000","last_became_peered":"2024-09-11T01:05:28.554279+0000","last_unstale":"2024-09-11T01:07:38.596334+0000","last_undegraded":"2024-09-11T01:07:38.596334+0000","last_fullsized":"2024-09-11T01:07:38.596334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:14.093403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.686282+0000","last_change":"2024-09-11T01:06:41.685672+0000","last_active":"2024-09-11T01:06:41.686282+0000","last_peered":"2024-09-11T01:06:41.686282+0000","last_clean":"2024-09-11T01:06:41.686282+0000","last_became_active":"2024-09-11T01:06:41.681272+0000","last_became_peered":"2024-09-11T01:06:41.681272+0000","last_unstale":"2024-09-11T01:06:41.686282+0000","last_undegraded":"2024-09-11T01:06:41.686282+0000","last_fullsized":"2024-09-11T01:06:41.686282+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:53:39.693530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"89'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.762975+0000","last_change":"2024-09-11T01:05:31.681743+0000","last_active":"2024-09-11T01:07:39.762975+0000","last_peered":"2024-09-11T01:07:39.762975+0000","last_clean":"2024-09-11T01:07:39.762975+0000","last_became_active":"2024-09-11T01:05:31.681223+0000","last_became_peered":"2024-09-11T01:05:31.681223+0000","last_unstale":"2024-09-11T01:07:39.762975+0000","last_undegraded":"2024-09-11T01:07:39.762975+0000","last_fullsized":"2024-09-11T01:07:39.762975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:49.449622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.651049+0000","last_change":"2024-09-11T01:05:28.552914+0000","last_active":"2024-09-11T01:06:41.651049+0000","last_peered":"2024-09-11T01:06:41.651049+0000","last_clean":"2024-09-11T01:06:41.651049+0000","last_became_active":"2024-09-11T01:05:28.552404+0000","last_became_peered":"2024-09-11T01:05:28.552404+0000","last_unstale":"2024-09-11T01:06:41.651049+0000","last_undegraded":"2024-09-11T01:06:41.651049+0000","last_fullsized":"2024-09-11T01:06:41.651049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:39.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598657+0000","last_change":"2024-09-11T01:05:40.985652+0000","last_active":"2024-09-11T01:06:41.598657+0000","last_peered":"2024-09-11T01:06:41.598657+0000","last_clean":"2024-09-11T01:06:41.598657+0000","last_became_active":"2024-09-11T01:05:40.984898+0000","last_became_peered":"2024-09-11T01:05:40.984898+0000","last_unstale":"2024-09-11T01:06:41.598657+0000","last_undegraded":"2024-09-11T01:06:41.598657+0000","last_fullsized":"2024-09-11T01:06:41.598657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:58.961342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"89'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.747524+0000","last_change":"2024-09-11T01:05:31.675590+0000","last_active":"2024-09-11T01:07:39.747524+0000","last_peered":"2024-09-11T01:07:39.747524+0000","last_clean":"2024-09-11T01:07:39.747524+0000","last_became_active":"2024-09-11T01:05:31.674426+0000","last_became_peered":"2024-09-11T01:05:31.674426+0000","last_unstale":"2024-09-11T01:07:39.747524+0000","last_undegraded":"2024-09-11T01:07:39.747524+0000","last_fullsized":"2024-09-11T01:07:39.747524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:49.499195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470558+0000","last_change":"2024-09-11T01:05:28.623677+0000","last_active":"2024-09-11T01:06:42.470558+0000","last_peered":"2024-09-11T01:06:42.470558+0000","last_clean":"2024-09-11T01:06:42.470558+0000","last_became_active":"2024-09-11T01:05:28.623357+0000","last_became_peered":"2024-09-11T01:05:28.623357+0000","last_unstale":"2024-09-11T01:06:42.470558+0000","last_undegraded":"2024-09-11T01:06:42.470558+0000","last_fullsized":"2024-09-11T01:06:42.470558+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:10.875425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595506+0000","last_change":"2024-09-11T01:05:40.978136+0000","last_active":"2024-09-11T01:06:41.595506+0000","last_peered":"2024-09-11T01:06:41.595506+0000","last_clean":"2024-09-11T01:06:41.595506+0000","last_became_active":"2024-09-11T01:05:40.977583+0000","last_became_peered":"2024-09-11T01:05:40.977583+0000","last_unstale":"2024-09-11T01:06:41.595506+0000","last_undegraded":"2024-09-11T01:06:41.595506+0000","last_fullsized":"2024-09-11T01:06:41.595506+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:58:20.297640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768246+0000","last_change":"2024-09-11T01:05:31.692938+0000","last_active":"2024-09-11T01:07:39.768246+0000","last_peered":"2024-09-11T01:07:39.768246+0000","last_clean":"2024-09-11T01:07:39.768246+0000","last_became_active":"2024-09-11T01:05:31.689869+0000","last_became_peered":"2024-09-11T01:05:31.689869+0000","last_unstale":"2024-09-11T01:07:39.768246+0000","last_undegraded":"2024-09-11T01:07:39.768246+0000","last_fullsized":"2024-09-11T01:07:39.768246+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:24.820033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595877+0000","last_change":"2024-09-11T01:05:28.755985+0000","last_active":"2024-09-11T01:06:41.595877+0000","last_peered":"2024-09-11T01:06:41.595877+0000","last_clean":"2024-09-11T01:06:41.595877+0000","last_became_active":"2024-09-11T01:05:28.755604+0000","last_became_peered":"2024-09-11T01:05:28.755604+0000","last_unstale":"2024-09-11T01:06:41.595877+0000","last_undegraded":"2024-09-11T01:06:41.595877+0000","last_fullsized":"2024-09-11T01:06:41.595877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:22.570473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594804+0000","last_change":"2024-09-11T01:05:40.963465+0000","last_active":"2024-09-11T01:06:41.594804+0000","last_peered":"2024-09-11T01:06:41.594804+0000","last_clean":"2024-09-11T01:06:41.594804+0000","last_became_active":"2024-09-11T01:05:40.962899+0000","last_became_peered":"2024-09-11T01:05:40.962899+0000","last_unstale":"2024-09-11T01:06:41.594804+0000","last_undegraded":"2024-09-11T01:06:41.594804+0000","last_fullsized":"2024-09-11T01:06:41.594804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:01.728640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"89'5","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765961+0000","last_change":"2024-09-11T01:05:31.675864+0000","last_active":"2024-09-11T01:07:39.765961+0000","last_peered":"2024-09-11T01:07:39.765961+0000","last_clean":"2024-09-11T01:07:39.765961+0000","last_became_active":"2024-09-11T01:05:31.675446+0000","last_became_peered":"2024-09-11T01:05:31.675446+0000","last_unstale":"2024-09-11T01:07:39.765961+0000","last_undegraded":"2024-09-11T01:07:39.765961+0000","last_fullsized":"2024-09-11T01:07:39.765961+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:36.457881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'13","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.801830+0000","last_change":"2024-09-11T01:05:28.553509+0000","last_active":"2024-09-11T01:07:39.801830+0000","last_peered":"2024-09-11T01:07:39.801830+0000","last_clean":"2024-09-11T01:07:39.801830+0000","last_became_active":"2024-09-11T01:05:28.553101+0000","last_became_peered":"2024-09-11T01:05:28.553101+0000","last_unstale":"2024-09-11T01:07:39.801830+0000","last_undegraded":"2024-09-11T01:07:39.801830+0000","last_fullsized":"2024-09-11T01:07:39.801830+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:41.300518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650601+0000","last_change":"2024-09-11T01:05:40.977146+0000","last_active":"2024-09-11T01:06:41.650601+0000","last_peered":"2024-09-11T01:06:41.650601+0000","last_clean":"2024-09-11T01:06:41.650601+0000","last_became_active":"2024-09-11T01:05:40.976804+0000","last_became_peered":"2024-09-11T01:05:40.976804+0000","last_unstale":"2024-09-11T01:06:41.650601+0000","last_undegraded":"2024-09-11T01:06:41.650601+0000","last_fullsized":"2024-09-11T01:06:41.650601+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:49.753417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.748798+0000","last_change":"2024-09-11T01:05:31.684219+0000","last_active":"2024-09-11T01:07:39.748798+0000","last_peered":"2024-09-11T01:07:39.748798+0000","last_clean":"2024-09-11T01:07:39.748798+0000","last_became_active":"2024-09-11T01:05:31.683937+0000","last_became_peered":"2024-09-11T01:05:31.683937+0000","last_unstale":"2024-09-11T01:07:39.748798+0000","last_undegraded":"2024-09-11T01:07:39.748798+0000","last_fullsized":"2024-09-11T01:07:39.748798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:53.813624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599226+0000","last_change":"2024-09-11T01:05:28.623680+0000","last_active":"2024-09-11T01:06:41.599226+0000","last_peered":"2024-09-11T01:06:41.599226+0000","last_clean":"2024-09-11T01:06:41.599226+0000","last_became_active":"2024-09-11T01:05:28.623261+0000","last_became_peered":"2024-09-11T01:05:28.623261+0000","last_unstale":"2024-09-11T01:06:41.599226+0000","last_undegraded":"2024-09-11T01:06:41.599226+0000","last_fullsized":"2024-09-11T01:06:41.599226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:17.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597628+0000","last_change":"2024-09-11T01:05:40.967165+0000","last_active":"2024-09-11T01:06:41.597628+0000","last_peered":"2024-09-11T01:06:41.597628+0000","last_clean":"2024-09-11T01:06:41.597628+0000","last_became_active":"2024-09-11T01:05:40.966723+0000","last_became_peered":"2024-09-11T01:05:40.966723+0000","last_unstale":"2024-09-11T01:06:41.597628+0000","last_undegraded":"2024-09-11T01:06:41.597628+0000","last_fullsized":"2024-09-11T01:06:41.597628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:48.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"89'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759459+0000","last_change":"2024-09-11T01:05:31.679865+0000","last_active":"2024-09-11T01:07:39.759459+0000","last_peered":"2024-09-11T01:07:39.759459+0000","last_clean":"2024-09-11T01:07:39.759459+0000","last_became_active":"2024-09-11T01:05:31.679494+0000","last_became_peered":"2024-09-11T01:05:31.679494+0000","last_unstale":"2024-09-11T01:07:39.759459+0000","last_undegraded":"2024-09-11T01:07:39.759459+0000","last_fullsized":"2024-09-11T01:07:39.759459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:56.300799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598538+0000","last_change":"2024-09-11T01:05:28.623746+0000","last_active":"2024-09-11T01:06:41.598538+0000","last_peered":"2024-09-11T01:06:41.598538+0000","last_clean":"2024-09-11T01:06:41.598538+0000","last_became_active":"2024-09-11T01:05:28.623358+0000","last_became_peered":"2024-09-11T01:05:28.623358+0000","last_unstale":"2024-09-11T01:06:41.598538+0000","last_undegraded":"2024-09-11T01:06:41.598538+0000","last_fullsized":"2024-09-11T01:06:41.598538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:13.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598180+0000","last_change":"2024-09-11T01:05:40.982108+0000","last_active":"2024-09-11T01:06:41.598180+0000","last_peered":"2024-09-11T01:06:41.598180+0000","last_clean":"2024-09-11T01:06:41.598180+0000","last_became_active":"2024-09-11T01:05:40.981737+0000","last_became_peered":"2024-09-11T01:05:40.981737+0000","last_unstale":"2024-09-11T01:06:41.598180+0000","last_undegraded":"2024-09-11T01:06:41.598180+0000","last_fullsized":"2024-09-11T01:06:41.598180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:16.717933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.751200+0000","last_change":"2024-09-11T01:05:31.680885+0000","last_active":"2024-09-11T01:07:39.751200+0000","last_peered":"2024-09-11T01:07:39.751200+0000","last_clean":"2024-09-11T01:07:39.751200+0000","last_became_active":"2024-09-11T01:05:31.680536+0000","last_became_peered":"2024-09-11T01:05:31.680536+0000","last_unstale":"2024-09-11T01:07:39.751200+0000","last_undegraded":"2024-09-11T01:07:39.751200+0000","last_fullsized":"2024-09-11T01:07:39.751200+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:12.963321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598709+0000","last_change":"2024-09-11T01:05:28.553957+0000","last_active":"2024-09-11T01:06:41.598709+0000","last_peered":"2024-09-11T01:06:41.598709+0000","last_clean":"2024-09-11T01:06:41.598709+0000","last_became_active":"2024-09-11T01:05:28.553572+0000","last_became_peered":"2024-09-11T01:05:28.553572+0000","last_unstale":"2024-09-11T01:06:41.598709+0000","last_undegraded":"2024-09-11T01:06:41.598709+0000","last_fullsized":"2024-09-11T01:06:41.598709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:14.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595235+0000","last_change":"2024-09-11T01:05:40.971221+0000","last_active":"2024-09-11T01:06:41.595235+0000","last_peered":"2024-09-11T01:06:41.595235+0000","last_clean":"2024-09-11T01:06:41.595235+0000","last_became_active":"2024-09-11T01:05:40.970063+0000","last_became_peered":"2024-09-11T01:05:40.970063+0000","last_unstale":"2024-09-11T01:06:41.595235+0000","last_undegraded":"2024-09-11T01:06:41.595235+0000","last_fullsized":"2024-09-11T01:06:41.595235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:46.299357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"89'8","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.754941+0000","last_change":"2024-09-11T01:05:31.677125+0000","last_active":"2024-09-11T01:07:39.754941+0000","last_peered":"2024-09-11T01:07:39.754941+0000","last_clean":"2024-09-11T01:07:39.754941+0000","last_became_active":"2024-09-11T01:05:31.676803+0000","last_became_peered":"2024-09-11T01:05:31.676803+0000","last_unstale":"2024-09-11T01:07:39.754941+0000","last_undegraded":"2024-09-11T01:07:39.754941+0000","last_fullsized":"2024-09-11T01:07:39.754941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:01:38.922178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:16.835476+0000","last_change":"2024-09-11T01:05:28.623895+0000","last_active":"2024-09-11T01:08:16.835476+0000","last_peered":"2024-09-11T01:08:16.835476+0000","last_clean":"2024-09-11T01:08:16.835476+0000","last_became_active":"2024-09-11T01:05:28.623520+0000","last_became_peered":"2024-09-11T01:05:28.623520+0000","last_unstale":"2024-09-11T01:08:16.835476+0000","last_undegraded":"2024-09-11T01:08:16.835476+0000","last_fullsized":"2024-09-11T01:08:16.835476+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:22.309521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595201+0000","last_change":"2024-09-11T01:05:40.974416+0000","last_active":"2024-09-11T01:06:41.595201+0000","last_peered":"2024-09-11T01:06:41.595201+0000","last_clean":"2024-09-11T01:06:41.595201+0000","last_became_active":"2024-09-11T01:05:40.973990+0000","last_became_peered":"2024-09-11T01:05:40.973990+0000","last_unstale":"2024-09-11T01:06:41.595201+0000","last_undegraded":"2024-09-11T01:06:41.595201+0000","last_fullsized":"2024-09-11T01:06:41.595201+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:30.018876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"89'5","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759166+0000","last_change":"2024-09-11T01:05:31.688968+0000","last_active":"2024-09-11T01:07:39.759166+0000","last_peered":"2024-09-11T01:07:39.759166+0000","last_clean":"2024-09-11T01:07:39.759166+0000","last_became_active":"2024-09-11T01:05:31.688672+0000","last_became_peered":"2024-09-11T01:05:31.688672+0000","last_unstale":"2024-09-11T01:07:39.759166+0000","last_undegraded":"2024-09-11T01:07:39.759166+0000","last_fullsized":"2024-09-11T01:07:39.759166+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:39.080386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597789+0000","last_change":"2024-09-11T01:05:28.554126+0000","last_active":"2024-09-11T01:06:41.597789+0000","last_peered":"2024-09-11T01:06:41.597789+0000","last_clean":"2024-09-11T01:06:41.597789+0000","last_became_active":"2024-09-11T01:05:28.553575+0000","last_became_peered":"2024-09-11T01:05:28.553575+0000","last_unstale":"2024-09-11T01:06:41.597789+0000","last_undegraded":"2024-09-11T01:06:41.597789+0000","last_fullsized":"2024-09-11T01:06:41.597789+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:42.203339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683998+0000","last_change":"2024-09-11T01:05:40.980415+0000","last_active":"2024-09-11T01:06:41.683998+0000","last_peered":"2024-09-11T01:06:41.683998+0000","last_clean":"2024-09-11T01:06:41.683998+0000","last_became_active":"2024-09-11T01:05:40.980062+0000","last_became_peered":"2024-09-11T01:05:40.980062+0000","last_unstale":"2024-09-11T01:06:41.683998+0000","last_undegraded":"2024-09-11T01:06:41.683998+0000","last_fullsized":"2024-09-11T01:06:41.683998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:25.889972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765210+0000","last_change":"2024-09-11T01:05:31.679622+0000","last_active":"2024-09-11T01:07:39.765210+0000","last_peered":"2024-09-11T01:07:39.765210+0000","last_clean":"2024-09-11T01:07:39.765210+0000","last_became_active":"2024-09-11T01:05:31.679239+0000","last_became_peered":"2024-09-11T01:05:31.679239+0000","last_unstale":"2024-09-11T01:07:39.765210+0000","last_undegraded":"2024-09-11T01:07:39.765210+0000","last_fullsized":"2024-09-11T01:07:39.765210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:32.240196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595578+0000","last_change":"2024-09-11T01:05:28.552203+0000","last_active":"2024-09-11T01:06:41.595578+0000","last_peered":"2024-09-11T01:06:41.595578+0000","last_clean":"2024-09-11T01:06:41.595578+0000","last_became_active":"2024-09-11T01:05:28.551658+0000","last_became_peered":"2024-09-11T01:05:28.551658+0000","last_unstale":"2024-09-11T01:06:41.595578+0000","last_undegraded":"2024-09-11T01:06:41.595578+0000","last_fullsized":"2024-09-11T01:06:41.595578+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:46.102466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":117,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598067+0000","last_change":"2024-09-11T01:04:12.299017+0000","last_active":"2024-09-11T01:06:41.598067+0000","last_peered":"2024-09-11T01:06:41.598067+0000","last_clean":"2024-09-11T01:06:41.598067+0000","last_became_active":"2024-09-11T01:04:11.998504+0000","last_became_peered":"2024-09-11T01:04:11.998504+0000","last_unstale":"2024-09-11T01:06:41.598067+0000","last_undegraded":"2024-09-11T01:06:41.598067+0000","last_fullsized":"2024-09-11T01:06:41.598067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:00:34.569322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:00:34.569322+0000","last_clean_scrub_stamp":"2024-09-11T01:00:34.569322+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:54.949789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597966+0000","last_change":"2024-09-11T01:05:40.982181+0000","last_active":"2024-09-11T01:06:41.597966+0000","last_peered":"2024-09-11T01:06:41.597966+0000","last_clean":"2024-09-11T01:06:41.597966+0000","last_became_active":"2024-09-11T01:05:40.981668+0000","last_became_peered":"2024-09-11T01:05:40.981668+0000","last_unstale":"2024-09-11T01:06:41.597966+0000","last_undegraded":"2024-09-11T01:06:41.597966+0000","last_fullsized":"2024-09-11T01:06:41.597966+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:48.199189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"89'7","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764704+0000","last_change":"2024-09-11T01:05:31.677978+0000","last_active":"2024-09-11T01:07:39.764704+0000","last_peered":"2024-09-11T01:07:39.764704+0000","last_clean":"2024-09-11T01:07:39.764704+0000","last_became_active":"2024-09-11T01:05:31.677478+0000","last_became_peered":"2024-09-11T01:05:31.677478+0000","last_unstale":"2024-09-11T01:07:39.764704+0000","last_undegraded":"2024-09-11T01:07:39.764704+0000","last_fullsized":"2024-09-11T01:07:39.764704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:39.568921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595451+0000","last_change":"2024-09-11T01:05:28.755866+0000","last_active":"2024-09-11T01:06:41.595451+0000","last_peered":"2024-09-11T01:06:41.595451+0000","last_clean":"2024-09-11T01:06:41.595451+0000","last_became_active":"2024-09-11T01:05:28.755475+0000","last_became_peered":"2024-09-11T01:05:28.755475+0000","last_unstale":"2024-09-11T01:06:41.595451+0000","last_undegraded":"2024-09-11T01:06:41.595451+0000","last_fullsized":"2024-09-11T01:06:41.595451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:22.324584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470249+0000","last_change":"2024-09-11T01:05:40.967181+0000","last_active":"2024-09-11T01:06:42.470249+0000","last_peered":"2024-09-11T01:06:42.470249+0000","last_clean":"2024-09-11T01:06:42.470249+0000","last_became_active":"2024-09-11T01:05:40.966748+0000","last_became_peered":"2024-09-11T01:05:40.966748+0000","last_unstale":"2024-09-11T01:06:42.470249+0000","last_undegraded":"2024-09-11T01:06:42.470249+0000","last_fullsized":"2024-09-11T01:06:42.470249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:15:28.446190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"89'6","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.763173+0000","last_change":"2024-09-11T01:05:40.981823+0000","last_active":"2024-09-11T01:07:39.763173+0000","last_peered":"2024-09-11T01:07:39.763173+0000","last_clean":"2024-09-11T01:07:39.763173+0000","last_became_active":"2024-09-11T01:05:40.981478+0000","last_became_peered":"2024-09-11T01:05:40.981478+0000","last_unstale":"2024-09-11T01:07:39.763173+0000","last_undegraded":"2024-09-11T01:07:39.763173+0000","last_fullsized":"2024-09-11T01:07:39.763173+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:55.848492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.684119+0000","last_change":"2024-09-11T01:05:28.549207+0000","last_active":"2024-09-11T01:06:41.684119+0000","last_peered":"2024-09-11T01:06:41.684119+0000","last_clean":"2024-09-11T01:06:41.684119+0000","last_became_active":"2024-09-11T01:05:28.548156+0000","last_became_peered":"2024-09-11T01:05:28.548156+0000","last_unstale":"2024-09-11T01:06:41.684119+0000","last_undegraded":"2024-09-11T01:06:41.684119+0000","last_fullsized":"2024-09-11T01:06:41.684119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:58.698379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470360+0000","last_change":"2024-09-11T01:05:40.982213+0000","last_active":"2024-09-11T01:06:42.470360+0000","last_peered":"2024-09-11T01:06:42.470360+0000","last_clean":"2024-09-11T01:06:42.470360+0000","last_became_active":"2024-09-11T01:05:40.981066+0000","last_became_peered":"2024-09-11T01:05:40.981066+0000","last_unstale":"2024-09-11T01:06:42.470360+0000","last_undegraded":"2024-09-11T01:06:42.470360+0000","last_fullsized":"2024-09-11T01:06:42.470360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:09.348973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759808+0000","last_change":"2024-09-11T01:05:31.677613+0000","last_active":"2024-09-11T01:07:39.759808+0000","last_peered":"2024-09-11T01:07:39.759808+0000","last_clean":"2024-09-11T01:07:39.759808+0000","last_became_active":"2024-09-11T01:05:31.677263+0000","last_became_peered":"2024-09-11T01:05:31.677263+0000","last_unstale":"2024-09-11T01:07:39.759808+0000","last_undegraded":"2024-09-11T01:07:39.759808+0000","last_fullsized":"2024-09-11T01:07:39.759808+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:32.490982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595401+0000","last_change":"2024-09-11T01:05:28.558437+0000","last_active":"2024-09-11T01:06:41.595401+0000","last_peered":"2024-09-11T01:06:41.595401+0000","last_clean":"2024-09-11T01:06:41.595401+0000","last_became_active":"2024-09-11T01:05:28.558070+0000","last_became_peered":"2024-09-11T01:05:28.558070+0000","last_unstale":"2024-09-11T01:06:41.595401+0000","last_undegraded":"2024-09-11T01:06:41.595401+0000","last_fullsized":"2024-09-11T01:06:41.595401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:26.589209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683031+0000","last_change":"2024-09-11T01:05:40.970422+0000","last_active":"2024-09-11T01:06:41.683031+0000","last_peered":"2024-09-11T01:06:41.683031+0000","last_clean":"2024-09-11T01:06:41.683031+0000","last_became_active":"2024-09-11T01:05:40.970087+0000","last_became_peered":"2024-09-11T01:05:40.970087+0000","last_unstale":"2024-09-11T01:06:41.683031+0000","last_undegraded":"2024-09-11T01:06:41.683031+0000","last_fullsized":"2024-09-11T01:06:41.683031+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:05.171700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.751047+0000","last_change":"2024-09-11T01:05:40.967014+0000","last_active":"2024-09-11T01:07:39.751047+0000","last_peered":"2024-09-11T01:07:39.751047+0000","last_clean":"2024-09-11T01:07:39.751047+0000","last_became_active":"2024-09-11T01:05:40.966567+0000","last_became_peered":"2024-09-11T01:05:40.966567+0000","last_unstale":"2024-09-11T01:07:39.751047+0000","last_undegraded":"2024-09-11T01:07:39.751047+0000","last_fullsized":"2024-09-11T01:07:39.751047+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:50.868245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599221+0000","last_change":"2024-09-11T01:05:28.553646+0000","last_active":"2024-09-11T01:06:41.599221+0000","last_peered":"2024-09-11T01:06:41.599221+0000","last_clean":"2024-09-11T01:06:41.599221+0000","last_became_active":"2024-09-11T01:05:28.553238+0000","last_became_peered":"2024-09-11T01:05:28.553238+0000","last_unstale":"2024-09-11T01:06:41.599221+0000","last_undegraded":"2024-09-11T01:06:41.599221+0000","last_fullsized":"2024-09-11T01:06:41.599221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:31.670321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683191+0000","last_change":"2024-09-11T01:05:40.973220+0000","last_active":"2024-09-11T01:06:41.683191+0000","last_peered":"2024-09-11T01:06:41.683191+0000","last_clean":"2024-09-11T01:06:41.683191+0000","last_became_active":"2024-09-11T01:05:40.972843+0000","last_became_peered":"2024-09-11T01:05:40.972843+0000","last_unstale":"2024-09-11T01:06:41.683191+0000","last_undegraded":"2024-09-11T01:06:41.683191+0000","last_fullsized":"2024-09-11T01:06:41.683191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:07.785474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"89'6","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.758209+0000","last_change":"2024-09-11T01:05:31.682064+0000","last_active":"2024-09-11T01:07:39.758209+0000","last_peered":"2024-09-11T01:07:39.758209+0000","last_clean":"2024-09-11T01:07:39.758209+0000","last_became_active":"2024-09-11T01:05:31.681744+0000","last_became_peered":"2024-09-11T01:05:31.681744+0000","last_unstale":"2024-09-11T01:07:39.758209+0000","last_undegraded":"2024-09-11T01:07:39.758209+0000","last_fullsized":"2024-09-11T01:07:39.758209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:29.055133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597128+0000","last_change":"2024-09-11T01:05:40.986656+0000","last_active":"2024-09-11T01:06:41.597128+0000","last_peered":"2024-09-11T01:06:41.597128+0000","last_clean":"2024-09-11T01:06:41.597128+0000","last_became_active":"2024-09-11T01:05:40.970230+0000","last_became_peered":"2024-09-11T01:05:40.970230+0000","last_unstale":"2024-09-11T01:06:41.597128+0000","last_undegraded":"2024-09-11T01:06:41.597128+0000","last_fullsized":"2024-09-11T01:06:41.597128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:25.468986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595300+0000","last_change":"2024-09-11T01:05:40.980843+0000","last_active":"2024-09-11T01:06:41.595300+0000","last_peered":"2024-09-11T01:06:41.595300+0000","last_clean":"2024-09-11T01:06:41.595300+0000","last_became_active":"2024-09-11T01:05:40.979033+0000","last_became_peered":"2024-09-11T01:05:40.979033+0000","last_unstale":"2024-09-11T01:06:41.595300+0000","last_undegraded":"2024-09-11T01:06:41.595300+0000","last_fullsized":"2024-09-11T01:06:41.595300+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:44.039548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"89'6","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.756220+0000","last_change":"2024-09-11T01:05:31.676046+0000","last_active":"2024-09-11T01:07:39.756220+0000","last_peered":"2024-09-11T01:07:39.756220+0000","last_clean":"2024-09-11T01:07:39.756220+0000","last_became_active":"2024-09-11T01:05:31.675704+0000","last_became_peered":"2024-09-11T01:05:31.675704+0000","last_unstale":"2024-09-11T01:07:39.756220+0000","last_undegraded":"2024-09-11T01:07:39.756220+0000","last_fullsized":"2024-09-11T01:07:39.756220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:17.907270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'5","reported_seq":169,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:16.836385+0000","last_change":"2024-09-11T01:05:28.550131+0000","last_active":"2024-09-11T01:08:16.836385+0000","last_peered":"2024-09-11T01:08:16.836385+0000","last_clean":"2024-09-11T01:08:16.836385+0000","last_became_active":"2024-09-11T01:05:28.549561+0000","last_became_peered":"2024-09-11T01:05:28.549561+0000","last_unstale":"2024-09-11T01:08:16.836385+0000","last_undegraded":"2024-09-11T01:08:16.836385+0000","last_fullsized":"2024-09-11T01:08:16.836385+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:52.001757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598656+0000","last_change":"2024-09-11T01:05:40.984877+0000","last_active":"2024-09-11T01:06:41.598656+0000","last_peered":"2024-09-11T01:06:41.598656+0000","last_clean":"2024-09-11T01:06:41.598656+0000","last_became_active":"2024-09-11T01:05:40.984500+0000","last_became_peered":"2024-09-11T01:05:40.984500+0000","last_unstale":"2024-09-11T01:06:41.598656+0000","last_undegraded":"2024-09-11T01:06:41.598656+0000","last_fullsized":"2024-09-11T01:06:41.598656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:44.309560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"89'15","reported_seq":58,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.766111+0000","last_change":"2024-09-11T01:05:40.976014+0000","last_active":"2024-09-11T01:07:39.766111+0000","last_peered":"2024-09-11T01:07:39.766111+0000","last_clean":"2024-09-11T01:07:39.766111+0000","last_became_active":"2024-09-11T01:05:40.975610+0000","last_became_peered":"2024-09-11T01:05:40.975610+0000","last_unstale":"2024-09-11T01:07:39.766111+0000","last_undegraded":"2024-09-11T01:07:39.766111+0000","last_fullsized":"2024-09-11T01:07:39.766111+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:26.920957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683533+0000","last_change":"2024-09-11T01:05:28.553043+0000","last_active":"2024-09-11T01:06:41.683533+0000","last_peered":"2024-09-11T01:06:41.683533+0000","last_clean":"2024-09-11T01:06:41.683533+0000","last_became_active":"2024-09-11T01:05:28.552678+0000","last_became_peered":"2024-09-11T01:05:28.552678+0000","last_unstale":"2024-09-11T01:06:41.683533+0000","last_undegraded":"2024-09-11T01:06:41.683533+0000","last_fullsized":"2024-09-11T01:06:41.683533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:23.279056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.601347+0000","last_change":"2024-09-11T01:06:41.600861+0000","last_active":"2024-09-11T01:06:41.601347+0000","last_peered":"2024-09-11T01:06:41.601347+0000","last_clean":"2024-09-11T01:06:41.601347+0000","last_became_active":"2024-09-11T01:06:41.600314+0000","last_became_peered":"2024-09-11T01:06:41.600314+0000","last_unstale":"2024-09-11T01:06:41.601347+0000","last_undegraded":"2024-09-11T01:06:41.601347+0000","last_fullsized":"2024-09-11T01:06:41.601347+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:29.070620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765346+0000","last_change":"2024-09-11T01:05:31.674324+0000","last_active":"2024-09-11T01:07:39.765346+0000","last_peered":"2024-09-11T01:07:39.765346+0000","last_clean":"2024-09-11T01:07:39.765346+0000","last_became_active":"2024-09-11T01:05:31.673648+0000","last_became_peered":"2024-09-11T01:05:31.673648+0000","last_unstale":"2024-09-11T01:07:39.765346+0000","last_undegraded":"2024-09-11T01:07:39.765346+0000","last_fullsized":"2024-09-11T01:07:39.765346+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:02.134422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597403+0000","last_change":"2024-09-11T01:05:40.972605+0000","last_active":"2024-09-11T01:06:41.597403+0000","last_peered":"2024-09-11T01:06:41.597403+0000","last_clean":"2024-09-11T01:06:41.597403+0000","last_became_active":"2024-09-11T01:05:40.961704+0000","last_became_peered":"2024-09-11T01:05:40.961704+0000","last_unstale":"2024-09-11T01:06:41.597403+0000","last_undegraded":"2024-09-11T01:06:41.597403+0000","last_fullsized":"2024-09-11T01:06:41.597403+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:45.276739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683867+0000","last_change":"2024-09-11T01:05:40.969424+0000","last_active":"2024-09-11T01:06:41.683867+0000","last_peered":"2024-09-11T01:06:41.683867+0000","last_clean":"2024-09-11T01:06:41.683867+0000","last_became_active":"2024-09-11T01:05:40.968994+0000","last_became_peered":"2024-09-11T01:05:40.968994+0000","last_unstale":"2024-09-11T01:06:41.683867+0000","last_undegraded":"2024-09-11T01:06:41.683867+0000","last_fullsized":"2024-09-11T01:06:41.683867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:08.554953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"89'6","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.755700+0000","last_change":"2024-09-11T01:05:31.675764+0000","last_active":"2024-09-11T01:07:39.755700+0000","last_peered":"2024-09-11T01:07:39.755700+0000","last_clean":"2024-09-11T01:07:39.755700+0000","last_became_active":"2024-09-11T01:05:31.674553+0000","last_became_peered":"2024-09-11T01:05:31.674553+0000","last_unstale":"2024-09-11T01:07:39.755700+0000","last_undegraded":"2024-09-11T01:07:39.755700+0000","last_fullsized":"2024-09-11T01:07:39.755700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:30.026758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'36","reported_seq":333,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:13.817204+0000","last_change":"2024-09-11T01:05:40.975735+0000","last_active":"2024-09-11T01:08:13.817204+0000","last_peered":"2024-09-11T01:08:13.817204+0000","last_clean":"2024-09-11T01:08:13.817204+0000","last_became_active":"2024-09-11T01:05:40.964582+0000","last_became_peered":"2024-09-11T01:05:40.964582+0000","last_unstale":"2024-09-11T01:08:13.817204+0000","last_undegraded":"2024-09-11T01:08:13.817204+0000","last_fullsized":"2024-09-11T01:08:13.817204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:57.424468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64385,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":239,"num_read_kb":182,"num_write":37,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597830+0000","last_change":"2024-09-11T01:05:40.981306+0000","last_active":"2024-09-11T01:06:41.597830+0000","last_peered":"2024-09-11T01:06:41.597830+0000","last_clean":"2024-09-11T01:06:41.597830+0000","last_became_active":"2024-09-11T01:05:40.977531+0000","last_became_peered":"2024-09-11T01:05:40.977531+0000","last_unstale":"2024-09-11T01:06:41.597830+0000","last_undegraded":"2024-09-11T01:06:41.597830+0000","last_fullsized":"2024-09-11T01:06:41.597830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:21.613080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"89'11","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764170+0000","last_change":"2024-09-11T01:05:31.681612+0000","last_active":"2024-09-11T01:07:39.764170+0000","last_peered":"2024-09-11T01:07:39.764170+0000","last_clean":"2024-09-11T01:07:39.764170+0000","last_became_active":"2024-09-11T01:05:31.680609+0000","last_became_peered":"2024-09-11T01:05:31.680609+0000","last_unstale":"2024-09-11T01:07:39.764170+0000","last_undegraded":"2024-09-11T01:07:39.764170+0000","last_fullsized":"2024-09-11T01:07:39.764170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:44.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.684460+0000","last_change":"2024-09-11T01:05:28.625177+0000","last_active":"2024-09-11T01:06:41.684460+0000","last_peered":"2024-09-11T01:06:41.684460+0000","last_clean":"2024-09-11T01:06:41.684460+0000","last_became_active":"2024-09-11T01:05:28.624819+0000","last_became_peered":"2024-09-11T01:05:28.624819+0000","last_unstale":"2024-09-11T01:06:41.684460+0000","last_undegraded":"2024-09-11T01:06:41.684460+0000","last_fullsized":"2024-09-11T01:06:41.684460+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:11.709636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595371+0000","last_change":"2024-09-11T01:05:40.978481+0000","last_active":"2024-09-11T01:06:41.595371+0000","last_peered":"2024-09-11T01:06:41.595371+0000","last_clean":"2024-09-11T01:06:41.595371+0000","last_became_active":"2024-09-11T01:05:40.977501+0000","last_became_peered":"2024-09-11T01:05:40.977501+0000","last_unstale":"2024-09-11T01:06:41.595371+0000","last_undegraded":"2024-09-11T01:06:41.595371+0000","last_fullsized":"2024-09-11T01:06:41.595371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:08.427274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"89'9","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.770113+0000","last_change":"2024-09-11T01:05:31.692675+0000","last_active":"2024-09-11T01:07:39.770113+0000","last_peered":"2024-09-11T01:07:39.770113+0000","last_clean":"2024-09-11T01:07:39.770113+0000","last_became_active":"2024-09-11T01:05:31.690308+0000","last_became_peered":"2024-09-11T01:05:31.690308+0000","last_unstale":"2024-09-11T01:07:39.770113+0000","last_undegraded":"2024-09-11T01:07:39.770113+0000","last_fullsized":"2024-09-11T01:07:39.770113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:14.823786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598101+0000","last_change":"2024-09-11T01:05:28.557868+0000","last_active":"2024-09-11T01:06:41.598101+0000","last_peered":"2024-09-11T01:06:41.598101+0000","last_clean":"2024-09-11T01:06:41.598101+0000","last_became_active":"2024-09-11T01:05:28.557512+0000","last_became_peered":"2024-09-11T01:05:28.557512+0000","last_unstale":"2024-09-11T01:06:41.598101+0000","last_undegraded":"2024-09-11T01:06:41.598101+0000","last_fullsized":"2024-09-11T01:06:41.598101+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:50.733551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597725+0000","last_change":"2024-09-11T01:05:40.982368+0000","last_active":"2024-09-11T01:06:41.597725+0000","last_peered":"2024-09-11T01:06:41.597725+0000","last_clean":"2024-09-11T01:06:41.597725+0000","last_became_active":"2024-09-11T01:05:40.980337+0000","last_became_peered":"2024-09-11T01:05:40.980337+0000","last_unstale":"2024-09-11T01:06:41.597725+0000","last_undegraded":"2024-09-11T01:06:41.597725+0000","last_fullsized":"2024-09-11T01:06:41.597725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:22.010496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"89'10","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.760342+0000","last_change":"2024-09-11T01:05:31.670806+0000","last_active":"2024-09-11T01:07:39.760342+0000","last_peered":"2024-09-11T01:07:39.760342+0000","last_clean":"2024-09-11T01:07:39.760342+0000","last_became_active":"2024-09-11T01:05:31.670452+0000","last_became_peered":"2024-09-11T01:05:31.670452+0000","last_unstale":"2024-09-11T01:07:39.760342+0000","last_undegraded":"2024-09-11T01:07:39.760342+0000","last_fullsized":"2024-09-11T01:07:39.760342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:22.489650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":159,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:12.815400+0000","last_change":"2024-09-11T01:05:28.555885+0000","last_active":"2024-09-11T01:08:12.815400+0000","last_peered":"2024-09-11T01:08:12.815400+0000","last_clean":"2024-09-11T01:08:12.815400+0000","last_became_active":"2024-09-11T01:05:28.555471+0000","last_became_peered":"2024-09-11T01:05:28.555471+0000","last_unstale":"2024-09-11T01:08:12.815400+0000","last_undegraded":"2024-09-11T01:08:12.815400+0000","last_fullsized":"2024-09-11T01:08:12.815400+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:50.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650778+0000","last_change":"2024-09-11T01:05:40.971982+0000","last_active":"2024-09-11T01:06:41.650778+0000","last_peered":"2024-09-11T01:06:41.650778+0000","last_clean":"2024-09-11T01:06:41.650778+0000","last_became_active":"2024-09-11T01:05:40.971614+0000","last_became_peered":"2024-09-11T01:05:40.971614+0000","last_unstale":"2024-09-11T01:06:41.650778+0000","last_undegraded":"2024-09-11T01:06:41.650778+0000","last_fullsized":"2024-09-11T01:06:41.650778+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:11.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470557+0000","last_change":"2024-09-11T01:05:40.972734+0000","last_active":"2024-09-11T01:06:42.470557+0000","last_peered":"2024-09-11T01:06:42.470557+0000","last_clean":"2024-09-11T01:06:42.470557+0000","last_became_active":"2024-09-11T01:05:40.969428+0000","last_became_peered":"2024-09-11T01:05:40.969428+0000","last_unstale":"2024-09-11T01:06:42.470557+0000","last_undegraded":"2024-09-11T01:06:42.470557+0000","last_fullsized":"2024-09-11T01:06:42.470557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:30.199055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.762803+0000","last_change":"2024-09-11T01:05:31.684114+0000","last_active":"2024-09-11T01:07:39.762803+0000","last_peered":"2024-09-11T01:07:39.762803+0000","last_clean":"2024-09-11T01:07:39.762803+0000","last_became_active":"2024-09-11T01:05:31.683830+0000","last_became_peered":"2024-09-11T01:05:31.683830+0000","last_unstale":"2024-09-11T01:07:39.762803+0000","last_undegraded":"2024-09-11T01:07:39.762803+0000","last_fullsized":"2024-09-11T01:07:39.762803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:43.695706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683722+0000","last_change":"2024-09-11T01:05:28.554745+0000","last_active":"2024-09-11T01:06:41.683722+0000","last_peered":"2024-09-11T01:06:41.683722+0000","last_clean":"2024-09-11T01:06:41.683722+0000","last_became_active":"2024-09-11T01:05:28.554354+0000","last_became_peered":"2024-09-11T01:05:28.554354+0000","last_unstale":"2024-09-11T01:06:41.683722+0000","last_undegraded":"2024-09-11T01:06:41.683722+0000","last_fullsized":"2024-09-11T01:06:41.683722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:33.663536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597505+0000","last_change":"2024-09-11T01:05:40.974956+0000","last_active":"2024-09-11T01:06:41.597505+0000","last_peered":"2024-09-11T01:06:41.597505+0000","last_clean":"2024-09-11T01:06:41.597505+0000","last_became_active":"2024-09-11T01:05:40.974434+0000","last_became_peered":"2024-09-11T01:05:40.974434+0000","last_unstale":"2024-09-11T01:06:41.597505+0000","last_undegraded":"2024-09-11T01:06:41.597505+0000","last_fullsized":"2024-09-11T01:06:41.597505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:01.196098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767222+0000","last_change":"2024-09-11T01:05:31.679904+0000","last_active":"2024-09-11T01:07:39.767222+0000","last_peered":"2024-09-11T01:07:39.767222+0000","last_clean":"2024-09-11T01:07:39.767222+0000","last_became_active":"2024-09-11T01:05:31.679517+0000","last_became_peered":"2024-09-11T01:05:31.679517+0000","last_unstale":"2024-09-11T01:07:39.767222+0000","last_undegraded":"2024-09-11T01:07:39.767222+0000","last_fullsized":"2024-09-11T01:07:39.767222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:24.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594664+0000","last_change":"2024-09-11T01:05:28.549752+0000","last_active":"2024-09-11T01:06:41.594664+0000","last_peered":"2024-09-11T01:06:41.594664+0000","last_clean":"2024-09-11T01:06:41.594664+0000","last_became_active":"2024-09-11T01:05:28.549253+0000","last_became_peered":"2024-09-11T01:05:28.549253+0000","last_unstale":"2024-09-11T01:06:41.594664+0000","last_undegraded":"2024-09-11T01:06:41.594664+0000","last_fullsized":"2024-09-11T01:06:41.594664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:25.774363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.680318+0000","last_change":"2024-09-11T01:05:28.553118+0000","last_active":"2024-09-11T01:06:41.680318+0000","last_peered":"2024-09-11T01:06:41.680318+0000","last_clean":"2024-09-11T01:06:41.680318+0000","last_became_active":"2024-09-11T01:05:28.552779+0000","last_became_peered":"2024-09-11T01:05:28.552779+0000","last_unstale":"2024-09-11T01:06:41.680318+0000","last_undegraded":"2024-09-11T01:06:41.680318+0000","last_fullsized":"2024-09-11T01:06:41.680318+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:58.297579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"89'8","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.762664+0000","last_change":"2024-09-11T01:05:40.981936+0000","last_active":"2024-09-11T01:07:39.762664+0000","last_peered":"2024-09-11T01:07:39.762664+0000","last_clean":"2024-09-11T01:07:39.762664+0000","last_became_active":"2024-09-11T01:05:40.981623+0000","last_became_peered":"2024-09-11T01:05:40.981623+0000","last_unstale":"2024-09-11T01:07:39.762664+0000","last_undegraded":"2024-09-11T01:07:39.762664+0000","last_fullsized":"2024-09-11T01:07:39.762664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:14.773406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.690918+0000","last_change":"2024-09-11T01:06:41.685046+0000","last_active":"2024-09-11T01:06:41.690918+0000","last_peered":"2024-09-11T01:06:41.690918+0000","last_clean":"2024-09-11T01:06:41.690918+0000","last_became_active":"2024-09-11T01:06:41.684442+0000","last_became_peered":"2024-09-11T01:06:41.684442+0000","last_unstale":"2024-09-11T01:06:41.690918+0000","last_undegraded":"2024-09-11T01:06:41.690918+0000","last_fullsized":"2024-09-11T01:06:41.690918+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:51.290772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'7","reported_seq":170,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:15.821062+0000","last_change":"2024-09-11T01:05:28.553479+0000","last_active":"2024-09-11T01:08:15.821062+0000","last_peered":"2024-09-11T01:08:15.821062+0000","last_clean":"2024-09-11T01:08:15.821062+0000","last_became_active":"2024-09-11T01:05:28.553171+0000","last_became_peered":"2024-09-11T01:05:28.553171+0000","last_unstale":"2024-09-11T01:08:15.821062+0000","last_undegraded":"2024-09-11T01:08:15.821062+0000","last_fullsized":"2024-09-11T01:08:15.821062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:04.877982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.760071+0000","last_change":"2024-09-11T01:05:40.982070+0000","last_active":"2024-09-11T01:07:39.760071+0000","last_peered":"2024-09-11T01:07:39.760071+0000","last_clean":"2024-09-11T01:07:39.760071+0000","last_became_active":"2024-09-11T01:05:40.981601+0000","last_became_peered":"2024-09-11T01:05:40.981601+0000","last_unstale":"2024-09-11T01:07:39.760071+0000","last_undegraded":"2024-09-11T01:07:39.760071+0000","last_fullsized":"2024-09-11T01:07:39.760071+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:31.409711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595121+0000","last_change":"2024-09-11T01:05:40.967374+0000","last_active":"2024-09-11T01:06:41.595121+0000","last_peered":"2024-09-11T01:06:41.595121+0000","last_clean":"2024-09-11T01:06:41.595121+0000","last_became_active":"2024-09-11T01:05:40.966705+0000","last_became_peered":"2024-09-11T01:05:40.966705+0000","last_unstale":"2024-09-11T01:06:41.595121+0000","last_undegraded":"2024-09-11T01:06:41.595121+0000","last_fullsized":"2024-09-11T01:06:41.595121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:17.278999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"89'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.747569+0000","last_change":"2024-09-11T01:05:31.675298+0000","last_active":"2024-09-11T01:07:39.747569+0000","last_peered":"2024-09-11T01:07:39.747569+0000","last_clean":"2024-09-11T01:07:39.747569+0000","last_became_active":"2024-09-11T01:05:31.674922+0000","last_became_peered":"2024-09-11T01:05:31.674922+0000","last_unstale":"2024-09-11T01:07:39.747569+0000","last_undegraded":"2024-09-11T01:07:39.747569+0000","last_fullsized":"2024-09-11T01:07:39.747569+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:54.059202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"89'12","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.750462+0000","last_change":"2024-09-11T01:05:31.685494+0000","last_active":"2024-09-11T01:07:39.750462+0000","last_peered":"2024-09-11T01:07:39.750462+0000","last_clean":"2024-09-11T01:07:39.750462+0000","last_became_active":"2024-09-11T01:05:31.685131+0000","last_became_peered":"2024-09-11T01:05:31.685131+0000","last_unstale":"2024-09-11T01:07:39.750462+0000","last_undegraded":"2024-09-11T01:07:39.750462+0000","last_fullsized":"2024-09-11T01:07:39.750462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:41.805135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759763+0000","last_change":"2024-09-11T01:05:31.686473+0000","last_active":"2024-09-11T01:07:39.759763+0000","last_peered":"2024-09-11T01:07:39.759763+0000","last_clean":"2024-09-11T01:07:39.759763+0000","last_became_active":"2024-09-11T01:05:31.685858+0000","last_became_peered":"2024-09-11T01:05:31.685858+0000","last_unstale":"2024-09-11T01:07:39.759763+0000","last_undegraded":"2024-09-11T01:07:39.759763+0000","last_fullsized":"2024-09-11T01:07:39.759763+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:52.174889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768644+0000","last_change":"2024-09-11T01:05:31.691078+0000","last_active":"2024-09-11T01:07:39.768644+0000","last_peered":"2024-09-11T01:07:39.768644+0000","last_clean":"2024-09-11T01:07:39.768644+0000","last_became_active":"2024-09-11T01:05:31.690755+0000","last_became_peered":"2024-09-11T01:05:31.690755+0000","last_unstale":"2024-09-11T01:07:39.768644+0000","last_undegraded":"2024-09-11T01:07:39.768644+0000","last_fullsized":"2024-09-11T01:07:39.768644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:50.643233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"89'4","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.769438+0000","last_change":"2024-09-11T01:05:31.681933+0000","last_active":"2024-09-11T01:07:39.769438+0000","last_peered":"2024-09-11T01:07:39.769438+0000","last_clean":"2024-09-11T01:07:39.769438+0000","last_became_active":"2024-09-11T01:05:31.681642+0000","last_became_peered":"2024-09-11T01:05:31.681642+0000","last_unstale":"2024-09-11T01:07:39.769438+0000","last_undegraded":"2024-09-11T01:07:39.769438+0000","last_fullsized":"2024-09-11T01:07:39.769438+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:05:10.434843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"89'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.751080+0000","last_change":"2024-09-11T01:05:31.677188+0000","last_active":"2024-09-11T01:07:39.751080+0000","last_peered":"2024-09-11T01:07:39.751080+0000","last_clean":"2024-09-11T01:07:39.751080+0000","last_became_active":"2024-09-11T01:05:31.676689+0000","last_became_peered":"2024-09-11T01:05:31.676689+0000","last_unstale":"2024-09-11T01:07:39.751080+0000","last_undegraded":"2024-09-11T01:07:39.751080+0000","last_fullsized":"2024-09-11T01:07:39.751080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:51.899743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"89'15","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.753001+0000","last_change":"2024-09-11T01:05:31.678994+0000","last_active":"2024-09-11T01:07:39.753001+0000","last_peered":"2024-09-11T01:07:39.753001+0000","last_clean":"2024-09-11T01:07:39.753001+0000","last_became_active":"2024-09-11T01:05:31.678675+0000","last_became_peered":"2024-09-11T01:05:31.678675+0000","last_unstale":"2024-09-11T01:07:39.753001+0000","last_undegraded":"2024-09-11T01:07:39.753001+0000","last_fullsized":"2024-09-11T01:07:39.753001+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:35.740872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"89'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759357+0000","last_change":"2024-09-11T01:05:31.680046+0000","last_active":"2024-09-11T01:07:39.759357+0000","last_peered":"2024-09-11T01:07:39.759357+0000","last_clean":"2024-09-11T01:07:39.759357+0000","last_became_active":"2024-09-11T01:05:31.679626+0000","last_became_peered":"2024-09-11T01:05:31.679626+0000","last_unstale":"2024-09-11T01:07:39.759357+0000","last_undegraded":"2024-09-11T01:07:39.759357+0000","last_fullsized":"2024-09-11T01:07:39.759357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:15.260470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"89'6","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767704+0000","last_change":"2024-09-11T01:05:31.683545+0000","last_active":"2024-09-11T01:07:39.767704+0000","last_peered":"2024-09-11T01:07:39.767704+0000","last_clean":"2024-09-11T01:07:39.767704+0000","last_became_active":"2024-09-11T01:05:31.683166+0000","last_became_peered":"2024-09-11T01:05:31.683166+0000","last_unstale":"2024-09-11T01:07:39.767704+0000","last_undegraded":"2024-09-11T01:07:39.767704+0000","last_fullsized":"2024-09-11T01:07:39.767704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:57.378211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765914+0000","last_change":"2024-09-11T01:05:31.678031+0000","last_active":"2024-09-11T01:07:39.765914+0000","last_peered":"2024-09-11T01:07:39.765914+0000","last_clean":"2024-09-11T01:07:39.765914+0000","last_became_active":"2024-09-11T01:05:31.677760+0000","last_became_peered":"2024-09-11T01:05:31.677760+0000","last_unstale":"2024-09-11T01:07:39.765914+0000","last_undegraded":"2024-09-11T01:07:39.765914+0000","last_fullsized":"2024-09-11T01:07:39.765914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:39.252655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767150+0000","last_change":"2024-09-11T01:05:31.677991+0000","last_active":"2024-09-11T01:07:39.767150+0000","last_peered":"2024-09-11T01:07:39.767150+0000","last_clean":"2024-09-11T01:07:39.767150+0000","last_became_active":"2024-09-11T01:05:31.677670+0000","last_became_peered":"2024-09-11T01:05:31.677670+0000","last_unstale":"2024-09-11T01:07:39.767150+0000","last_undegraded":"2024-09-11T01:07:39.767150+0000","last_fullsized":"2024-09-11T01:07:39.767150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:55.622757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"89'11","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.769904+0000","last_change":"2024-09-11T01:05:31.678213+0000","last_active":"2024-09-11T01:07:39.769904+0000","last_peered":"2024-09-11T01:07:39.769904+0000","last_clean":"2024-09-11T01:07:39.769904+0000","last_became_active":"2024-09-11T01:05:31.676422+0000","last_became_peered":"2024-09-11T01:05:31.676422+0000","last_unstale":"2024-09-11T01:07:39.769904+0000","last_undegraded":"2024-09-11T01:07:39.769904+0000","last_fullsized":"2024-09-11T01:07:39.769904+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:29.096123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"89'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.757534+0000","last_change":"2024-09-11T01:05:31.680945+0000","last_active":"2024-09-11T01:07:39.757534+0000","last_peered":"2024-09-11T01:07:39.757534+0000","last_clean":"2024-09-11T01:07:39.757534+0000","last_became_active":"2024-09-11T01:05:31.680458+0000","last_became_peered":"2024-09-11T01:05:31.680458+0000","last_unstale":"2024-09-11T01:07:39.757534+0000","last_undegraded":"2024-09-11T01:07:39.757534+0000","last_fullsized":"2024-09-11T01:07:39.757534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:01.382341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.758171+0000","last_change":"2024-09-11T01:05:31.685792+0000","last_active":"2024-09-11T01:07:39.758171+0000","last_peered":"2024-09-11T01:07:39.758171+0000","last_clean":"2024-09-11T01:07:39.758171+0000","last_became_active":"2024-09-11T01:05:31.685467+0000","last_became_peered":"2024-09-11T01:05:31.685467+0000","last_unstale":"2024-09-11T01:07:39.758171+0000","last_undegraded":"2024-09-11T01:07:39.758171+0000","last_fullsized":"2024-09-11T01:07:39.758171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:37.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"89'10","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.756874+0000","last_change":"2024-09-11T01:05:31.678855+0000","last_active":"2024-09-11T01:07:39.756874+0000","last_peered":"2024-09-11T01:07:39.756874+0000","last_clean":"2024-09-11T01:07:39.756874+0000","last_became_active":"2024-09-11T01:05:31.678583+0000","last_became_peered":"2024-09-11T01:05:31.678583+0000","last_unstale":"2024-09-11T01:07:39.756874+0000","last_undegraded":"2024-09-11T01:07:39.756874+0000","last_fullsized":"2024-09-11T01:07:39.756874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:24.112383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"89'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768683+0000","last_change":"2024-09-11T01:05:31.682261+0000","last_active":"2024-09-11T01:07:39.768683+0000","last_peered":"2024-09-11T01:07:39.768683+0000","last_clean":"2024-09-11T01:07:39.768683+0000","last_became_active":"2024-09-11T01:05:31.681924+0000","last_became_peered":"2024-09-11T01:05:31.681924+0000","last_unstale":"2024-09-11T01:07:39.768683+0000","last_undegraded":"2024-09-11T01:07:39.768683+0000","last_fullsized":"2024-09-11T01:07:39.768683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:54.556438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764873+0000","last_change":"2024-09-11T01:05:31.674687+0000","last_active":"2024-09-11T01:07:39.764873+0000","last_peered":"2024-09-11T01:07:39.764873+0000","last_clean":"2024-09-11T01:07:39.764873+0000","last_became_active":"2024-09-11T01:05:31.674348+0000","last_became_peered":"2024-09-11T01:05:31.674348+0000","last_unstale":"2024-09-11T01:07:39.764873+0000","last_undegraded":"2024-09-11T01:07:39.764873+0000","last_fullsized":"2024-09-11T01:07:39.764873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:46.086798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"89'7","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768016+0000","last_change":"2024-09-11T01:05:40.967775+0000","last_active":"2024-09-11T01:07:39.768016+0000","last_peered":"2024-09-11T01:07:39.768016+0000","last_clean":"2024-09-11T01:07:39.768016+0000","last_became_active":"2024-09-11T01:05:40.967355+0000","last_became_peered":"2024-09-11T01:05:40.967355+0000","last_unstale":"2024-09-11T01:07:39.768016+0000","last_undegraded":"2024-09-11T01:07:39.768016+0000","last_fullsized":"2024-09-11T01:07:39.768016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:43.224010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767996+0000","last_change":"2024-09-11T01:05:31.674655+0000","last_active":"2024-09-11T01:07:39.767996+0000","last_peered":"2024-09-11T01:07:39.767996+0000","last_clean":"2024-09-11T01:07:39.767996+0000","last_became_active":"2024-09-11T01:05:31.674342+0000","last_became_peered":"2024-09-11T01:05:31.674342+0000","last_unstale":"2024-09-11T01:07:39.767996+0000","last_undegraded":"2024-09-11T01:07:39.767996+0000","last_fullsized":"2024-09-11T01:07:39.767996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:28.593441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"89'10","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764929+0000","last_change":"2024-09-11T01:05:31.678521+0000","last_active":"2024-09-11T01:07:39.764929+0000","last_peered":"2024-09-11T01:07:39.764929+0000","last_clean":"2024-09-11T01:07:39.764929+0000","last_became_active":"2024-09-11T01:05:31.674828+0000","last_became_peered":"2024-09-11T01:05:31.674828+0000","last_unstale":"2024-09-11T01:07:39.764929+0000","last_undegraded":"2024-09-11T01:07:39.764929+0000","last_fullsized":"2024-09-11T01:07:39.764929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:38.797887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"89'7","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.757696+0000","last_change":"2024-09-11T01:05:31.685075+0000","last_active":"2024-09-11T01:07:39.757696+0000","last_peered":"2024-09-11T01:07:39.757696+0000","last_clean":"2024-09-11T01:07:39.757696+0000","last_became_active":"2024-09-11T01:05:31.684742+0000","last_became_peered":"2024-09-11T01:05:31.684742+0000","last_unstale":"2024-09-11T01:07:39.757696+0000","last_undegraded":"2024-09-11T01:07:39.757696+0000","last_fullsized":"2024-09-11T01:07:39.757696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:29.381976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"89'6","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764349+0000","last_change":"2024-09-11T01:05:31.678921+0000","last_active":"2024-09-11T01:07:39.764349+0000","last_peered":"2024-09-11T01:07:39.764349+0000","last_clean":"2024-09-11T01:07:39.764349+0000","last_became_active":"2024-09-11T01:05:31.678547+0000","last_became_peered":"2024-09-11T01:05:31.678547+0000","last_unstale":"2024-09-11T01:07:39.764349+0000","last_undegraded":"2024-09-11T01:07:39.764349+0000","last_fullsized":"2024-09-11T01:07:39.764349+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:59.618685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'16","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.757628+0000","last_change":"2024-09-11T01:05:31.685565+0000","last_active":"2024-09-11T01:07:39.757628+0000","last_peered":"2024-09-11T01:07:39.757628+0000","last_clean":"2024-09-11T01:07:39.757628+0000","last_became_active":"2024-09-11T01:05:31.685234+0000","last_became_peered":"2024-09-11T01:05:31.685234+0000","last_unstale":"2024-09-11T01:07:39.757628+0000","last_undegraded":"2024-09-11T01:07:39.757628+0000","last_fullsized":"2024-09-11T01:07:39.757628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:07.831922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"89'11","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759002+0000","last_change":"2024-09-11T01:05:31.677464+0000","last_active":"2024-09-11T01:07:39.759002+0000","last_peered":"2024-09-11T01:07:39.759002+0000","last_clean":"2024-09-11T01:07:39.759002+0000","last_became_active":"2024-09-11T01:05:31.677161+0000","last_became_peered":"2024-09-11T01:05:31.677161+0000","last_unstale":"2024-09-11T01:07:39.759002+0000","last_undegraded":"2024-09-11T01:07:39.759002+0000","last_fullsized":"2024-09-11T01:07:39.759002+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:26.590429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"89'9","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767267+0000","last_change":"2024-09-11T01:05:31.679977+0000","last_active":"2024-09-11T01:07:39.767267+0000","last_peered":"2024-09-11T01:07:39.767267+0000","last_clean":"2024-09-11T01:07:39.767267+0000","last_became_active":"2024-09-11T01:05:31.679661+0000","last_became_peered":"2024-09-11T01:05:31.679661+0000","last_unstale":"2024-09-11T01:07:39.767267+0000","last_undegraded":"2024-09-11T01:07:39.767267+0000","last_fullsized":"2024-09-11T01:07:39.767267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:00.040651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"89'5","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765585+0000","last_change":"2024-09-11T01:05:31.685419+0000","last_active":"2024-09-11T01:07:39.765585+0000","last_peered":"2024-09-11T01:07:39.765585+0000","last_clean":"2024-09-11T01:07:39.765585+0000","last_became_active":"2024-09-11T01:05:31.684772+0000","last_became_peered":"2024-09-11T01:05:31.684772+0000","last_unstale":"2024-09-11T01:07:39.765585+0000","last_undegraded":"2024-09-11T01:07:39.765585+0000","last_fullsized":"2024-09-11T01:07:39.765585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:19.283742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"89'6","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.758775+0000","last_change":"2024-09-11T01:05:31.681691+0000","last_active":"2024-09-11T01:07:39.758775+0000","last_peered":"2024-09-11T01:07:39.758775+0000","last_clean":"2024-09-11T01:07:39.758775+0000","last_became_active":"2024-09-11T01:05:31.680549+0000","last_became_peered":"2024-09-11T01:05:31.680549+0000","last_unstale":"2024-09-11T01:07:39.758775+0000","last_undegraded":"2024-09-11T01:07:39.758775+0000","last_fullsized":"2024-09-11T01:07:39.758775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:15.561978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"89'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767096+0000","last_change":"2024-09-11T01:05:31.687135+0000","last_active":"2024-09-11T01:07:39.767096+0000","last_peered":"2024-09-11T01:07:39.767096+0000","last_clean":"2024-09-11T01:07:39.767096+0000","last_became_active":"2024-09-11T01:05:31.686719+0000","last_became_peered":"2024-09-11T01:05:31.686719+0000","last_unstale":"2024-09-11T01:07:39.767096+0000","last_undegraded":"2024-09-11T01:07:39.767096+0000","last_fullsized":"2024-09-11T01:07:39.767096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:42.044930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"89'8","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.753981+0000","last_change":"2024-09-11T01:05:31.688154+0000","last_active":"2024-09-11T01:07:39.753981+0000","last_peered":"2024-09-11T01:07:39.753981+0000","last_clean":"2024-09-11T01:07:39.753981+0000","last_became_active":"2024-09-11T01:05:31.687734+0000","last_became_peered":"2024-09-11T01:05:31.687734+0000","last_unstale":"2024-09-11T01:07:39.753981+0000","last_undegraded":"2024-09-11T01:07:39.753981+0000","last_fullsized":"2024-09-11T01:07:39.753981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:57.789086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.769196+0000","last_change":"2024-09-11T01:05:31.679761+0000","last_active":"2024-09-11T01:07:39.769196+0000","last_peered":"2024-09-11T01:07:39.769196+0000","last_clean":"2024-09-11T01:07:39.769196+0000","last_became_active":"2024-09-11T01:05:31.679345+0000","last_became_peered":"2024-09-11T01:05:31.679345+0000","last_unstale":"2024-09-11T01:07:39.769196+0000","last_undegraded":"2024-09-11T01:07:39.769196+0000","last_fullsized":"2024-09-11T01:07:39.769196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:28.480561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"89'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.756084+0000","last_change":"2024-09-11T01:05:31.680782+0000","last_active":"2024-09-11T01:07:39.756084+0000","last_peered":"2024-09-11T01:07:39.756084+0000","last_clean":"2024-09-11T01:07:39.756084+0000","last_became_active":"2024-09-11T01:05:31.679984+0000","last_became_peered":"2024-09-11T01:05:31.679984+0000","last_unstale":"2024-09-11T01:07:39.756084+0000","last_undegraded":"2024-09-11T01:07:39.756084+0000","last_fullsized":"2024-09-11T01:07:39.756084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:10.306868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"89'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768521+0000","last_change":"2024-09-11T01:05:31.681462+0000","last_active":"2024-09-11T01:07:39.768521+0000","last_peered":"2024-09-11T01:07:39.768521+0000","last_clean":"2024-09-11T01:07:39.768521+0000","last_became_active":"2024-09-11T01:05:31.680799+0000","last_became_peered":"2024-09-11T01:05:31.680799+0000","last_unstale":"2024-09-11T01:07:39.768521+0000","last_undegraded":"2024-09-11T01:07:39.768521+0000","last_fullsized":"2024-09-11T01:07:39.768521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:56:44.512831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69059,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":728,"num_read_kb":436,"num_write":181,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1646,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":208732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645359,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1024000,"data_stored":506452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841588,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28692,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716460,"statfs":{"total":95995035648,"available":95965655040,"internally_reserved":0,"allocated":1708032,"data_stored":1162587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005112,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":506542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201343,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":506350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397573,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36928,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708224,"statfs":{"total":95995035648,"available":95957221376,"internally_reserved":0,"allocated":1622016,"data_stored":1103355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593802,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":501718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790032,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28616,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716536,"statfs":{"total":95995035648,"available":95965732864,"internally_reserved":0,"allocated":1630208,"data_stored":1098100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953557,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":571285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149786,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":501912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411425,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":503787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1077248,"data_stored":566013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738473,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":503106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:08:21.064 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T01:08:21.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:20 smithi117 ceph-mon[35358]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-11T01:08:21.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:20 smithi117 ceph-mon[35358]: pgmap v399: 129 pgs: 129 active+clean; 644 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 6 op/s 2024-09-11T01:08:21.439 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:21.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:21 smithi103 ceph-mon[30562]: from='client.25292 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:08:21.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:21 smithi103 ceph-mon[30562]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-11T01:08:21.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:21 smithi103 ceph-mon[30562]: pgmap v400: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-11T01:08:21.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:21 smithi183 ceph-mon[34992]: from='client.25292 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:08:21.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:21 smithi183 ceph-mon[34992]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-11T01:08:21.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:21 smithi183 ceph-mon[34992]: pgmap v400: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-11T01:08:22.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.067+0000 7fd7e5400640 1 -- 172.21.15.103:0/2161356167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e0104e10 msgr2=0x7fd7e01051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:22.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.067+0000 7fd7e5400640 1 --2- 172.21.15.103:0/2161356167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e0104e10 0x7fd7e01051f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009860 tx=0x7fd7d002a340 comp rx=0 tx=0).stop 2024-09-11T01:08:22.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.067+0000 7fd7e5400640 1 -- 172.21.15.103:0/2161356167 shutdown_connections 2024-09-11T01:08:22.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.067+0000 7fd7e5400640 1 --2- 172.21.15.103:0/2161356167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7e010b1a0 0x7fd7e01119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:22.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.067+0000 7fd7e5400640 1 --2- 172.21.15.103:0/2161356167 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7e010a820 0x7fd7e010ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:22.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.067+0000 7fd7e5400640 1 --2- 172.21.15.103:0/2161356167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e0104e10 0x7fd7e01051f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:22.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.067+0000 7fd7e5400640 1 -- 172.21.15.103:0/2161356167 >> 172.21.15.103:0/2161356167 conn(0x7fd7e0100840 msgr2=0x7fd7e0102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:22.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.067+0000 7fd7e5400640 1 -- 172.21.15.103:0/2161356167 shutdown_connections 2024-09-11T01:08:22.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.067+0000 7fd7e5400640 1 -- 172.21.15.103:0/2161356167 wait complete. 2024-09-11T01:08:22.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.068+0000 7fd7e5400640 1 Processor -- start 2024-09-11T01:08:22.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.068+0000 7fd7e5400640 1 -- start start 2024-09-11T01:08:22.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.069+0000 7fd7e5400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7e0104e10 0x7fd7e019b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:22.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.069+0000 7fd7e5400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e010a820 0x7fd7e019b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:22.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.069+0000 7fd7e5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7e010b1a0 0x7fd7e01a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:22.084 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.069+0000 7fd7e5400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e0114e60 con 0x7fd7e010b1a0 2024-09-11T01:08:22.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.069+0000 7fd7e5400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e0114ce0 con 0x7fd7e010a820 2024-09-11T01:08:22.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.069+0000 7fd7e5400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e0114fe0 con 0x7fd7e0104e10 2024-09-11T01:08:22.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.069+0000 7fd7e4a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7e010b1a0 0x7fd7e01a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:22.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.069+0000 7fd7e4a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7e010b1a0 0x7fd7e01a0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55600/0 (socket says 172.21.15.103:55600) 2024-09-11T01:08:22.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.069+0000 7fd7e4a00640 1 -- 172.21.15.103:0/2932995659 learned_addr learned my addr 172.21.15.103:0/2932995659 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:22.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.069+0000 7fd7df400640 1 --2- 172.21.15.103:0/2932995659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e010a820 0x7fd7e019b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:22.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.070+0000 7fd7e4a00640 1 -- 172.21.15.103:0/2932995659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7e0104e10 msgr2=0x7fd7e019b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:22.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.070+0000 7fd7e4a00640 1 --2- 172.21.15.103:0/2932995659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7e0104e10 0x7fd7e019b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:22.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.070+0000 7fd7e4a00640 1 -- 172.21.15.103:0/2932995659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e010a820 msgr2=0x7fd7e019b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:22.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.070+0000 7fd7e4a00640 1 --2- 172.21.15.103:0/2932995659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e010a820 0x7fd7e019b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:22.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.070+0000 7fd7e4a00640 1 -- 172.21.15.103:0/2932995659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e01a12e0 con 0x7fd7e010b1a0 2024-09-11T01:08:22.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.070+0000 7fd7df400640 1 --2- 172.21.15.103:0/2932995659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e010a820 0x7fd7e019b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:22.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.070+0000 7fd7e4a00640 1 --2- 172.21.15.103:0/2932995659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7e010b1a0 0x7fd7e01a0b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800efc0 tx=0x7fd7d800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.070+0000 7fd7dcc00640 1 -- 172.21.15.103:0/2932995659 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8003970 con 0x7fd7e010b1a0 2024-09-11T01:08:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.070+0000 7fd7e5400640 1 -- 172.21.15.103:0/2932995659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e01a15d0 con 0x7fd7e010b1a0 2024-09-11T01:08:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.070+0000 7fd7dcc00640 1 -- 172.21.15.103:0/2932995659 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7d8004020 con 0x7fd7e010b1a0 2024-09-11T01:08:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.070+0000 7fd7e5400640 1 -- 172.21.15.103:0/2932995659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e01a7c90 con 0x7fd7e010b1a0 2024-09-11T01:08:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.071+0000 7fd7dcc00640 1 -- 172.21.15.103:0/2932995659 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8004d40 con 0x7fd7e010b1a0 2024-09-11T01:08:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.071+0000 7fd7e5400640 1 -- 172.21.15.103:0/2932995659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e01051f0 con 0x7fd7e010b1a0 2024-09-11T01:08:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.074+0000 7fd7dcc00640 1 -- 172.21.15.103:0/2932995659 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7fd7d800b040 con 0x7fd7e010b1a0 2024-09-11T01:08:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.075+0000 7fd7dcc00640 1 --2- 172.21.15.103:0/2932995659 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd7c40b5410 0x7fd7c40b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.075+0000 7fd7dcc00640 1 -- 172.21.15.103:0/2932995659 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fd7d80e6bc0 con 0x7fd7e010b1a0 2024-09-11T01:08:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.075+0000 7fd7dfe00640 1 --2- 172.21.15.103:0/2932995659 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd7c40b5410 0x7fd7c40b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.076+0000 7fd7dfe00640 1 --2- 172.21.15.103:0/2932995659 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd7c40b5410 0x7fd7c40b78d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009780 tx=0x7fd7d0030b90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:22.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.076+0000 7fd7dcc00640 1 -- 172.21.15.103:0/2932995659 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fd7d8024030 con 0x7fd7e010b1a0 2024-09-11T01:08:22.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:21 smithi117 ceph-mon[35358]: from='client.25292 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:08:22.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:21 smithi117 ceph-mon[35358]: mgrmap e19: x(active, since 10m), standbys: z, y 2024-09-11T01:08:22.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:21 smithi117 ceph-mon[35358]: pgmap v400: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-11T01:08:22.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.259+0000 7fd7e5400640 1 -- 172.21.15.103:0/2932995659 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd7e0102770 con 0x7fd7c40b5410 2024-09-11T01:08:22.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.265+0000 7fd7dcc00640 1 -- 172.21.15.103:0/2932995659 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340490 (secure 0 0 0) 0x7fd7e0102770 con 0x7fd7c40b5410 2024-09-11T01:08:22.271 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:08:22.273 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T01:08:22.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.270+0000 7fd7e5400640 1 -- 172.21.15.103:0/2932995659 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd7c40b5410 msgr2=0x7fd7c40b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:22.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.270+0000 7fd7e5400640 1 --2- 172.21.15.103:0/2932995659 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd7c40b5410 0x7fd7c40b78d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009780 tx=0x7fd7d0030b90 comp rx=0 tx=0).stop 2024-09-11T01:08:22.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.270+0000 7fd7e5400640 1 -- 172.21.15.103:0/2932995659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7e010b1a0 msgr2=0x7fd7e01a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:22.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.270+0000 7fd7e5400640 1 --2- 172.21.15.103:0/2932995659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7e010b1a0 0x7fd7e01a0b10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800efc0 tx=0x7fd7d800c800 comp rx=0 tx=0).stop 2024-09-11T01:08:22.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.270+0000 7fd7e5400640 1 -- 172.21.15.103:0/2932995659 shutdown_connections 2024-09-11T01:08:22.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.270+0000 7fd7e5400640 1 --2- 172.21.15.103:0/2932995659 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fd7c40b5410 0x7fd7c40b78d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:22.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.270+0000 7fd7e5400640 1 --2- 172.21.15.103:0/2932995659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd7e010b1a0 0x7fd7e01a0b10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:22.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.270+0000 7fd7e5400640 1 --2- 172.21.15.103:0/2932995659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd7e010a820 0x7fd7e019b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:22.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.270+0000 7fd7e5400640 1 --2- 172.21.15.103:0/2932995659 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fd7e0104e10 0x7fd7e019b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:22.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.270+0000 7fd7e5400640 1 -- 172.21.15.103:0/2932995659 >> 172.21.15.103:0/2932995659 conn(0x7fd7e0100840 msgr2=0x7fd7e0102060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:22.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.270+0000 7fd7e5400640 1 -- 172.21.15.103:0/2932995659 shutdown_connections 2024-09-11T01:08:22.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:22.270+0000 7fd7e5400640 1 -- 172.21.15.103:0/2932995659 wait complete. 2024-09-11T01:08:22.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:22 smithi183 ceph-mon[34992]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:08:23.081 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:22 smithi103 ceph-mon[30562]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:08:23.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:22 smithi117 ceph-mon[35358]: from='client.15291 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:08:23.125 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":400,"stamp":"2024-09-11T01:08:21.554112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664677,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":820,"num_read_kb":511,"num_write":314,"num_write_kb":2289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2953603,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":754,"ondisk_log_size":754,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384000,"kb_used_data":13952,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557824,"statfs":{"total":1151940427776,"available":1151547211776,"internally_reserved":0,"allocated":14286848,"data_stored":8031518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5016,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":41,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003269"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598778+0000","last_change":"2024-09-11T01:05:28.553987+0000","last_active":"2024-09-11T01:06:41.598778+0000","last_peered":"2024-09-11T01:06:41.598778+0000","last_clean":"2024-09-11T01:06:41.598778+0000","last_became_active":"2024-09-11T01:05:28.553691+0000","last_became_peered":"2024-09-11T01:05:28.553691+0000","last_unstale":"2024-09-11T01:06:41.598778+0000","last_undegraded":"2024-09-11T01:06:41.598778+0000","last_fullsized":"2024-09-11T01:06:41.598778+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:50.407880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"89'5","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.761762+0000","last_change":"2024-09-11T01:05:31.677005+0000","last_active":"2024-09-11T01:07:39.761762+0000","last_peered":"2024-09-11T01:07:39.761762+0000","last_clean":"2024-09-11T01:07:39.761762+0000","last_became_active":"2024-09-11T01:05:31.676597+0000","last_became_peered":"2024-09-11T01:05:31.676597+0000","last_unstale":"2024-09-11T01:07:39.761762+0000","last_undegraded":"2024-09-11T01:07:39.761762+0000","last_fullsized":"2024-09-11T01:07:39.761762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:06.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594715+0000","last_change":"2024-09-11T01:05:40.975009+0000","last_active":"2024-09-11T01:06:41.594715+0000","last_peered":"2024-09-11T01:06:41.594715+0000","last_clean":"2024-09-11T01:06:41.594715+0000","last_became_active":"2024-09-11T01:05:40.974546+0000","last_became_peered":"2024-09-11T01:05:40.974546+0000","last_unstale":"2024-09-11T01:06:41.594715+0000","last_undegraded":"2024-09-11T01:06:41.594715+0000","last_fullsized":"2024-09-11T01:06:41.594715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:56.420262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.651381+0000","last_change":"2024-09-11T01:05:28.623367+0000","last_active":"2024-09-11T01:06:41.651381+0000","last_peered":"2024-09-11T01:06:41.651381+0000","last_clean":"2024-09-11T01:06:41.651381+0000","last_became_active":"2024-09-11T01:05:28.622990+0000","last_became_peered":"2024-09-11T01:05:28.622990+0000","last_unstale":"2024-09-11T01:06:41.651381+0000","last_undegraded":"2024-09-11T01:06:41.651381+0000","last_fullsized":"2024-09-11T01:06:41.651381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:35.022280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"89'6","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.770032+0000","last_change":"2024-09-11T01:05:31.693910+0000","last_active":"2024-09-11T01:07:39.770032+0000","last_peered":"2024-09-11T01:07:39.770032+0000","last_clean":"2024-09-11T01:07:39.770032+0000","last_became_active":"2024-09-11T01:05:31.692906+0000","last_became_peered":"2024-09-11T01:05:31.692906+0000","last_unstale":"2024-09-11T01:07:39.770032+0000","last_undegraded":"2024-09-11T01:07:39.770032+0000","last_fullsized":"2024-09-11T01:07:39.770032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:11.906323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595041+0000","last_change":"2024-09-11T01:05:40.975768+0000","last_active":"2024-09-11T01:06:41.595041+0000","last_peered":"2024-09-11T01:06:41.595041+0000","last_clean":"2024-09-11T01:06:41.595041+0000","last_became_active":"2024-09-11T01:05:40.974721+0000","last_became_peered":"2024-09-11T01:05:40.974721+0000","last_unstale":"2024-09-11T01:06:41.595041+0000","last_undegraded":"2024-09-11T01:06:41.595041+0000","last_fullsized":"2024-09-11T01:06:41.595041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:27.475531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599080+0000","last_change":"2024-09-11T01:05:28.558980+0000","last_active":"2024-09-11T01:06:41.599080+0000","last_peered":"2024-09-11T01:06:41.599080+0000","last_clean":"2024-09-11T01:06:41.599080+0000","last_became_active":"2024-09-11T01:05:28.558617+0000","last_became_peered":"2024-09-11T01:05:28.558617+0000","last_unstale":"2024-09-11T01:06:41.599080+0000","last_undegraded":"2024-09-11T01:06:41.599080+0000","last_fullsized":"2024-09-11T01:06:41.599080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:13.659175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764701+0000","last_change":"2024-09-11T01:05:31.664705+0000","last_active":"2024-09-11T01:07:39.764701+0000","last_peered":"2024-09-11T01:07:39.764701+0000","last_clean":"2024-09-11T01:07:39.764701+0000","last_became_active":"2024-09-11T01:05:31.664328+0000","last_became_peered":"2024-09-11T01:05:31.664328+0000","last_unstale":"2024-09-11T01:07:39.764701+0000","last_undegraded":"2024-09-11T01:07:39.764701+0000","last_fullsized":"2024-09-11T01:07:39.764701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:20.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.652585+0000","last_change":"2024-09-11T01:06:41.652143+0000","last_active":"2024-09-11T01:06:41.652585+0000","last_peered":"2024-09-11T01:06:41.652585+0000","last_clean":"2024-09-11T01:06:41.652585+0000","last_became_active":"2024-09-11T01:06:41.651661+0000","last_became_peered":"2024-09-11T01:06:41.651661+0000","last_unstale":"2024-09-11T01:06:41.652585+0000","last_undegraded":"2024-09-11T01:06:41.652585+0000","last_fullsized":"2024-09-11T01:06:41.652585+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:03.377915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,8],"acting":[4,3,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599695+0000","last_change":"2024-09-11T01:05:28.555081+0000","last_active":"2024-09-11T01:06:41.599695+0000","last_peered":"2024-09-11T01:06:41.599695+0000","last_clean":"2024-09-11T01:06:41.599695+0000","last_became_active":"2024-09-11T01:05:28.554562+0000","last_became_peered":"2024-09-11T01:05:28.554562+0000","last_unstale":"2024-09-11T01:06:41.599695+0000","last_undegraded":"2024-09-11T01:06:41.599695+0000","last_fullsized":"2024-09-11T01:06:41.599695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:23.922285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"89'15","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.758235+0000","last_change":"2024-09-11T01:05:31.680442+0000","last_active":"2024-09-11T01:07:39.758235+0000","last_peered":"2024-09-11T01:07:39.758235+0000","last_clean":"2024-09-11T01:07:39.758235+0000","last_became_active":"2024-09-11T01:05:31.680107+0000","last_became_peered":"2024-09-11T01:05:31.680107+0000","last_unstale":"2024-09-11T01:07:39.758235+0000","last_undegraded":"2024-09-11T01:07:39.758235+0000","last_fullsized":"2024-09-11T01:07:39.758235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:16:02.853855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595209+0000","last_change":"2024-09-11T01:05:40.969365+0000","last_active":"2024-09-11T01:06:41.595209+0000","last_peered":"2024-09-11T01:06:41.595209+0000","last_clean":"2024-09-11T01:06:41.595209+0000","last_became_active":"2024-09-11T01:05:40.969005+0000","last_became_peered":"2024-09-11T01:05:40.969005+0000","last_unstale":"2024-09-11T01:06:41.595209+0000","last_undegraded":"2024-09-11T01:06:41.595209+0000","last_fullsized":"2024-09-11T01:06:41.595209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:42.942848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'5","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765784+0000","last_change":"2024-09-11T01:05:31.676943+0000","last_active":"2024-09-11T01:07:39.765784+0000","last_peered":"2024-09-11T01:07:39.765784+0000","last_clean":"2024-09-11T01:07:39.765784+0000","last_became_active":"2024-09-11T01:05:31.676584+0000","last_became_peered":"2024-09-11T01:05:31.676584+0000","last_unstale":"2024-09-11T01:07:39.765784+0000","last_undegraded":"2024-09-11T01:07:39.765784+0000","last_fullsized":"2024-09-11T01:07:39.765784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:08.288439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599214+0000","last_change":"2024-09-11T01:05:28.559196+0000","last_active":"2024-09-11T01:06:41.599214+0000","last_peered":"2024-09-11T01:06:41.599214+0000","last_clean":"2024-09-11T01:06:41.599214+0000","last_became_active":"2024-09-11T01:05:28.558746+0000","last_became_peered":"2024-09-11T01:05:28.558746+0000","last_unstale":"2024-09-11T01:06:41.599214+0000","last_undegraded":"2024-09-11T01:06:41.599214+0000","last_fullsized":"2024-09-11T01:06:41.599214+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:32.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595676+0000","last_change":"2024-09-11T01:05:40.963609+0000","last_active":"2024-09-11T01:06:41.595676+0000","last_peered":"2024-09-11T01:06:41.595676+0000","last_clean":"2024-09-11T01:06:41.595676+0000","last_became_active":"2024-09-11T01:05:40.963088+0000","last_became_peered":"2024-09-11T01:05:40.963088+0000","last_unstale":"2024-09-11T01:06:41.595676+0000","last_undegraded":"2024-09-11T01:06:41.595676+0000","last_fullsized":"2024-09-11T01:06:41.595676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:27.135362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.770097+0000","last_change":"2024-09-11T01:05:31.681258+0000","last_active":"2024-09-11T01:07:39.770097+0000","last_peered":"2024-09-11T01:07:39.770097+0000","last_clean":"2024-09-11T01:07:39.770097+0000","last_became_active":"2024-09-11T01:05:31.680946+0000","last_became_peered":"2024-09-11T01:05:31.680946+0000","last_unstale":"2024-09-11T01:07:39.770097+0000","last_undegraded":"2024-09-11T01:07:39.770097+0000","last_fullsized":"2024-09-11T01:07:39.770097+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:42.047250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:38.596334+0000","last_change":"2024-09-11T01:05:28.554651+0000","last_active":"2024-09-11T01:07:38.596334+0000","last_peered":"2024-09-11T01:07:38.596334+0000","last_clean":"2024-09-11T01:07:38.596334+0000","last_became_active":"2024-09-11T01:05:28.554279+0000","last_became_peered":"2024-09-11T01:05:28.554279+0000","last_unstale":"2024-09-11T01:07:38.596334+0000","last_undegraded":"2024-09-11T01:07:38.596334+0000","last_fullsized":"2024-09-11T01:07:38.596334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:14.093403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.686282+0000","last_change":"2024-09-11T01:06:41.685672+0000","last_active":"2024-09-11T01:06:41.686282+0000","last_peered":"2024-09-11T01:06:41.686282+0000","last_clean":"2024-09-11T01:06:41.686282+0000","last_became_active":"2024-09-11T01:06:41.681272+0000","last_became_peered":"2024-09-11T01:06:41.681272+0000","last_unstale":"2024-09-11T01:06:41.686282+0000","last_undegraded":"2024-09-11T01:06:41.686282+0000","last_fullsized":"2024-09-11T01:06:41.686282+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:53:39.693530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"89'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.762975+0000","last_change":"2024-09-11T01:05:31.681743+0000","last_active":"2024-09-11T01:07:39.762975+0000","last_peered":"2024-09-11T01:07:39.762975+0000","last_clean":"2024-09-11T01:07:39.762975+0000","last_became_active":"2024-09-11T01:05:31.681223+0000","last_became_peered":"2024-09-11T01:05:31.681223+0000","last_unstale":"2024-09-11T01:07:39.762975+0000","last_undegraded":"2024-09-11T01:07:39.762975+0000","last_fullsized":"2024-09-11T01:07:39.762975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:49.449622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.651049+0000","last_change":"2024-09-11T01:05:28.552914+0000","last_active":"2024-09-11T01:06:41.651049+0000","last_peered":"2024-09-11T01:06:41.651049+0000","last_clean":"2024-09-11T01:06:41.651049+0000","last_became_active":"2024-09-11T01:05:28.552404+0000","last_became_peered":"2024-09-11T01:05:28.552404+0000","last_unstale":"2024-09-11T01:06:41.651049+0000","last_undegraded":"2024-09-11T01:06:41.651049+0000","last_fullsized":"2024-09-11T01:06:41.651049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:39.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598657+0000","last_change":"2024-09-11T01:05:40.985652+0000","last_active":"2024-09-11T01:06:41.598657+0000","last_peered":"2024-09-11T01:06:41.598657+0000","last_clean":"2024-09-11T01:06:41.598657+0000","last_became_active":"2024-09-11T01:05:40.984898+0000","last_became_peered":"2024-09-11T01:05:40.984898+0000","last_unstale":"2024-09-11T01:06:41.598657+0000","last_undegraded":"2024-09-11T01:06:41.598657+0000","last_fullsized":"2024-09-11T01:06:41.598657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:58.961342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"89'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.747524+0000","last_change":"2024-09-11T01:05:31.675590+0000","last_active":"2024-09-11T01:07:39.747524+0000","last_peered":"2024-09-11T01:07:39.747524+0000","last_clean":"2024-09-11T01:07:39.747524+0000","last_became_active":"2024-09-11T01:05:31.674426+0000","last_became_peered":"2024-09-11T01:05:31.674426+0000","last_unstale":"2024-09-11T01:07:39.747524+0000","last_undegraded":"2024-09-11T01:07:39.747524+0000","last_fullsized":"2024-09-11T01:07:39.747524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:49.499195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470558+0000","last_change":"2024-09-11T01:05:28.623677+0000","last_active":"2024-09-11T01:06:42.470558+0000","last_peered":"2024-09-11T01:06:42.470558+0000","last_clean":"2024-09-11T01:06:42.470558+0000","last_became_active":"2024-09-11T01:05:28.623357+0000","last_became_peered":"2024-09-11T01:05:28.623357+0000","last_unstale":"2024-09-11T01:06:42.470558+0000","last_undegraded":"2024-09-11T01:06:42.470558+0000","last_fullsized":"2024-09-11T01:06:42.470558+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:10.875425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595506+0000","last_change":"2024-09-11T01:05:40.978136+0000","last_active":"2024-09-11T01:06:41.595506+0000","last_peered":"2024-09-11T01:06:41.595506+0000","last_clean":"2024-09-11T01:06:41.595506+0000","last_became_active":"2024-09-11T01:05:40.977583+0000","last_became_peered":"2024-09-11T01:05:40.977583+0000","last_unstale":"2024-09-11T01:06:41.595506+0000","last_undegraded":"2024-09-11T01:06:41.595506+0000","last_fullsized":"2024-09-11T01:06:41.595506+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:58:20.297640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768246+0000","last_change":"2024-09-11T01:05:31.692938+0000","last_active":"2024-09-11T01:07:39.768246+0000","last_peered":"2024-09-11T01:07:39.768246+0000","last_clean":"2024-09-11T01:07:39.768246+0000","last_became_active":"2024-09-11T01:05:31.689869+0000","last_became_peered":"2024-09-11T01:05:31.689869+0000","last_unstale":"2024-09-11T01:07:39.768246+0000","last_undegraded":"2024-09-11T01:07:39.768246+0000","last_fullsized":"2024-09-11T01:07:39.768246+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:24.820033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595877+0000","last_change":"2024-09-11T01:05:28.755985+0000","last_active":"2024-09-11T01:06:41.595877+0000","last_peered":"2024-09-11T01:06:41.595877+0000","last_clean":"2024-09-11T01:06:41.595877+0000","last_became_active":"2024-09-11T01:05:28.755604+0000","last_became_peered":"2024-09-11T01:05:28.755604+0000","last_unstale":"2024-09-11T01:06:41.595877+0000","last_undegraded":"2024-09-11T01:06:41.595877+0000","last_fullsized":"2024-09-11T01:06:41.595877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:22.570473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594804+0000","last_change":"2024-09-11T01:05:40.963465+0000","last_active":"2024-09-11T01:06:41.594804+0000","last_peered":"2024-09-11T01:06:41.594804+0000","last_clean":"2024-09-11T01:06:41.594804+0000","last_became_active":"2024-09-11T01:05:40.962899+0000","last_became_peered":"2024-09-11T01:05:40.962899+0000","last_unstale":"2024-09-11T01:06:41.594804+0000","last_undegraded":"2024-09-11T01:06:41.594804+0000","last_fullsized":"2024-09-11T01:06:41.594804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:01.728640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"89'5","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765961+0000","last_change":"2024-09-11T01:05:31.675864+0000","last_active":"2024-09-11T01:07:39.765961+0000","last_peered":"2024-09-11T01:07:39.765961+0000","last_clean":"2024-09-11T01:07:39.765961+0000","last_became_active":"2024-09-11T01:05:31.675446+0000","last_became_peered":"2024-09-11T01:05:31.675446+0000","last_unstale":"2024-09-11T01:07:39.765961+0000","last_undegraded":"2024-09-11T01:07:39.765961+0000","last_fullsized":"2024-09-11T01:07:39.765961+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:36.457881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'15","reported_seq":56,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:17.703246+0000","last_change":"2024-09-11T01:05:28.553509+0000","last_active":"2024-09-11T01:08:17.703246+0000","last_peered":"2024-09-11T01:08:17.703246+0000","last_clean":"2024-09-11T01:08:17.703246+0000","last_became_active":"2024-09-11T01:05:28.553101+0000","last_became_peered":"2024-09-11T01:05:28.553101+0000","last_unstale":"2024-09-11T01:08:17.703246+0000","last_undegraded":"2024-09-11T01:08:17.703246+0000","last_fullsized":"2024-09-11T01:08:17.703246+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:41.300518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650601+0000","last_change":"2024-09-11T01:05:40.977146+0000","last_active":"2024-09-11T01:06:41.650601+0000","last_peered":"2024-09-11T01:06:41.650601+0000","last_clean":"2024-09-11T01:06:41.650601+0000","last_became_active":"2024-09-11T01:05:40.976804+0000","last_became_peered":"2024-09-11T01:05:40.976804+0000","last_unstale":"2024-09-11T01:06:41.650601+0000","last_undegraded":"2024-09-11T01:06:41.650601+0000","last_fullsized":"2024-09-11T01:06:41.650601+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:49.753417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.748798+0000","last_change":"2024-09-11T01:05:31.684219+0000","last_active":"2024-09-11T01:07:39.748798+0000","last_peered":"2024-09-11T01:07:39.748798+0000","last_clean":"2024-09-11T01:07:39.748798+0000","last_became_active":"2024-09-11T01:05:31.683937+0000","last_became_peered":"2024-09-11T01:05:31.683937+0000","last_unstale":"2024-09-11T01:07:39.748798+0000","last_undegraded":"2024-09-11T01:07:39.748798+0000","last_fullsized":"2024-09-11T01:07:39.748798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:53.813624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599226+0000","last_change":"2024-09-11T01:05:28.623680+0000","last_active":"2024-09-11T01:06:41.599226+0000","last_peered":"2024-09-11T01:06:41.599226+0000","last_clean":"2024-09-11T01:06:41.599226+0000","last_became_active":"2024-09-11T01:05:28.623261+0000","last_became_peered":"2024-09-11T01:05:28.623261+0000","last_unstale":"2024-09-11T01:06:41.599226+0000","last_undegraded":"2024-09-11T01:06:41.599226+0000","last_fullsized":"2024-09-11T01:06:41.599226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:17.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597628+0000","last_change":"2024-09-11T01:05:40.967165+0000","last_active":"2024-09-11T01:06:41.597628+0000","last_peered":"2024-09-11T01:06:41.597628+0000","last_clean":"2024-09-11T01:06:41.597628+0000","last_became_active":"2024-09-11T01:05:40.966723+0000","last_became_peered":"2024-09-11T01:05:40.966723+0000","last_unstale":"2024-09-11T01:06:41.597628+0000","last_undegraded":"2024-09-11T01:06:41.597628+0000","last_fullsized":"2024-09-11T01:06:41.597628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:48.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"89'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759459+0000","last_change":"2024-09-11T01:05:31.679865+0000","last_active":"2024-09-11T01:07:39.759459+0000","last_peered":"2024-09-11T01:07:39.759459+0000","last_clean":"2024-09-11T01:07:39.759459+0000","last_became_active":"2024-09-11T01:05:31.679494+0000","last_became_peered":"2024-09-11T01:05:31.679494+0000","last_unstale":"2024-09-11T01:07:39.759459+0000","last_undegraded":"2024-09-11T01:07:39.759459+0000","last_fullsized":"2024-09-11T01:07:39.759459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:56.300799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598538+0000","last_change":"2024-09-11T01:05:28.623746+0000","last_active":"2024-09-11T01:06:41.598538+0000","last_peered":"2024-09-11T01:06:41.598538+0000","last_clean":"2024-09-11T01:06:41.598538+0000","last_became_active":"2024-09-11T01:05:28.623358+0000","last_became_peered":"2024-09-11T01:05:28.623358+0000","last_unstale":"2024-09-11T01:06:41.598538+0000","last_undegraded":"2024-09-11T01:06:41.598538+0000","last_fullsized":"2024-09-11T01:06:41.598538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:13.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598180+0000","last_change":"2024-09-11T01:05:40.982108+0000","last_active":"2024-09-11T01:06:41.598180+0000","last_peered":"2024-09-11T01:06:41.598180+0000","last_clean":"2024-09-11T01:06:41.598180+0000","last_became_active":"2024-09-11T01:05:40.981737+0000","last_became_peered":"2024-09-11T01:05:40.981737+0000","last_unstale":"2024-09-11T01:06:41.598180+0000","last_undegraded":"2024-09-11T01:06:41.598180+0000","last_fullsized":"2024-09-11T01:06:41.598180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:16.717933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.751200+0000","last_change":"2024-09-11T01:05:31.680885+0000","last_active":"2024-09-11T01:07:39.751200+0000","last_peered":"2024-09-11T01:07:39.751200+0000","last_clean":"2024-09-11T01:07:39.751200+0000","last_became_active":"2024-09-11T01:05:31.680536+0000","last_became_peered":"2024-09-11T01:05:31.680536+0000","last_unstale":"2024-09-11T01:07:39.751200+0000","last_undegraded":"2024-09-11T01:07:39.751200+0000","last_fullsized":"2024-09-11T01:07:39.751200+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:12.963321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598709+0000","last_change":"2024-09-11T01:05:28.553957+0000","last_active":"2024-09-11T01:06:41.598709+0000","last_peered":"2024-09-11T01:06:41.598709+0000","last_clean":"2024-09-11T01:06:41.598709+0000","last_became_active":"2024-09-11T01:05:28.553572+0000","last_became_peered":"2024-09-11T01:05:28.553572+0000","last_unstale":"2024-09-11T01:06:41.598709+0000","last_undegraded":"2024-09-11T01:06:41.598709+0000","last_fullsized":"2024-09-11T01:06:41.598709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:14.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595235+0000","last_change":"2024-09-11T01:05:40.971221+0000","last_active":"2024-09-11T01:06:41.595235+0000","last_peered":"2024-09-11T01:06:41.595235+0000","last_clean":"2024-09-11T01:06:41.595235+0000","last_became_active":"2024-09-11T01:05:40.970063+0000","last_became_peered":"2024-09-11T01:05:40.970063+0000","last_unstale":"2024-09-11T01:06:41.595235+0000","last_undegraded":"2024-09-11T01:06:41.595235+0000","last_fullsized":"2024-09-11T01:06:41.595235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:46.299357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"89'8","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.754941+0000","last_change":"2024-09-11T01:05:31.677125+0000","last_active":"2024-09-11T01:07:39.754941+0000","last_peered":"2024-09-11T01:07:39.754941+0000","last_clean":"2024-09-11T01:07:39.754941+0000","last_became_active":"2024-09-11T01:05:31.676803+0000","last_became_peered":"2024-09-11T01:05:31.676803+0000","last_unstale":"2024-09-11T01:07:39.754941+0000","last_undegraded":"2024-09-11T01:07:39.754941+0000","last_fullsized":"2024-09-11T01:07:39.754941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:01:38.922178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:16.835476+0000","last_change":"2024-09-11T01:05:28.623895+0000","last_active":"2024-09-11T01:08:16.835476+0000","last_peered":"2024-09-11T01:08:16.835476+0000","last_clean":"2024-09-11T01:08:16.835476+0000","last_became_active":"2024-09-11T01:05:28.623520+0000","last_became_peered":"2024-09-11T01:05:28.623520+0000","last_unstale":"2024-09-11T01:08:16.835476+0000","last_undegraded":"2024-09-11T01:08:16.835476+0000","last_fullsized":"2024-09-11T01:08:16.835476+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:22.309521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595201+0000","last_change":"2024-09-11T01:05:40.974416+0000","last_active":"2024-09-11T01:06:41.595201+0000","last_peered":"2024-09-11T01:06:41.595201+0000","last_clean":"2024-09-11T01:06:41.595201+0000","last_became_active":"2024-09-11T01:05:40.973990+0000","last_became_peered":"2024-09-11T01:05:40.973990+0000","last_unstale":"2024-09-11T01:06:41.595201+0000","last_undegraded":"2024-09-11T01:06:41.595201+0000","last_fullsized":"2024-09-11T01:06:41.595201+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:30.018876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"89'5","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759166+0000","last_change":"2024-09-11T01:05:31.688968+0000","last_active":"2024-09-11T01:07:39.759166+0000","last_peered":"2024-09-11T01:07:39.759166+0000","last_clean":"2024-09-11T01:07:39.759166+0000","last_became_active":"2024-09-11T01:05:31.688672+0000","last_became_peered":"2024-09-11T01:05:31.688672+0000","last_unstale":"2024-09-11T01:07:39.759166+0000","last_undegraded":"2024-09-11T01:07:39.759166+0000","last_fullsized":"2024-09-11T01:07:39.759166+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:39.080386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597789+0000","last_change":"2024-09-11T01:05:28.554126+0000","last_active":"2024-09-11T01:06:41.597789+0000","last_peered":"2024-09-11T01:06:41.597789+0000","last_clean":"2024-09-11T01:06:41.597789+0000","last_became_active":"2024-09-11T01:05:28.553575+0000","last_became_peered":"2024-09-11T01:05:28.553575+0000","last_unstale":"2024-09-11T01:06:41.597789+0000","last_undegraded":"2024-09-11T01:06:41.597789+0000","last_fullsized":"2024-09-11T01:06:41.597789+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:42.203339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683998+0000","last_change":"2024-09-11T01:05:40.980415+0000","last_active":"2024-09-11T01:06:41.683998+0000","last_peered":"2024-09-11T01:06:41.683998+0000","last_clean":"2024-09-11T01:06:41.683998+0000","last_became_active":"2024-09-11T01:05:40.980062+0000","last_became_peered":"2024-09-11T01:05:40.980062+0000","last_unstale":"2024-09-11T01:06:41.683998+0000","last_undegraded":"2024-09-11T01:06:41.683998+0000","last_fullsized":"2024-09-11T01:06:41.683998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:25.889972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765210+0000","last_change":"2024-09-11T01:05:31.679622+0000","last_active":"2024-09-11T01:07:39.765210+0000","last_peered":"2024-09-11T01:07:39.765210+0000","last_clean":"2024-09-11T01:07:39.765210+0000","last_became_active":"2024-09-11T01:05:31.679239+0000","last_became_peered":"2024-09-11T01:05:31.679239+0000","last_unstale":"2024-09-11T01:07:39.765210+0000","last_undegraded":"2024-09-11T01:07:39.765210+0000","last_fullsized":"2024-09-11T01:07:39.765210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:32.240196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595578+0000","last_change":"2024-09-11T01:05:28.552203+0000","last_active":"2024-09-11T01:06:41.595578+0000","last_peered":"2024-09-11T01:06:41.595578+0000","last_clean":"2024-09-11T01:06:41.595578+0000","last_became_active":"2024-09-11T01:05:28.551658+0000","last_became_peered":"2024-09-11T01:05:28.551658+0000","last_unstale":"2024-09-11T01:06:41.595578+0000","last_undegraded":"2024-09-11T01:06:41.595578+0000","last_fullsized":"2024-09-11T01:06:41.595578+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:46.102466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":117,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598067+0000","last_change":"2024-09-11T01:04:12.299017+0000","last_active":"2024-09-11T01:06:41.598067+0000","last_peered":"2024-09-11T01:06:41.598067+0000","last_clean":"2024-09-11T01:06:41.598067+0000","last_became_active":"2024-09-11T01:04:11.998504+0000","last_became_peered":"2024-09-11T01:04:11.998504+0000","last_unstale":"2024-09-11T01:06:41.598067+0000","last_undegraded":"2024-09-11T01:06:41.598067+0000","last_fullsized":"2024-09-11T01:06:41.598067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:00:34.569322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:00:34.569322+0000","last_clean_scrub_stamp":"2024-09-11T01:00:34.569322+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:54.949789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597966+0000","last_change":"2024-09-11T01:05:40.982181+0000","last_active":"2024-09-11T01:06:41.597966+0000","last_peered":"2024-09-11T01:06:41.597966+0000","last_clean":"2024-09-11T01:06:41.597966+0000","last_became_active":"2024-09-11T01:05:40.981668+0000","last_became_peered":"2024-09-11T01:05:40.981668+0000","last_unstale":"2024-09-11T01:06:41.597966+0000","last_undegraded":"2024-09-11T01:06:41.597966+0000","last_fullsized":"2024-09-11T01:06:41.597966+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:48.199189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"89'7","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764704+0000","last_change":"2024-09-11T01:05:31.677978+0000","last_active":"2024-09-11T01:07:39.764704+0000","last_peered":"2024-09-11T01:07:39.764704+0000","last_clean":"2024-09-11T01:07:39.764704+0000","last_became_active":"2024-09-11T01:05:31.677478+0000","last_became_peered":"2024-09-11T01:05:31.677478+0000","last_unstale":"2024-09-11T01:07:39.764704+0000","last_undegraded":"2024-09-11T01:07:39.764704+0000","last_fullsized":"2024-09-11T01:07:39.764704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:39.568921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595451+0000","last_change":"2024-09-11T01:05:28.755866+0000","last_active":"2024-09-11T01:06:41.595451+0000","last_peered":"2024-09-11T01:06:41.595451+0000","last_clean":"2024-09-11T01:06:41.595451+0000","last_became_active":"2024-09-11T01:05:28.755475+0000","last_became_peered":"2024-09-11T01:05:28.755475+0000","last_unstale":"2024-09-11T01:06:41.595451+0000","last_undegraded":"2024-09-11T01:06:41.595451+0000","last_fullsized":"2024-09-11T01:06:41.595451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:22.324584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470249+0000","last_change":"2024-09-11T01:05:40.967181+0000","last_active":"2024-09-11T01:06:42.470249+0000","last_peered":"2024-09-11T01:06:42.470249+0000","last_clean":"2024-09-11T01:06:42.470249+0000","last_became_active":"2024-09-11T01:05:40.966748+0000","last_became_peered":"2024-09-11T01:05:40.966748+0000","last_unstale":"2024-09-11T01:06:42.470249+0000","last_undegraded":"2024-09-11T01:06:42.470249+0000","last_fullsized":"2024-09-11T01:06:42.470249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:15:28.446190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"89'6","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.763173+0000","last_change":"2024-09-11T01:05:40.981823+0000","last_active":"2024-09-11T01:07:39.763173+0000","last_peered":"2024-09-11T01:07:39.763173+0000","last_clean":"2024-09-11T01:07:39.763173+0000","last_became_active":"2024-09-11T01:05:40.981478+0000","last_became_peered":"2024-09-11T01:05:40.981478+0000","last_unstale":"2024-09-11T01:07:39.763173+0000","last_undegraded":"2024-09-11T01:07:39.763173+0000","last_fullsized":"2024-09-11T01:07:39.763173+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:55.848492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.684119+0000","last_change":"2024-09-11T01:05:28.549207+0000","last_active":"2024-09-11T01:06:41.684119+0000","last_peered":"2024-09-11T01:06:41.684119+0000","last_clean":"2024-09-11T01:06:41.684119+0000","last_became_active":"2024-09-11T01:05:28.548156+0000","last_became_peered":"2024-09-11T01:05:28.548156+0000","last_unstale":"2024-09-11T01:06:41.684119+0000","last_undegraded":"2024-09-11T01:06:41.684119+0000","last_fullsized":"2024-09-11T01:06:41.684119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:58.698379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470360+0000","last_change":"2024-09-11T01:05:40.982213+0000","last_active":"2024-09-11T01:06:42.470360+0000","last_peered":"2024-09-11T01:06:42.470360+0000","last_clean":"2024-09-11T01:06:42.470360+0000","last_became_active":"2024-09-11T01:05:40.981066+0000","last_became_peered":"2024-09-11T01:05:40.981066+0000","last_unstale":"2024-09-11T01:06:42.470360+0000","last_undegraded":"2024-09-11T01:06:42.470360+0000","last_fullsized":"2024-09-11T01:06:42.470360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:09.348973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759808+0000","last_change":"2024-09-11T01:05:31.677613+0000","last_active":"2024-09-11T01:07:39.759808+0000","last_peered":"2024-09-11T01:07:39.759808+0000","last_clean":"2024-09-11T01:07:39.759808+0000","last_became_active":"2024-09-11T01:05:31.677263+0000","last_became_peered":"2024-09-11T01:05:31.677263+0000","last_unstale":"2024-09-11T01:07:39.759808+0000","last_undegraded":"2024-09-11T01:07:39.759808+0000","last_fullsized":"2024-09-11T01:07:39.759808+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:32.490982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595401+0000","last_change":"2024-09-11T01:05:28.558437+0000","last_active":"2024-09-11T01:06:41.595401+0000","last_peered":"2024-09-11T01:06:41.595401+0000","last_clean":"2024-09-11T01:06:41.595401+0000","last_became_active":"2024-09-11T01:05:28.558070+0000","last_became_peered":"2024-09-11T01:05:28.558070+0000","last_unstale":"2024-09-11T01:06:41.595401+0000","last_undegraded":"2024-09-11T01:06:41.595401+0000","last_fullsized":"2024-09-11T01:06:41.595401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:26.589209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683031+0000","last_change":"2024-09-11T01:05:40.970422+0000","last_active":"2024-09-11T01:06:41.683031+0000","last_peered":"2024-09-11T01:06:41.683031+0000","last_clean":"2024-09-11T01:06:41.683031+0000","last_became_active":"2024-09-11T01:05:40.970087+0000","last_became_peered":"2024-09-11T01:05:40.970087+0000","last_unstale":"2024-09-11T01:06:41.683031+0000","last_undegraded":"2024-09-11T01:06:41.683031+0000","last_fullsized":"2024-09-11T01:06:41.683031+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:05.171700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.751047+0000","last_change":"2024-09-11T01:05:40.967014+0000","last_active":"2024-09-11T01:07:39.751047+0000","last_peered":"2024-09-11T01:07:39.751047+0000","last_clean":"2024-09-11T01:07:39.751047+0000","last_became_active":"2024-09-11T01:05:40.966567+0000","last_became_peered":"2024-09-11T01:05:40.966567+0000","last_unstale":"2024-09-11T01:07:39.751047+0000","last_undegraded":"2024-09-11T01:07:39.751047+0000","last_fullsized":"2024-09-11T01:07:39.751047+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:50.868245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599221+0000","last_change":"2024-09-11T01:05:28.553646+0000","last_active":"2024-09-11T01:06:41.599221+0000","last_peered":"2024-09-11T01:06:41.599221+0000","last_clean":"2024-09-11T01:06:41.599221+0000","last_became_active":"2024-09-11T01:05:28.553238+0000","last_became_peered":"2024-09-11T01:05:28.553238+0000","last_unstale":"2024-09-11T01:06:41.599221+0000","last_undegraded":"2024-09-11T01:06:41.599221+0000","last_fullsized":"2024-09-11T01:06:41.599221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:31.670321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683191+0000","last_change":"2024-09-11T01:05:40.973220+0000","last_active":"2024-09-11T01:06:41.683191+0000","last_peered":"2024-09-11T01:06:41.683191+0000","last_clean":"2024-09-11T01:06:41.683191+0000","last_became_active":"2024-09-11T01:05:40.972843+0000","last_became_peered":"2024-09-11T01:05:40.972843+0000","last_unstale":"2024-09-11T01:06:41.683191+0000","last_undegraded":"2024-09-11T01:06:41.683191+0000","last_fullsized":"2024-09-11T01:06:41.683191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:07.785474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"89'6","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.758209+0000","last_change":"2024-09-11T01:05:31.682064+0000","last_active":"2024-09-11T01:07:39.758209+0000","last_peered":"2024-09-11T01:07:39.758209+0000","last_clean":"2024-09-11T01:07:39.758209+0000","last_became_active":"2024-09-11T01:05:31.681744+0000","last_became_peered":"2024-09-11T01:05:31.681744+0000","last_unstale":"2024-09-11T01:07:39.758209+0000","last_undegraded":"2024-09-11T01:07:39.758209+0000","last_fullsized":"2024-09-11T01:07:39.758209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:29.055133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597128+0000","last_change":"2024-09-11T01:05:40.986656+0000","last_active":"2024-09-11T01:06:41.597128+0000","last_peered":"2024-09-11T01:06:41.597128+0000","last_clean":"2024-09-11T01:06:41.597128+0000","last_became_active":"2024-09-11T01:05:40.970230+0000","last_became_peered":"2024-09-11T01:05:40.970230+0000","last_unstale":"2024-09-11T01:06:41.597128+0000","last_undegraded":"2024-09-11T01:06:41.597128+0000","last_fullsized":"2024-09-11T01:06:41.597128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:25.468986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595300+0000","last_change":"2024-09-11T01:05:40.980843+0000","last_active":"2024-09-11T01:06:41.595300+0000","last_peered":"2024-09-11T01:06:41.595300+0000","last_clean":"2024-09-11T01:06:41.595300+0000","last_became_active":"2024-09-11T01:05:40.979033+0000","last_became_peered":"2024-09-11T01:05:40.979033+0000","last_unstale":"2024-09-11T01:06:41.595300+0000","last_undegraded":"2024-09-11T01:06:41.595300+0000","last_fullsized":"2024-09-11T01:06:41.595300+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:44.039548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"89'6","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.756220+0000","last_change":"2024-09-11T01:05:31.676046+0000","last_active":"2024-09-11T01:07:39.756220+0000","last_peered":"2024-09-11T01:07:39.756220+0000","last_clean":"2024-09-11T01:07:39.756220+0000","last_became_active":"2024-09-11T01:05:31.675704+0000","last_became_peered":"2024-09-11T01:05:31.675704+0000","last_unstale":"2024-09-11T01:07:39.756220+0000","last_undegraded":"2024-09-11T01:07:39.756220+0000","last_fullsized":"2024-09-11T01:07:39.756220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:17.907270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'5","reported_seq":169,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:16.836385+0000","last_change":"2024-09-11T01:05:28.550131+0000","last_active":"2024-09-11T01:08:16.836385+0000","last_peered":"2024-09-11T01:08:16.836385+0000","last_clean":"2024-09-11T01:08:16.836385+0000","last_became_active":"2024-09-11T01:05:28.549561+0000","last_became_peered":"2024-09-11T01:05:28.549561+0000","last_unstale":"2024-09-11T01:08:16.836385+0000","last_undegraded":"2024-09-11T01:08:16.836385+0000","last_fullsized":"2024-09-11T01:08:16.836385+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:52.001757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598656+0000","last_change":"2024-09-11T01:05:40.984877+0000","last_active":"2024-09-11T01:06:41.598656+0000","last_peered":"2024-09-11T01:06:41.598656+0000","last_clean":"2024-09-11T01:06:41.598656+0000","last_became_active":"2024-09-11T01:05:40.984500+0000","last_became_peered":"2024-09-11T01:05:40.984500+0000","last_unstale":"2024-09-11T01:06:41.598656+0000","last_undegraded":"2024-09-11T01:06:41.598656+0000","last_fullsized":"2024-09-11T01:06:41.598656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:44.309560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"89'15","reported_seq":58,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.766111+0000","last_change":"2024-09-11T01:05:40.976014+0000","last_active":"2024-09-11T01:07:39.766111+0000","last_peered":"2024-09-11T01:07:39.766111+0000","last_clean":"2024-09-11T01:07:39.766111+0000","last_became_active":"2024-09-11T01:05:40.975610+0000","last_became_peered":"2024-09-11T01:05:40.975610+0000","last_unstale":"2024-09-11T01:07:39.766111+0000","last_undegraded":"2024-09-11T01:07:39.766111+0000","last_fullsized":"2024-09-11T01:07:39.766111+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:26.920957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683533+0000","last_change":"2024-09-11T01:05:28.553043+0000","last_active":"2024-09-11T01:06:41.683533+0000","last_peered":"2024-09-11T01:06:41.683533+0000","last_clean":"2024-09-11T01:06:41.683533+0000","last_became_active":"2024-09-11T01:05:28.552678+0000","last_became_peered":"2024-09-11T01:05:28.552678+0000","last_unstale":"2024-09-11T01:06:41.683533+0000","last_undegraded":"2024-09-11T01:06:41.683533+0000","last_fullsized":"2024-09-11T01:06:41.683533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:23.279056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.601347+0000","last_change":"2024-09-11T01:06:41.600861+0000","last_active":"2024-09-11T01:06:41.601347+0000","last_peered":"2024-09-11T01:06:41.601347+0000","last_clean":"2024-09-11T01:06:41.601347+0000","last_became_active":"2024-09-11T01:06:41.600314+0000","last_became_peered":"2024-09-11T01:06:41.600314+0000","last_unstale":"2024-09-11T01:06:41.601347+0000","last_undegraded":"2024-09-11T01:06:41.601347+0000","last_fullsized":"2024-09-11T01:06:41.601347+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:29.070620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765346+0000","last_change":"2024-09-11T01:05:31.674324+0000","last_active":"2024-09-11T01:07:39.765346+0000","last_peered":"2024-09-11T01:07:39.765346+0000","last_clean":"2024-09-11T01:07:39.765346+0000","last_became_active":"2024-09-11T01:05:31.673648+0000","last_became_peered":"2024-09-11T01:05:31.673648+0000","last_unstale":"2024-09-11T01:07:39.765346+0000","last_undegraded":"2024-09-11T01:07:39.765346+0000","last_fullsized":"2024-09-11T01:07:39.765346+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:02.134422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597403+0000","last_change":"2024-09-11T01:05:40.972605+0000","last_active":"2024-09-11T01:06:41.597403+0000","last_peered":"2024-09-11T01:06:41.597403+0000","last_clean":"2024-09-11T01:06:41.597403+0000","last_became_active":"2024-09-11T01:05:40.961704+0000","last_became_peered":"2024-09-11T01:05:40.961704+0000","last_unstale":"2024-09-11T01:06:41.597403+0000","last_undegraded":"2024-09-11T01:06:41.597403+0000","last_fullsized":"2024-09-11T01:06:41.597403+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:45.276739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683867+0000","last_change":"2024-09-11T01:05:40.969424+0000","last_active":"2024-09-11T01:06:41.683867+0000","last_peered":"2024-09-11T01:06:41.683867+0000","last_clean":"2024-09-11T01:06:41.683867+0000","last_became_active":"2024-09-11T01:05:40.968994+0000","last_became_peered":"2024-09-11T01:05:40.968994+0000","last_unstale":"2024-09-11T01:06:41.683867+0000","last_undegraded":"2024-09-11T01:06:41.683867+0000","last_fullsized":"2024-09-11T01:06:41.683867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:08.554953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"89'6","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.755700+0000","last_change":"2024-09-11T01:05:31.675764+0000","last_active":"2024-09-11T01:07:39.755700+0000","last_peered":"2024-09-11T01:07:39.755700+0000","last_clean":"2024-09-11T01:07:39.755700+0000","last_became_active":"2024-09-11T01:05:31.674553+0000","last_became_peered":"2024-09-11T01:05:31.674553+0000","last_unstale":"2024-09-11T01:07:39.755700+0000","last_undegraded":"2024-09-11T01:07:39.755700+0000","last_fullsized":"2024-09-11T01:07:39.755700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:30.026758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'39","reported_seq":347,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:18.826051+0000","last_change":"2024-09-11T01:05:40.975735+0000","last_active":"2024-09-11T01:08:18.826051+0000","last_peered":"2024-09-11T01:08:18.826051+0000","last_clean":"2024-09-11T01:08:18.826051+0000","last_became_active":"2024-09-11T01:05:40.964582+0000","last_became_peered":"2024-09-11T01:05:40.964582+0000","last_unstale":"2024-09-11T01:08:18.826051+0000","last_undegraded":"2024-09-11T01:08:18.826051+0000","last_fullsized":"2024-09-11T01:08:18.826051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:57.424468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69401,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":250,"num_read_kb":188,"num_write":40,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597830+0000","last_change":"2024-09-11T01:05:40.981306+0000","last_active":"2024-09-11T01:06:41.597830+0000","last_peered":"2024-09-11T01:06:41.597830+0000","last_clean":"2024-09-11T01:06:41.597830+0000","last_became_active":"2024-09-11T01:05:40.977531+0000","last_became_peered":"2024-09-11T01:05:40.977531+0000","last_unstale":"2024-09-11T01:06:41.597830+0000","last_undegraded":"2024-09-11T01:06:41.597830+0000","last_fullsized":"2024-09-11T01:06:41.597830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:21.613080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"89'11","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764170+0000","last_change":"2024-09-11T01:05:31.681612+0000","last_active":"2024-09-11T01:07:39.764170+0000","last_peered":"2024-09-11T01:07:39.764170+0000","last_clean":"2024-09-11T01:07:39.764170+0000","last_became_active":"2024-09-11T01:05:31.680609+0000","last_became_peered":"2024-09-11T01:05:31.680609+0000","last_unstale":"2024-09-11T01:07:39.764170+0000","last_undegraded":"2024-09-11T01:07:39.764170+0000","last_fullsized":"2024-09-11T01:07:39.764170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:44.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.684460+0000","last_change":"2024-09-11T01:05:28.625177+0000","last_active":"2024-09-11T01:06:41.684460+0000","last_peered":"2024-09-11T01:06:41.684460+0000","last_clean":"2024-09-11T01:06:41.684460+0000","last_became_active":"2024-09-11T01:05:28.624819+0000","last_became_peered":"2024-09-11T01:05:28.624819+0000","last_unstale":"2024-09-11T01:06:41.684460+0000","last_undegraded":"2024-09-11T01:06:41.684460+0000","last_fullsized":"2024-09-11T01:06:41.684460+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:11.709636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595371+0000","last_change":"2024-09-11T01:05:40.978481+0000","last_active":"2024-09-11T01:06:41.595371+0000","last_peered":"2024-09-11T01:06:41.595371+0000","last_clean":"2024-09-11T01:06:41.595371+0000","last_became_active":"2024-09-11T01:05:40.977501+0000","last_became_peered":"2024-09-11T01:05:40.977501+0000","last_unstale":"2024-09-11T01:06:41.595371+0000","last_undegraded":"2024-09-11T01:06:41.595371+0000","last_fullsized":"2024-09-11T01:06:41.595371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:08.427274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"89'9","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.770113+0000","last_change":"2024-09-11T01:05:31.692675+0000","last_active":"2024-09-11T01:07:39.770113+0000","last_peered":"2024-09-11T01:07:39.770113+0000","last_clean":"2024-09-11T01:07:39.770113+0000","last_became_active":"2024-09-11T01:05:31.690308+0000","last_became_peered":"2024-09-11T01:05:31.690308+0000","last_unstale":"2024-09-11T01:07:39.770113+0000","last_undegraded":"2024-09-11T01:07:39.770113+0000","last_fullsized":"2024-09-11T01:07:39.770113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:14.823786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598101+0000","last_change":"2024-09-11T01:05:28.557868+0000","last_active":"2024-09-11T01:06:41.598101+0000","last_peered":"2024-09-11T01:06:41.598101+0000","last_clean":"2024-09-11T01:06:41.598101+0000","last_became_active":"2024-09-11T01:05:28.557512+0000","last_became_peered":"2024-09-11T01:05:28.557512+0000","last_unstale":"2024-09-11T01:06:41.598101+0000","last_undegraded":"2024-09-11T01:06:41.598101+0000","last_fullsized":"2024-09-11T01:06:41.598101+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:50.733551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597725+0000","last_change":"2024-09-11T01:05:40.982368+0000","last_active":"2024-09-11T01:06:41.597725+0000","last_peered":"2024-09-11T01:06:41.597725+0000","last_clean":"2024-09-11T01:06:41.597725+0000","last_became_active":"2024-09-11T01:05:40.980337+0000","last_became_peered":"2024-09-11T01:05:40.980337+0000","last_unstale":"2024-09-11T01:06:41.597725+0000","last_undegraded":"2024-09-11T01:06:41.597725+0000","last_fullsized":"2024-09-11T01:06:41.597725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:22.010496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"89'10","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.760342+0000","last_change":"2024-09-11T01:05:31.670806+0000","last_active":"2024-09-11T01:07:39.760342+0000","last_peered":"2024-09-11T01:07:39.760342+0000","last_clean":"2024-09-11T01:07:39.760342+0000","last_became_active":"2024-09-11T01:05:31.670452+0000","last_became_peered":"2024-09-11T01:05:31.670452+0000","last_unstale":"2024-09-11T01:07:39.760342+0000","last_undegraded":"2024-09-11T01:07:39.760342+0000","last_fullsized":"2024-09-11T01:07:39.760342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:22.489650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'5","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:17.823576+0000","last_change":"2024-09-11T01:05:28.555885+0000","last_active":"2024-09-11T01:08:17.823576+0000","last_peered":"2024-09-11T01:08:17.823576+0000","last_clean":"2024-09-11T01:08:17.823576+0000","last_became_active":"2024-09-11T01:05:28.555471+0000","last_became_peered":"2024-09-11T01:05:28.555471+0000","last_unstale":"2024-09-11T01:08:17.823576+0000","last_undegraded":"2024-09-11T01:08:17.823576+0000","last_fullsized":"2024-09-11T01:08:17.823576+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:50.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650778+0000","last_change":"2024-09-11T01:05:40.971982+0000","last_active":"2024-09-11T01:06:41.650778+0000","last_peered":"2024-09-11T01:06:41.650778+0000","last_clean":"2024-09-11T01:06:41.650778+0000","last_became_active":"2024-09-11T01:05:40.971614+0000","last_became_peered":"2024-09-11T01:05:40.971614+0000","last_unstale":"2024-09-11T01:06:41.650778+0000","last_undegraded":"2024-09-11T01:06:41.650778+0000","last_fullsized":"2024-09-11T01:06:41.650778+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:11.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470557+0000","last_change":"2024-09-11T01:05:40.972734+0000","last_active":"2024-09-11T01:06:42.470557+0000","last_peered":"2024-09-11T01:06:42.470557+0000","last_clean":"2024-09-11T01:06:42.470557+0000","last_became_active":"2024-09-11T01:05:40.969428+0000","last_became_peered":"2024-09-11T01:05:40.969428+0000","last_unstale":"2024-09-11T01:06:42.470557+0000","last_undegraded":"2024-09-11T01:06:42.470557+0000","last_fullsized":"2024-09-11T01:06:42.470557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:30.199055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.762803+0000","last_change":"2024-09-11T01:05:31.684114+0000","last_active":"2024-09-11T01:07:39.762803+0000","last_peered":"2024-09-11T01:07:39.762803+0000","last_clean":"2024-09-11T01:07:39.762803+0000","last_became_active":"2024-09-11T01:05:31.683830+0000","last_became_peered":"2024-09-11T01:05:31.683830+0000","last_unstale":"2024-09-11T01:07:39.762803+0000","last_undegraded":"2024-09-11T01:07:39.762803+0000","last_fullsized":"2024-09-11T01:07:39.762803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:43.695706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683722+0000","last_change":"2024-09-11T01:05:28.554745+0000","last_active":"2024-09-11T01:06:41.683722+0000","last_peered":"2024-09-11T01:06:41.683722+0000","last_clean":"2024-09-11T01:06:41.683722+0000","last_became_active":"2024-09-11T01:05:28.554354+0000","last_became_peered":"2024-09-11T01:05:28.554354+0000","last_unstale":"2024-09-11T01:06:41.683722+0000","last_undegraded":"2024-09-11T01:06:41.683722+0000","last_fullsized":"2024-09-11T01:06:41.683722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:33.663536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597505+0000","last_change":"2024-09-11T01:05:40.974956+0000","last_active":"2024-09-11T01:06:41.597505+0000","last_peered":"2024-09-11T01:06:41.597505+0000","last_clean":"2024-09-11T01:06:41.597505+0000","last_became_active":"2024-09-11T01:05:40.974434+0000","last_became_peered":"2024-09-11T01:05:40.974434+0000","last_unstale":"2024-09-11T01:06:41.597505+0000","last_undegraded":"2024-09-11T01:06:41.597505+0000","last_fullsized":"2024-09-11T01:06:41.597505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:01.196098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767222+0000","last_change":"2024-09-11T01:05:31.679904+0000","last_active":"2024-09-11T01:07:39.767222+0000","last_peered":"2024-09-11T01:07:39.767222+0000","last_clean":"2024-09-11T01:07:39.767222+0000","last_became_active":"2024-09-11T01:05:31.679517+0000","last_became_peered":"2024-09-11T01:05:31.679517+0000","last_unstale":"2024-09-11T01:07:39.767222+0000","last_undegraded":"2024-09-11T01:07:39.767222+0000","last_fullsized":"2024-09-11T01:07:39.767222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:24.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594664+0000","last_change":"2024-09-11T01:05:28.549752+0000","last_active":"2024-09-11T01:06:41.594664+0000","last_peered":"2024-09-11T01:06:41.594664+0000","last_clean":"2024-09-11T01:06:41.594664+0000","last_became_active":"2024-09-11T01:05:28.549253+0000","last_became_peered":"2024-09-11T01:05:28.549253+0000","last_unstale":"2024-09-11T01:06:41.594664+0000","last_undegraded":"2024-09-11T01:06:41.594664+0000","last_fullsized":"2024-09-11T01:06:41.594664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:25.774363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.680318+0000","last_change":"2024-09-11T01:05:28.553118+0000","last_active":"2024-09-11T01:06:41.680318+0000","last_peered":"2024-09-11T01:06:41.680318+0000","last_clean":"2024-09-11T01:06:41.680318+0000","last_became_active":"2024-09-11T01:05:28.552779+0000","last_became_peered":"2024-09-11T01:05:28.552779+0000","last_unstale":"2024-09-11T01:06:41.680318+0000","last_undegraded":"2024-09-11T01:06:41.680318+0000","last_fullsized":"2024-09-11T01:06:41.680318+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:58.297579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"89'8","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.762664+0000","last_change":"2024-09-11T01:05:40.981936+0000","last_active":"2024-09-11T01:07:39.762664+0000","last_peered":"2024-09-11T01:07:39.762664+0000","last_clean":"2024-09-11T01:07:39.762664+0000","last_became_active":"2024-09-11T01:05:40.981623+0000","last_became_peered":"2024-09-11T01:05:40.981623+0000","last_unstale":"2024-09-11T01:07:39.762664+0000","last_undegraded":"2024-09-11T01:07:39.762664+0000","last_fullsized":"2024-09-11T01:07:39.762664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:14.773406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.690918+0000","last_change":"2024-09-11T01:06:41.685046+0000","last_active":"2024-09-11T01:06:41.690918+0000","last_peered":"2024-09-11T01:06:41.690918+0000","last_clean":"2024-09-11T01:06:41.690918+0000","last_became_active":"2024-09-11T01:06:41.684442+0000","last_became_peered":"2024-09-11T01:06:41.684442+0000","last_unstale":"2024-09-11T01:06:41.690918+0000","last_undegraded":"2024-09-11T01:06:41.690918+0000","last_fullsized":"2024-09-11T01:06:41.690918+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:51.290772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'7","reported_seq":170,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:15.821062+0000","last_change":"2024-09-11T01:05:28.553479+0000","last_active":"2024-09-11T01:08:15.821062+0000","last_peered":"2024-09-11T01:08:15.821062+0000","last_clean":"2024-09-11T01:08:15.821062+0000","last_became_active":"2024-09-11T01:05:28.553171+0000","last_became_peered":"2024-09-11T01:05:28.553171+0000","last_unstale":"2024-09-11T01:08:15.821062+0000","last_undegraded":"2024-09-11T01:08:15.821062+0000","last_fullsized":"2024-09-11T01:08:15.821062+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:04.877982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.760071+0000","last_change":"2024-09-11T01:05:40.982070+0000","last_active":"2024-09-11T01:07:39.760071+0000","last_peered":"2024-09-11T01:07:39.760071+0000","last_clean":"2024-09-11T01:07:39.760071+0000","last_became_active":"2024-09-11T01:05:40.981601+0000","last_became_peered":"2024-09-11T01:05:40.981601+0000","last_unstale":"2024-09-11T01:07:39.760071+0000","last_undegraded":"2024-09-11T01:07:39.760071+0000","last_fullsized":"2024-09-11T01:07:39.760071+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:31.409711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595121+0000","last_change":"2024-09-11T01:05:40.967374+0000","last_active":"2024-09-11T01:06:41.595121+0000","last_peered":"2024-09-11T01:06:41.595121+0000","last_clean":"2024-09-11T01:06:41.595121+0000","last_became_active":"2024-09-11T01:05:40.966705+0000","last_became_peered":"2024-09-11T01:05:40.966705+0000","last_unstale":"2024-09-11T01:06:41.595121+0000","last_undegraded":"2024-09-11T01:06:41.595121+0000","last_fullsized":"2024-09-11T01:06:41.595121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:17.278999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"89'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.747569+0000","last_change":"2024-09-11T01:05:31.675298+0000","last_active":"2024-09-11T01:07:39.747569+0000","last_peered":"2024-09-11T01:07:39.747569+0000","last_clean":"2024-09-11T01:07:39.747569+0000","last_became_active":"2024-09-11T01:05:31.674922+0000","last_became_peered":"2024-09-11T01:05:31.674922+0000","last_unstale":"2024-09-11T01:07:39.747569+0000","last_undegraded":"2024-09-11T01:07:39.747569+0000","last_fullsized":"2024-09-11T01:07:39.747569+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:54.059202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"89'12","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.750462+0000","last_change":"2024-09-11T01:05:31.685494+0000","last_active":"2024-09-11T01:07:39.750462+0000","last_peered":"2024-09-11T01:07:39.750462+0000","last_clean":"2024-09-11T01:07:39.750462+0000","last_became_active":"2024-09-11T01:05:31.685131+0000","last_became_peered":"2024-09-11T01:05:31.685131+0000","last_unstale":"2024-09-11T01:07:39.750462+0000","last_undegraded":"2024-09-11T01:07:39.750462+0000","last_fullsized":"2024-09-11T01:07:39.750462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:41.805135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759763+0000","last_change":"2024-09-11T01:05:31.686473+0000","last_active":"2024-09-11T01:07:39.759763+0000","last_peered":"2024-09-11T01:07:39.759763+0000","last_clean":"2024-09-11T01:07:39.759763+0000","last_became_active":"2024-09-11T01:05:31.685858+0000","last_became_peered":"2024-09-11T01:05:31.685858+0000","last_unstale":"2024-09-11T01:07:39.759763+0000","last_undegraded":"2024-09-11T01:07:39.759763+0000","last_fullsized":"2024-09-11T01:07:39.759763+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:52.174889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768644+0000","last_change":"2024-09-11T01:05:31.691078+0000","last_active":"2024-09-11T01:07:39.768644+0000","last_peered":"2024-09-11T01:07:39.768644+0000","last_clean":"2024-09-11T01:07:39.768644+0000","last_became_active":"2024-09-11T01:05:31.690755+0000","last_became_peered":"2024-09-11T01:05:31.690755+0000","last_unstale":"2024-09-11T01:07:39.768644+0000","last_undegraded":"2024-09-11T01:07:39.768644+0000","last_fullsized":"2024-09-11T01:07:39.768644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:50.643233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"89'4","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.769438+0000","last_change":"2024-09-11T01:05:31.681933+0000","last_active":"2024-09-11T01:07:39.769438+0000","last_peered":"2024-09-11T01:07:39.769438+0000","last_clean":"2024-09-11T01:07:39.769438+0000","last_became_active":"2024-09-11T01:05:31.681642+0000","last_became_peered":"2024-09-11T01:05:31.681642+0000","last_unstale":"2024-09-11T01:07:39.769438+0000","last_undegraded":"2024-09-11T01:07:39.769438+0000","last_fullsized":"2024-09-11T01:07:39.769438+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:05:10.434843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"89'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.751080+0000","last_change":"2024-09-11T01:05:31.677188+0000","last_active":"2024-09-11T01:07:39.751080+0000","last_peered":"2024-09-11T01:07:39.751080+0000","last_clean":"2024-09-11T01:07:39.751080+0000","last_became_active":"2024-09-11T01:05:31.676689+0000","last_became_peered":"2024-09-11T01:05:31.676689+0000","last_unstale":"2024-09-11T01:07:39.751080+0000","last_undegraded":"2024-09-11T01:07:39.751080+0000","last_fullsized":"2024-09-11T01:07:39.751080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:51.899743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"89'15","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.753001+0000","last_change":"2024-09-11T01:05:31.678994+0000","last_active":"2024-09-11T01:07:39.753001+0000","last_peered":"2024-09-11T01:07:39.753001+0000","last_clean":"2024-09-11T01:07:39.753001+0000","last_became_active":"2024-09-11T01:05:31.678675+0000","last_became_peered":"2024-09-11T01:05:31.678675+0000","last_unstale":"2024-09-11T01:07:39.753001+0000","last_undegraded":"2024-09-11T01:07:39.753001+0000","last_fullsized":"2024-09-11T01:07:39.753001+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:35.740872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"89'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759357+0000","last_change":"2024-09-11T01:05:31.680046+0000","last_active":"2024-09-11T01:07:39.759357+0000","last_peered":"2024-09-11T01:07:39.759357+0000","last_clean":"2024-09-11T01:07:39.759357+0000","last_became_active":"2024-09-11T01:05:31.679626+0000","last_became_peered":"2024-09-11T01:05:31.679626+0000","last_unstale":"2024-09-11T01:07:39.759357+0000","last_undegraded":"2024-09-11T01:07:39.759357+0000","last_fullsized":"2024-09-11T01:07:39.759357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:15.260470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"89'6","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767704+0000","last_change":"2024-09-11T01:05:31.683545+0000","last_active":"2024-09-11T01:07:39.767704+0000","last_peered":"2024-09-11T01:07:39.767704+0000","last_clean":"2024-09-11T01:07:39.767704+0000","last_became_active":"2024-09-11T01:05:31.683166+0000","last_became_peered":"2024-09-11T01:05:31.683166+0000","last_unstale":"2024-09-11T01:07:39.767704+0000","last_undegraded":"2024-09-11T01:07:39.767704+0000","last_fullsized":"2024-09-11T01:07:39.767704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:57.378211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765914+0000","last_change":"2024-09-11T01:05:31.678031+0000","last_active":"2024-09-11T01:07:39.765914+0000","last_peered":"2024-09-11T01:07:39.765914+0000","last_clean":"2024-09-11T01:07:39.765914+0000","last_became_active":"2024-09-11T01:05:31.677760+0000","last_became_peered":"2024-09-11T01:05:31.677760+0000","last_unstale":"2024-09-11T01:07:39.765914+0000","last_undegraded":"2024-09-11T01:07:39.765914+0000","last_fullsized":"2024-09-11T01:07:39.765914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:39.252655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767150+0000","last_change":"2024-09-11T01:05:31.677991+0000","last_active":"2024-09-11T01:07:39.767150+0000","last_peered":"2024-09-11T01:07:39.767150+0000","last_clean":"2024-09-11T01:07:39.767150+0000","last_became_active":"2024-09-11T01:05:31.677670+0000","last_became_peered":"2024-09-11T01:05:31.677670+0000","last_unstale":"2024-09-11T01:07:39.767150+0000","last_undegraded":"2024-09-11T01:07:39.767150+0000","last_fullsized":"2024-09-11T01:07:39.767150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:55.622757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"89'11","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.769904+0000","last_change":"2024-09-11T01:05:31.678213+0000","last_active":"2024-09-11T01:07:39.769904+0000","last_peered":"2024-09-11T01:07:39.769904+0000","last_clean":"2024-09-11T01:07:39.769904+0000","last_became_active":"2024-09-11T01:05:31.676422+0000","last_became_peered":"2024-09-11T01:05:31.676422+0000","last_unstale":"2024-09-11T01:07:39.769904+0000","last_undegraded":"2024-09-11T01:07:39.769904+0000","last_fullsized":"2024-09-11T01:07:39.769904+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:29.096123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"89'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.757534+0000","last_change":"2024-09-11T01:05:31.680945+0000","last_active":"2024-09-11T01:07:39.757534+0000","last_peered":"2024-09-11T01:07:39.757534+0000","last_clean":"2024-09-11T01:07:39.757534+0000","last_became_active":"2024-09-11T01:05:31.680458+0000","last_became_peered":"2024-09-11T01:05:31.680458+0000","last_unstale":"2024-09-11T01:07:39.757534+0000","last_undegraded":"2024-09-11T01:07:39.757534+0000","last_fullsized":"2024-09-11T01:07:39.757534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:01.382341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.758171+0000","last_change":"2024-09-11T01:05:31.685792+0000","last_active":"2024-09-11T01:07:39.758171+0000","last_peered":"2024-09-11T01:07:39.758171+0000","last_clean":"2024-09-11T01:07:39.758171+0000","last_became_active":"2024-09-11T01:05:31.685467+0000","last_became_peered":"2024-09-11T01:05:31.685467+0000","last_unstale":"2024-09-11T01:07:39.758171+0000","last_undegraded":"2024-09-11T01:07:39.758171+0000","last_fullsized":"2024-09-11T01:07:39.758171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:37.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"89'10","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.756874+0000","last_change":"2024-09-11T01:05:31.678855+0000","last_active":"2024-09-11T01:07:39.756874+0000","last_peered":"2024-09-11T01:07:39.756874+0000","last_clean":"2024-09-11T01:07:39.756874+0000","last_became_active":"2024-09-11T01:05:31.678583+0000","last_became_peered":"2024-09-11T01:05:31.678583+0000","last_unstale":"2024-09-11T01:07:39.756874+0000","last_undegraded":"2024-09-11T01:07:39.756874+0000","last_fullsized":"2024-09-11T01:07:39.756874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:24.112383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"89'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768683+0000","last_change":"2024-09-11T01:05:31.682261+0000","last_active":"2024-09-11T01:07:39.768683+0000","last_peered":"2024-09-11T01:07:39.768683+0000","last_clean":"2024-09-11T01:07:39.768683+0000","last_became_active":"2024-09-11T01:05:31.681924+0000","last_became_peered":"2024-09-11T01:05:31.681924+0000","last_unstale":"2024-09-11T01:07:39.768683+0000","last_undegraded":"2024-09-11T01:07:39.768683+0000","last_fullsized":"2024-09-11T01:07:39.768683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:54.556438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764873+0000","last_change":"2024-09-11T01:05:31.674687+0000","last_active":"2024-09-11T01:07:39.764873+0000","last_peered":"2024-09-11T01:07:39.764873+0000","last_clean":"2024-09-11T01:07:39.764873+0000","last_became_active":"2024-09-11T01:05:31.674348+0000","last_became_peered":"2024-09-11T01:05:31.674348+0000","last_unstale":"2024-09-11T01:07:39.764873+0000","last_undegraded":"2024-09-11T01:07:39.764873+0000","last_fullsized":"2024-09-11T01:07:39.764873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:46.086798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"89'7","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768016+0000","last_change":"2024-09-11T01:05:40.967775+0000","last_active":"2024-09-11T01:07:39.768016+0000","last_peered":"2024-09-11T01:07:39.768016+0000","last_clean":"2024-09-11T01:07:39.768016+0000","last_became_active":"2024-09-11T01:05:40.967355+0000","last_became_peered":"2024-09-11T01:05:40.967355+0000","last_unstale":"2024-09-11T01:07:39.768016+0000","last_undegraded":"2024-09-11T01:07:39.768016+0000","last_fullsized":"2024-09-11T01:07:39.768016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:43.224010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767996+0000","last_change":"2024-09-11T01:05:31.674655+0000","last_active":"2024-09-11T01:07:39.767996+0000","last_peered":"2024-09-11T01:07:39.767996+0000","last_clean":"2024-09-11T01:07:39.767996+0000","last_became_active":"2024-09-11T01:05:31.674342+0000","last_became_peered":"2024-09-11T01:05:31.674342+0000","last_unstale":"2024-09-11T01:07:39.767996+0000","last_undegraded":"2024-09-11T01:07:39.767996+0000","last_fullsized":"2024-09-11T01:07:39.767996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:28.593441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"89'10","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764929+0000","last_change":"2024-09-11T01:05:31.678521+0000","last_active":"2024-09-11T01:07:39.764929+0000","last_peered":"2024-09-11T01:07:39.764929+0000","last_clean":"2024-09-11T01:07:39.764929+0000","last_became_active":"2024-09-11T01:05:31.674828+0000","last_became_peered":"2024-09-11T01:05:31.674828+0000","last_unstale":"2024-09-11T01:07:39.764929+0000","last_undegraded":"2024-09-11T01:07:39.764929+0000","last_fullsized":"2024-09-11T01:07:39.764929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:38.797887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"89'7","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.757696+0000","last_change":"2024-09-11T01:05:31.685075+0000","last_active":"2024-09-11T01:07:39.757696+0000","last_peered":"2024-09-11T01:07:39.757696+0000","last_clean":"2024-09-11T01:07:39.757696+0000","last_became_active":"2024-09-11T01:05:31.684742+0000","last_became_peered":"2024-09-11T01:05:31.684742+0000","last_unstale":"2024-09-11T01:07:39.757696+0000","last_undegraded":"2024-09-11T01:07:39.757696+0000","last_fullsized":"2024-09-11T01:07:39.757696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:29.381976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"89'6","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764349+0000","last_change":"2024-09-11T01:05:31.678921+0000","last_active":"2024-09-11T01:07:39.764349+0000","last_peered":"2024-09-11T01:07:39.764349+0000","last_clean":"2024-09-11T01:07:39.764349+0000","last_became_active":"2024-09-11T01:05:31.678547+0000","last_became_peered":"2024-09-11T01:05:31.678547+0000","last_unstale":"2024-09-11T01:07:39.764349+0000","last_undegraded":"2024-09-11T01:07:39.764349+0000","last_fullsized":"2024-09-11T01:07:39.764349+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:59.618685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'16","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.757628+0000","last_change":"2024-09-11T01:05:31.685565+0000","last_active":"2024-09-11T01:07:39.757628+0000","last_peered":"2024-09-11T01:07:39.757628+0000","last_clean":"2024-09-11T01:07:39.757628+0000","last_became_active":"2024-09-11T01:05:31.685234+0000","last_became_peered":"2024-09-11T01:05:31.685234+0000","last_unstale":"2024-09-11T01:07:39.757628+0000","last_undegraded":"2024-09-11T01:07:39.757628+0000","last_fullsized":"2024-09-11T01:07:39.757628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:07.831922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"89'11","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759002+0000","last_change":"2024-09-11T01:05:31.677464+0000","last_active":"2024-09-11T01:07:39.759002+0000","last_peered":"2024-09-11T01:07:39.759002+0000","last_clean":"2024-09-11T01:07:39.759002+0000","last_became_active":"2024-09-11T01:05:31.677161+0000","last_became_peered":"2024-09-11T01:05:31.677161+0000","last_unstale":"2024-09-11T01:07:39.759002+0000","last_undegraded":"2024-09-11T01:07:39.759002+0000","last_fullsized":"2024-09-11T01:07:39.759002+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:26.590429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"89'9","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767267+0000","last_change":"2024-09-11T01:05:31.679977+0000","last_active":"2024-09-11T01:07:39.767267+0000","last_peered":"2024-09-11T01:07:39.767267+0000","last_clean":"2024-09-11T01:07:39.767267+0000","last_became_active":"2024-09-11T01:05:31.679661+0000","last_became_peered":"2024-09-11T01:05:31.679661+0000","last_unstale":"2024-09-11T01:07:39.767267+0000","last_undegraded":"2024-09-11T01:07:39.767267+0000","last_fullsized":"2024-09-11T01:07:39.767267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:00.040651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"89'5","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765585+0000","last_change":"2024-09-11T01:05:31.685419+0000","last_active":"2024-09-11T01:07:39.765585+0000","last_peered":"2024-09-11T01:07:39.765585+0000","last_clean":"2024-09-11T01:07:39.765585+0000","last_became_active":"2024-09-11T01:05:31.684772+0000","last_became_peered":"2024-09-11T01:05:31.684772+0000","last_unstale":"2024-09-11T01:07:39.765585+0000","last_undegraded":"2024-09-11T01:07:39.765585+0000","last_fullsized":"2024-09-11T01:07:39.765585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:19.283742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"89'6","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.758775+0000","last_change":"2024-09-11T01:05:31.681691+0000","last_active":"2024-09-11T01:07:39.758775+0000","last_peered":"2024-09-11T01:07:39.758775+0000","last_clean":"2024-09-11T01:07:39.758775+0000","last_became_active":"2024-09-11T01:05:31.680549+0000","last_became_peered":"2024-09-11T01:05:31.680549+0000","last_unstale":"2024-09-11T01:07:39.758775+0000","last_undegraded":"2024-09-11T01:07:39.758775+0000","last_fullsized":"2024-09-11T01:07:39.758775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:15.561978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"89'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767096+0000","last_change":"2024-09-11T01:05:31.687135+0000","last_active":"2024-09-11T01:07:39.767096+0000","last_peered":"2024-09-11T01:07:39.767096+0000","last_clean":"2024-09-11T01:07:39.767096+0000","last_became_active":"2024-09-11T01:05:31.686719+0000","last_became_peered":"2024-09-11T01:05:31.686719+0000","last_unstale":"2024-09-11T01:07:39.767096+0000","last_undegraded":"2024-09-11T01:07:39.767096+0000","last_fullsized":"2024-09-11T01:07:39.767096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:42.044930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"89'8","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.753981+0000","last_change":"2024-09-11T01:05:31.688154+0000","last_active":"2024-09-11T01:07:39.753981+0000","last_peered":"2024-09-11T01:07:39.753981+0000","last_clean":"2024-09-11T01:07:39.753981+0000","last_became_active":"2024-09-11T01:05:31.687734+0000","last_became_peered":"2024-09-11T01:05:31.687734+0000","last_unstale":"2024-09-11T01:07:39.753981+0000","last_undegraded":"2024-09-11T01:07:39.753981+0000","last_fullsized":"2024-09-11T01:07:39.753981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:57.789086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.769196+0000","last_change":"2024-09-11T01:05:31.679761+0000","last_active":"2024-09-11T01:07:39.769196+0000","last_peered":"2024-09-11T01:07:39.769196+0000","last_clean":"2024-09-11T01:07:39.769196+0000","last_became_active":"2024-09-11T01:05:31.679345+0000","last_became_peered":"2024-09-11T01:05:31.679345+0000","last_unstale":"2024-09-11T01:07:39.769196+0000","last_undegraded":"2024-09-11T01:07:39.769196+0000","last_fullsized":"2024-09-11T01:07:39.769196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:28.480561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"89'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.756084+0000","last_change":"2024-09-11T01:05:31.680782+0000","last_active":"2024-09-11T01:07:39.756084+0000","last_peered":"2024-09-11T01:07:39.756084+0000","last_clean":"2024-09-11T01:07:39.756084+0000","last_became_active":"2024-09-11T01:05:31.679984+0000","last_became_peered":"2024-09-11T01:05:31.679984+0000","last_unstale":"2024-09-11T01:07:39.756084+0000","last_undegraded":"2024-09-11T01:07:39.756084+0000","last_fullsized":"2024-09-11T01:07:39.756084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:10.306868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"89'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768521+0000","last_change":"2024-09-11T01:05:31.681462+0000","last_active":"2024-09-11T01:07:39.768521+0000","last_peered":"2024-09-11T01:07:39.768521+0000","last_clean":"2024-09-11T01:07:39.768521+0000","last_became_active":"2024-09-11T01:05:31.680799+0000","last_became_peered":"2024-09-11T01:05:31.680799+0000","last_unstale":"2024-09-11T01:07:39.768521+0000","last_undegraded":"2024-09-11T01:07:39.768521+0000","last_fullsized":"2024-09-11T01:07:39.768521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:56:44.512831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74075,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":744,"num_read_kb":447,"num_write":189,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1646,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":213748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645360,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1024000,"data_stored":506452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841589,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28692,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716460,"statfs":{"total":95995035648,"available":95965655040,"internally_reserved":0,"allocated":1708032,"data_stored":1162898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005113,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":506542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201343,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":506350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397573,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36928,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708224,"statfs":{"total":95995035648,"available":95957221376,"internally_reserved":0,"allocated":1622016,"data_stored":1103355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593802,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":501718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790032,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28616,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716536,"statfs":{"total":95995035648,"available":95965732864,"internally_reserved":0,"allocated":1630208,"data_stored":1098100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953557,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36412,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708740,"statfs":{"total":95995035648,"available":95957749760,"internally_reserved":0,"allocated":1093632,"data_stored":571285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149786,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":501912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411425,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":503787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1077248,"data_stored":566013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738473,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":503106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":65872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:08:23.130 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-11T01:08:23.131 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph pg dump --format=json 2024-09-11T01:08:23.506 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:23.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:23 smithi183 ceph-mon[34992]: pgmap v401: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-11T01:08:24.018 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:23 smithi103 ceph-mon[30562]: pgmap v401: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-11T01:08:24.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:23 smithi117 ceph-mon[35358]: pgmap v401: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-11T01:08:24.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.128+0000 7fbf83400640 1 -- 172.21.15.103:0/2652196267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c10a9b0 msgr2=0x7fbf7c10adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:24.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.128+0000 7fbf83400640 1 --2- 172.21.15.103:0/2652196267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c10a9b0 0x7fbf7c10adf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fbf64009900 tx=0x7fbf6402a410 comp rx=0 tx=0).stop 2024-09-11T01:08:24.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.128+0000 7fbf83400640 1 -- 172.21.15.103:0/2652196267 shutdown_connections 2024-09-11T01:08:24.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.128+0000 7fbf83400640 1 --2- 172.21.15.103:0/2652196267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf7c10b330 0x7fbf7c111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:24.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.128+0000 7fbf83400640 1 --2- 172.21.15.103:0/2652196267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c10a9b0 0x7fbf7c10adf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:24.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.128+0000 7fbf83400640 1 --2- 172.21.15.103:0/2652196267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf7c104fa0 0x7fbf7c105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:24.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.128+0000 7fbf83400640 1 -- 172.21.15.103:0/2652196267 >> 172.21.15.103:0/2652196267 conn(0x7fbf7c100a50 msgr2=0x7fbf7c102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:24.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.128+0000 7fbf83400640 1 -- 172.21.15.103:0/2652196267 shutdown_connections 2024-09-11T01:08:24.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.128+0000 7fbf83400640 1 -- 172.21.15.103:0/2652196267 wait complete. 2024-09-11T01:08:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.129+0000 7fbf83400640 1 Processor -- start 2024-09-11T01:08:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.129+0000 7fbf83400640 1 -- start start 2024-09-11T01:08:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.129+0000 7fbf83400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf7c104fa0 0x7fbf7c19b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.129+0000 7fbf83400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c10a9b0 0x7fbf7c19ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.129+0000 7fbf83400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf7c10b330 0x7fbf7c1a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.129+0000 7fbf83400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c114fb0 con 0x7fbf7c10a9b0 2024-09-11T01:08:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.129+0000 7fbf83400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c114e30 con 0x7fbf7c10b330 2024-09-11T01:08:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.129+0000 7fbf83400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c115130 con 0x7fbf7c104fa0 2024-09-11T01:08:24.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.130+0000 7fbf73e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c10a9b0 0x7fbf7c19ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:24.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.130+0000 7fbf80a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf7c104fa0 0x7fbf7c19b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:24.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.130+0000 7fbf73e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c10a9b0 0x7fbf7c19ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55622/0 (socket says 172.21.15.103:55622) 2024-09-11T01:08:24.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.130+0000 7fbf73e00640 1 -- 172.21.15.103:0/1254524310 learned_addr learned my addr 172.21.15.103:0/1254524310 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:24.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.130+0000 7fbf81400640 1 --2- 172.21.15.103:0/1254524310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf7c10b330 0x7fbf7c1a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.130+0000 7fbf80a00640 1 -- 172.21.15.103:0/1254524310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf7c10b330 msgr2=0x7fbf7c1a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.130+0000 7fbf80a00640 1 --2- 172.21.15.103:0/1254524310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf7c10b330 0x7fbf7c1a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.130+0000 7fbf80a00640 1 -- 172.21.15.103:0/1254524310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c10a9b0 msgr2=0x7fbf7c19ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.130+0000 7fbf80a00640 1 --2- 172.21.15.103:0/1254524310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c10a9b0 0x7fbf7c19ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.130+0000 7fbf80a00640 1 -- 172.21.15.103:0/1254524310 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7c1a1570 con 0x7fbf7c104fa0 2024-09-11T01:08:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.130+0000 7fbf73e00640 1 --2- 172.21.15.103:0/1254524310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c10a9b0 0x7fbf7c19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.130+0000 7fbf80a00640 1 --2- 172.21.15.103:0/1254524310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf7c104fa0 0x7fbf7c19b4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00e9f0 tx=0x7fbf6c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.131+0000 7fbf7a000640 1 -- 172.21.15.103:0/1254524310 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c00ccc0 con 0x7fbf7c104fa0 2024-09-11T01:08:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.131+0000 7fbf83400640 1 -- 172.21.15.103:0/1254524310 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf7c1a1860 con 0x7fbf7c104fa0 2024-09-11T01:08:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.131+0000 7fbf7a000640 1 -- 172.21.15.103:0/1254524310 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbf6c0108e0 con 0x7fbf7c104fa0 2024-09-11T01:08:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.131+0000 7fbf7a000640 1 -- 172.21.15.103:0/1254524310 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c018880 con 0x7fbf7c104fa0 2024-09-11T01:08:24.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.131+0000 7fbf83400640 1 -- 172.21.15.103:0/1254524310 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf7c1a80f0 con 0x7fbf7c104fa0 2024-09-11T01:08:24.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.132+0000 7fbf83400640 1 -- 172.21.15.103:0/1254524310 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf7c106250 con 0x7fbf7c104fa0 2024-09-11T01:08:24.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.134+0000 7fbf7a000640 1 -- 172.21.15.103:0/1254524310 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7fbf6c010430 con 0x7fbf7c104fa0 2024-09-11T01:08:24.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.136+0000 7fbf7a000640 1 --2- 172.21.15.103:0/1254524310 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbf600b5370 0x7fbf600b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:24.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.136+0000 7fbf7a000640 1 -- 172.21.15.103:0/1254524310 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fbf6c0e6940 con 0x7fbf7c104fa0 2024-09-11T01:08:24.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.136+0000 7fbf73e00640 1 --2- 172.21.15.103:0/1254524310 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbf600b5370 0x7fbf600b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:24.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.137+0000 7fbf73e00640 1 --2- 172.21.15.103:0/1254524310 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbf600b5370 0x7fbf600b7830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c109690 tx=0x7fbf64005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:24.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.137+0000 7fbf7a000640 1 -- 172.21.15.103:0/1254524310 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fbf6c0acc40 con 0x7fbf7c104fa0 2024-09-11T01:08:24.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.321+0000 7fbf83400640 1 -- 172.21.15.103:0/1254524310 --> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf7c063590 con 0x7fbf600b5370 2024-09-11T01:08:24.330 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.329+0000 7fbf7a000640 1 -- 172.21.15.103:0/1254524310 <== mgr.14150 v2:172.21.15.103:6800/3230239737 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340490 (secure 0 0 0) 0x7fbf7c063590 con 0x7fbf600b5370 2024-09-11T01:08:24.335 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:08:24.337 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-09-11T01:08:24.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.334+0000 7fbf83400640 1 -- 172.21.15.103:0/1254524310 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbf600b5370 msgr2=0x7fbf600b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:24.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.334+0000 7fbf83400640 1 --2- 172.21.15.103:0/1254524310 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbf600b5370 0x7fbf600b7830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c109690 tx=0x7fbf64005a20 comp rx=0 tx=0).stop 2024-09-11T01:08:24.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.334+0000 7fbf83400640 1 -- 172.21.15.103:0/1254524310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf7c104fa0 msgr2=0x7fbf7c19b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:24.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.334+0000 7fbf83400640 1 --2- 172.21.15.103:0/1254524310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf7c104fa0 0x7fbf7c19b4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00e9f0 tx=0x7fbf6c00eeb0 comp rx=0 tx=0).stop 2024-09-11T01:08:24.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.334+0000 7fbf83400640 1 -- 172.21.15.103:0/1254524310 shutdown_connections 2024-09-11T01:08:24.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.334+0000 7fbf83400640 1 --2- 172.21.15.103:0/1254524310 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbf600b5370 0x7fbf600b7830 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:24.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.334+0000 7fbf83400640 1 --2- 172.21.15.103:0/1254524310 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbf7c10b330 0x7fbf7c1a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:24.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.334+0000 7fbf83400640 1 --2- 172.21.15.103:0/1254524310 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf7c10a9b0 0x7fbf7c19ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:24.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.334+0000 7fbf83400640 1 --2- 172.21.15.103:0/1254524310 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbf7c104fa0 0x7fbf7c19b4c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:24.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.334+0000 7fbf83400640 1 -- 172.21.15.103:0/1254524310 >> 172.21.15.103:0/1254524310 conn(0x7fbf7c100a50 msgr2=0x7fbf7c102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:24.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.334+0000 7fbf83400640 1 -- 172.21.15.103:0/1254524310 shutdown_connections 2024-09-11T01:08:24.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:24.334+0000 7fbf83400640 1 -- 172.21.15.103:0/1254524310 wait complete. 2024-09-11T01:08:24.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:24 smithi183 ceph-mon[34992]: from='client.25279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:08:25.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:24 smithi103 ceph-mon[30562]: from='client.25279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:08:25.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:24 smithi117 ceph-mon[35358]: from='client.25279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-11T01:08:25.229 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":401,"stamp":"2024-09-11T01:08:23.554561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664988,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":836,"num_read_kb":517,"num_write":315,"num_write_kb":2290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":2953603,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":755,"ondisk_log_size":755,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384016,"kb_used_data":13968,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557808,"statfs":{"total":1151940427776,"available":1151547195392,"internally_reserved":0,"allocated":14303232,"data_stored":8046901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5327,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":37,"num_write":11,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003175"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598778+0000","last_change":"2024-09-11T01:05:28.553987+0000","last_active":"2024-09-11T01:06:41.598778+0000","last_peered":"2024-09-11T01:06:41.598778+0000","last_clean":"2024-09-11T01:06:41.598778+0000","last_became_active":"2024-09-11T01:05:28.553691+0000","last_became_peered":"2024-09-11T01:05:28.553691+0000","last_unstale":"2024-09-11T01:06:41.598778+0000","last_undegraded":"2024-09-11T01:06:41.598778+0000","last_fullsized":"2024-09-11T01:06:41.598778+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:41:50.407880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"89'5","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.761762+0000","last_change":"2024-09-11T01:05:31.677005+0000","last_active":"2024-09-11T01:07:39.761762+0000","last_peered":"2024-09-11T01:07:39.761762+0000","last_clean":"2024-09-11T01:07:39.761762+0000","last_became_active":"2024-09-11T01:05:31.676597+0000","last_became_peered":"2024-09-11T01:05:31.676597+0000","last_unstale":"2024-09-11T01:07:39.761762+0000","last_undegraded":"2024-09-11T01:07:39.761762+0000","last_fullsized":"2024-09-11T01:07:39.761762+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:26:06.260736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594715+0000","last_change":"2024-09-11T01:05:40.975009+0000","last_active":"2024-09-11T01:06:41.594715+0000","last_peered":"2024-09-11T01:06:41.594715+0000","last_clean":"2024-09-11T01:06:41.594715+0000","last_became_active":"2024-09-11T01:05:40.974546+0000","last_became_peered":"2024-09-11T01:05:40.974546+0000","last_unstale":"2024-09-11T01:06:41.594715+0000","last_undegraded":"2024-09-11T01:06:41.594715+0000","last_fullsized":"2024-09-11T01:06:41.594715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:56.420262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.651381+0000","last_change":"2024-09-11T01:05:28.623367+0000","last_active":"2024-09-11T01:06:41.651381+0000","last_peered":"2024-09-11T01:06:41.651381+0000","last_clean":"2024-09-11T01:06:41.651381+0000","last_became_active":"2024-09-11T01:05:28.622990+0000","last_became_peered":"2024-09-11T01:05:28.622990+0000","last_unstale":"2024-09-11T01:06:41.651381+0000","last_undegraded":"2024-09-11T01:06:41.651381+0000","last_fullsized":"2024-09-11T01:06:41.651381+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:28:35.022280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"89'6","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.770032+0000","last_change":"2024-09-11T01:05:31.693910+0000","last_active":"2024-09-11T01:07:39.770032+0000","last_peered":"2024-09-11T01:07:39.770032+0000","last_clean":"2024-09-11T01:07:39.770032+0000","last_became_active":"2024-09-11T01:05:31.692906+0000","last_became_peered":"2024-09-11T01:05:31.692906+0000","last_unstale":"2024-09-11T01:07:39.770032+0000","last_undegraded":"2024-09-11T01:07:39.770032+0000","last_fullsized":"2024-09-11T01:07:39.770032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:11.906323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595041+0000","last_change":"2024-09-11T01:05:40.975768+0000","last_active":"2024-09-11T01:06:41.595041+0000","last_peered":"2024-09-11T01:06:41.595041+0000","last_clean":"2024-09-11T01:06:41.595041+0000","last_became_active":"2024-09-11T01:05:40.974721+0000","last_became_peered":"2024-09-11T01:05:40.974721+0000","last_unstale":"2024-09-11T01:06:41.595041+0000","last_undegraded":"2024-09-11T01:06:41.595041+0000","last_fullsized":"2024-09-11T01:06:41.595041+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:27.475531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599080+0000","last_change":"2024-09-11T01:05:28.558980+0000","last_active":"2024-09-11T01:06:41.599080+0000","last_peered":"2024-09-11T01:06:41.599080+0000","last_clean":"2024-09-11T01:06:41.599080+0000","last_became_active":"2024-09-11T01:05:28.558617+0000","last_became_peered":"2024-09-11T01:05:28.558617+0000","last_unstale":"2024-09-11T01:06:41.599080+0000","last_undegraded":"2024-09-11T01:06:41.599080+0000","last_fullsized":"2024-09-11T01:06:41.599080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:07:13.659175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764701+0000","last_change":"2024-09-11T01:05:31.664705+0000","last_active":"2024-09-11T01:07:39.764701+0000","last_peered":"2024-09-11T01:07:39.764701+0000","last_clean":"2024-09-11T01:07:39.764701+0000","last_became_active":"2024-09-11T01:05:31.664328+0000","last_became_peered":"2024-09-11T01:05:31.664328+0000","last_unstale":"2024-09-11T01:07:39.764701+0000","last_undegraded":"2024-09-11T01:07:39.764701+0000","last_fullsized":"2024-09-11T01:07:39.764701+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:20.938539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.652585+0000","last_change":"2024-09-11T01:06:41.652143+0000","last_active":"2024-09-11T01:06:41.652585+0000","last_peered":"2024-09-11T01:06:41.652585+0000","last_clean":"2024-09-11T01:06:41.652585+0000","last_became_active":"2024-09-11T01:06:41.651661+0000","last_became_peered":"2024-09-11T01:06:41.651661+0000","last_unstale":"2024-09-11T01:06:41.652585+0000","last_undegraded":"2024-09-11T01:06:41.652585+0000","last_fullsized":"2024-09-11T01:06:41.652585+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:03.377915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,8],"acting":[4,3,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599695+0000","last_change":"2024-09-11T01:05:28.555081+0000","last_active":"2024-09-11T01:06:41.599695+0000","last_peered":"2024-09-11T01:06:41.599695+0000","last_clean":"2024-09-11T01:06:41.599695+0000","last_became_active":"2024-09-11T01:05:28.554562+0000","last_became_peered":"2024-09-11T01:05:28.554562+0000","last_unstale":"2024-09-11T01:06:41.599695+0000","last_undegraded":"2024-09-11T01:06:41.599695+0000","last_fullsized":"2024-09-11T01:06:41.599695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:19:23.922285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"89'15","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.758235+0000","last_change":"2024-09-11T01:05:31.680442+0000","last_active":"2024-09-11T01:07:39.758235+0000","last_peered":"2024-09-11T01:07:39.758235+0000","last_clean":"2024-09-11T01:07:39.758235+0000","last_became_active":"2024-09-11T01:05:31.680107+0000","last_became_peered":"2024-09-11T01:05:31.680107+0000","last_unstale":"2024-09-11T01:07:39.758235+0000","last_undegraded":"2024-09-11T01:07:39.758235+0000","last_fullsized":"2024-09-11T01:07:39.758235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:16:02.853855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595209+0000","last_change":"2024-09-11T01:05:40.969365+0000","last_active":"2024-09-11T01:06:41.595209+0000","last_peered":"2024-09-11T01:06:41.595209+0000","last_clean":"2024-09-11T01:06:41.595209+0000","last_became_active":"2024-09-11T01:05:40.969005+0000","last_became_peered":"2024-09-11T01:05:40.969005+0000","last_unstale":"2024-09-11T01:06:41.595209+0000","last_undegraded":"2024-09-11T01:06:41.595209+0000","last_fullsized":"2024-09-11T01:06:41.595209+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:01:42.942848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'5","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765784+0000","last_change":"2024-09-11T01:05:31.676943+0000","last_active":"2024-09-11T01:07:39.765784+0000","last_peered":"2024-09-11T01:07:39.765784+0000","last_clean":"2024-09-11T01:07:39.765784+0000","last_became_active":"2024-09-11T01:05:31.676584+0000","last_became_peered":"2024-09-11T01:05:31.676584+0000","last_unstale":"2024-09-11T01:07:39.765784+0000","last_undegraded":"2024-09-11T01:07:39.765784+0000","last_fullsized":"2024-09-11T01:07:39.765784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:17:08.288439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599214+0000","last_change":"2024-09-11T01:05:28.559196+0000","last_active":"2024-09-11T01:06:41.599214+0000","last_peered":"2024-09-11T01:06:41.599214+0000","last_clean":"2024-09-11T01:06:41.599214+0000","last_became_active":"2024-09-11T01:05:28.558746+0000","last_became_peered":"2024-09-11T01:05:28.558746+0000","last_unstale":"2024-09-11T01:06:41.599214+0000","last_undegraded":"2024-09-11T01:06:41.599214+0000","last_fullsized":"2024-09-11T01:06:41.599214+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:23:32.537620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595676+0000","last_change":"2024-09-11T01:05:40.963609+0000","last_active":"2024-09-11T01:06:41.595676+0000","last_peered":"2024-09-11T01:06:41.595676+0000","last_clean":"2024-09-11T01:06:41.595676+0000","last_became_active":"2024-09-11T01:05:40.963088+0000","last_became_peered":"2024-09-11T01:05:40.963088+0000","last_unstale":"2024-09-11T01:06:41.595676+0000","last_undegraded":"2024-09-11T01:06:41.595676+0000","last_fullsized":"2024-09-11T01:06:41.595676+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:25:27.135362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.770097+0000","last_change":"2024-09-11T01:05:31.681258+0000","last_active":"2024-09-11T01:07:39.770097+0000","last_peered":"2024-09-11T01:07:39.770097+0000","last_clean":"2024-09-11T01:07:39.770097+0000","last_became_active":"2024-09-11T01:05:31.680946+0000","last_became_peered":"2024-09-11T01:05:31.680946+0000","last_unstale":"2024-09-11T01:07:39.770097+0000","last_undegraded":"2024-09-11T01:07:39.770097+0000","last_fullsized":"2024-09-11T01:07:39.770097+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:24:42.047250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"89'2","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:38.596334+0000","last_change":"2024-09-11T01:05:28.554651+0000","last_active":"2024-09-11T01:07:38.596334+0000","last_peered":"2024-09-11T01:07:38.596334+0000","last_clean":"2024-09-11T01:07:38.596334+0000","last_became_active":"2024-09-11T01:05:28.554279+0000","last_became_peered":"2024-09-11T01:05:28.554279+0000","last_unstale":"2024-09-11T01:07:38.596334+0000","last_undegraded":"2024-09-11T01:07:38.596334+0000","last_fullsized":"2024-09-11T01:07:38.596334+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:05:14.093403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"87'1","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.686282+0000","last_change":"2024-09-11T01:06:41.685672+0000","last_active":"2024-09-11T01:06:41.686282+0000","last_peered":"2024-09-11T01:06:41.686282+0000","last_clean":"2024-09-11T01:06:41.686282+0000","last_became_active":"2024-09-11T01:06:41.681272+0000","last_became_peered":"2024-09-11T01:06:41.681272+0000","last_unstale":"2024-09-11T01:06:41.686282+0000","last_undegraded":"2024-09-11T01:06:41.686282+0000","last_fullsized":"2024-09-11T01:06:41.686282+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:53:39.693530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,7,8],"acting":[4,10,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"89'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.762975+0000","last_change":"2024-09-11T01:05:31.681743+0000","last_active":"2024-09-11T01:07:39.762975+0000","last_peered":"2024-09-11T01:07:39.762975+0000","last_clean":"2024-09-11T01:07:39.762975+0000","last_became_active":"2024-09-11T01:05:31.681223+0000","last_became_peered":"2024-09-11T01:05:31.681223+0000","last_unstale":"2024-09-11T01:07:39.762975+0000","last_undegraded":"2024-09-11T01:07:39.762975+0000","last_fullsized":"2024-09-11T01:07:39.762975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:49.449622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.651049+0000","last_change":"2024-09-11T01:05:28.552914+0000","last_active":"2024-09-11T01:06:41.651049+0000","last_peered":"2024-09-11T01:06:41.651049+0000","last_clean":"2024-09-11T01:06:41.651049+0000","last_became_active":"2024-09-11T01:05:28.552404+0000","last_became_peered":"2024-09-11T01:05:28.552404+0000","last_unstale":"2024-09-11T01:06:41.651049+0000","last_undegraded":"2024-09-11T01:06:41.651049+0000","last_fullsized":"2024-09-11T01:06:41.651049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:00:39.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598657+0000","last_change":"2024-09-11T01:05:40.985652+0000","last_active":"2024-09-11T01:06:41.598657+0000","last_peered":"2024-09-11T01:06:41.598657+0000","last_clean":"2024-09-11T01:06:41.598657+0000","last_became_active":"2024-09-11T01:05:40.984898+0000","last_became_peered":"2024-09-11T01:05:40.984898+0000","last_unstale":"2024-09-11T01:06:41.598657+0000","last_undegraded":"2024-09-11T01:06:41.598657+0000","last_fullsized":"2024-09-11T01:06:41.598657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:14:58.961342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"89'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.747524+0000","last_change":"2024-09-11T01:05:31.675590+0000","last_active":"2024-09-11T01:07:39.747524+0000","last_peered":"2024-09-11T01:07:39.747524+0000","last_clean":"2024-09-11T01:07:39.747524+0000","last_became_active":"2024-09-11T01:05:31.674426+0000","last_became_peered":"2024-09-11T01:05:31.674426+0000","last_unstale":"2024-09-11T01:07:39.747524+0000","last_undegraded":"2024-09-11T01:07:39.747524+0000","last_fullsized":"2024-09-11T01:07:39.747524+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:30:49.499195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470558+0000","last_change":"2024-09-11T01:05:28.623677+0000","last_active":"2024-09-11T01:06:42.470558+0000","last_peered":"2024-09-11T01:06:42.470558+0000","last_clean":"2024-09-11T01:06:42.470558+0000","last_became_active":"2024-09-11T01:05:28.623357+0000","last_became_peered":"2024-09-11T01:05:28.623357+0000","last_unstale":"2024-09-11T01:06:42.470558+0000","last_undegraded":"2024-09-11T01:06:42.470558+0000","last_fullsized":"2024-09-11T01:06:42.470558+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:10.875425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595506+0000","last_change":"2024-09-11T01:05:40.978136+0000","last_active":"2024-09-11T01:06:41.595506+0000","last_peered":"2024-09-11T01:06:41.595506+0000","last_clean":"2024-09-11T01:06:41.595506+0000","last_became_active":"2024-09-11T01:05:40.977583+0000","last_became_peered":"2024-09-11T01:05:40.977583+0000","last_unstale":"2024-09-11T01:06:41.595506+0000","last_undegraded":"2024-09-11T01:06:41.595506+0000","last_fullsized":"2024-09-11T01:06:41.595506+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:58:20.297640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768246+0000","last_change":"2024-09-11T01:05:31.692938+0000","last_active":"2024-09-11T01:07:39.768246+0000","last_peered":"2024-09-11T01:07:39.768246+0000","last_clean":"2024-09-11T01:07:39.768246+0000","last_became_active":"2024-09-11T01:05:31.689869+0000","last_became_peered":"2024-09-11T01:05:31.689869+0000","last_unstale":"2024-09-11T01:07:39.768246+0000","last_undegraded":"2024-09-11T01:07:39.768246+0000","last_fullsized":"2024-09-11T01:07:39.768246+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:53:24.820033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595877+0000","last_change":"2024-09-11T01:05:28.755985+0000","last_active":"2024-09-11T01:06:41.595877+0000","last_peered":"2024-09-11T01:06:41.595877+0000","last_clean":"2024-09-11T01:06:41.595877+0000","last_became_active":"2024-09-11T01:05:28.755604+0000","last_became_peered":"2024-09-11T01:05:28.755604+0000","last_unstale":"2024-09-11T01:06:41.595877+0000","last_undegraded":"2024-09-11T01:06:41.595877+0000","last_fullsized":"2024-09-11T01:06:41.595877+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:22.570473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594804+0000","last_change":"2024-09-11T01:05:40.963465+0000","last_active":"2024-09-11T01:06:41.594804+0000","last_peered":"2024-09-11T01:06:41.594804+0000","last_clean":"2024-09-11T01:06:41.594804+0000","last_became_active":"2024-09-11T01:05:40.962899+0000","last_became_peered":"2024-09-11T01:05:40.962899+0000","last_unstale":"2024-09-11T01:06:41.594804+0000","last_undegraded":"2024-09-11T01:06:41.594804+0000","last_fullsized":"2024-09-11T01:06:41.594804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:01.728640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"89'5","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765961+0000","last_change":"2024-09-11T01:05:31.675864+0000","last_active":"2024-09-11T01:07:39.765961+0000","last_peered":"2024-09-11T01:07:39.765961+0000","last_clean":"2024-09-11T01:07:39.765961+0000","last_became_active":"2024-09-11T01:05:31.675446+0000","last_became_peered":"2024-09-11T01:05:31.675446+0000","last_unstale":"2024-09-11T01:07:39.765961+0000","last_undegraded":"2024-09-11T01:07:39.765961+0000","last_fullsized":"2024-09-11T01:07:39.765961+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:36.457881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'15","reported_seq":56,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:17.703246+0000","last_change":"2024-09-11T01:05:28.553509+0000","last_active":"2024-09-11T01:08:17.703246+0000","last_peered":"2024-09-11T01:08:17.703246+0000","last_clean":"2024-09-11T01:08:17.703246+0000","last_became_active":"2024-09-11T01:05:28.553101+0000","last_became_peered":"2024-09-11T01:05:28.553101+0000","last_unstale":"2024-09-11T01:08:17.703246+0000","last_undegraded":"2024-09-11T01:08:17.703246+0000","last_fullsized":"2024-09-11T01:08:17.703246+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:41.300518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650601+0000","last_change":"2024-09-11T01:05:40.977146+0000","last_active":"2024-09-11T01:06:41.650601+0000","last_peered":"2024-09-11T01:06:41.650601+0000","last_clean":"2024-09-11T01:06:41.650601+0000","last_became_active":"2024-09-11T01:05:40.976804+0000","last_became_peered":"2024-09-11T01:05:40.976804+0000","last_unstale":"2024-09-11T01:06:41.650601+0000","last_undegraded":"2024-09-11T01:06:41.650601+0000","last_fullsized":"2024-09-11T01:06:41.650601+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:40:49.753417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.748798+0000","last_change":"2024-09-11T01:05:31.684219+0000","last_active":"2024-09-11T01:07:39.748798+0000","last_peered":"2024-09-11T01:07:39.748798+0000","last_clean":"2024-09-11T01:07:39.748798+0000","last_became_active":"2024-09-11T01:05:31.683937+0000","last_became_peered":"2024-09-11T01:05:31.683937+0000","last_unstale":"2024-09-11T01:07:39.748798+0000","last_undegraded":"2024-09-11T01:07:39.748798+0000","last_fullsized":"2024-09-11T01:07:39.748798+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:23:53.813624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599226+0000","last_change":"2024-09-11T01:05:28.623680+0000","last_active":"2024-09-11T01:06:41.599226+0000","last_peered":"2024-09-11T01:06:41.599226+0000","last_clean":"2024-09-11T01:06:41.599226+0000","last_became_active":"2024-09-11T01:05:28.623261+0000","last_became_peered":"2024-09-11T01:05:28.623261+0000","last_unstale":"2024-09-11T01:06:41.599226+0000","last_undegraded":"2024-09-11T01:06:41.599226+0000","last_fullsized":"2024-09-11T01:06:41.599226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:59:17.693915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597628+0000","last_change":"2024-09-11T01:05:40.967165+0000","last_active":"2024-09-11T01:06:41.597628+0000","last_peered":"2024-09-11T01:06:41.597628+0000","last_clean":"2024-09-11T01:06:41.597628+0000","last_became_active":"2024-09-11T01:05:40.966723+0000","last_became_peered":"2024-09-11T01:05:40.966723+0000","last_unstale":"2024-09-11T01:06:41.597628+0000","last_undegraded":"2024-09-11T01:06:41.597628+0000","last_fullsized":"2024-09-11T01:06:41.597628+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:48.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"89'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759459+0000","last_change":"2024-09-11T01:05:31.679865+0000","last_active":"2024-09-11T01:07:39.759459+0000","last_peered":"2024-09-11T01:07:39.759459+0000","last_clean":"2024-09-11T01:07:39.759459+0000","last_became_active":"2024-09-11T01:05:31.679494+0000","last_became_peered":"2024-09-11T01:05:31.679494+0000","last_unstale":"2024-09-11T01:07:39.759459+0000","last_undegraded":"2024-09-11T01:07:39.759459+0000","last_fullsized":"2024-09-11T01:07:39.759459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:00:56.300799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598538+0000","last_change":"2024-09-11T01:05:28.623746+0000","last_active":"2024-09-11T01:06:41.598538+0000","last_peered":"2024-09-11T01:06:41.598538+0000","last_clean":"2024-09-11T01:06:41.598538+0000","last_became_active":"2024-09-11T01:05:28.623358+0000","last_became_peered":"2024-09-11T01:05:28.623358+0000","last_unstale":"2024-09-11T01:06:41.598538+0000","last_undegraded":"2024-09-11T01:06:41.598538+0000","last_fullsized":"2024-09-11T01:06:41.598538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:13.651973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598180+0000","last_change":"2024-09-11T01:05:40.982108+0000","last_active":"2024-09-11T01:06:41.598180+0000","last_peered":"2024-09-11T01:06:41.598180+0000","last_clean":"2024-09-11T01:06:41.598180+0000","last_became_active":"2024-09-11T01:05:40.981737+0000","last_became_peered":"2024-09-11T01:05:40.981737+0000","last_unstale":"2024-09-11T01:06:41.598180+0000","last_undegraded":"2024-09-11T01:06:41.598180+0000","last_fullsized":"2024-09-11T01:06:41.598180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:56:16.717933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.751200+0000","last_change":"2024-09-11T01:05:31.680885+0000","last_active":"2024-09-11T01:07:39.751200+0000","last_peered":"2024-09-11T01:07:39.751200+0000","last_clean":"2024-09-11T01:07:39.751200+0000","last_became_active":"2024-09-11T01:05:31.680536+0000","last_became_peered":"2024-09-11T01:05:31.680536+0000","last_unstale":"2024-09-11T01:07:39.751200+0000","last_undegraded":"2024-09-11T01:07:39.751200+0000","last_fullsized":"2024-09-11T01:07:39.751200+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:12.963321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598709+0000","last_change":"2024-09-11T01:05:28.553957+0000","last_active":"2024-09-11T01:06:41.598709+0000","last_peered":"2024-09-11T01:06:41.598709+0000","last_clean":"2024-09-11T01:06:41.598709+0000","last_became_active":"2024-09-11T01:05:28.553572+0000","last_became_peered":"2024-09-11T01:05:28.553572+0000","last_unstale":"2024-09-11T01:06:41.598709+0000","last_undegraded":"2024-09-11T01:06:41.598709+0000","last_fullsized":"2024-09-11T01:06:41.598709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:05:14.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595235+0000","last_change":"2024-09-11T01:05:40.971221+0000","last_active":"2024-09-11T01:06:41.595235+0000","last_peered":"2024-09-11T01:06:41.595235+0000","last_clean":"2024-09-11T01:06:41.595235+0000","last_became_active":"2024-09-11T01:05:40.970063+0000","last_became_peered":"2024-09-11T01:05:40.970063+0000","last_unstale":"2024-09-11T01:06:41.595235+0000","last_undegraded":"2024-09-11T01:06:41.595235+0000","last_fullsized":"2024-09-11T01:06:41.595235+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:46.299357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"89'8","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.754941+0000","last_change":"2024-09-11T01:05:31.677125+0000","last_active":"2024-09-11T01:07:39.754941+0000","last_peered":"2024-09-11T01:07:39.754941+0000","last_clean":"2024-09-11T01:07:39.754941+0000","last_became_active":"2024-09-11T01:05:31.676803+0000","last_became_peered":"2024-09-11T01:05:31.676803+0000","last_unstale":"2024-09-11T01:07:39.754941+0000","last_undegraded":"2024-09-11T01:07:39.754941+0000","last_fullsized":"2024-09-11T01:07:39.754941+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:01:38.922178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":170,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:21.844743+0000","last_change":"2024-09-11T01:05:28.623895+0000","last_active":"2024-09-11T01:08:21.844743+0000","last_peered":"2024-09-11T01:08:21.844743+0000","last_clean":"2024-09-11T01:08:21.844743+0000","last_became_active":"2024-09-11T01:05:28.623520+0000","last_became_peered":"2024-09-11T01:05:28.623520+0000","last_unstale":"2024-09-11T01:08:21.844743+0000","last_undegraded":"2024-09-11T01:08:21.844743+0000","last_fullsized":"2024-09-11T01:08:21.844743+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:22:22.309521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595201+0000","last_change":"2024-09-11T01:05:40.974416+0000","last_active":"2024-09-11T01:06:41.595201+0000","last_peered":"2024-09-11T01:06:41.595201+0000","last_clean":"2024-09-11T01:06:41.595201+0000","last_became_active":"2024-09-11T01:05:40.973990+0000","last_became_peered":"2024-09-11T01:05:40.973990+0000","last_unstale":"2024-09-11T01:06:41.595201+0000","last_undegraded":"2024-09-11T01:06:41.595201+0000","last_fullsized":"2024-09-11T01:06:41.595201+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:57:30.018876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"89'5","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759166+0000","last_change":"2024-09-11T01:05:31.688968+0000","last_active":"2024-09-11T01:07:39.759166+0000","last_peered":"2024-09-11T01:07:39.759166+0000","last_clean":"2024-09-11T01:07:39.759166+0000","last_became_active":"2024-09-11T01:05:31.688672+0000","last_became_peered":"2024-09-11T01:05:31.688672+0000","last_unstale":"2024-09-11T01:07:39.759166+0000","last_undegraded":"2024-09-11T01:07:39.759166+0000","last_fullsized":"2024-09-11T01:07:39.759166+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:39.080386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597789+0000","last_change":"2024-09-11T01:05:28.554126+0000","last_active":"2024-09-11T01:06:41.597789+0000","last_peered":"2024-09-11T01:06:41.597789+0000","last_clean":"2024-09-11T01:06:41.597789+0000","last_became_active":"2024-09-11T01:05:28.553575+0000","last_became_peered":"2024-09-11T01:05:28.553575+0000","last_unstale":"2024-09-11T01:06:41.597789+0000","last_undegraded":"2024-09-11T01:06:41.597789+0000","last_fullsized":"2024-09-11T01:06:41.597789+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:42.203339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683998+0000","last_change":"2024-09-11T01:05:40.980415+0000","last_active":"2024-09-11T01:06:41.683998+0000","last_peered":"2024-09-11T01:06:41.683998+0000","last_clean":"2024-09-11T01:06:41.683998+0000","last_became_active":"2024-09-11T01:05:40.980062+0000","last_became_peered":"2024-09-11T01:05:40.980062+0000","last_unstale":"2024-09-11T01:06:41.683998+0000","last_undegraded":"2024-09-11T01:06:41.683998+0000","last_fullsized":"2024-09-11T01:06:41.683998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:25.889972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765210+0000","last_change":"2024-09-11T01:05:31.679622+0000","last_active":"2024-09-11T01:07:39.765210+0000","last_peered":"2024-09-11T01:07:39.765210+0000","last_clean":"2024-09-11T01:07:39.765210+0000","last_became_active":"2024-09-11T01:05:31.679239+0000","last_became_peered":"2024-09-11T01:05:31.679239+0000","last_unstale":"2024-09-11T01:07:39.765210+0000","last_undegraded":"2024-09-11T01:07:39.765210+0000","last_fullsized":"2024-09-11T01:07:39.765210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:40:32.240196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595578+0000","last_change":"2024-09-11T01:05:28.552203+0000","last_active":"2024-09-11T01:06:41.595578+0000","last_peered":"2024-09-11T01:06:41.595578+0000","last_clean":"2024-09-11T01:06:41.595578+0000","last_became_active":"2024-09-11T01:05:28.551658+0000","last_became_peered":"2024-09-11T01:05:28.551658+0000","last_unstale":"2024-09-11T01:06:41.595578+0000","last_undegraded":"2024-09-11T01:06:41.595578+0000","last_fullsized":"2024-09-11T01:06:41.595578+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:20:46.102466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'92","reported_seq":117,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598067+0000","last_change":"2024-09-11T01:04:12.299017+0000","last_active":"2024-09-11T01:06:41.598067+0000","last_peered":"2024-09-11T01:06:41.598067+0000","last_clean":"2024-09-11T01:06:41.598067+0000","last_became_active":"2024-09-11T01:04:11.998504+0000","last_became_peered":"2024-09-11T01:04:11.998504+0000","last_unstale":"2024-09-11T01:06:41.598067+0000","last_undegraded":"2024-09-11T01:06:41.598067+0000","last_fullsized":"2024-09-11T01:06:41.598067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:00:34.569322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:00:34.569322+0000","last_clean_scrub_stamp":"2024-09-11T01:00:34.569322+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:19:54.949789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"87'1","reported_seq":27,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597966+0000","last_change":"2024-09-11T01:05:40.982181+0000","last_active":"2024-09-11T01:06:41.597966+0000","last_peered":"2024-09-11T01:06:41.597966+0000","last_clean":"2024-09-11T01:06:41.597966+0000","last_became_active":"2024-09-11T01:05:40.981668+0000","last_became_peered":"2024-09-11T01:05:40.981668+0000","last_unstale":"2024-09-11T01:06:41.597966+0000","last_undegraded":"2024-09-11T01:06:41.597966+0000","last_fullsized":"2024-09-11T01:06:41.597966+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:48:48.199189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"89'7","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764704+0000","last_change":"2024-09-11T01:05:31.677978+0000","last_active":"2024-09-11T01:07:39.764704+0000","last_peered":"2024-09-11T01:07:39.764704+0000","last_clean":"2024-09-11T01:07:39.764704+0000","last_became_active":"2024-09-11T01:05:31.677478+0000","last_became_peered":"2024-09-11T01:05:31.677478+0000","last_unstale":"2024-09-11T01:07:39.764704+0000","last_undegraded":"2024-09-11T01:07:39.764704+0000","last_fullsized":"2024-09-11T01:07:39.764704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:39.568921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595451+0000","last_change":"2024-09-11T01:05:28.755866+0000","last_active":"2024-09-11T01:06:41.595451+0000","last_peered":"2024-09-11T01:06:41.595451+0000","last_clean":"2024-09-11T01:06:41.595451+0000","last_became_active":"2024-09-11T01:05:28.755475+0000","last_became_peered":"2024-09-11T01:05:28.755475+0000","last_unstale":"2024-09-11T01:06:41.595451+0000","last_undegraded":"2024-09-11T01:06:41.595451+0000","last_fullsized":"2024-09-11T01:06:41.595451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:22.324584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470249+0000","last_change":"2024-09-11T01:05:40.967181+0000","last_active":"2024-09-11T01:06:42.470249+0000","last_peered":"2024-09-11T01:06:42.470249+0000","last_clean":"2024-09-11T01:06:42.470249+0000","last_became_active":"2024-09-11T01:05:40.966748+0000","last_became_peered":"2024-09-11T01:05:40.966748+0000","last_unstale":"2024-09-11T01:06:42.470249+0000","last_undegraded":"2024-09-11T01:06:42.470249+0000","last_fullsized":"2024-09-11T01:06:42.470249+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:15:28.446190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"89'6","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.763173+0000","last_change":"2024-09-11T01:05:40.981823+0000","last_active":"2024-09-11T01:07:39.763173+0000","last_peered":"2024-09-11T01:07:39.763173+0000","last_clean":"2024-09-11T01:07:39.763173+0000","last_became_active":"2024-09-11T01:05:40.981478+0000","last_became_peered":"2024-09-11T01:05:40.981478+0000","last_unstale":"2024-09-11T01:07:39.763173+0000","last_undegraded":"2024-09-11T01:07:39.763173+0000","last_fullsized":"2024-09-11T01:07:39.763173+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:02:55.848492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.684119+0000","last_change":"2024-09-11T01:05:28.549207+0000","last_active":"2024-09-11T01:06:41.684119+0000","last_peered":"2024-09-11T01:06:41.684119+0000","last_clean":"2024-09-11T01:06:41.684119+0000","last_became_active":"2024-09-11T01:05:28.548156+0000","last_became_peered":"2024-09-11T01:05:28.548156+0000","last_unstale":"2024-09-11T01:06:41.684119+0000","last_undegraded":"2024-09-11T01:06:41.684119+0000","last_fullsized":"2024-09-11T01:06:41.684119+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:04:58.698379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470360+0000","last_change":"2024-09-11T01:05:40.982213+0000","last_active":"2024-09-11T01:06:42.470360+0000","last_peered":"2024-09-11T01:06:42.470360+0000","last_clean":"2024-09-11T01:06:42.470360+0000","last_became_active":"2024-09-11T01:05:40.981066+0000","last_became_peered":"2024-09-11T01:05:40.981066+0000","last_unstale":"2024-09-11T01:06:42.470360+0000","last_undegraded":"2024-09-11T01:06:42.470360+0000","last_fullsized":"2024-09-11T01:06:42.470360+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:44:09.348973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759808+0000","last_change":"2024-09-11T01:05:31.677613+0000","last_active":"2024-09-11T01:07:39.759808+0000","last_peered":"2024-09-11T01:07:39.759808+0000","last_clean":"2024-09-11T01:07:39.759808+0000","last_became_active":"2024-09-11T01:05:31.677263+0000","last_became_peered":"2024-09-11T01:05:31.677263+0000","last_unstale":"2024-09-11T01:07:39.759808+0000","last_undegraded":"2024-09-11T01:07:39.759808+0000","last_fullsized":"2024-09-11T01:07:39.759808+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:09:32.490982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595401+0000","last_change":"2024-09-11T01:05:28.558437+0000","last_active":"2024-09-11T01:06:41.595401+0000","last_peered":"2024-09-11T01:06:41.595401+0000","last_clean":"2024-09-11T01:06:41.595401+0000","last_became_active":"2024-09-11T01:05:28.558070+0000","last_became_peered":"2024-09-11T01:05:28.558070+0000","last_unstale":"2024-09-11T01:06:41.595401+0000","last_undegraded":"2024-09-11T01:06:41.595401+0000","last_fullsized":"2024-09-11T01:06:41.595401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:26.589209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683031+0000","last_change":"2024-09-11T01:05:40.970422+0000","last_active":"2024-09-11T01:06:41.683031+0000","last_peered":"2024-09-11T01:06:41.683031+0000","last_clean":"2024-09-11T01:06:41.683031+0000","last_became_active":"2024-09-11T01:05:40.970087+0000","last_became_peered":"2024-09-11T01:05:40.970087+0000","last_unstale":"2024-09-11T01:06:41.683031+0000","last_undegraded":"2024-09-11T01:06:41.683031+0000","last_fullsized":"2024-09-11T01:06:41.683031+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:30:05.171700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'5","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.751047+0000","last_change":"2024-09-11T01:05:40.967014+0000","last_active":"2024-09-11T01:07:39.751047+0000","last_peered":"2024-09-11T01:07:39.751047+0000","last_clean":"2024-09-11T01:07:39.751047+0000","last_became_active":"2024-09-11T01:05:40.966567+0000","last_became_peered":"2024-09-11T01:05:40.966567+0000","last_unstale":"2024-09-11T01:07:39.751047+0000","last_undegraded":"2024-09-11T01:07:39.751047+0000","last_fullsized":"2024-09-11T01:07:39.751047+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:50.868245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,8],"acting":[11,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.599221+0000","last_change":"2024-09-11T01:05:28.553646+0000","last_active":"2024-09-11T01:06:41.599221+0000","last_peered":"2024-09-11T01:06:41.599221+0000","last_clean":"2024-09-11T01:06:41.599221+0000","last_became_active":"2024-09-11T01:05:28.553238+0000","last_became_peered":"2024-09-11T01:05:28.553238+0000","last_unstale":"2024-09-11T01:06:41.599221+0000","last_undegraded":"2024-09-11T01:06:41.599221+0000","last_fullsized":"2024-09-11T01:06:41.599221+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:31.670321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683191+0000","last_change":"2024-09-11T01:05:40.973220+0000","last_active":"2024-09-11T01:06:41.683191+0000","last_peered":"2024-09-11T01:06:41.683191+0000","last_clean":"2024-09-11T01:06:41.683191+0000","last_became_active":"2024-09-11T01:05:40.972843+0000","last_became_peered":"2024-09-11T01:05:40.972843+0000","last_unstale":"2024-09-11T01:06:41.683191+0000","last_undegraded":"2024-09-11T01:06:41.683191+0000","last_fullsized":"2024-09-11T01:06:41.683191+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:47:07.785474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"89'6","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.758209+0000","last_change":"2024-09-11T01:05:31.682064+0000","last_active":"2024-09-11T01:07:39.758209+0000","last_peered":"2024-09-11T01:07:39.758209+0000","last_clean":"2024-09-11T01:07:39.758209+0000","last_became_active":"2024-09-11T01:05:31.681744+0000","last_became_peered":"2024-09-11T01:05:31.681744+0000","last_unstale":"2024-09-11T01:07:39.758209+0000","last_undegraded":"2024-09-11T01:07:39.758209+0000","last_fullsized":"2024-09-11T01:07:39.758209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:38:29.055133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597128+0000","last_change":"2024-09-11T01:05:40.986656+0000","last_active":"2024-09-11T01:06:41.597128+0000","last_peered":"2024-09-11T01:06:41.597128+0000","last_clean":"2024-09-11T01:06:41.597128+0000","last_became_active":"2024-09-11T01:05:40.970230+0000","last_became_peered":"2024-09-11T01:05:40.970230+0000","last_unstale":"2024-09-11T01:06:41.597128+0000","last_undegraded":"2024-09-11T01:06:41.597128+0000","last_fullsized":"2024-09-11T01:06:41.597128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:01:25.468986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595300+0000","last_change":"2024-09-11T01:05:40.980843+0000","last_active":"2024-09-11T01:06:41.595300+0000","last_peered":"2024-09-11T01:06:41.595300+0000","last_clean":"2024-09-11T01:06:41.595300+0000","last_became_active":"2024-09-11T01:05:40.979033+0000","last_became_peered":"2024-09-11T01:05:40.979033+0000","last_unstale":"2024-09-11T01:06:41.595300+0000","last_undegraded":"2024-09-11T01:06:41.595300+0000","last_fullsized":"2024-09-11T01:06:41.595300+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:44.039548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"89'6","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.756220+0000","last_change":"2024-09-11T01:05:31.676046+0000","last_active":"2024-09-11T01:07:39.756220+0000","last_peered":"2024-09-11T01:07:39.756220+0000","last_clean":"2024-09-11T01:07:39.756220+0000","last_became_active":"2024-09-11T01:05:31.675704+0000","last_became_peered":"2024-09-11T01:05:31.675704+0000","last_unstale":"2024-09-11T01:07:39.756220+0000","last_undegraded":"2024-09-11T01:07:39.756220+0000","last_fullsized":"2024-09-11T01:07:39.756220+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:17.907270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"89'5","reported_seq":174,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:21.845738+0000","last_change":"2024-09-11T01:05:28.550131+0000","last_active":"2024-09-11T01:08:21.845738+0000","last_peered":"2024-09-11T01:08:21.845738+0000","last_clean":"2024-09-11T01:08:21.845738+0000","last_became_active":"2024-09-11T01:05:28.549561+0000","last_became_peered":"2024-09-11T01:05:28.549561+0000","last_unstale":"2024-09-11T01:08:21.845738+0000","last_undegraded":"2024-09-11T01:08:21.845738+0000","last_fullsized":"2024-09-11T01:08:21.845738+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:26:52.001757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598656+0000","last_change":"2024-09-11T01:05:40.984877+0000","last_active":"2024-09-11T01:06:41.598656+0000","last_peered":"2024-09-11T01:06:41.598656+0000","last_clean":"2024-09-11T01:06:41.598656+0000","last_became_active":"2024-09-11T01:05:40.984500+0000","last_became_peered":"2024-09-11T01:05:40.984500+0000","last_unstale":"2024-09-11T01:06:41.598656+0000","last_undegraded":"2024-09-11T01:06:41.598656+0000","last_fullsized":"2024-09-11T01:06:41.598656+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:44.309560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"89'15","reported_seq":58,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.766111+0000","last_change":"2024-09-11T01:05:40.976014+0000","last_active":"2024-09-11T01:07:39.766111+0000","last_peered":"2024-09-11T01:07:39.766111+0000","last_clean":"2024-09-11T01:07:39.766111+0000","last_became_active":"2024-09-11T01:05:40.975610+0000","last_became_peered":"2024-09-11T01:05:40.975610+0000","last_unstale":"2024-09-11T01:07:39.766111+0000","last_undegraded":"2024-09-11T01:07:39.766111+0000","last_fullsized":"2024-09-11T01:07:39.766111+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:53:26.920957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,6],"acting":[7,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683533+0000","last_change":"2024-09-11T01:05:28.553043+0000","last_active":"2024-09-11T01:06:41.683533+0000","last_peered":"2024-09-11T01:06:41.683533+0000","last_clean":"2024-09-11T01:06:41.683533+0000","last_became_active":"2024-09-11T01:05:28.552678+0000","last_became_peered":"2024-09-11T01:05:28.552678+0000","last_unstale":"2024-09-11T01:06:41.683533+0000","last_undegraded":"2024-09-11T01:06:41.683533+0000","last_fullsized":"2024-09-11T01:06:41.683533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:44:23.279056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.601347+0000","last_change":"2024-09-11T01:06:41.600861+0000","last_active":"2024-09-11T01:06:41.601347+0000","last_peered":"2024-09-11T01:06:41.601347+0000","last_clean":"2024-09-11T01:06:41.601347+0000","last_became_active":"2024-09-11T01:06:41.600314+0000","last_became_peered":"2024-09-11T01:06:41.600314+0000","last_unstale":"2024-09-11T01:06:41.601347+0000","last_undegraded":"2024-09-11T01:06:41.601347+0000","last_fullsized":"2024-09-11T01:06:41.601347+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:55:29.070620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,7,6],"acting":[11,8,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765346+0000","last_change":"2024-09-11T01:05:31.674324+0000","last_active":"2024-09-11T01:07:39.765346+0000","last_peered":"2024-09-11T01:07:39.765346+0000","last_clean":"2024-09-11T01:07:39.765346+0000","last_became_active":"2024-09-11T01:05:31.673648+0000","last_became_peered":"2024-09-11T01:05:31.673648+0000","last_unstale":"2024-09-11T01:07:39.765346+0000","last_undegraded":"2024-09-11T01:07:39.765346+0000","last_fullsized":"2024-09-11T01:07:39.765346+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:22:02.134422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597403+0000","last_change":"2024-09-11T01:05:40.972605+0000","last_active":"2024-09-11T01:06:41.597403+0000","last_peered":"2024-09-11T01:06:41.597403+0000","last_clean":"2024-09-11T01:06:41.597403+0000","last_became_active":"2024-09-11T01:05:40.961704+0000","last_became_peered":"2024-09-11T01:05:40.961704+0000","last_unstale":"2024-09-11T01:06:41.597403+0000","last_undegraded":"2024-09-11T01:06:41.597403+0000","last_fullsized":"2024-09-11T01:06:41.597403+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:36:45.276739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683867+0000","last_change":"2024-09-11T01:05:40.969424+0000","last_active":"2024-09-11T01:06:41.683867+0000","last_peered":"2024-09-11T01:06:41.683867+0000","last_clean":"2024-09-11T01:06:41.683867+0000","last_became_active":"2024-09-11T01:05:40.968994+0000","last_became_peered":"2024-09-11T01:05:40.968994+0000","last_unstale":"2024-09-11T01:06:41.683867+0000","last_undegraded":"2024-09-11T01:06:41.683867+0000","last_fullsized":"2024-09-11T01:06:41.683867+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:24:08.554953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"89'6","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.755700+0000","last_change":"2024-09-11T01:05:31.675764+0000","last_active":"2024-09-11T01:07:39.755700+0000","last_peered":"2024-09-11T01:07:39.755700+0000","last_clean":"2024-09-11T01:07:39.755700+0000","last_became_active":"2024-09-11T01:05:31.674553+0000","last_became_peered":"2024-09-11T01:05:31.674553+0000","last_unstale":"2024-09-11T01:07:39.755700+0000","last_undegraded":"2024-09-11T01:07:39.755700+0000","last_fullsized":"2024-09-11T01:07:39.755700+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:24:30.026758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'39","reported_seq":347,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:18.826051+0000","last_change":"2024-09-11T01:05:40.975735+0000","last_active":"2024-09-11T01:08:18.826051+0000","last_peered":"2024-09-11T01:08:18.826051+0000","last_clean":"2024-09-11T01:08:18.826051+0000","last_became_active":"2024-09-11T01:05:40.964582+0000","last_became_peered":"2024-09-11T01:05:40.964582+0000","last_unstale":"2024-09-11T01:08:18.826051+0000","last_undegraded":"2024-09-11T01:08:18.826051+0000","last_fullsized":"2024-09-11T01:08:18.826051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:56:57.424468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69401,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":250,"num_read_kb":188,"num_write":40,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1612,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597830+0000","last_change":"2024-09-11T01:05:40.981306+0000","last_active":"2024-09-11T01:06:41.597830+0000","last_peered":"2024-09-11T01:06:41.597830+0000","last_clean":"2024-09-11T01:06:41.597830+0000","last_became_active":"2024-09-11T01:05:40.977531+0000","last_became_peered":"2024-09-11T01:05:40.977531+0000","last_unstale":"2024-09-11T01:06:41.597830+0000","last_undegraded":"2024-09-11T01:06:41.597830+0000","last_fullsized":"2024-09-11T01:06:41.597830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:15:21.613080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"89'11","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764170+0000","last_change":"2024-09-11T01:05:31.681612+0000","last_active":"2024-09-11T01:07:39.764170+0000","last_peered":"2024-09-11T01:07:39.764170+0000","last_clean":"2024-09-11T01:07:39.764170+0000","last_became_active":"2024-09-11T01:05:31.680609+0000","last_became_peered":"2024-09-11T01:05:31.680609+0000","last_unstale":"2024-09-11T01:07:39.764170+0000","last_undegraded":"2024-09-11T01:07:39.764170+0000","last_fullsized":"2024-09-11T01:07:39.764170+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:55:44.554562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.684460+0000","last_change":"2024-09-11T01:05:28.625177+0000","last_active":"2024-09-11T01:06:41.684460+0000","last_peered":"2024-09-11T01:06:41.684460+0000","last_clean":"2024-09-11T01:06:41.684460+0000","last_became_active":"2024-09-11T01:05:28.624819+0000","last_became_peered":"2024-09-11T01:05:28.624819+0000","last_unstale":"2024-09-11T01:06:41.684460+0000","last_undegraded":"2024-09-11T01:06:41.684460+0000","last_fullsized":"2024-09-11T01:06:41.684460+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:46:11.709636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":26,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595371+0000","last_change":"2024-09-11T01:05:40.978481+0000","last_active":"2024-09-11T01:06:41.595371+0000","last_peered":"2024-09-11T01:06:41.595371+0000","last_clean":"2024-09-11T01:06:41.595371+0000","last_became_active":"2024-09-11T01:05:40.977501+0000","last_became_peered":"2024-09-11T01:05:40.977501+0000","last_unstale":"2024-09-11T01:06:41.595371+0000","last_undegraded":"2024-09-11T01:06:41.595371+0000","last_fullsized":"2024-09-11T01:06:41.595371+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:08.427274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"89'9","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.770113+0000","last_change":"2024-09-11T01:05:31.692675+0000","last_active":"2024-09-11T01:07:39.770113+0000","last_peered":"2024-09-11T01:07:39.770113+0000","last_clean":"2024-09-11T01:07:39.770113+0000","last_became_active":"2024-09-11T01:05:31.690308+0000","last_became_peered":"2024-09-11T01:05:31.690308+0000","last_unstale":"2024-09-11T01:07:39.770113+0000","last_undegraded":"2024-09-11T01:07:39.770113+0000","last_fullsized":"2024-09-11T01:07:39.770113+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:16:14.823786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.598101+0000","last_change":"2024-09-11T01:05:28.557868+0000","last_active":"2024-09-11T01:06:41.598101+0000","last_peered":"2024-09-11T01:06:41.598101+0000","last_clean":"2024-09-11T01:06:41.598101+0000","last_became_active":"2024-09-11T01:05:28.557512+0000","last_became_peered":"2024-09-11T01:05:28.557512+0000","last_unstale":"2024-09-11T01:06:41.598101+0000","last_undegraded":"2024-09-11T01:06:41.598101+0000","last_fullsized":"2024-09-11T01:06:41.598101+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:53:50.733551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597725+0000","last_change":"2024-09-11T01:05:40.982368+0000","last_active":"2024-09-11T01:06:41.597725+0000","last_peered":"2024-09-11T01:06:41.597725+0000","last_clean":"2024-09-11T01:06:41.597725+0000","last_became_active":"2024-09-11T01:05:40.980337+0000","last_became_peered":"2024-09-11T01:05:40.980337+0000","last_unstale":"2024-09-11T01:06:41.597725+0000","last_undegraded":"2024-09-11T01:06:41.597725+0000","last_fullsized":"2024-09-11T01:06:41.597725+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:13:22.010496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"89'10","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.760342+0000","last_change":"2024-09-11T01:05:31.670806+0000","last_active":"2024-09-11T01:07:39.760342+0000","last_peered":"2024-09-11T01:07:39.760342+0000","last_clean":"2024-09-11T01:07:39.760342+0000","last_became_active":"2024-09-11T01:05:31.670452+0000","last_became_peered":"2024-09-11T01:05:31.670452+0000","last_unstale":"2024-09-11T01:07:39.760342+0000","last_undegraded":"2024-09-11T01:07:39.760342+0000","last_fullsized":"2024-09-11T01:07:39.760342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:42:22.489650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'5","reported_seq":165,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:17.823576+0000","last_change":"2024-09-11T01:05:28.555885+0000","last_active":"2024-09-11T01:08:17.823576+0000","last_peered":"2024-09-11T01:08:17.823576+0000","last_clean":"2024-09-11T01:08:17.823576+0000","last_became_active":"2024-09-11T01:05:28.555471+0000","last_became_peered":"2024-09-11T01:05:28.555471+0000","last_unstale":"2024-09-11T01:08:17.823576+0000","last_undegraded":"2024-09-11T01:08:17.823576+0000","last_fullsized":"2024-09-11T01:08:17.823576+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:33:50.935125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":119,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.650778+0000","last_change":"2024-09-11T01:05:40.971982+0000","last_active":"2024-09-11T01:06:41.650778+0000","last_peered":"2024-09-11T01:06:41.650778+0000","last_clean":"2024-09-11T01:06:41.650778+0000","last_became_active":"2024-09-11T01:05:40.971614+0000","last_became_peered":"2024-09-11T01:05:40.971614+0000","last_unstale":"2024-09-11T01:06:41.650778+0000","last_undegraded":"2024-09-11T01:06:41.650778+0000","last_fullsized":"2024-09-11T01:06:41.650778+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:11.939374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:42.470557+0000","last_change":"2024-09-11T01:05:40.972734+0000","last_active":"2024-09-11T01:06:42.470557+0000","last_peered":"2024-09-11T01:06:42.470557+0000","last_clean":"2024-09-11T01:06:42.470557+0000","last_became_active":"2024-09-11T01:05:40.969428+0000","last_became_peered":"2024-09-11T01:05:40.969428+0000","last_unstale":"2024-09-11T01:06:42.470557+0000","last_undegraded":"2024-09-11T01:06:42.470557+0000","last_fullsized":"2024-09-11T01:06:42.470557+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:23:30.199055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.762803+0000","last_change":"2024-09-11T01:05:31.684114+0000","last_active":"2024-09-11T01:07:39.762803+0000","last_peered":"2024-09-11T01:07:39.762803+0000","last_clean":"2024-09-11T01:07:39.762803+0000","last_became_active":"2024-09-11T01:05:31.683830+0000","last_became_peered":"2024-09-11T01:05:31.683830+0000","last_unstale":"2024-09-11T01:07:39.762803+0000","last_undegraded":"2024-09-11T01:07:39.762803+0000","last_fullsized":"2024-09-11T01:07:39.762803+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:14:43.695706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.683722+0000","last_change":"2024-09-11T01:05:28.554745+0000","last_active":"2024-09-11T01:06:41.683722+0000","last_peered":"2024-09-11T01:06:41.683722+0000","last_clean":"2024-09-11T01:06:41.683722+0000","last_became_active":"2024-09-11T01:05:28.554354+0000","last_became_peered":"2024-09-11T01:05:28.554354+0000","last_unstale":"2024-09-11T01:06:41.683722+0000","last_undegraded":"2024-09-11T01:06:41.683722+0000","last_fullsized":"2024-09-11T01:06:41.683722+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:33.663536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.597505+0000","last_change":"2024-09-11T01:05:40.974956+0000","last_active":"2024-09-11T01:06:41.597505+0000","last_peered":"2024-09-11T01:06:41.597505+0000","last_clean":"2024-09-11T01:06:41.597505+0000","last_became_active":"2024-09-11T01:05:40.974434+0000","last_became_peered":"2024-09-11T01:05:40.974434+0000","last_unstale":"2024-09-11T01:06:41.597505+0000","last_undegraded":"2024-09-11T01:06:41.597505+0000","last_fullsized":"2024-09-11T01:06:41.597505+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:06:01.196098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767222+0000","last_change":"2024-09-11T01:05:31.679904+0000","last_active":"2024-09-11T01:07:39.767222+0000","last_peered":"2024-09-11T01:07:39.767222+0000","last_clean":"2024-09-11T01:07:39.767222+0000","last_became_active":"2024-09-11T01:05:31.679517+0000","last_became_peered":"2024-09-11T01:05:31.679517+0000","last_unstale":"2024-09-11T01:07:39.767222+0000","last_undegraded":"2024-09-11T01:07:39.767222+0000","last_fullsized":"2024-09-11T01:07:39.767222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:19:24.725794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.594664+0000","last_change":"2024-09-11T01:05:28.549752+0000","last_active":"2024-09-11T01:06:41.594664+0000","last_peered":"2024-09-11T01:06:41.594664+0000","last_clean":"2024-09-11T01:06:41.594664+0000","last_became_active":"2024-09-11T01:05:28.549253+0000","last_became_peered":"2024-09-11T01:05:28.549253+0000","last_unstale":"2024-09-11T01:06:41.594664+0000","last_undegraded":"2024-09-11T01:06:41.594664+0000","last_fullsized":"2024-09-11T01:06:41.594664+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:07:25.774363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.680318+0000","last_change":"2024-09-11T01:05:28.553118+0000","last_active":"2024-09-11T01:06:41.680318+0000","last_peered":"2024-09-11T01:06:41.680318+0000","last_clean":"2024-09-11T01:06:41.680318+0000","last_became_active":"2024-09-11T01:05:28.552779+0000","last_became_peered":"2024-09-11T01:05:28.552779+0000","last_unstale":"2024-09-11T01:06:41.680318+0000","last_undegraded":"2024-09-11T01:06:41.680318+0000","last_fullsized":"2024-09-11T01:06:41.680318+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:58.297579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"89'8","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.762664+0000","last_change":"2024-09-11T01:05:40.981936+0000","last_active":"2024-09-11T01:07:39.762664+0000","last_peered":"2024-09-11T01:07:39.762664+0000","last_clean":"2024-09-11T01:07:39.762664+0000","last_became_active":"2024-09-11T01:05:40.981623+0000","last_became_peered":"2024-09-11T01:05:40.981623+0000","last_unstale":"2024-09-11T01:07:39.762664+0000","last_undegraded":"2024-09-11T01:07:39.762664+0000","last_fullsized":"2024-09-11T01:07:39.762664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:16:14.773406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.690918+0000","last_change":"2024-09-11T01:06:41.685046+0000","last_active":"2024-09-11T01:06:41.690918+0000","last_peered":"2024-09-11T01:06:41.690918+0000","last_clean":"2024-09-11T01:06:41.690918+0000","last_became_active":"2024-09-11T01:06:41.684442+0000","last_became_peered":"2024-09-11T01:06:41.684442+0000","last_unstale":"2024-09-11T01:06:41.690918+0000","last_undegraded":"2024-09-11T01:06:41.690918+0000","last_fullsized":"2024-09-11T01:06:41.690918+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:56:51.290772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'8","reported_seq":177,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:08:20.829046+0000","last_change":"2024-09-11T01:05:28.553479+0000","last_active":"2024-09-11T01:08:20.829046+0000","last_peered":"2024-09-11T01:08:20.829046+0000","last_clean":"2024-09-11T01:08:20.829046+0000","last_became_active":"2024-09-11T01:05:28.553171+0000","last_became_peered":"2024-09-11T01:05:28.553171+0000","last_unstale":"2024-09-11T01:08:20.829046+0000","last_undegraded":"2024-09-11T01:08:20.829046+0000","last_fullsized":"2024-09-11T01:08:20.829046+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:27.536181+0000","last_clean_scrub_stamp":"2024-09-11T01:05:27.536181+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:21:04.877982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.760071+0000","last_change":"2024-09-11T01:05:40.982070+0000","last_active":"2024-09-11T01:07:39.760071+0000","last_peered":"2024-09-11T01:07:39.760071+0000","last_clean":"2024-09-11T01:07:39.760071+0000","last_became_active":"2024-09-11T01:05:40.981601+0000","last_became_peered":"2024-09-11T01:05:40.981601+0000","last_unstale":"2024-09-11T01:07:39.760071+0000","last_undegraded":"2024-09-11T01:07:39.760071+0000","last_fullsized":"2024-09-11T01:07:39.760071+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T06:34:31.409711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":24,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:06:41.595121+0000","last_change":"2024-09-11T01:05:40.967374+0000","last_active":"2024-09-11T01:06:41.595121+0000","last_peered":"2024-09-11T01:06:41.595121+0000","last_clean":"2024-09-11T01:06:41.595121+0000","last_became_active":"2024-09-11T01:05:40.966705+0000","last_became_peered":"2024-09-11T01:05:40.966705+0000","last_unstale":"2024-09-11T01:06:41.595121+0000","last_undegraded":"2024-09-11T01:06:41.595121+0000","last_fullsized":"2024-09-11T01:06:41.595121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:39.944944+0000","last_clean_scrub_stamp":"2024-09-11T01:05:39.944944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:17.278999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"89'9","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.747569+0000","last_change":"2024-09-11T01:05:31.675298+0000","last_active":"2024-09-11T01:07:39.747569+0000","last_peered":"2024-09-11T01:07:39.747569+0000","last_clean":"2024-09-11T01:07:39.747569+0000","last_became_active":"2024-09-11T01:05:31.674922+0000","last_became_peered":"2024-09-11T01:05:31.674922+0000","last_unstale":"2024-09-11T01:07:39.747569+0000","last_undegraded":"2024-09-11T01:07:39.747569+0000","last_fullsized":"2024-09-11T01:07:39.747569+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:54:54.059202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"89'12","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.750462+0000","last_change":"2024-09-11T01:05:31.685494+0000","last_active":"2024-09-11T01:07:39.750462+0000","last_peered":"2024-09-11T01:07:39.750462+0000","last_clean":"2024-09-11T01:07:39.750462+0000","last_became_active":"2024-09-11T01:05:31.685131+0000","last_became_peered":"2024-09-11T01:05:31.685131+0000","last_unstale":"2024-09-11T01:07:39.750462+0000","last_undegraded":"2024-09-11T01:07:39.750462+0000","last_fullsized":"2024-09-11T01:07:39.750462+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:29:41.805135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759763+0000","last_change":"2024-09-11T01:05:31.686473+0000","last_active":"2024-09-11T01:07:39.759763+0000","last_peered":"2024-09-11T01:07:39.759763+0000","last_clean":"2024-09-11T01:07:39.759763+0000","last_became_active":"2024-09-11T01:05:31.685858+0000","last_became_peered":"2024-09-11T01:05:31.685858+0000","last_unstale":"2024-09-11T01:07:39.759763+0000","last_undegraded":"2024-09-11T01:07:39.759763+0000","last_fullsized":"2024-09-11T01:07:39.759763+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:43:52.174889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768644+0000","last_change":"2024-09-11T01:05:31.691078+0000","last_active":"2024-09-11T01:07:39.768644+0000","last_peered":"2024-09-11T01:07:39.768644+0000","last_clean":"2024-09-11T01:07:39.768644+0000","last_became_active":"2024-09-11T01:05:31.690755+0000","last_became_peered":"2024-09-11T01:05:31.690755+0000","last_unstale":"2024-09-11T01:07:39.768644+0000","last_undegraded":"2024-09-11T01:07:39.768644+0000","last_fullsized":"2024-09-11T01:07:39.768644+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:29:50.643233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"89'4","reported_seq":40,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.769438+0000","last_change":"2024-09-11T01:05:31.681933+0000","last_active":"2024-09-11T01:07:39.769438+0000","last_peered":"2024-09-11T01:07:39.769438+0000","last_clean":"2024-09-11T01:07:39.769438+0000","last_became_active":"2024-09-11T01:05:31.681642+0000","last_became_peered":"2024-09-11T01:05:31.681642+0000","last_unstale":"2024-09-11T01:07:39.769438+0000","last_undegraded":"2024-09-11T01:07:39.769438+0000","last_fullsized":"2024-09-11T01:07:39.769438+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:05:10.434843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"89'6","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.751080+0000","last_change":"2024-09-11T01:05:31.677188+0000","last_active":"2024-09-11T01:07:39.751080+0000","last_peered":"2024-09-11T01:07:39.751080+0000","last_clean":"2024-09-11T01:07:39.751080+0000","last_became_active":"2024-09-11T01:05:31.676689+0000","last_became_peered":"2024-09-11T01:05:31.676689+0000","last_unstale":"2024-09-11T01:07:39.751080+0000","last_undegraded":"2024-09-11T01:07:39.751080+0000","last_fullsized":"2024-09-11T01:07:39.751080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:44:51.899743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"89'15","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.753001+0000","last_change":"2024-09-11T01:05:31.678994+0000","last_active":"2024-09-11T01:07:39.753001+0000","last_peered":"2024-09-11T01:07:39.753001+0000","last_clean":"2024-09-11T01:07:39.753001+0000","last_became_active":"2024-09-11T01:05:31.678675+0000","last_became_peered":"2024-09-11T01:05:31.678675+0000","last_unstale":"2024-09-11T01:07:39.753001+0000","last_undegraded":"2024-09-11T01:07:39.753001+0000","last_fullsized":"2024-09-11T01:07:39.753001+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:09:35.740872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"89'2","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759357+0000","last_change":"2024-09-11T01:05:31.680046+0000","last_active":"2024-09-11T01:07:39.759357+0000","last_peered":"2024-09-11T01:07:39.759357+0000","last_clean":"2024-09-11T01:07:39.759357+0000","last_became_active":"2024-09-11T01:05:31.679626+0000","last_became_peered":"2024-09-11T01:05:31.679626+0000","last_unstale":"2024-09-11T01:07:39.759357+0000","last_undegraded":"2024-09-11T01:07:39.759357+0000","last_fullsized":"2024-09-11T01:07:39.759357+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:07:15.260470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"89'6","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767704+0000","last_change":"2024-09-11T01:05:31.683545+0000","last_active":"2024-09-11T01:07:39.767704+0000","last_peered":"2024-09-11T01:07:39.767704+0000","last_clean":"2024-09-11T01:07:39.767704+0000","last_became_active":"2024-09-11T01:05:31.683166+0000","last_became_peered":"2024-09-11T01:05:31.683166+0000","last_unstale":"2024-09-11T01:07:39.767704+0000","last_undegraded":"2024-09-11T01:07:39.767704+0000","last_fullsized":"2024-09-11T01:07:39.767704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:57.378211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"89'8","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765914+0000","last_change":"2024-09-11T01:05:31.678031+0000","last_active":"2024-09-11T01:07:39.765914+0000","last_peered":"2024-09-11T01:07:39.765914+0000","last_clean":"2024-09-11T01:07:39.765914+0000","last_became_active":"2024-09-11T01:05:31.677760+0000","last_became_peered":"2024-09-11T01:05:31.677760+0000","last_unstale":"2024-09-11T01:07:39.765914+0000","last_undegraded":"2024-09-11T01:07:39.765914+0000","last_fullsized":"2024-09-11T01:07:39.765914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:39.252655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767150+0000","last_change":"2024-09-11T01:05:31.677991+0000","last_active":"2024-09-11T01:07:39.767150+0000","last_peered":"2024-09-11T01:07:39.767150+0000","last_clean":"2024-09-11T01:07:39.767150+0000","last_became_active":"2024-09-11T01:05:31.677670+0000","last_became_peered":"2024-09-11T01:05:31.677670+0000","last_unstale":"2024-09-11T01:07:39.767150+0000","last_undegraded":"2024-09-11T01:07:39.767150+0000","last_fullsized":"2024-09-11T01:07:39.767150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:15:55.622757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"89'11","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.769904+0000","last_change":"2024-09-11T01:05:31.678213+0000","last_active":"2024-09-11T01:07:39.769904+0000","last_peered":"2024-09-11T01:07:39.769904+0000","last_clean":"2024-09-11T01:07:39.769904+0000","last_became_active":"2024-09-11T01:05:31.676422+0000","last_became_peered":"2024-09-11T01:05:31.676422+0000","last_unstale":"2024-09-11T01:07:39.769904+0000","last_undegraded":"2024-09-11T01:07:39.769904+0000","last_fullsized":"2024-09-11T01:07:39.769904+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:04:29.096123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"89'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.757534+0000","last_change":"2024-09-11T01:05:31.680945+0000","last_active":"2024-09-11T01:07:39.757534+0000","last_peered":"2024-09-11T01:07:39.757534+0000","last_clean":"2024-09-11T01:07:39.757534+0000","last_became_active":"2024-09-11T01:05:31.680458+0000","last_became_peered":"2024-09-11T01:05:31.680458+0000","last_unstale":"2024-09-11T01:07:39.757534+0000","last_undegraded":"2024-09-11T01:07:39.757534+0000","last_fullsized":"2024-09-11T01:07:39.757534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:09:01.382341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.758171+0000","last_change":"2024-09-11T01:05:31.685792+0000","last_active":"2024-09-11T01:07:39.758171+0000","last_peered":"2024-09-11T01:07:39.758171+0000","last_clean":"2024-09-11T01:07:39.758171+0000","last_became_active":"2024-09-11T01:05:31.685467+0000","last_became_peered":"2024-09-11T01:05:31.685467+0000","last_unstale":"2024-09-11T01:07:39.758171+0000","last_undegraded":"2024-09-11T01:07:39.758171+0000","last_fullsized":"2024-09-11T01:07:39.758171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:48:37.519075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"89'10","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.756874+0000","last_change":"2024-09-11T01:05:31.678855+0000","last_active":"2024-09-11T01:07:39.756874+0000","last_peered":"2024-09-11T01:07:39.756874+0000","last_clean":"2024-09-11T01:07:39.756874+0000","last_became_active":"2024-09-11T01:05:31.678583+0000","last_became_peered":"2024-09-11T01:05:31.678583+0000","last_unstale":"2024-09-11T01:07:39.756874+0000","last_undegraded":"2024-09-11T01:07:39.756874+0000","last_fullsized":"2024-09-11T01:07:39.756874+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:24.112383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"89'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768683+0000","last_change":"2024-09-11T01:05:31.682261+0000","last_active":"2024-09-11T01:07:39.768683+0000","last_peered":"2024-09-11T01:07:39.768683+0000","last_clean":"2024-09-11T01:07:39.768683+0000","last_became_active":"2024-09-11T01:05:31.681924+0000","last_became_peered":"2024-09-11T01:05:31.681924+0000","last_unstale":"2024-09-11T01:07:39.768683+0000","last_undegraded":"2024-09-11T01:07:39.768683+0000","last_fullsized":"2024-09-11T01:07:39.768683+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:05:54.556438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"89'9","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764873+0000","last_change":"2024-09-11T01:05:31.674687+0000","last_active":"2024-09-11T01:07:39.764873+0000","last_peered":"2024-09-11T01:07:39.764873+0000","last_clean":"2024-09-11T01:07:39.764873+0000","last_became_active":"2024-09-11T01:05:31.674348+0000","last_became_peered":"2024-09-11T01:05:31.674348+0000","last_unstale":"2024-09-11T01:07:39.764873+0000","last_undegraded":"2024-09-11T01:07:39.764873+0000","last_fullsized":"2024-09-11T01:07:39.764873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:17:46.086798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"89'7","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768016+0000","last_change":"2024-09-11T01:05:40.967775+0000","last_active":"2024-09-11T01:07:39.768016+0000","last_peered":"2024-09-11T01:07:39.768016+0000","last_clean":"2024-09-11T01:07:39.768016+0000","last_became_active":"2024-09-11T01:05:40.967355+0000","last_became_peered":"2024-09-11T01:05:40.967355+0000","last_unstale":"2024-09-11T01:07:39.768016+0000","last_undegraded":"2024-09-11T01:07:39.768016+0000","last_fullsized":"2024-09-11T01:07:39.768016+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:18:43.224010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767996+0000","last_change":"2024-09-11T01:05:31.674655+0000","last_active":"2024-09-11T01:07:39.767996+0000","last_peered":"2024-09-11T01:07:39.767996+0000","last_clean":"2024-09-11T01:07:39.767996+0000","last_became_active":"2024-09-11T01:05:31.674342+0000","last_became_peered":"2024-09-11T01:05:31.674342+0000","last_unstale":"2024-09-11T01:07:39.767996+0000","last_undegraded":"2024-09-11T01:07:39.767996+0000","last_fullsized":"2024-09-11T01:07:39.767996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:42:28.593441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"89'10","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764929+0000","last_change":"2024-09-11T01:05:31.678521+0000","last_active":"2024-09-11T01:07:39.764929+0000","last_peered":"2024-09-11T01:07:39.764929+0000","last_clean":"2024-09-11T01:07:39.764929+0000","last_became_active":"2024-09-11T01:05:31.674828+0000","last_became_peered":"2024-09-11T01:05:31.674828+0000","last_unstale":"2024-09-11T01:07:39.764929+0000","last_undegraded":"2024-09-11T01:07:39.764929+0000","last_fullsized":"2024-09-11T01:07:39.764929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:22:38.797887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"89'7","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.757696+0000","last_change":"2024-09-11T01:05:31.685075+0000","last_active":"2024-09-11T01:07:39.757696+0000","last_peered":"2024-09-11T01:07:39.757696+0000","last_clean":"2024-09-11T01:07:39.757696+0000","last_became_active":"2024-09-11T01:05:31.684742+0000","last_became_peered":"2024-09-11T01:05:31.684742+0000","last_unstale":"2024-09-11T01:07:39.757696+0000","last_undegraded":"2024-09-11T01:07:39.757696+0000","last_fullsized":"2024-09-11T01:07:39.757696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:29.381976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"89'6","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.764349+0000","last_change":"2024-09-11T01:05:31.678921+0000","last_active":"2024-09-11T01:07:39.764349+0000","last_peered":"2024-09-11T01:07:39.764349+0000","last_clean":"2024-09-11T01:07:39.764349+0000","last_became_active":"2024-09-11T01:05:31.678547+0000","last_became_peered":"2024-09-11T01:05:31.678547+0000","last_unstale":"2024-09-11T01:07:39.764349+0000","last_undegraded":"2024-09-11T01:07:39.764349+0000","last_fullsized":"2024-09-11T01:07:39.764349+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:59.618685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'16","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.757628+0000","last_change":"2024-09-11T01:05:31.685565+0000","last_active":"2024-09-11T01:07:39.757628+0000","last_peered":"2024-09-11T01:07:39.757628+0000","last_clean":"2024-09-11T01:07:39.757628+0000","last_became_active":"2024-09-11T01:05:31.685234+0000","last_became_peered":"2024-09-11T01:05:31.685234+0000","last_unstale":"2024-09-11T01:07:39.757628+0000","last_undegraded":"2024-09-11T01:07:39.757628+0000","last_fullsized":"2024-09-11T01:07:39.757628+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:09:07.831922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"89'11","reported_seq":47,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.759002+0000","last_change":"2024-09-11T01:05:31.677464+0000","last_active":"2024-09-11T01:07:39.759002+0000","last_peered":"2024-09-11T01:07:39.759002+0000","last_clean":"2024-09-11T01:07:39.759002+0000","last_became_active":"2024-09-11T01:05:31.677161+0000","last_became_peered":"2024-09-11T01:05:31.677161+0000","last_unstale":"2024-09-11T01:07:39.759002+0000","last_undegraded":"2024-09-11T01:07:39.759002+0000","last_fullsized":"2024-09-11T01:07:39.759002+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T05:25:26.590429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"89'9","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767267+0000","last_change":"2024-09-11T01:05:31.679977+0000","last_active":"2024-09-11T01:07:39.767267+0000","last_peered":"2024-09-11T01:07:39.767267+0000","last_clean":"2024-09-11T01:07:39.767267+0000","last_became_active":"2024-09-11T01:05:31.679661+0000","last_became_peered":"2024-09-11T01:05:31.679661+0000","last_unstale":"2024-09-11T01:07:39.767267+0000","last_undegraded":"2024-09-11T01:07:39.767267+0000","last_fullsized":"2024-09-11T01:07:39.767267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:12:00.040651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"89'5","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.765585+0000","last_change":"2024-09-11T01:05:31.685419+0000","last_active":"2024-09-11T01:07:39.765585+0000","last_peered":"2024-09-11T01:07:39.765585+0000","last_clean":"2024-09-11T01:07:39.765585+0000","last_became_active":"2024-09-11T01:05:31.684772+0000","last_became_peered":"2024-09-11T01:05:31.684772+0000","last_unstale":"2024-09-11T01:07:39.765585+0000","last_undegraded":"2024-09-11T01:07:39.765585+0000","last_fullsized":"2024-09-11T01:07:39.765585+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:37:19.283742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"89'6","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.758775+0000","last_change":"2024-09-11T01:05:31.681691+0000","last_active":"2024-09-11T01:07:39.758775+0000","last_peered":"2024-09-11T01:07:39.758775+0000","last_clean":"2024-09-11T01:07:39.758775+0000","last_became_active":"2024-09-11T01:05:31.680549+0000","last_became_peered":"2024-09-11T01:05:31.680549+0000","last_unstale":"2024-09-11T01:07:39.758775+0000","last_undegraded":"2024-09-11T01:07:39.758775+0000","last_fullsized":"2024-09-11T01:07:39.758775+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:15.561978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"89'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.767096+0000","last_change":"2024-09-11T01:05:31.687135+0000","last_active":"2024-09-11T01:07:39.767096+0000","last_peered":"2024-09-11T01:07:39.767096+0000","last_clean":"2024-09-11T01:07:39.767096+0000","last_became_active":"2024-09-11T01:05:31.686719+0000","last_became_peered":"2024-09-11T01:05:31.686719+0000","last_unstale":"2024-09-11T01:07:39.767096+0000","last_undegraded":"2024-09-11T01:07:39.767096+0000","last_fullsized":"2024-09-11T01:07:39.767096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:42.044930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"89'8","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.753981+0000","last_change":"2024-09-11T01:05:31.688154+0000","last_active":"2024-09-11T01:07:39.753981+0000","last_peered":"2024-09-11T01:07:39.753981+0000","last_clean":"2024-09-11T01:07:39.753981+0000","last_became_active":"2024-09-11T01:05:31.687734+0000","last_became_peered":"2024-09-11T01:05:31.687734+0000","last_unstale":"2024-09-11T01:07:39.753981+0000","last_undegraded":"2024-09-11T01:07:39.753981+0000","last_fullsized":"2024-09-11T01:07:39.753981+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:42:57.789086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"89'7","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.769196+0000","last_change":"2024-09-11T01:05:31.679761+0000","last_active":"2024-09-11T01:07:39.769196+0000","last_peered":"2024-09-11T01:07:39.769196+0000","last_clean":"2024-09-11T01:07:39.769196+0000","last_became_active":"2024-09-11T01:05:31.679345+0000","last_became_peered":"2024-09-11T01:05:31.679345+0000","last_unstale":"2024-09-11T01:07:39.769196+0000","last_undegraded":"2024-09-11T01:07:39.769196+0000","last_fullsized":"2024-09-11T01:07:39.769196+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:43:28.480561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"89'4","reported_seq":39,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.756084+0000","last_change":"2024-09-11T01:05:31.680782+0000","last_active":"2024-09-11T01:07:39.756084+0000","last_peered":"2024-09-11T01:07:39.756084+0000","last_clean":"2024-09-11T01:07:39.756084+0000","last_became_active":"2024-09-11T01:05:31.679984+0000","last_became_peered":"2024-09-11T01:05:31.679984+0000","last_unstale":"2024-09-11T01:07:39.756084+0000","last_undegraded":"2024-09-11T01:07:39.756084+0000","last_fullsized":"2024-09-11T01:07:39.756084+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:02:10.306868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"89'8","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-11T01:07:39.768521+0000","last_change":"2024-09-11T01:05:31.681462+0000","last_active":"2024-09-11T01:07:39.768521+0000","last_peered":"2024-09-11T01:07:39.768521+0000","last_clean":"2024-09-11T01:07:39.768521+0000","last_became_active":"2024-09-11T01:05:31.680799+0000","last_became_peered":"2024-09-11T01:05:31.680799+0000","last_unstale":"2024-09-11T01:07:39.768521+0000","last_undegraded":"2024-09-11T01:07:39.768521+0000","last_fullsized":"2024-09-11T01:07:39.768521+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T01:05:30.649507+0000","last_clean_scrub_stamp":"2024-09-11T01:05:30.649507+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:56:44.512831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74386,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":760,"num_read_kb":453,"num_write":190,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1646,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":450560,"data_stored":228198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":4132576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645360,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36344,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708808,"statfs":{"total":95995035648,"available":95957819392,"internally_reserved":0,"allocated":1024000,"data_stored":506452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841589,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28692,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716460,"statfs":{"total":95995035648,"available":95965655040,"internally_reserved":0,"allocated":1708032,"data_stored":1162898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005113,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":506542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201344,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":506350,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397573,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36928,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708224,"statfs":{"total":95995035648,"available":95957221376,"internally_reserved":0,"allocated":1622016,"data_stored":1103355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593803,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":501718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790033,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28616,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716536,"statfs":{"total":95995035648,"available":95965732864,"internally_reserved":0,"allocated":1630208,"data_stored":1098411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953558,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36420,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708732,"statfs":{"total":95995035648,"available":95957741568,"internally_reserved":0,"allocated":1101824,"data_stored":578821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149787,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32180,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712972,"statfs":{"total":95995035648,"available":95962083328,"internally_reserved":0,"allocated":1019904,"data_stored":501912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411425,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1024000,"data_stored":503787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1085440,"data_stored":573549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738474,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":503106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":71921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":73097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":71511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T01:08:25.234 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:08:25.602 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:25.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:25 smithi183 ceph-mon[34992]: pgmap v402: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T01:08:25.974 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:25 smithi103 ceph-mon[30562]: pgmap v402: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T01:08:26.024 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:25 smithi117 ceph-mon[35358]: pgmap v402: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T01:08:26.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.244+0000 7f0840a00640 1 -- 172.21.15.103:0/2879865894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f083c10aa70 msgr2=0x7f083c1154d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.244+0000 7f0840a00640 1 --2- 172.21.15.103:0/2879865894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f083c10aa70 0x7f083c1154d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f0828009900 tx=0x7f082802a480 comp rx=0 tx=0).stop 2024-09-11T01:08:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.244+0000 7f0840a00640 1 -- 172.21.15.103:0/2879865894 shutdown_connections 2024-09-11T01:08:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.244+0000 7f0840a00640 1 --2- 172.21.15.103:0/2879865894 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f083c115a10 0x7f083c117e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.244+0000 7f0840a00640 1 --2- 172.21.15.103:0/2879865894 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f083c10aa70 0x7f083c1154d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.244+0000 7f0840a00640 1 --2- 172.21.15.103:0/2879865894 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f083c10a150 0x7f083c10a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.244+0000 7f0840a00640 1 -- 172.21.15.103:0/2879865894 >> 172.21.15.103:0/2879865894 conn(0x7f083c06dfc0 msgr2=0x7f083c06e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.244+0000 7f0840a00640 1 -- 172.21.15.103:0/2879865894 shutdown_connections 2024-09-11T01:08:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.244+0000 7f0840a00640 1 -- 172.21.15.103:0/2879865894 wait complete. 2024-09-11T01:08:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.245+0000 7f0840a00640 1 Processor -- start 2024-09-11T01:08:26.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.245+0000 7f0840a00640 1 -- start start 2024-09-11T01:08:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.246+0000 7f0840a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f083c10a150 0x7f083c1a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.246+0000 7f0840a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f083c10aa70 0x7f083c1a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.246+0000 7f0840a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f083c115a10 0x7f083c1a7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.246+0000 7f0840a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f083c11b550 con 0x7f083c10aa70 2024-09-11T01:08:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.246+0000 7f0840a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f083c11b3d0 con 0x7f083c10a150 2024-09-11T01:08:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.246+0000 7f0840a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f083c11b6d0 con 0x7f083c115a10 2024-09-11T01:08:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.246+0000 7f0839400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f083c10aa70 0x7f083c1a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.246+0000 7f0839400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f083c10aa70 0x7f083c1a1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55648/0 (socket says 172.21.15.103:55648) 2024-09-11T01:08:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.246+0000 7f0839e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f083c10a150 0x7f083c1a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.246+0000 7f0839400640 1 -- 172.21.15.103:0/1341473456 learned_addr learned my addr 172.21.15.103:0/1341473456 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.246+0000 7f083a800640 1 --2- 172.21.15.103:0/1341473456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f083c115a10 0x7f083c1a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:26.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.247+0000 7f0839400640 1 -- 172.21.15.103:0/1341473456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f083c115a10 msgr2=0x7f083c1a7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:26.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.247+0000 7f0839400640 1 --2- 172.21.15.103:0/1341473456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f083c115a10 0x7f083c1a7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:26.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.247+0000 7f0839400640 1 -- 172.21.15.103:0/1341473456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f083c10a150 msgr2=0x7f083c1a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:26.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.247+0000 7f0839400640 1 --2- 172.21.15.103:0/1341473456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f083c10a150 0x7f083c1a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:26.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.247+0000 7f0839400640 1 -- 172.21.15.103:0/1341473456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c1a7af0 con 0x7f083c10aa70 2024-09-11T01:08:26.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.247+0000 7f0839400640 1 --2- 172.21.15.103:0/1341473456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f083c10aa70 0x7f083c1a1f80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0828005940 tx=0x7f08280040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:26.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.247+0000 7f0832a00640 1 -- 172.21.15.103:0/1341473456 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082803f030 con 0x7f083c10aa70 2024-09-11T01:08:26.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.247+0000 7f0832a00640 1 -- 172.21.15.103:0/1341473456 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f08280044c0 con 0x7f083c10aa70 2024-09-11T01:08:26.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.247+0000 7f0840a00640 1 -- 172.21.15.103:0/1341473456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083c1a7d80 con 0x7f083c10aa70 2024-09-11T01:08:26.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.247+0000 7f0832a00640 1 -- 172.21.15.103:0/1341473456 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828035070 con 0x7f083c10aa70 2024-09-11T01:08:26.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.248+0000 7f0840a00640 1 -- 172.21.15.103:0/1341473456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f083c1ae4a0 con 0x7f083c10aa70 2024-09-11T01:08:26.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.249+0000 7f0840a00640 1 -- 172.21.15.103:0/1341473456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f083c074940 con 0x7f083c10aa70 2024-09-11T01:08:26.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.251+0000 7f0832a00640 1 -- 172.21.15.103:0/1341473456 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7f082803b9f0 con 0x7f083c10aa70 2024-09-11T01:08:26.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.252+0000 7f0832a00640 1 --2- 172.21.15.103:0/1341473456 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f08200b53f0 0x7f08200b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:26.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.252+0000 7f0832a00640 1 -- 172.21.15.103:0/1341473456 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f08281066c0 con 0x7f083c10aa70 2024-09-11T01:08:26.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.253+0000 7f0839e00640 1 --2- 172.21.15.103:0/1341473456 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f08200b53f0 0x7f08200b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:26.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.253+0000 7f0839e00640 1 --2- 172.21.15.103:0/1341473456 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f08200b53f0 0x7f08200b78b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f082c009bd0 tx=0x7f082c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:26.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.256+0000 7f0832a00640 1 -- 172.21.15.103:0/1341473456 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f08280cc9c0 con 0x7f083c10aa70 2024-09-11T01:08:26.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.486+0000 7f0840a00640 1 -- 172.21.15.103:0/1341473456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f083c1a2b70 con 0x7f083c10aa70 2024-09-11T01:08:26.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.487+0000 7f0832a00640 1 -- 172.21.15.103:0/1341473456 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11930 (secure 0 0 0) 0x7f08280d13f0 con 0x7f083c10aa70 2024-09-11T01:08:26.489 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:08:26.489 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-09-11T01:08:18:615937+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:08:18.524092+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24629,24619]},"id":1}]} 2024-09-11T01:08:26.489 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-09-11T01:08:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.490+0000 7f0840a00640 1 -- 172.21.15.103:0/1341473456 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f08200b53f0 msgr2=0x7f08200b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.490+0000 7f0840a00640 1 --2- 172.21.15.103:0/1341473456 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f08200b53f0 0x7f08200b78b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f082c009bd0 tx=0x7f082c005f90 comp rx=0 tx=0).stop 2024-09-11T01:08:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.490+0000 7f0840a00640 1 -- 172.21.15.103:0/1341473456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f083c10aa70 msgr2=0x7f083c1a1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.490+0000 7f0840a00640 1 --2- 172.21.15.103:0/1341473456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f083c10aa70 0x7f083c1a1f80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0828005940 tx=0x7f08280040c0 comp rx=0 tx=0).stop 2024-09-11T01:08:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.490+0000 7f0840a00640 1 -- 172.21.15.103:0/1341473456 shutdown_connections 2024-09-11T01:08:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.490+0000 7f0840a00640 1 --2- 172.21.15.103:0/1341473456 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f08200b53f0 0x7f08200b78b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.490+0000 7f0840a00640 1 --2- 172.21.15.103:0/1341473456 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f083c115a10 0x7f083c1a7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.490+0000 7f0840a00640 1 --2- 172.21.15.103:0/1341473456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f083c10aa70 0x7f083c1a1f80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.490+0000 7f0840a00640 1 --2- 172.21.15.103:0/1341473456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f083c10a150 0x7f083c1a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.490+0000 7f0840a00640 1 -- 172.21.15.103:0/1341473456 >> 172.21.15.103:0/1341473456 conn(0x7f083c06dfc0 msgr2=0x7f083c071730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.490+0000 7f0840a00640 1 -- 172.21.15.103:0/1341473456 shutdown_connections 2024-09-11T01:08:26.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:26.490+0000 7f0840a00640 1 -- 172.21.15.103:0/1341473456 wait complete. 2024-09-11T01:08:26.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:26 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1341473456' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:26.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:26 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1341473456' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:27.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:26 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1341473456' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:27.533 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:08:27.761 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:27 smithi103 ceph-mon[30562]: pgmap v403: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-11T01:08:27.914 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:27.921 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:27 smithi183 ceph-mon[34992]: pgmap v403: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-11T01:08:28.125 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:27 smithi117 ceph-mon[35358]: pgmap v403: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-11T01:08:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.616+0000 7f7bd5400640 1 -- 172.21.15.103:0/1250990657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bd0100fc0 msgr2=0x7f7bd01013e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.616+0000 7f7bd5400640 1 --2- 172.21.15.103:0/1250990657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bd0100fc0 0x7f7bd01013e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc009900 tx=0x7f7bbc02a410 comp rx=0 tx=0).stop 2024-09-11T01:08:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.617+0000 7f7bd5400640 1 -- 172.21.15.103:0/1250990657 shutdown_connections 2024-09-11T01:08:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.617+0000 7f7bd5400640 1 --2- 172.21.15.103:0/1250990657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd0101b90 0x7f7bd0111770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.617+0000 7f7bd5400640 1 --2- 172.21.15.103:0/1250990657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bd0100fc0 0x7f7bd01013e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.617+0000 7f7bd5400640 1 --2- 172.21.15.103:0/1250990657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bd0103900 0x7f7bd0103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.617+0000 7f7bd5400640 1 -- 172.21.15.103:0/1250990657 >> 172.21.15.103:0/1250990657 conn(0x7f7bd0078100 msgr2=0x7f7bd00ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.617+0000 7f7bd5400640 1 -- 172.21.15.103:0/1250990657 shutdown_connections 2024-09-11T01:08:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.617+0000 7f7bd5400640 1 -- 172.21.15.103:0/1250990657 wait complete. 2024-09-11T01:08:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.618+0000 7f7bd5400640 1 Processor -- start 2024-09-11T01:08:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.618+0000 7f7bd5400640 1 -- start start 2024-09-11T01:08:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.618+0000 7f7bd5400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd0100fc0 0x7f7bd019b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.618+0000 7f7bd5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bd0101b90 0x7f7bd019ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.618+0000 7f7bd5400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bd0103900 0x7f7bd01a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.618+0000 7f7bd5400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd0114ff0 con 0x7f7bd0101b90 2024-09-11T01:08:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.618+0000 7f7bd5400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd0114e70 con 0x7f7bd0100fc0 2024-09-11T01:08:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.618+0000 7f7bd5400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd0115170 con 0x7f7bd0103900 2024-09-11T01:08:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.618+0000 7f7bce800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd0100fc0 0x7f7bd019b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.618+0000 7f7bce800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd0100fc0 0x7f7bd019b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:41784/0 (socket says 172.21.15.103:41784) 2024-09-11T01:08:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.618+0000 7f7bcde00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bd0101b90 0x7f7bd019ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.618+0000 7f7bce800640 1 -- 172.21.15.103:0/3779620283 learned_addr learned my addr 172.21.15.103:0/3779620283 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.618+0000 7f7bcf200640 1 --2- 172.21.15.103:0/3779620283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bd0103900 0x7f7bd01a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.619+0000 7f7bce800640 1 -- 172.21.15.103:0/3779620283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bd0103900 msgr2=0x7f7bd01a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.619+0000 7f7bce800640 1 --2- 172.21.15.103:0/3779620283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bd0103900 0x7f7bd01a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.619+0000 7f7bce800640 1 -- 172.21.15.103:0/3779620283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bd0101b90 msgr2=0x7f7bd019ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.619+0000 7f7bce800640 1 --2- 172.21.15.103:0/3779620283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bd0101b90 0x7f7bd019ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.619+0000 7f7bce800640 1 -- 172.21.15.103:0/3779620283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd01a15f0 con 0x7f7bd0100fc0 2024-09-11T01:08:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.619+0000 7f7bce800640 1 --2- 172.21.15.103:0/3779620283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd0100fc0 0x7f7bd019b540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000eb90 tx=0x7f7bc000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.619+0000 7f7bc7400640 1 -- 172.21.15.103:0/3779620283 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0004d20 con 0x7f7bd0100fc0 2024-09-11T01:08:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.619+0000 7f7bd5400640 1 -- 172.21.15.103:0/3779620283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd01a18e0 con 0x7f7bd0100fc0 2024-09-11T01:08:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.619+0000 7f7bc7400640 1 -- 172.21.15.103:0/3779620283 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bc000ee90 con 0x7f7bd0100fc0 2024-09-11T01:08:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.619+0000 7f7bc7400640 1 -- 172.21.15.103:0/3779620283 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0010670 con 0x7f7bd0100fc0 2024-09-11T01:08:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.619+0000 7f7bd5400640 1 -- 172.21.15.103:0/3779620283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd01a7fa0 con 0x7f7bd0100fc0 2024-09-11T01:08:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.620+0000 7f7bd5400640 1 -- 172.21.15.103:0/3779620283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd01013e0 con 0x7f7bd0100fc0 2024-09-11T01:08:28.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.623+0000 7f7bc7400640 1 -- 172.21.15.103:0/3779620283 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7f7bc0010830 con 0x7f7bd0100fc0 2024-09-11T01:08:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.624+0000 7f7bc7400640 1 --2- 172.21.15.103:0/3779620283 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7bb40b5370 0x7f7bb40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.624+0000 7f7bc7400640 1 -- 172.21.15.103:0/3779620283 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f7bc00e6a70 con 0x7f7bd0100fc0 2024-09-11T01:08:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.624+0000 7f7bcde00640 1 --2- 172.21.15.103:0/3779620283 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7bb40b5370 0x7f7bb40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.625+0000 7f7bcde00640 1 --2- 172.21.15.103:0/3779620283 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7bb40b5370 0x7f7bb40b7830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc005ab0 tx=0x7f7bbc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.626+0000 7f7bc7400640 1 -- 172.21.15.103:0/3779620283 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f7bc0056220 con 0x7f7bd0100fc0 2024-09-11T01:08:28.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.845+0000 7f7bd5400640 1 -- 172.21.15.103:0/3779620283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bd01a8270 con 0x7f7bd0100fc0 2024-09-11T01:08:28.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.846+0000 7f7bc7400640 1 -- 172.21.15.103:0/3779620283 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11930 (secure 0 0 0) 0x7f7bc00ad3c0 con 0x7f7bd0100fc0 2024-09-11T01:08:28.848 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:08:28.848 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-09-11T01:08:18:615937+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:08:18.524092+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24629,24619]},"id":1}]} 2024-09-11T01:08:28.849 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-09-11T01:08:28.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.849+0000 7f7bd5400640 1 -- 172.21.15.103:0/3779620283 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7bb40b5370 msgr2=0x7f7bb40b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:28.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.849+0000 7f7bd5400640 1 --2- 172.21.15.103:0/3779620283 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7bb40b5370 0x7f7bb40b7830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc005ab0 tx=0x7f7bbc005a20 comp rx=0 tx=0).stop 2024-09-11T01:08:28.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.849+0000 7f7bd5400640 1 -- 172.21.15.103:0/3779620283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd0100fc0 msgr2=0x7f7bd019b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:28.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.849+0000 7f7bd5400640 1 --2- 172.21.15.103:0/3779620283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd0100fc0 0x7f7bd019b540 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000eb90 tx=0x7f7bc000c6a0 comp rx=0 tx=0).stop 2024-09-11T01:08:28.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.849+0000 7f7bd5400640 1 -- 172.21.15.103:0/3779620283 shutdown_connections 2024-09-11T01:08:28.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.849+0000 7f7bd5400640 1 --2- 172.21.15.103:0/3779620283 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7bb40b5370 0x7f7bb40b7830 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:28.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.849+0000 7f7bd5400640 1 --2- 172.21.15.103:0/3779620283 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7bd0103900 0x7f7bd01a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:28.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.849+0000 7f7bd5400640 1 --2- 172.21.15.103:0/3779620283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7bd0101b90 0x7f7bd019ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:28.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.849+0000 7f7bd5400640 1 --2- 172.21.15.103:0/3779620283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7bd0100fc0 0x7f7bd019b540 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:28.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.849+0000 7f7bd5400640 1 -- 172.21.15.103:0/3779620283 >> 172.21.15.103:0/3779620283 conn(0x7f7bd0078100 msgr2=0x7f7bd00fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:28.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.849+0000 7f7bd5400640 1 -- 172.21.15.103:0/3779620283 shutdown_connections 2024-09-11T01:08:28.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:28.849+0000 7f7bd5400640 1 -- 172.21.15.103:0/3779620283 wait complete. 2024-09-11T01:08:29.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:28 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3779620283' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:29.270 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:28 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3779620283' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:29.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:28 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3779620283' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:29.822 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T01:08:30.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:29 smithi103 ceph-mon[30562]: pgmap v404: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T01:08:30.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:29 smithi183 ceph-mon[34992]: pgmap v404: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T01:08:30.194 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:30.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:29 smithi117 ceph-mon[35358]: pgmap v404: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T01:08:30.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.808+0000 7ff4fd600640 1 -- 172.21.15.103:0/1745201360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4f8101ab0 msgr2=0x7ff4f8101e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:30.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.808+0000 7ff4fd600640 1 --2- 172.21.15.103:0/1745201360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4f8101ab0 0x7ff4f8101e90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8009900 tx=0x7ff4e802a410 comp rx=0 tx=0).stop 2024-09-11T01:08:30.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.808+0000 7ff4fd600640 1 -- 172.21.15.103:0/1745201360 shutdown_connections 2024-09-11T01:08:30.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.808+0000 7ff4fd600640 1 --2- 172.21.15.103:0/1745201360 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4f8106ef0 0x7ff4f8107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:30.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.808+0000 7ff4fd600640 1 --2- 172.21.15.103:0/1745201360 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4f81023d0 0x7ff4f81068a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:30.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.808+0000 7ff4fd600640 1 --2- 172.21.15.103:0/1745201360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4f8101ab0 0x7ff4f8101e90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:30.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.808+0000 7ff4fd600640 1 -- 172.21.15.103:0/1745201360 >> 172.21.15.103:0/1745201360 conn(0x7ff4f80fd700 msgr2=0x7ff4f80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:30.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.808+0000 7ff4fd600640 1 -- 172.21.15.103:0/1745201360 shutdown_connections 2024-09-11T01:08:30.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.808+0000 7ff4fd600640 1 -- 172.21.15.103:0/1745201360 wait complete. 2024-09-11T01:08:30.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.809+0000 7ff4fd600640 1 Processor -- start 2024-09-11T01:08:30.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.809+0000 7ff4fd600640 1 -- start start 2024-09-11T01:08:30.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.809+0000 7ff4fd600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4f8101ab0 0x7ff4f819f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.809+0000 7ff4fd600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4f81023d0 0x7ff4f819fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.809+0000 7ff4fd600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4f8106ef0 0x7ff4f81a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.809+0000 7ff4fd600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f8119380 con 0x7ff4f81023d0 2024-09-11T01:08:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.809+0000 7ff4fd600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f8119200 con 0x7ff4f8101ab0 2024-09-11T01:08:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.809+0000 7ff4fd600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f8119500 con 0x7ff4f8106ef0 2024-09-11T01:08:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.809+0000 7ff4ee000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4f81023d0 0x7ff4f819fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.810+0000 7ff4ee000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4f81023d0 0x7ff4f819fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43868/0 (socket says 172.21.15.103:43868) 2024-09-11T01:08:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.810+0000 7ff4ee000640 1 -- 172.21.15.103:0/3545912560 learned_addr learned my addr 172.21.15.103:0/3545912560 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.810+0000 7ff4f7400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4f8106ef0 0x7ff4f81a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.810+0000 7ff4f6a00640 1 --2- 172.21.15.103:0/3545912560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4f8101ab0 0x7ff4f819f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.810+0000 7ff4ee000640 1 -- 172.21.15.103:0/3545912560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4f8106ef0 msgr2=0x7ff4f81a51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.810+0000 7ff4ee000640 1 --2- 172.21.15.103:0/3545912560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4f8106ef0 0x7ff4f81a51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.810+0000 7ff4ee000640 1 -- 172.21.15.103:0/3545912560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4f8101ab0 msgr2=0x7ff4f819f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.810+0000 7ff4ee000640 1 --2- 172.21.15.103:0/3545912560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4f8101ab0 0x7ff4f819f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.810+0000 7ff4ee000640 1 -- 172.21.15.103:0/3545912560 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f81a59a0 con 0x7ff4f81023d0 2024-09-11T01:08:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.810+0000 7ff4f7400640 1 --2- 172.21.15.103:0/3545912560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4f8106ef0 0x7ff4f81a51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.810+0000 7ff4ee000640 1 --2- 172.21.15.103:0/3545912560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4f81023d0 0x7ff4f819fe30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000e9c0 tx=0x7ff4e000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.811+0000 7ff4efe00640 1 -- 172.21.15.103:0/3545912560 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e000ccc0 con 0x7ff4f81023d0 2024-09-11T01:08:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.811+0000 7ff4fd600640 1 -- 172.21.15.103:0/3545912560 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f81a5c90 con 0x7ff4f81023d0 2024-09-11T01:08:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.811+0000 7ff4efe00640 1 -- 172.21.15.103:0/3545912560 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff4e00035f0 con 0x7ff4f81023d0 2024-09-11T01:08:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.811+0000 7ff4efe00640 1 -- 172.21.15.103:0/3545912560 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e000ce60 con 0x7ff4f81023d0 2024-09-11T01:08:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.811+0000 7ff4fd600640 1 -- 172.21.15.103:0/3545912560 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f81ac350 con 0x7ff4f81023d0 2024-09-11T01:08:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.812+0000 7ff4fd600640 1 -- 172.21.15.103:0/3545912560 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f81068a0 con 0x7ff4f81023d0 2024-09-11T01:08:30.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.814+0000 7ff4efe00640 1 -- 172.21.15.103:0/3545912560 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7ff4e0004000 con 0x7ff4f81023d0 2024-09-11T01:08:30.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.816+0000 7ff4efe00640 1 --2- 172.21.15.103:0/3545912560 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff4dc0b5370 0x7ff4dc0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:30.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.816+0000 7ff4efe00640 1 -- 172.21.15.103:0/3545912560 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7ff4e00e6560 con 0x7ff4f81023d0 2024-09-11T01:08:30.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.816+0000 7ff4f6a00640 1 --2- 172.21.15.103:0/3545912560 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff4dc0b5370 0x7ff4dc0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:30.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.817+0000 7ff4f6a00640 1 --2- 172.21.15.103:0/3545912560 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff4dc0b5370 0x7ff4dc0b7830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8031440 tx=0x7ff4e8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:30.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:30.817+0000 7ff4efe00640 1 -- 172.21.15.103:0/3545912560 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff4e00aceb0 con 0x7ff4f81023d0 2024-09-11T01:08:31.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:31.002+0000 7ff4fd600640 1 -- 172.21.15.103:0/3545912560 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4f81ac670 con 0x7ff4f81023d0 2024-09-11T01:08:31.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:31.004+0000 7ff4efe00640 1 -- 172.21.15.103:0/3545912560 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24984 (secure 0 0 0) 0x7ff4e00ac7b0 con 0x7ff4f81023d0 2024-09-11T01:08:31.006 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:08:31.006 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","created":"2024-09-11T00:56:46.242882+0000","modified":"2024-09-11T01:06:41.586918+0000","last_up_change":"2024-09-11T01:04:34.895368+0000","last_in_change":"2024-09-11T01:04:11.663436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:00:33.745338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T01:05:27.486014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T01:05:29.797513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T01:05:38.956635+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1b3e4222-43fd-4af0-bf97-3ba1000221b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6803","nonce":1867193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6805","nonce":1867193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6809","nonce":1867193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6807","nonce":1867193874}]},"public_addr":"172.21.15.103:6803/1867193874","cluster_addr":"172.21.15.103:6805/1867193874","heartbeat_back_addr":"172.21.15.103:6809/1867193874","heartbeat_front_addr":"172.21.15.103:6807/1867193874","state":["exists","up"]},{"osd":1,"uuid":"9a2b40da-7361-4c4f-a9dc-a769b427a0fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6801","nonce":2629532556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6803","nonce":2629532556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6807","nonce":2629532556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6805","nonce":2629532556}]},"public_addr":"172.21.15.117:6801/2629532556","cluster_addr":"172.21.15.117:6803/2629532556","heartbeat_back_addr":"172.21.15.117:6807/2629532556","heartbeat_front_addr":"172.21.15.117:6805/2629532556","state":["exists","up"]},{"osd":2,"uuid":"5db919c1-90a7-4ba7-acf3-89eeb77ae131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6801","nonce":3208966770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6803","nonce":3208966770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6807","nonce":3208966770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6805","nonce":3208966770}]},"public_addr":"172.21.15.183:6801/3208966770","cluster_addr":"172.21.15.183:6803/3208966770","heartbeat_back_addr":"172.21.15.183:6807/3208966770","heartbeat_front_addr":"172.21.15.183:6805/3208966770","state":["exists","up"]},{"osd":3,"uuid":"bdc465f2-06a5-4667-9651-4e168700d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6811","nonce":2238128162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6813","nonce":2238128162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6817","nonce":2238128162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6815","nonce":2238128162}]},"public_addr":"172.21.15.103:6811/2238128162","cluster_addr":"172.21.15.103:6813/2238128162","heartbeat_back_addr":"172.21.15.103:6817/2238128162","heartbeat_front_addr":"172.21.15.103:6815/2238128162","state":["exists","up"]},{"osd":4,"uuid":"be86a5d2-5e86-4bf4-8464-9dff7a801e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6809","nonce":2368878504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6811","nonce":2368878504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6815","nonce":2368878504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6813","nonce":2368878504}]},"public_addr":"172.21.15.117:6809/2368878504","cluster_addr":"172.21.15.117:6811/2368878504","heartbeat_back_addr":"172.21.15.117:6815/2368878504","heartbeat_front_addr":"172.21.15.117:6813/2368878504","state":["exists","up"]},{"osd":5,"uuid":"090b20ec-d9ff-4e10-ad9f-52ab41dbf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6809","nonce":1668069547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6811","nonce":1668069547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6815","nonce":1668069547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6813","nonce":1668069547}]},"public_addr":"172.21.15.183:6809/1668069547","cluster_addr":"172.21.15.183:6811/1668069547","heartbeat_back_addr":"172.21.15.183:6815/1668069547","heartbeat_front_addr":"172.21.15.183:6813/1668069547","state":["exists","up"]},{"osd":6,"uuid":"19abe982-3522-40f9-a628-ddaef462cdb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6819","nonce":4203476972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6821","nonce":4203476972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6825","nonce":4203476972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6823","nonce":4203476972}]},"public_addr":"172.21.15.103:6819/4203476972","cluster_addr":"172.21.15.103:6821/4203476972","heartbeat_back_addr":"172.21.15.103:6825/4203476972","heartbeat_front_addr":"172.21.15.103:6823/4203476972","state":["exists","up"]},{"osd":7,"uuid":"e875ff09-805a-40ff-9d6a-dd2607ce3432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6817","nonce":1207680713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6819","nonce":1207680713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6823","nonce":1207680713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6821","nonce":1207680713}]},"public_addr":"172.21.15.117:6817/1207680713","cluster_addr":"172.21.15.117:6819/1207680713","heartbeat_back_addr":"172.21.15.117:6823/1207680713","heartbeat_front_addr":"172.21.15.117:6821/1207680713","state":["exists","up"]},{"osd":8,"uuid":"2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6817","nonce":2935820593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6819","nonce":2935820593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6823","nonce":2935820593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6821","nonce":2935820593}]},"public_addr":"172.21.15.183:6817/2935820593","cluster_addr":"172.21.15.183:6819/2935820593","heartbeat_back_addr":"172.21.15.183:6823/2935820593","heartbeat_front_addr":"172.21.15.183:6821/2935820593","state":["exists","up"]},{"osd":9,"uuid":"c36d17d2-0bc8-4322-a998-9c8eff970e58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6827","nonce":2104855877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6829","nonce":2104855877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6833","nonce":2104855877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6831","nonce":2104855877}]},"public_addr":"172.21.15.103:6827/2104855877","cluster_addr":"172.21.15.103:6829/2104855877","heartbeat_back_addr":"172.21.15.103:6833/2104855877","heartbeat_front_addr":"172.21.15.103:6831/2104855877","state":["exists","up"]},{"osd":10,"uuid":"e71bc5f7-a829-43cf-a10b-b2444da1d773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6825","nonce":3792981873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6827","nonce":3792981873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6831","nonce":3792981873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6829","nonce":3792981873}]},"public_addr":"172.21.15.117:6825/3792981873","cluster_addr":"172.21.15.117:6827/3792981873","heartbeat_back_addr":"172.21.15.117:6831/3792981873","heartbeat_front_addr":"172.21.15.117:6829/3792981873","state":["exists","up"]},{"osd":11,"uuid":"8f36697f-4d18-4efa-bf14-d68a13464958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6825","nonce":1250387289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6827","nonce":1250387289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6831","nonce":1250387289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6829","nonce":1250387289}]},"public_addr":"172.21.15.183:6825/1250387289","cluster_addr":"172.21.15.183:6827/1250387289","heartbeat_back_addr":"172.21.15.183:6831/1250387289","heartbeat_front_addr":"172.21.15.183:6829/1250387289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:59:39.916330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:06.042858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:30.703648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:59.493376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:25.190299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:50.480326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:20.815441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:46.398318+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:11.499922+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:41.895096+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:08.411538+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:32.943466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/366890372":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6800/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2372812363":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2844264136":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/2046654364":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6801/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/211510947":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6801/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6800/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/189409602":"2024-09-12T00:57:11.412015+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:08:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:31.006+0000 7ff4fd600640 1 -- 172.21.15.103:0/3545912560 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff4dc0b5370 msgr2=0x7ff4dc0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:31.006+0000 7ff4fd600640 1 --2- 172.21.15.103:0/3545912560 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff4dc0b5370 0x7ff4dc0b7830 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8031440 tx=0x7ff4e8005b50 comp rx=0 tx=0).stop 2024-09-11T01:08:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:31.006+0000 7ff4fd600640 1 -- 172.21.15.103:0/3545912560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4f81023d0 msgr2=0x7ff4f819fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:31.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:31.006+0000 7ff4fd600640 1 --2- 172.21.15.103:0/3545912560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4f81023d0 0x7ff4f819fe30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000e9c0 tx=0x7ff4e000ee80 comp rx=0 tx=0).stop 2024-09-11T01:08:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:31.006+0000 7ff4fd600640 1 -- 172.21.15.103:0/3545912560 shutdown_connections 2024-09-11T01:08:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:31.006+0000 7ff4fd600640 1 --2- 172.21.15.103:0/3545912560 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff4dc0b5370 0x7ff4dc0b7830 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:31.006+0000 7ff4fd600640 1 --2- 172.21.15.103:0/3545912560 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff4f8106ef0 0x7ff4f81a51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:31.006+0000 7ff4fd600640 1 --2- 172.21.15.103:0/3545912560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4f81023d0 0x7ff4f819fe30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:31.006+0000 7ff4fd600640 1 --2- 172.21.15.103:0/3545912560 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4f8101ab0 0x7ff4f819f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:31.006+0000 7ff4fd600640 1 -- 172.21.15.103:0/3545912560 >> 172.21.15.103:0/3545912560 conn(0x7ff4f80fd700 msgr2=0x7ff4f8104870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:31.007+0000 7ff4fd600640 1 -- 172.21.15.103:0/3545912560 shutdown_connections 2024-09-11T01:08:31.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:31.007+0000 7ff4fd600640 1 -- 172.21.15.103:0/3545912560 wait complete. 2024-09-11T01:08:31.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:31 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3545912560' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:08:31.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:31 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3545912560' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:08:31.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:31 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3545912560' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:08:31.897 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-11T01:08:32.285 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.285+0000 7f2d7ac00640 1 -- 172.21.15.103:0/1329257840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d7410a6b0 msgr2=0x7f2d7410cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.285+0000 7f2d7ac00640 1 --2- 172.21.15.103:0/1329257840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d7410a6b0 0x7f2d7410cb70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009ca0 tx=0x7f2d6c02a8c0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.287 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.286+0000 7f2d7ac00640 1 -- 172.21.15.103:0/1329257840 shutdown_connections 2024-09-11T01:08:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.286+0000 7f2d7ac00640 1 --2- 172.21.15.103:0/1329257840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d7410a6b0 0x7f2d7410cb70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.286+0000 7f2d7ac00640 1 --2- 172.21.15.103:0/1329257840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d74075b20 0x7f2d74075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.286+0000 7f2d7ac00640 1 --2- 172.21.15.103:0/1329257840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d74076f90 0x7f2d740755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.286+0000 7f2d7ac00640 1 -- 172.21.15.103:0/1329257840 >> 172.21.15.103:0/1329257840 conn(0x7f2d740fe030 msgr2=0x7f2d74100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.286+0000 7f2d7ac00640 1 -- 172.21.15.103:0/1329257840 shutdown_connections 2024-09-11T01:08:32.288 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.286+0000 7f2d7ac00640 1 -- 172.21.15.103:0/1329257840 wait complete. 2024-09-11T01:08:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.286+0000 7f2d7ac00640 1 Processor -- start 2024-09-11T01:08:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.287+0000 7f2d7ac00640 1 -- start start 2024-09-11T01:08:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.287+0000 7f2d7ac00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d74075b20 0x7f2d7419ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.287+0000 7f2d7ac00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d74076f90 0x7f2d7419b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.287+0000 7f2d7ac00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d7410a6b0 0x7f2d7419bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.287+0000 7f2d7ac00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2d74110630 con 0x7f2d7410a6b0 2024-09-11T01:08:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.287+0000 7f2d7ac00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741104b0 con 0x7f2d74076f90 2024-09-11T01:08:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.287+0000 7f2d7ac00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741107b0 con 0x7f2d74075b20 2024-09-11T01:08:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.287+0000 7f2d79800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d74075b20 0x7f2d7419ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.287+0000 7f2d79800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d74075b20 0x7f2d7419ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:44170/0 (socket says 172.21.15.103:44170) 2024-09-11T01:08:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.287+0000 7f2d79800640 1 -- 172.21.15.103:0/443794594 learned_addr learned my addr 172.21.15.103:0/443794594 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.287+0000 7f2d7a200640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d7410a6b0 0x7f2d7419bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.287+0000 7f2d78e00640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d74076f90 0x7f2d7419b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.288+0000 7f2d79800640 1 -- 172.21.15.103:0/443794594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d74076f90 msgr2=0x7f2d7419b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.288+0000 7f2d79800640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d74076f90 0x7f2d7419b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.288+0000 7f2d79800640 1 -- 172.21.15.103:0/443794594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d7410a6b0 msgr2=0x7f2d7419bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.288+0000 7f2d79800640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d7410a6b0 0x7f2d7419bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.288+0000 7f2d79800640 1 -- 172.21.15.103:0/443794594 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7419c850 con 0x7f2d74075b20 2024-09-11T01:08:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.288+0000 7f2d78e00640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d74076f90 0x7f2d7419b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.288+0000 7f2d79800640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d74075b20 0x7f2d7419ad10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800ea60 tx=0x7f2d6800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.288+0000 7f2d72000640 1 -- 172.21.15.103:0/443794594 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6800cde0 con 0x7f2d74075b20 2024-09-11T01:08:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.288+0000 7f2d72000640 1 -- 172.21.15.103:0/443794594 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d680035f0 con 0x7f2d74075b20 2024-09-11T01:08:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.288+0000 7f2d72000640 1 -- 172.21.15.103:0/443794594 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68010690 con 0x7f2d74075b20 2024-09-11T01:08:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.288+0000 7f2d7ac00640 1 -- 172.21.15.103:0/443794594 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d7419cb40 con 0x7f2d74075b20 2024-09-11T01:08:32.292 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.288+0000 7f2d7ac00640 1 -- 172.21.15.103:0/443794594 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d741a3210 con 0x7f2d74075b20 2024-09-11T01:08:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.291+0000 7f2d7f053740 1 Processor -- start 2024-09-11T01:08:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.291+0000 7f2d7f053740 1 -- start start 2024-09-11T01:08:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d72000640 1 -- 172.21.15.103:0/443794594 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7f2d68004000 con 0x7f2d74075b20 2024-09-11T01:08:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d7f053740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146c970 0x55e1b146ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d7f053740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146f2a0 0x55e1b1471690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d7f053740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b1471ce0 0x55e1b14741a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d7f053740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e1b13df6b0 con 0x55e1b146f2a0 2024-09-11T01:08:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d7f053740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e1b13ceae0 con 0x55e1b146c970 2024-09-11T01:08:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d7f053740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e1b13d28f0 con 0x55e1b1471ce0 2024-09-11T01:08:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d7a200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146c970 0x55e1b146ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d79800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146f2a0 0x55e1b1471690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d7a200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146c970 0x55e1b146ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:55268/0 (socket says 172.21.15.103:55268) 2024-09-11T01:08:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d7a200640 1 -- 172.21.15.103:0/4032641768 learned_addr learned my addr 172.21.15.103:0/4032641768 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d78e00640 1 --2- 172.21.15.103:0/4032641768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b1471ce0 0x55e1b14741a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d7a200640 1 -- 172.21.15.103:0/4032641768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b1471ce0 msgr2=0x55e1b14741a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d7a200640 1 --2- 172.21.15.103:0/4032641768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b1471ce0 0x55e1b14741a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d7a200640 1 -- 172.21.15.103:0/4032641768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146f2a0 msgr2=0x55e1b1471690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d7a200640 1 --2- 172.21.15.103:0/4032641768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146f2a0 0x55e1b1471690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d7a200640 1 -- 172.21.15.103:0/4032641768 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1b139b780 con 0x55e1b146c970 2024-09-11T01:08:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.292+0000 7f2d78e00640 1 --2- 172.21.15.103:0/4032641768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b1471ce0 0x55e1b14741a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:08:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.293+0000 7f2d7a200640 1 --2- 172.21.15.103:0/4032641768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146c970 0x55e1b146ed60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009ca0 tx=0x7f2d6c0093c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bec111ba6fe46044 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.293+0000 7f2d66a00640 1 -- 172.21.15.103:0/4032641768 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c031650 con 0x55e1b146c970 2024-09-11T01:08:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.293+0000 7f2d66a00640 1 -- 172.21.15.103:0/4032641768 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d6c036030 con 0x55e1b146c970 2024-09-11T01:08:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.293+0000 7f2d66a00640 1 -- 172.21.15.103:0/4032641768 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c004680 con 0x55e1b146c970 2024-09-11T01:08:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.293+0000 7f2d72000640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2d5c0b5370 0x7f2d5c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.294+0000 7f2d72000640 1 -- 172.21.15.103:0/443794594 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f2d680e63b0 con 0x7f2d74075b20 2024-09-11T01:08:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.294+0000 7f2d79800640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2d5c0b5370 0x7f2d5c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.294+0000 7f2d7f053740 1 -- 172.21.15.103:0/4032641768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146c970 msgr2=0x55e1b146ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.294+0000 7f2d7f053740 1 --2- 172.21.15.103:0/4032641768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146c970 0x55e1b146ed60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009ca0 tx=0x7f2d6c0093c0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.294+0000 7f2d7f053740 1 -- 172.21.15.103:0/4032641768 shutdown_connections 2024-09-11T01:08:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.294+0000 7f2d7f053740 1 --2- 172.21.15.103:0/4032641768 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b1471ce0 0x55e1b14741a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.294+0000 7f2d7f053740 1 --2- 172.21.15.103:0/4032641768 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146f2a0 0x55e1b1471690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.294+0000 7f2d7f053740 1 --2- 172.21.15.103:0/4032641768 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146c970 0x55e1b146ed60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.294+0000 7f2d7f053740 1 -- 172.21.15.103:0/4032641768 >> 172.21.15.103:0/4032641768 conn(0x55e1b1467ac0 msgr2=0x55e1b1468850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.294+0000 7f2d7f053740 1 -- 172.21.15.103:0/4032641768 shutdown_connections 2024-09-11T01:08:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.294+0000 7f2d7f053740 1 -- 172.21.15.103:0/4032641768 wait complete. 2024-09-11T01:08:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.294+0000 7f2d79800640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2d5c0b5370 0x7f2d5c0b7830 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2d680e9fd0 tx=0x7f2d680e9f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.295+0000 7f2d7f053740 1 -- start start 2024-09-11T01:08:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.295+0000 7f2d7f053740 1 Processor -- start 2024-09-11T01:08:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.295+0000 7f2d7f053740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b146c970 0x55e1b1475e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.295+0000 7f2d7f053740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146f2a0 0x55e1b1476530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.295+0000 7f2d7f053740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b1471ce0 0x55e1b1477100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.295+0000 7f2d7f053740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e1b1306ab0 con 0x55e1b146f2a0 2024-09-11T01:08:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.295+0000 7f2d7f053740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e1b1375570 con 0x55e1b1471ce0 2024-09-11T01:08:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.295+0000 7f2d7f053740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e1b1474ae0 con 0x55e1b146c970 2024-09-11T01:08:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.295+0000 7f2d7f053740 10 client.0 _ll_register_callbacks cb 0x55e1b1384100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.296+0000 7f2d78e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146f2a0 0x55e1b1476530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.296+0000 7f2d7a200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b146c970 0x55e1b1475e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.296+0000 7f2d78e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146f2a0 0x55e1b1476530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43902/0 (socket says 172.21.15.103:43902) 2024-09-11T01:08:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.296+0000 7f2d7a200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b146c970 0x55e1b1475e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:44188/0 (socket says 172.21.15.103:44188) 2024-09-11T01:08:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.296+0000 7f2d78e00640 1 -- 172.21.15.103:0/2828457764 learned_addr learned my addr 172.21.15.103:0/2828457764 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.296+0000 7f2d7a200640 1 --2- 172.21.15.103:0/2828457764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b1471ce0 0x55e1b1477100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.296+0000 7f2d7a200640 1 -- 172.21.15.103:0/2828457764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b1471ce0 msgr2=0x55e1b1477100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:32.304 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.296+0000 7f2d7a200640 1 --2- 172.21.15.103:0/2828457764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b1471ce0 0x55e1b1477100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.296+0000 7f2d7a200640 1 -- 172.21.15.103:0/2828457764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146f2a0 msgr2=0x55e1b1476530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.296+0000 7f2d7a200640 1 --2- 172.21.15.103:0/2828457764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146f2a0 0x55e1b1476530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.296+0000 7f2d7a200640 1 -- 172.21.15.103:0/2828457764 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1b1130790 con 0x55e1b146c970 2024-09-11T01:08:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.296+0000 7f2d78e00640 1 --2- 172.21.15.103:0/2828457764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146f2a0 0x55e1b1476530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.296+0000 7f2d7a200640 1 --2- 172.21.15.103:0/2828457764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b146c970 0x55e1b1475e90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c031a20 tx=0x7f2d6c031af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7313f3727997c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.296+0000 7f2d5b400640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:08:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.297+0000 7f2d5b400640 1 -- 172.21.15.103:0/2828457764 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c003d80 con 0x55e1b146c970 2024-09-11T01:08:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.297+0000 7f2d7f053740 1 -- 172.21.15.103:0/2828457764 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d6c036030 con 0x55e1b146c970 2024-09-11T01:08:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.297+0000 7f2d5b400640 1 -- 172.21.15.103:0/2828457764 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f2d6c02f610 con 0x55e1b146c970 2024-09-11T01:08:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.297+0000 7f2d5b400640 1 -- 172.21.15.103:0/2828457764 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2d6c004b40 con 0x55e1b146c970 2024-09-11T01:08:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.297+0000 7f2d7f053740 10 client.25309 fetch_fsmap learned FSMap version 26 2024-09-11T01:08:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.297+0000 7f2d7f053740 1 -- 172.21.15.103:0/2828457764 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e1b11a9620 con 0x55e1b146c970 2024-09-11T01:08:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.297+0000 7f2d5b400640 1 -- 172.21.15.103:0/2828457764 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d6c036030 con 0x55e1b146c970 2024-09-11T01:08:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.297+0000 7f2d5b400640 1 -- 172.21.15.103:0/2828457764 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f2d6c043070 con 0x55e1b146c970 2024-09-11T01:08:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.297+0000 7f2d7f053740 10 client.25309 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:08:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.297+0000 7f2d7f053740 10 client.25309 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:08:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.298+0000 7f2d7f053740 20 client.25309 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.298+0000 7f2d7f053740 1 --2- 172.21.15.103:0/2828457764 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1b1481380 0x55e1b1483770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.298+0000 7f2d7f053740 4 client.25309 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:08:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.298+0000 7f2d7f053740 1 -- 172.21.15.103:0/2828457764 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1b13e1600 con 0x55e1b1481380 2024-09-11T01:08:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.298+0000 7f2d78e00640 1 --2- 172.21.15.103:0/2828457764 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1b1481380 0x55e1b1483770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.299+0000 7f2d78e00640 1 --2- 172.21.15.103:0/2828457764 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1b1481380 0x55e1b1483770 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75dd8d4bf15a7d1d server_cookie=2e5ec83367d8ec40 in_seq=0 out_seq=0 2024-09-11T01:08:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.299+0000 7f2d5b400640 10 client.25309 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.299+0000 7f2d5b400640 1 -- 172.21.15.103:0/2828457764 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e1b13e1600 con 0x55e1b1481380 2024-09-11T01:08:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.299+0000 7f2d5b400640 10 client.25309 handle_command_reply: tid=0 2024-09-11T01:08:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.299+0000 7f2d7f053740 1 client.25309 shutdown 2024-09-11T01:08:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.300+0000 7f2d7f053740 1 -- 172.21.15.103:0/2828457764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b146c970 msgr2=0x55e1b1475e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.300+0000 7f2d7f053740 1 --2- 172.21.15.103:0/2828457764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b146c970 0x55e1b1475e90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c031a20 tx=0x7f2d6c031af0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.300+0000 7f2d7f053740 1 -- 172.21.15.103:0/2828457764 shutdown_connections 2024-09-11T01:08:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.300+0000 7f2d7f053740 1 --2- 172.21.15.103:0/2828457764 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b1471ce0 0x55e1b1477100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.300+0000 7f2d7f053740 1 --2- 172.21.15.103:0/2828457764 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146f2a0 0x55e1b1476530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.300+0000 7f2d7f053740 1 --2- 172.21.15.103:0/2828457764 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1b1481380 0x55e1b1483770 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.300+0000 7f2d7f053740 1 --2- 172.21.15.103:0/2828457764 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b146c970 0x55e1b1475e90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.300+0000 7f2d5b400640 0 client.25309 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.300+0000 7f2d7f053740 1 -- 172.21.15.103:0/2828457764 >> 172.21.15.103:0/2828457764 conn(0x55e1b1467ac0 msgr2=0x55e1b1466bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.300+0000 7f2d7f053740 1 -- 172.21.15.103:0/2828457764 shutdown_connections 2024-09-11T01:08:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.300+0000 7f2d7f053740 1 -- 172.21.15.103:0/2828457764 wait complete. 2024-09-11T01:08:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.300+0000 7f2d7f053740 20 client.25309 trim_cache size 0 max 16384 2024-09-11T01:08:32.321 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.318+0000 7f2d7f053740 1 Processor -- start 2024-09-11T01:08:32.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.318+0000 7f2d7f053740 1 -- start start 2024-09-11T01:08:32.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7f053740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146c970 0x55e1b146be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7f053740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146f2a0 0x55e1b146c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7f053740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b1471ce0 0x55e1b146a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7f053740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741afed0 con 0x55e1b146c970 2024-09-11T01:08:32.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7f053740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741ad7a0 con 0x55e1b146f2a0 2024-09-11T01:08:32.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7f053740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741ab5f0 con 0x55e1b1471ce0 2024-09-11T01:08:32.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146c970 0x55e1b146be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146c970 0x55e1b146be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43912/0 (socket says 172.21.15.103:43912) 2024-09-11T01:08:32.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7a200640 1 -- 172.21.15.103:0/3802344671 learned_addr learned my addr 172.21.15.103:0/3802344671 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:32.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d78e00640 1 --2- 172.21.15.103:0/3802344671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146f2a0 0x55e1b146c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7a200640 1 --2- 172.21.15.103:0/3802344671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b1471ce0 0x55e1b146a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7a200640 1 -- 172.21.15.103:0/3802344671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b1471ce0 msgr2=0x55e1b146a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7a200640 1 --2- 172.21.15.103:0/3802344671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b1471ce0 0x55e1b146a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7a200640 1 -- 172.21.15.103:0/3802344671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146f2a0 msgr2=0x55e1b146c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7a200640 1 --2- 172.21.15.103:0/3802344671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146f2a0 0x55e1b146c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.319+0000 7f2d7a200640 1 -- 172.21.15.103:0/3802344671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1b1475990 con 0x55e1b146c970 2024-09-11T01:08:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.320+0000 7f2d78e00640 1 --2- 172.21.15.103:0/3802344671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146f2a0 0x55e1b146c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.320+0000 7f2d7a200640 1 --2- 172.21.15.103:0/3802344671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146c970 0x55e1b146be00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c02f470 tx=0x7f2d6c03f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6be15c4b8161073a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.320+0000 7f2d66000640 1 -- 172.21.15.103:0/3802344671 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c004ce0 con 0x55e1b146c970 2024-09-11T01:08:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.320+0000 7f2d66000640 1 -- 172.21.15.103:0/3802344671 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d6c036040 con 0x55e1b146c970 2024-09-11T01:08:32.323 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.320+0000 7f2d66000640 1 -- 172.21.15.103:0/3802344671 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c003de0 con 0x55e1b146c970 2024-09-11T01:08:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.321+0000 7f2d7f053740 1 -- 172.21.15.103:0/3802344671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146c970 msgr2=0x55e1b146be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.321+0000 7f2d7f053740 1 --2- 172.21.15.103:0/3802344671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146c970 0x55e1b146be00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c02f470 tx=0x7f2d6c03f040 comp rx=0 tx=0).stop 2024-09-11T01:08:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.321+0000 7f2d7f053740 1 -- 172.21.15.103:0/3802344671 shutdown_connections 2024-09-11T01:08:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.321+0000 7f2d7f053740 1 --2- 172.21.15.103:0/3802344671 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b1471ce0 0x55e1b146a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.327 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.321+0000 7f2d7f053740 1 --2- 172.21.15.103:0/3802344671 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146f2a0 0x55e1b146c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.321+0000 7f2d7f053740 1 --2- 172.21.15.103:0/3802344671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b146c970 0x55e1b146be00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.321+0000 7f2d7f053740 1 -- 172.21.15.103:0/3802344671 >> 172.21.15.103:0/3802344671 conn(0x55e1b1467ac0 msgr2=0x55e1b1468560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.321+0000 7f2d7f053740 1 -- 172.21.15.103:0/3802344671 shutdown_connections 2024-09-11T01:08:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.321+0000 7f2d7f053740 1 -- 172.21.15.103:0/3802344671 wait complete. 2024-09-11T01:08:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.322+0000 7f2d7f053740 1 -- start start 2024-09-11T01:08:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.322+0000 7f2d7f053740 1 Processor -- start 2024-09-11T01:08:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.322+0000 7f2d7f053740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146c970 0x55e1b147da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.322+0000 7f2d7f053740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b146f2a0 0x55e1b14ea150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.322+0000 7f2d7f053740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b1471ce0 0x55e1b14ec770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.322+0000 7f2d7f053740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741abc60 con 0x55e1b1471ce0 2024-09-11T01:08:32.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.322+0000 7f2d7f053740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741ad0d0 con 0x55e1b146c970 2024-09-11T01:08:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.322+0000 7f2d7f053740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741ac330 con 0x55e1b146f2a0 2024-09-11T01:08:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.322+0000 7f2d7f053740 10 client.0 _ll_register_callbacks cb 0x7f2d680e9e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.323+0000 7f2d7a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b1471ce0 0x55e1b14ec770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.323+0000 7f2d78e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b146f2a0 0x55e1b14ea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.323+0000 7f2d78e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b146f2a0 0x55e1b14ea150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:44204/0 (socket says 172.21.15.103:44204) 2024-09-11T01:08:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.323+0000 7f2d78e00640 1 -- 172.21.15.103:0/2491636690 learned_addr learned my addr 172.21.15.103:0/2491636690 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.323+0000 7f2d7a200640 1 --2- 172.21.15.103:0/2491636690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146c970 0x55e1b147da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.323+0000 7f2d78e00640 1 -- 172.21.15.103:0/2491636690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146c970 msgr2=0x55e1b147da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.323+0000 7f2d78e00640 1 --2- 172.21.15.103:0/2491636690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146c970 0x55e1b147da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.323+0000 7f2d78e00640 1 -- 172.21.15.103:0/2491636690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b1471ce0 msgr2=0x55e1b14ec770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.323+0000 7f2d78e00640 1 --2- 172.21.15.103:0/2491636690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b1471ce0 0x55e1b14ec770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.323+0000 7f2d78e00640 1 -- 172.21.15.103:0/2491636690 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1b14ecfa0 con 0x55e1b146f2a0 2024-09-11T01:08:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.324+0000 7f2d78e00640 1 --2- 172.21.15.103:0/2491636690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b146f2a0 0x55e1b14ea150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55e1b1483ee0 tx=0x7f2d60012ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed29707b428d39f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.324+0000 7f2d5b400640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:08:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.324+0000 7f2d5b400640 1 -- 172.21.15.103:0/2491636690 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60029060 con 0x55e1b146f2a0 2024-09-11T01:08:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.324+0000 7f2d7f053740 1 -- 172.21.15.103:0/2491636690 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d6c036040 con 0x55e1b146f2a0 2024-09-11T01:08:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.324+0000 7f2d5b400640 1 -- 172.21.15.103:0/2491636690 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f2d60010be0 con 0x55e1b146f2a0 2024-09-11T01:08:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.324+0000 7f2d5b400640 1 -- 172.21.15.103:0/2491636690 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f2d60030050 con 0x55e1b146f2a0 2024-09-11T01:08:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.324+0000 7f2d7f053740 10 client.25315 fetch_fsmap learned FSMap version 26 2024-09-11T01:08:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.324+0000 7f2d7f053740 1 -- 172.21.15.103:0/2491636690 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55e1b14ee380 con 0x55e1b146f2a0 2024-09-11T01:08:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.325+0000 7f2d5b400640 1 -- 172.21.15.103:0/2491636690 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d6c036040 con 0x55e1b146f2a0 2024-09-11T01:08:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.325+0000 7f2d5b400640 1 -- 172.21.15.103:0/2491636690 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f2d60003a40 con 0x55e1b146f2a0 2024-09-11T01:08:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.325+0000 7f2d7f053740 10 client.25315 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:08:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.325+0000 7f2d7f053740 10 client.25315 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:08:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.325+0000 7f2d7f053740 20 client.25315 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.325+0000 7f2d7f053740 1 --2- 172.21.15.103:0/2491636690 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1b14eed10 0x55e1b14f1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.325+0000 7f2d7f053740 4 client.25315 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:08:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.325+0000 7f2d7f053740 1 -- 172.21.15.103:0/2491636690 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e1b13dd0b0 con 0x55e1b14eed10 2024-09-11T01:08:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.325+0000 7f2d7a200640 1 --2- 172.21.15.103:0/2491636690 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1b14eed10 0x55e1b14f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.326+0000 7f2d7a200640 1 --2- 172.21.15.103:0/2491636690 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1b14eed10 0x55e1b14f1130 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22b06efccfcbf15e server_cookie=2d6c1ac6f2f4446a in_seq=0 out_seq=0 2024-09-11T01:08:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.326+0000 7f2d5b400640 10 client.25315 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:32.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:32 smithi103 ceph-mon[30562]: pgmap v405: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T01:08:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.338+0000 7f2d5b400640 1 -- 172.21.15.103:0/2491636690 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e1b13dd0b0 con 0x55e1b14eed10 2024-09-11T01:08:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.338+0000 7f2d5b400640 10 client.25315 handle_command_reply: tid=0 2024-09-11T01:08:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.338+0000 7f2d7f053740 1 client.25315 shutdown 2024-09-11T01:08:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.338+0000 7f2d7f053740 1 -- 172.21.15.103:0/2491636690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b146f2a0 msgr2=0x55e1b14ea150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.338+0000 7f2d7f053740 1 --2- 172.21.15.103:0/2491636690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b146f2a0 0x55e1b14ea150 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55e1b1483ee0 tx=0x7f2d60012ed0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.338+0000 7f2d7f053740 1 -- 172.21.15.103:0/2491636690 shutdown_connections 2024-09-11T01:08:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.338+0000 7f2d7f053740 1 --2- 172.21.15.103:0/2491636690 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1b1471ce0 0x55e1b14ec770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.338+0000 7f2d7f053740 1 --2- 172.21.15.103:0/2491636690 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1b14eed10 0x55e1b14f1130 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.338+0000 7f2d7f053740 1 --2- 172.21.15.103:0/2491636690 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1b146f2a0 0x55e1b14ea150 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.338+0000 7f2d7f053740 1 --2- 172.21.15.103:0/2491636690 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1b146c970 0x55e1b147da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.338+0000 7f2d7f053740 1 -- 172.21.15.103:0/2491636690 >> 172.21.15.103:0/2491636690 conn(0x55e1b1467ac0 msgr2=0x55e1b146bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.338+0000 7f2d5b400640 0 client.25315 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.338+0000 7f2d7f053740 1 -- 172.21.15.103:0/2491636690 shutdown_connections 2024-09-11T01:08:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.338+0000 7f2d7f053740 1 -- 172.21.15.103:0/2491636690 wait complete. 2024-09-11T01:08:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.339+0000 7f2d7f053740 20 client.25315 trim_cache size 0 max 16384 2024-09-11T01:08:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:08:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:08:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:08:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:08:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.339+0000 7f2d7ac00640 1 -- 172.21.15.103:0/443794594 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2d5c0b5370 msgr2=0x7f2d5c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.339+0000 7f2d7ac00640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2d5c0b5370 0x7f2d5c0b7830 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2d680e9fd0 tx=0x7f2d680e9f40 comp rx=0 tx=0).stop 2024-09-11T01:08:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.339+0000 7f2d7ac00640 1 -- 172.21.15.103:0/443794594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d74075b20 msgr2=0x7f2d7419ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.339+0000 7f2d7ac00640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d74075b20 0x7f2d7419ad10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2d6800ea60 tx=0x7f2d6800ef20 comp rx=0 tx=0).stop 2024-09-11T01:08:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.339+0000 7f2d7ac00640 1 -- 172.21.15.103:0/443794594 shutdown_connections 2024-09-11T01:08:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.339+0000 7f2d7ac00640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2d5c0b5370 0x7f2d5c0b7830 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.339+0000 7f2d7ac00640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d7410a6b0 0x7f2d7419bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.339+0000 7f2d7ac00640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2d74076f90 0x7f2d7419b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.339+0000 7f2d7ac00640 1 --2- 172.21.15.103:0/443794594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2d74075b20 0x7f2d7419ad10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.339+0000 7f2d7ac00640 1 -- 172.21.15.103:0/443794594 >> 172.21.15.103:0/443794594 conn(0x7f2d740fe030 msgr2=0x7f2d74106690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.339+0000 7f2d7ac00640 1 -- 172.21.15.103:0/443794594 shutdown_connections 2024-09-11T01:08:32.344 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:32.339+0000 7f2d7ac00640 1 -- 172.21.15.103:0/443794594 wait complete. 2024-09-11T01:08:32.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:32 smithi117 ceph-mon[35358]: pgmap v405: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T01:08:32.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:32 smithi183 ceph-mon[34992]: pgmap v405: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T01:08:33.829 INFO:teuthology.orchestra.run.smithi103.stdout:{"run_dir":"/var/run/ceph"} 2024-09-11T01:08:33.829 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-11T01:08:33.830 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 6190 2024-09-11T01:08:33.830 DEBUG:tasks.quiescer:Yielding 2024-09-11T01:08:33.830 INFO:teuthology.run_tasks:Running task workunit... 2024-09-11T01:08:33.850 INFO:tasks.workunit:Pulling workunits from ref 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T01:08:33.850 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-11T01:08:33.850 INFO:tasks.workunit:timeout=3h 2024-09-11T01:08:33.850 INFO:tasks.workunit:cleanup=True 2024-09-11T01:08:33.851 DEBUG:teuthology.orchestra.run.smithi103:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-11T01:08:33.851 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:08:33.888 INFO:teuthology.orchestra.run.smithi103.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-11T01:08:33.888 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-11T01:08:33.888 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-11T01:08:33.888 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T01:08:33.888 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-11T01:08:33.888 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-11 01:06:31.454892242 +0000 2024-09-11T01:08:33.888 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-11 01:06:31.454892242 +0000 2024-09-11T01:08:33.888 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-11 01:08:17.661464857 +0000 2024-09-11T01:08:33.889 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-09-11 01:06:31.454892242 +0000 2024-09-11T01:08:33.889 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-11T01:08:33.889 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-11T01:08:33.999 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 8f219c476cb4f26fc5719c661c0323719a45cb30 2024-09-11T01:08:34.037 INFO:tasks.workunit.client.0.smithi103.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-11T01:08:34.250 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:34.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:34 smithi103 ceph-mon[30562]: pgmap v406: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-11T01:08:34.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:34 smithi117 ceph-mon[35358]: pgmap v406: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-11T01:08:34.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.897+0000 7f614f200640 1 -- 172.21.15.103:0/4137668949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6148104fa0 msgr2=0x7f6148105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:34.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.897+0000 7f614f200640 1 --2- 172.21.15.103:0/4137668949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6148104fa0 0x7f6148105380 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6138009ca0 tx=0x7f613802a8c0 comp rx=0 tx=0).stop 2024-09-11T01:08:34.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.897+0000 7f614f200640 1 -- 172.21.15.103:0/4137668949 shutdown_connections 2024-09-11T01:08:34.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.897+0000 7f614f200640 1 --2- 172.21.15.103:0/4137668949 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f614810b330 0x7f6148111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:34.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.897+0000 7f614f200640 1 --2- 172.21.15.103:0/4137668949 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614810a9b0 0x7f614810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:34.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.897+0000 7f614f200640 1 --2- 172.21.15.103:0/4137668949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6148104fa0 0x7f6148105380 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:34.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.897+0000 7f614f200640 1 -- 172.21.15.103:0/4137668949 >> 172.21.15.103:0/4137668949 conn(0x7f6148100a50 msgr2=0x7f6148102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:34.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.897+0000 7f614f200640 1 -- 172.21.15.103:0/4137668949 shutdown_connections 2024-09-11T01:08:34.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.897+0000 7f614f200640 1 -- 172.21.15.103:0/4137668949 wait complete. 2024-09-11T01:08:34.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.898+0000 7f614f200640 1 Processor -- start 2024-09-11T01:08:34.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.898+0000 7f614f200640 1 -- start start 2024-09-11T01:08:34.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.898+0000 7f614f200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6148104fa0 0x7f614819b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.898+0000 7f614f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614810a9b0 0x7f614819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.898+0000 7f614f200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614810b330 0x7f61481a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.898+0000 7f614f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6148114f60 con 0x7f614810a9b0 2024-09-11T01:08:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.898+0000 7f614f200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6148114de0 con 0x7f6148104fa0 2024-09-11T01:08:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.898+0000 7f614f200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f61481150e0 con 0x7f614810b330 2024-09-11T01:08:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.898+0000 7f6147400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614810a9b0 0x7f614819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.899+0000 7f6147400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614810a9b0 0x7f614819b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43942/0 (socket says 172.21.15.103:43942) 2024-09-11T01:08:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.899+0000 7f6147400640 1 -- 172.21.15.103:0/957849597 learned_addr learned my addr 172.21.15.103:0/957849597 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.899+0000 7f614d200640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614810b330 0x7f61481a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.899+0000 7f6147e00640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6148104fa0 0x7f614819b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.899+0000 7f6147400640 1 -- 172.21.15.103:0/957849597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614810b330 msgr2=0x7f61481a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:34.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.899+0000 7f6147400640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614810b330 0x7f61481a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:34.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.899+0000 7f6147400640 1 -- 172.21.15.103:0/957849597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6148104fa0 msgr2=0x7f614819b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:34.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.899+0000 7f6147400640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6148104fa0 0x7f614819b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:34.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.899+0000 7f6147400640 1 -- 172.21.15.103:0/957849597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61481a1540 con 0x7f614810a9b0 2024-09-11T01:08:34.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.899+0000 7f614d200640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614810b330 0x7f61481a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:34.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.899+0000 7f6147400640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614810a9b0 0x7f614819b9d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f613400e9f0 tx=0x7f613400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:34.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.900+0000 7f6144c00640 1 -- 172.21.15.103:0/957849597 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f613400cd80 con 0x7f614810a9b0 2024-09-11T01:08:34.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.900+0000 7f6144c00640 1 -- 172.21.15.103:0/957849597 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61340054d0 con 0x7f614810a9b0 2024-09-11T01:08:34.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.900+0000 7f6144c00640 1 -- 172.21.15.103:0/957849597 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134010690 con 0x7f614810a9b0 2024-09-11T01:08:34.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.900+0000 7f614f200640 1 -- 172.21.15.103:0/957849597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61481a1830 con 0x7f614810a9b0 2024-09-11T01:08:34.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.900+0000 7f614f200640 1 -- 172.21.15.103:0/957849597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61481a7ef0 con 0x7f614810a9b0 2024-09-11T01:08:34.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.901+0000 7f614f200640 1 -- 172.21.15.103:0/957849597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6148105380 con 0x7f614810a9b0 2024-09-11T01:08:34.905 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.904+0000 7f6144c00640 1 -- 172.21.15.103:0/957849597 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7f6134004e90 con 0x7f614810a9b0 2024-09-11T01:08:34.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.905+0000 7f6144c00640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f612c0b5370 0x7f612c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.905+0000 7f6144c00640 1 -- 172.21.15.103:0/957849597 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f61340e6580 con 0x7f614810a9b0 2024-09-11T01:08:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.905+0000 7f6147e00640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f612c0b5370 0x7f612c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:34.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.906+0000 7f6147e00640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f612c0b5370 0x7f612c0b7830 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6138009430 tx=0x7f6138009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:34.910 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:34.909+0000 7f6144c00640 1 -- 172.21.15.103:0/957849597 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f61340aced0 con 0x7f614810a9b0 2024-09-11T01:08:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:34 smithi183 ceph-mon[34992]: pgmap v406: 129 pgs: 129 active+clean; 652 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-11T01:08:35.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:35.131+0000 7f614f200640 1 -- 172.21.15.103:0/957849597 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f614810cb80 con 0x7f614810a9b0 2024-09-11T01:08:35.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:35.131+0000 7f6144c00640 1 -- 172.21.15.103:0/957849597 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11930 (secure 0 0 0) 0x7f61340ac7d0 con 0x7f614810a9b0 2024-09-11T01:08:35.133 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:08:35.133 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-09-11T01:08:18:615937+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:08:18.524092+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24629,24619]},"id":1}]} 2024-09-11T01:08:35.134 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-09-11T01:08:35.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:35.134+0000 7f614f200640 1 -- 172.21.15.103:0/957849597 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f612c0b5370 msgr2=0x7f612c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:35.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:35.134+0000 7f614f200640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f612c0b5370 0x7f612c0b7830 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6138009430 tx=0x7f6138009360 comp rx=0 tx=0).stop 2024-09-11T01:08:35.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:35.134+0000 7f614f200640 1 -- 172.21.15.103:0/957849597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614810a9b0 msgr2=0x7f614819b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:35.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:35.134+0000 7f614f200640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614810a9b0 0x7f614819b9d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f613400e9f0 tx=0x7f613400edf0 comp rx=0 tx=0).stop 2024-09-11T01:08:35.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:35.134+0000 7f614f200640 1 -- 172.21.15.103:0/957849597 shutdown_connections 2024-09-11T01:08:35.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:35.134+0000 7f614f200640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f612c0b5370 0x7f612c0b7830 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:35.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:35.134+0000 7f614f200640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f614810b330 0x7f61481a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:35.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:35.134+0000 7f614f200640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f614810a9b0 0x7f614819b9d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:35.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:35.134+0000 7f614f200640 1 --2- 172.21.15.103:0/957849597 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6148104fa0 0x7f614819b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:35.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:35.134+0000 7f614f200640 1 -- 172.21.15.103:0/957849597 >> 172.21.15.103:0/957849597 conn(0x7f6148100a50 msgr2=0x7f6148102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:35.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:35.134+0000 7f614f200640 1 -- 172.21.15.103:0/957849597 shutdown_connections 2024-09-11T01:08:35.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:35.134+0000 7f614f200640 1 -- 172.21.15.103:0/957849597 wait complete. 2024-09-11T01:08:35.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:35 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/957849597' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:35.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:35 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/957849597' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:35.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:35 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/957849597' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:35.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-11T01:05:32.767364+0000', 'modified': '2024-09-11T01:08:18.524092+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24665, 'mds_1': 24629, 'mds_2': 24619}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24595': {'gid': 24595, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.183:6835/2084396200', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6834', 'nonce': 2084396200}, {'type': 'v1', 'addr': '172.21.15.183:6835', 'nonce': 2084396200}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24602': {'gid': 24602, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.117:6835/3506900188', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6834', 'nonce': 3506900188}, {'type': 'v1', 'addr': '172.21.15.117:6835', 'nonce': 3506900188}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24607': {'gid': 24607, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.183:6837/1863510967', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6836', 'nonce': 1863510967}, {'type': 'v1', 'addr': '172.21.15.183:6837', 'nonce': 1863510967}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24619': {'gid': 24619, 'name': 'i', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.183:6839/1006805616', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.183:6838', 'nonce': 1006805616}, {'type': 'v1', 'addr': '172.21.15.183:6839', 'nonce': 1006805616}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24629': {'gid': 24629, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 19, 'addr': '172.21.15.117:6837/294794871', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6836', 'nonce': 294794871}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 294794871}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24665': {'gid': 24665, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.117:6839/1820809235', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6838', 'nonce': 1820809235}, {'type': 'v1', 'addr': '172.21.15.117:6839', 'nonce': 1820809235}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24665, 'qdb_cluster': [24665, 24629, 24619]} 2024-09-11T01:08:35.957 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-11T01:08:35.958 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell mds.i status 2024-09-11T01:08:36.368 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:36.759 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:36 smithi103 ceph-mon[30562]: pgmap v407: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-11T01:08:36.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:36 smithi117 ceph-mon[35358]: pgmap v407: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-11T01:08:36.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:36 smithi183 ceph-mon[34992]: pgmap v407: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-11T01:08:36.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.974+0000 7f709c000640 1 -- 172.21.15.103:0/4125298601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7094101220 msgr2=0x7f7094101600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:36.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.974+0000 7f709c000640 1 --2- 172.21.15.103:0/4125298601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7094101220 0x7f7094101600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7088009900 tx=0x7f708802a3f0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.974+0000 7f709c000640 1 -- 172.21.15.103:0/4125298601 shutdown_connections 2024-09-11T01:08:36.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.974+0000 7f709c000640 1 --2- 172.21.15.103:0/4125298601 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7094105ef0 0x7f709410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.974+0000 7f709c000640 1 --2- 172.21.15.103:0/4125298601 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7094105570 0x7f70941059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.974+0000 7f709c000640 1 --2- 172.21.15.103:0/4125298601 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7094101220 0x7f7094101600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.974+0000 7f709c000640 1 -- 172.21.15.103:0/4125298601 >> 172.21.15.103:0/4125298601 conn(0x7f7094078100 msgr2=0x7f70940ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.974+0000 7f709c000640 1 -- 172.21.15.103:0/4125298601 shutdown_connections 2024-09-11T01:08:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.974+0000 7f709c000640 1 -- 172.21.15.103:0/4125298601 wait complete. 2024-09-11T01:08:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.975+0000 7f709c000640 1 Processor -- start 2024-09-11T01:08:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.975+0000 7f709c000640 1 -- start start 2024-09-11T01:08:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f709c000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7094101220 0x7f709419b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f709c000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7094105570 0x7f709419ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f709c000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7094105ef0 0x7f70941a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f709c000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7094112e00 con 0x7f7094101220 2024-09-11T01:08:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f709c000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7094112c80 con 0x7f7094105570 2024-09-11T01:08:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f709c000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7094112f80 con 0x7f7094105ef0 2024-09-11T01:08:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f7099600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7094101220 0x7f709419b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f7098c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7094105570 0x7f709419ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f7098c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7094105570 0x7f709419ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:55322/0 (socket says 172.21.15.103:55322) 2024-09-11T01:08:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f709a000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7094105ef0 0x7f70941a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f7098c00640 1 -- 172.21.15.103:0/531859286 learned_addr learned my addr 172.21.15.103:0/531859286 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f7098c00640 1 -- 172.21.15.103:0/531859286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7094105ef0 msgr2=0x7f70941a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f7098c00640 1 --2- 172.21.15.103:0/531859286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7094105ef0 0x7f70941a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f7098c00640 1 -- 172.21.15.103:0/531859286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7094101220 msgr2=0x7f709419b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f7098c00640 1 --2- 172.21.15.103:0/531859286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7094101220 0x7f709419b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.976+0000 7f7098c00640 1 -- 172.21.15.103:0/531859286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70941a15c0 con 0x7f7094105570 2024-09-11T01:08:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.977+0000 7f7098c00640 1 --2- 172.21.15.103:0/531859286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7094105570 0x7f709419ba50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f708000e9f0 tx=0x7f708000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.977+0000 7f7092000640 1 -- 172.21.15.103:0/531859286 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708000cd80 con 0x7f7094105570 2024-09-11T01:08:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.977+0000 7f7092000640 1 -- 172.21.15.103:0/531859286 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70800108e0 con 0x7f7094105570 2024-09-11T01:08:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.977+0000 7f709c000640 1 -- 172.21.15.103:0/531859286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70941a18b0 con 0x7f7094105570 2024-09-11T01:08:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.977+0000 7f7092000640 1 -- 172.21.15.103:0/531859286 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7080018980 con 0x7f7094105570 2024-09-11T01:08:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.977+0000 7f709c000640 1 -- 172.21.15.103:0/531859286 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70941a7f70 con 0x7f7094105570 2024-09-11T01:08:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.980+0000 7f709ec02740 1 Processor -- start 2024-09-11T01:08:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.980+0000 7f709ec02740 1 -- start start 2024-09-11T01:08:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f709ec02740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05c240 0x555dbb05c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f7092000640 1 -- 172.21.15.103:0/531859286 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7f7080010430 con 0x7f7094105570 2024-09-11T01:08:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f709ec02740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb05cb60 0x555dbb0685b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f709ec02740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb068af0 0x555dbb06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f709ec02740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555dbafd3d50 con 0x555dbb05cb60 2024-09-11T01:08:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f709ec02740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555dbafc3180 con 0x555dbb05c240 2024-09-11T01:08:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f709ec02740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555dbafc6f90 con 0x555dbb068af0 2024-09-11T01:08:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f7099600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb05cb60 0x555dbb0685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f709a000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05c240 0x555dbb05c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f7099600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb05cb60 0x555dbb0685b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43972/0 (socket says 172.21.15.103:43972) 2024-09-11T01:08:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f7099600640 1 -- 172.21.15.103:0/1130410756 learned_addr learned my addr 172.21.15.103:0/1130410756 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f709a000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05c240 0x555dbb05c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:55326/0 (socket says 172.21.15.103:55326) 2024-09-11T01:08:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f7098c00640 1 --2- 172.21.15.103:0/1130410756 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb068af0 0x555dbb06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f709a000640 1 -- 172.21.15.103:0/1130410756 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb068af0 msgr2=0x555dbb06aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f709a000640 1 --2- 172.21.15.103:0/1130410756 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb068af0 0x555dbb06aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f709a000640 1 -- 172.21.15.103:0/1130410756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb05cb60 msgr2=0x555dbb0685b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f709a000640 1 --2- 172.21.15.103:0/1130410756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb05cb60 0x555dbb0685b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.981+0000 7f709a000640 1 -- 172.21.15.103:0/1130410756 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dbaf8da70 con 0x555dbb05c240 2024-09-11T01:08:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.982+0000 7f709a000640 1 --2- 172.21.15.103:0/1130410756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05c240 0x555dbb05c620 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f708c009f30 tx=0x7f708c010800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee8c92b363b80937 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.982+0000 7f7086600640 1 -- 172.21.15.103:0/1130410756 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c016070 con 0x555dbb05c240 2024-09-11T01:08:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.982+0000 7f7086600640 1 -- 172.21.15.103:0/1130410756 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f708c004d20 con 0x555dbb05c240 2024-09-11T01:08:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.982+0000 7f7086600640 1 -- 172.21.15.103:0/1130410756 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c0127d0 con 0x555dbb05c240 2024-09-11T01:08:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.982+0000 7f7092000640 1 --2- 172.21.15.103:0/531859286 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f707c0b5370 0x7f707c0b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.982+0000 7f709ec02740 1 -- 172.21.15.103:0/1130410756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05c240 msgr2=0x555dbb05c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.982+0000 7f709ec02740 1 --2- 172.21.15.103:0/1130410756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05c240 0x555dbb05c620 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f708c009f30 tx=0x7f708c010800 comp rx=0 tx=0).stop 2024-09-11T01:08:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.983+0000 7f7092000640 1 -- 172.21.15.103:0/531859286 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f70800e63c0 con 0x7f7094105570 2024-09-11T01:08:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.983+0000 7f709ec02740 1 -- 172.21.15.103:0/1130410756 shutdown_connections 2024-09-11T01:08:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.983+0000 7f709ec02740 1 --2- 172.21.15.103:0/1130410756 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb068af0 0x555dbb06aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.983+0000 7f709ec02740 1 --2- 172.21.15.103:0/1130410756 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb05cb60 0x555dbb0685b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.983+0000 7f709ec02740 1 --2- 172.21.15.103:0/1130410756 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05c240 0x555dbb05c620 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.983+0000 7f709ec02740 1 -- 172.21.15.103:0/1130410756 >> 172.21.15.103:0/1130410756 conn(0x555dbb05a020 msgr2=0x555dbb05b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.983+0000 7f7099600640 1 --2- 172.21.15.103:0/531859286 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f707c0b5370 0x7f707c0b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.983+0000 7f709ec02740 1 -- 172.21.15.103:0/1130410756 shutdown_connections 2024-09-11T01:08:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.983+0000 7f709ec02740 1 -- 172.21.15.103:0/1130410756 wait complete. 2024-09-11T01:08:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.983+0000 7f7099600640 1 --2- 172.21.15.103:0/531859286 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f707c0b5370 0x7f707c0b7830 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x555dbb05f3c0 tx=0x7f7088005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.983+0000 7f709ec02740 1 -- start start 2024-09-11T01:08:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.984+0000 7f709ec02740 1 Processor -- start 2024-09-11T01:08:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.984+0000 7f709ec02740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05c240 0x555dbb065a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.984+0000 7f709ec02740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05cb60 0x555dbb065f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.984+0000 7f709ec02740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 0x555dbb0664d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.984+0000 7f709ec02740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555dbae245f0 con 0x555dbb068af0 2024-09-11T01:08:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.984+0000 7f709ec02740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555dbaf5e460 con 0x555dbb05cb60 2024-09-11T01:08:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.984+0000 7f709ec02740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555dbb06b840 con 0x555dbb05c240 2024-09-11T01:08:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.984+0000 7f709ec02740 10 client.0 _ll_register_callbacks cb 0x555dbaf6e210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.984+0000 7f709a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 0x555dbb0664d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.984+0000 7f709a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 0x555dbb0664d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43976/0 (socket says 172.21.15.103:43976) 2024-09-11T01:08:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.985+0000 7f709a000640 1 -- 172.21.15.103:0/4222981843 learned_addr learned my addr 172.21.15.103:0/4222981843 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.985+0000 7f7098c00640 1 --2- 172.21.15.103:0/4222981843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05cb60 0x555dbb065f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.985+0000 7f7099600640 1 --2- 172.21.15.103:0/4222981843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05c240 0x555dbb065a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.985+0000 7f709a000640 1 -- 172.21.15.103:0/4222981843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05c240 msgr2=0x555dbb065a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.985+0000 7f709a000640 1 --2- 172.21.15.103:0/4222981843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05c240 0x555dbb065a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.985+0000 7f709a000640 1 -- 172.21.15.103:0/4222981843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05cb60 msgr2=0x555dbb065f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.985+0000 7f709a000640 1 --2- 172.21.15.103:0/4222981843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05cb60 0x555dbb065f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.985+0000 7f709a000640 1 -- 172.21.15.103:0/4222981843 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dbad21540 con 0x555dbb068af0 2024-09-11T01:08:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.985+0000 7f7099600640 1 --2- 172.21.15.103:0/4222981843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05c240 0x555dbb065a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:08:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.985+0000 7f709a000640 1 --2- 172.21.15.103:0/4222981843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 0x555dbb0664d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f708c0059a0 tx=0x7f708c012780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7355b0f0b051f591 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.985+0000 7f707aa00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:08:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.985+0000 7f707aa00640 1 -- 172.21.15.103:0/4222981843 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f708c029060 con 0x555dbb068af0 2024-09-11T01:08:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.985+0000 7f707aa00640 1 -- 172.21.15.103:0/4222981843 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f708c012db0 con 0x555dbb068af0 2024-09-11T01:08:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.985+0000 7f709ec02740 1 -- 172.21.15.103:0/4222981843 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555dbaf60a70 con 0x555dbb068af0 2024-09-11T01:08:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.986+0000 7f707aa00640 1 -- 172.21.15.103:0/4222981843 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f708c030050 con 0x555dbb068af0 2024-09-11T01:08:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.986+0000 7f709ec02740 10 client.15351 fetch_fsmap learned FSMap version 26 2024-09-11T01:08:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.986+0000 7f709ec02740 1 -- 172.21.15.103:0/4222981843 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555dbaf7b6f0 con 0x555dbb068af0 2024-09-11T01:08:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.986+0000 7f707aa00640 1 -- 172.21.15.103:0/4222981843 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555dbaf60a70 con 0x555dbb068af0 2024-09-11T01:08:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.986+0000 7f707aa00640 1 -- 172.21.15.103:0/4222981843 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f708c00f040 con 0x555dbb068af0 2024-09-11T01:08:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.986+0000 7f709ec02740 10 client.15351 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:08:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.986+0000 7f709ec02740 10 client.15351 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T01:08:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.986+0000 7f709ec02740 20 client.15351 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.986+0000 7f709ec02740 1 --2- 172.21.15.103:0/4222981843 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x555dbb079430 0x555dbb07a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.987+0000 7f709ec02740 4 client.15351 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:08:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.987+0000 7f709ec02740 1 -- 172.21.15.103:0/4222981843 --> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555dbafd5ca0 con 0x555dbb079430 2024-09-11T01:08:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.987+0000 7f7099600640 1 --2- 172.21.15.103:0/4222981843 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x555dbb079430 0x555dbb07a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.988+0000 7f7099600640 1 --2- 172.21.15.103:0/4222981843 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x555dbb079430 0x555dbb07a8a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b6e3da1ff67e360a server_cookie=1cda81d9a79c7644 in_seq=0 out_seq=0 2024-09-11T01:08:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.988+0000 7f707aa00640 10 client.15351 ms_handle_connect on v2:172.21.15.183:6838/1006805616 2024-09-11T01:08:36.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.988+0000 7f707aa00640 1 -- 172.21.15.103:0/4222981843 <== mds.2 v2:172.21.15.183:6838/1006805616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555dbafd5ca0 con 0x555dbb079430 2024-09-11T01:08:36.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.988+0000 7f707aa00640 10 client.15351 handle_command_reply: tid=0 2024-09-11T01:08:36.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.988+0000 7f709ec02740 1 client.15351 shutdown 2024-09-11T01:08:36.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.989+0000 7f709ec02740 1 -- 172.21.15.103:0/4222981843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 msgr2=0x555dbb0664d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:36.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.989+0000 7f709ec02740 1 --2- 172.21.15.103:0/4222981843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 0x555dbb0664d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f708c0059a0 tx=0x7f708c012780 comp rx=0 tx=0).stop 2024-09-11T01:08:36.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.989+0000 7f709ec02740 1 -- 172.21.15.103:0/4222981843 shutdown_connections 2024-09-11T01:08:36.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.989+0000 7f709ec02740 1 --2- 172.21.15.103:0/4222981843 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x555dbb079430 0x555dbb07a8a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.989+0000 7f709ec02740 1 --2- 172.21.15.103:0/4222981843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 0x555dbb0664d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.989+0000 7f709ec02740 1 --2- 172.21.15.103:0/4222981843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05cb60 0x555dbb065f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.989+0000 7f709ec02740 1 --2- 172.21.15.103:0/4222981843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05c240 0x555dbb065a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:36.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.989+0000 7f709ec02740 1 -- 172.21.15.103:0/4222981843 >> 172.21.15.103:0/4222981843 conn(0x555dbb05a020 msgr2=0x555dbb05fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:36.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.989+0000 7f707aa00640 0 client.15351 ms_handle_reset on v2:172.21.15.183:6838/1006805616 2024-09-11T01:08:36.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.989+0000 7f709ec02740 1 -- 172.21.15.103:0/4222981843 shutdown_connections 2024-09-11T01:08:36.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.989+0000 7f709ec02740 1 -- 172.21.15.103:0/4222981843 wait complete. 2024-09-11T01:08:36.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:36.989+0000 7f709ec02740 20 client.15351 trim_cache size 0 max 16384 2024-09-11T01:08:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.008+0000 7f709ec02740 1 Processor -- start 2024-09-11T01:08:37.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.008+0000 7f709ec02740 1 -- start start 2024-09-11T01:08:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.008+0000 7f709ec02740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05c240 0x555dbb060400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.008+0000 7f709ec02740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05cb60 0x555dbb062c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.008+0000 7f709ec02740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 0x555dbb0631a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.008+0000 7f709ec02740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555dbb078be0 con 0x555dbb068af0 2024-09-11T01:08:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.008+0000 7f709ec02740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555dbb0792b0 con 0x555dbb05c240 2024-09-11T01:08:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.008+0000 7f709ec02740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555dbb079980 con 0x555dbb05cb60 2024-09-11T01:08:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.008+0000 7f709a000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 0x555dbb0631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.008+0000 7f7099600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05c240 0x555dbb060400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.008+0000 7f7099600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05c240 0x555dbb060400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:55350/0 (socket says 172.21.15.103:55350) 2024-09-11T01:08:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.008+0000 7f7099600640 1 -- 172.21.15.103:0/1596984971 learned_addr learned my addr 172.21.15.103:0/1596984971 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.009+0000 7f7098c00640 1 --2- 172.21.15.103:0/1596984971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05cb60 0x555dbb062c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.009+0000 7f7099600640 1 -- 172.21.15.103:0/1596984971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05cb60 msgr2=0x555dbb062c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.009+0000 7f7099600640 1 --2- 172.21.15.103:0/1596984971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05cb60 0x555dbb062c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.009+0000 7f7099600640 1 -- 172.21.15.103:0/1596984971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 msgr2=0x555dbb0631a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:37.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.009+0000 7f7099600640 1 --2- 172.21.15.103:0/1596984971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 0x555dbb0631a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.009+0000 7f7099600640 1 -- 172.21.15.103:0/1596984971 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dbb05aaa0 con 0x555dbb05c240 2024-09-11T01:08:37.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.009+0000 7f7099600640 1 --2- 172.21.15.103:0/1596984971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05c240 0x555dbb060400 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7088031440 tx=0x7f708803f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f1a0c30f1c6535f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:37.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.009+0000 7f7085c00640 1 -- 172.21.15.103:0/1596984971 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088058070 con 0x555dbb05c240 2024-09-11T01:08:37.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.009+0000 7f7085c00640 1 -- 172.21.15.103:0/1596984971 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70880055f0 con 0x555dbb05c240 2024-09-11T01:08:37.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.009+0000 7f7085c00640 1 -- 172.21.15.103:0/1596984971 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7088035040 con 0x555dbb05c240 2024-09-11T01:08:37.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.010+0000 7f709ec02740 1 -- 172.21.15.103:0/1596984971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05c240 msgr2=0x555dbb060400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:37.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.010+0000 7f709ec02740 1 --2- 172.21.15.103:0/1596984971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05c240 0x555dbb060400 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7088031440 tx=0x7f708803f000 comp rx=0 tx=0).stop 2024-09-11T01:08:37.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.010+0000 7f709ec02740 1 -- 172.21.15.103:0/1596984971 shutdown_connections 2024-09-11T01:08:37.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.010+0000 7f709ec02740 1 --2- 172.21.15.103:0/1596984971 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 0x555dbb0631a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.010+0000 7f709ec02740 1 --2- 172.21.15.103:0/1596984971 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05cb60 0x555dbb062c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.010+0000 7f709ec02740 1 --2- 172.21.15.103:0/1596984971 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05c240 0x555dbb060400 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.010+0000 7f709ec02740 1 -- 172.21.15.103:0/1596984971 >> 172.21.15.103:0/1596984971 conn(0x555dbb05a020 msgr2=0x555dbb05af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.010+0000 7f709ec02740 1 -- 172.21.15.103:0/1596984971 shutdown_connections 2024-09-11T01:08:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.010+0000 7f709ec02740 1 -- 172.21.15.103:0/1596984971 wait complete. 2024-09-11T01:08:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.011+0000 7f709ec02740 1 -- start start 2024-09-11T01:08:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.011+0000 7f709ec02740 1 Processor -- start 2024-09-11T01:08:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.011+0000 7f709ec02740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05c240 0x555dbb07cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.011+0000 7f709ec02740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05cb60 0x555dbb07d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.011+0000 7f709ec02740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 0x555dbb07d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.011+0000 7f709ec02740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555dbb07a720 con 0x555dbb068af0 2024-09-11T01:08:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.011+0000 7f709ec02740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555dbb07a050 con 0x555dbb05cb60 2024-09-11T01:08:37.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.011+0000 7f709ec02740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555dbb07adf0 con 0x555dbb05c240 2024-09-11T01:08:37.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.012+0000 7f709ec02740 10 client.0 _ll_register_callbacks cb 0x7f708c005860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:37.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.012+0000 7f7098c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05cb60 0x555dbb07d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.012+0000 7f7098c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05cb60 0x555dbb07d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:55356/0 (socket says 172.21.15.103:55356) 2024-09-11T01:08:37.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.012+0000 7f7098c00640 1 -- 172.21.15.103:0/2237399113 learned_addr learned my addr 172.21.15.103:0/2237399113 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:37.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.012+0000 7f7099600640 1 --2- 172.21.15.103:0/2237399113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05c240 0x555dbb07cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.012+0000 7f709a000640 1 --2- 172.21.15.103:0/2237399113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 0x555dbb07d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.012+0000 7f7098c00640 1 -- 172.21.15.103:0/2237399113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05c240 msgr2=0x555dbb07cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:37.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.012+0000 7f7098c00640 1 --2- 172.21.15.103:0/2237399113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05c240 0x555dbb07cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.012+0000 7f7098c00640 1 -- 172.21.15.103:0/2237399113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 msgr2=0x555dbb07d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:37.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.012+0000 7f7098c00640 1 --2- 172.21.15.103:0/2237399113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 0x555dbb07d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.012+0000 7f7098c00640 1 -- 172.21.15.103:0/2237399113 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dbb082440 con 0x555dbb05cb60 2024-09-11T01:08:37.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.012+0000 7f7098c00640 1 --2- 172.21.15.103:0/2237399113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05cb60 0x555dbb07d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f708000e9c0 tx=0x7f7080018420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94f9e58c70b5a478 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:37.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.012+0000 7f707aa00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:08:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.013+0000 7f707aa00640 1 -- 172.21.15.103:0/2237399113 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70800a6e60 con 0x555dbb05cb60 2024-09-11T01:08:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.013+0000 7f707aa00640 1 -- 172.21.15.103:0/2237399113 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f70800ab9c0 con 0x555dbb05cb60 2024-09-11T01:08:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.013+0000 7f709ec02740 1 -- 172.21.15.103:0/2237399113 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70880055f0 con 0x555dbb05cb60 2024-09-11T01:08:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.013+0000 7f707aa00640 1 -- 172.21.15.103:0/2237399113 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f70800abed0 con 0x555dbb05cb60 2024-09-11T01:08:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.013+0000 7f709ec02740 10 client.25364 fetch_fsmap learned FSMap version 26 2024-09-11T01:08:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.013+0000 7f709ec02740 1 -- 172.21.15.103:0/2237399113 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555dbb0ee9e0 con 0x555dbb05cb60 2024-09-11T01:08:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.013+0000 7f707aa00640 1 -- 172.21.15.103:0/2237399113 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f70880055f0 con 0x555dbb05cb60 2024-09-11T01:08:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.013+0000 7f707aa00640 1 -- 172.21.15.103:0/2237399113 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f70800a80b0 con 0x555dbb05cb60 2024-09-11T01:08:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.013+0000 7f709ec02740 10 client.25364 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:08:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.013+0000 7f709ec02740 10 client.25364 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-11T01:08:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.013+0000 7f709ec02740 20 client.25364 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.013+0000 7f709ec02740 1 --2- 172.21.15.103:0/2237399113 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x555dbb0f35c0 0x555dbb0f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.014+0000 7f709ec02740 4 client.25364 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T01:08:37.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.014+0000 7f709ec02740 1 -- 172.21.15.103:0/2237399113 --> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] -- command(tid 0: {"prefix": "status"}) -- 0x555dbafd1750 con 0x555dbb0f35c0 2024-09-11T01:08:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.014+0000 7f7099600640 1 --2- 172.21.15.103:0/2237399113 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x555dbb0f35c0 0x555dbb0f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.014+0000 7f7099600640 1 --2- 172.21.15.103:0/2237399113 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x555dbb0f35c0 0x555dbb0f22d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e8c3b80aefc49513 server_cookie=9d75a8f1b9791903 in_seq=0 out_seq=0 2024-09-11T01:08:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.014+0000 7f707aa00640 10 client.25364 ms_handle_connect on v2:172.21.15.183:6838/1006805616 2024-09-11T01:08:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f707aa00640 1 -- 172.21.15.103:0/2237399113 <== mds.2 v2:172.21.15.183:6838/1006805616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x555dbafd1750 con 0x555dbb0f35c0 2024-09-11T01:08:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f707aa00640 10 client.25364 handle_command_reply: tid=0 2024-09-11T01:08:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f709ec02740 1 client.25364 shutdown 2024-09-11T01:08:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f709ec02740 1 -- 172.21.15.103:0/2237399113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05cb60 msgr2=0x555dbb07d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f709ec02740 1 --2- 172.21.15.103:0/2237399113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05cb60 0x555dbb07d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f708000e9c0 tx=0x7f7080018420 comp rx=0 tx=0).stop 2024-09-11T01:08:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f709ec02740 1 -- 172.21.15.103:0/2237399113 shutdown_connections 2024-09-11T01:08:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f709ec02740 1 --2- 172.21.15.103:0/2237399113 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x555dbb0f35c0 0x555dbb0f22d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f709ec02740 1 --2- 172.21.15.103:0/2237399113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555dbb068af0 0x555dbb07d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f709ec02740 1 --2- 172.21.15.103:0/2237399113 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555dbb05cb60 0x555dbb07d0c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f709ec02740 1 --2- 172.21.15.103:0/2237399113 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555dbb05c240 0x555dbb07cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f707aa00640 0 client.25364 ms_handle_reset on v2:172.21.15.183:6838/1006805616 2024-09-11T01:08:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f709ec02740 1 -- 172.21.15.103:0/2237399113 >> 172.21.15.103:0/2237399113 conn(0x555dbb05a020 msgr2=0x555dbb067080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f709ec02740 1 -- 172.21.15.103:0/2237399113 shutdown_connections 2024-09-11T01:08:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f709ec02740 1 -- 172.21.15.103:0/2237399113 wait complete. 2024-09-11T01:08:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.015+0000 7f709ec02740 20 client.25364 trim_cache size 0 max 16384 2024-09-11T01:08:37.020 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:08:37.020 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "917288bc-6fd8-11ef-bcea-c7b262605968", 2024-09-11T01:08:37.020 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-09-11T01:08:37.020 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24619, 2024-09-11T01:08:37.020 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-11T01:08:37.020 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-11T01:08:37.021 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-11T01:08:37.021 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 137.37886124100001, 2024-09-11T01:08:37.021 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 26, 2024-09-11T01:08:37.021 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-09-11T01:08:37.021 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 89, 2024-09-11T01:08:37.021 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 206.8640661 2024-09-11T01:08:37.021 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:08:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.016+0000 7f709c000640 1 -- 172.21.15.103:0/531859286 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f707c0b5370 msgr2=0x7f707c0b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.016+0000 7f709c000640 1 --2- 172.21.15.103:0/531859286 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f707c0b5370 0x7f707c0b7830 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x555dbb05f3c0 tx=0x7f7088005a20 comp rx=0 tx=0).stop 2024-09-11T01:08:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.016+0000 7f709c000640 1 -- 172.21.15.103:0/531859286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7094105570 msgr2=0x7f709419ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.016+0000 7f709c000640 1 --2- 172.21.15.103:0/531859286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7094105570 0x7f709419ba50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f708000e9f0 tx=0x7f708000eeb0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.016+0000 7f709c000640 1 -- 172.21.15.103:0/531859286 shutdown_connections 2024-09-11T01:08:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.016+0000 7f709c000640 1 --2- 172.21.15.103:0/531859286 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f707c0b5370 0x7f707c0b7830 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.016+0000 7f709c000640 1 --2- 172.21.15.103:0/531859286 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7094105ef0 0x7f70941a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.016+0000 7f709c000640 1 --2- 172.21.15.103:0/531859286 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7094105570 0x7f709419ba50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.016+0000 7f709c000640 1 --2- 172.21.15.103:0/531859286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7094101220 0x7f709419b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.016+0000 7f709c000640 1 -- 172.21.15.103:0/531859286 >> 172.21.15.103:0/531859286 conn(0x7f7094078100 msgr2=0x7f7094108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.016+0000 7f709c000640 1 -- 172.21.15.103:0/531859286 shutdown_connections 2024-09-11T01:08:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:37.016+0000 7f709c000640 1 -- 172.21.15.103:0/531859286 wait complete. 2024-09-11T01:08:37.943 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell mds.h status 2024-09-11T01:08:38.312 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:38.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:38 smithi103 ceph-mon[30562]: pgmap v408: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-11T01:08:38.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:08:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:38 smithi183 ceph-mon[34992]: pgmap v408: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-11T01:08:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:08:38.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.964+0000 7f3cbe600640 1 -- 172.21.15.103:0/1888793170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb810f1e0 msgr2=0x7f3cb81115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:38.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.964+0000 7f3cbe600640 1 --2- 172.21.15.103:0/1888793170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb810f1e0 0x7f3cb81115f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009ca0 tx=0x7f3cb002a940 comp rx=0 tx=0).stop 2024-09-11T01:08:38.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.964+0000 7f3cbe600640 1 -- 172.21.15.103:0/1888793170 shutdown_connections 2024-09-11T01:08:38.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.964+0000 7f3cbe600640 1 --2- 172.21.15.103:0/1888793170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb810f1e0 0x7f3cb81115f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.964+0000 7f3cbe600640 1 --2- 172.21.15.103:0/1888793170 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb8075e20 0x7f3cb810eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.964+0000 7f3cbe600640 1 --2- 172.21.15.103:0/1888793170 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb8075500 0x7f3cb80758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.964+0000 7f3cbe600640 1 -- 172.21.15.103:0/1888793170 >> 172.21.15.103:0/1888793170 conn(0x7f3cb80fe6c0 msgr2=0x7f3cb8100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:38.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.964+0000 7f3cbe600640 1 -- 172.21.15.103:0/1888793170 shutdown_connections 2024-09-11T01:08:38.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.964+0000 7f3cbe600640 1 -- 172.21.15.103:0/1888793170 wait complete. 2024-09-11T01:08:38.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.965+0000 7f3cbe600640 1 Processor -- start 2024-09-11T01:08:38.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.965+0000 7f3cbe600640 1 -- start start 2024-09-11T01:08:38.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbe600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb8075500 0x7f3cb819b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:38.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbe600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb8075e20 0x7f3cb819b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:38.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbe600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb810f1e0 0x7f3cb81a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:38.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbe600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb8114e50 con 0x7f3cb810f1e0 2024-09-11T01:08:38.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbe600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb8114cd0 con 0x7f3cb8075e20 2024-09-11T01:08:38.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbe600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb8114fd0 con 0x7f3cb8075500 2024-09-11T01:08:38.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbd200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb8075500 0x7f3cb819b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:38.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbd200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb8075500 0x7f3cb819b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:44296/0 (socket says 172.21.15.103:44296) 2024-09-11T01:08:38.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbd200640 1 -- 172.21.15.103:0/47293701 learned_addr learned my addr 172.21.15.103:0/47293701 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:38.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cb7e00640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb8075e20 0x7f3cb819b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:38.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbdc00640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb810f1e0 0x7f3cb81a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:38.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbd200640 1 -- 172.21.15.103:0/47293701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb8075e20 msgr2=0x7f3cb819b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:38.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbd200640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb8075e20 0x7f3cb819b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbd200640 1 -- 172.21.15.103:0/47293701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb810f1e0 msgr2=0x7f3cb81a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:38.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbd200640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb810f1e0 0x7f3cb81a0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cbd200640 1 -- 172.21.15.103:0/47293701 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb81a12f0 con 0x7f3cb8075500 2024-09-11T01:08:38.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.966+0000 7f3cb7e00640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb8075e20 0x7f3cb819b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:38.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.967+0000 7f3cbd200640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb8075500 0x7f3cb819b240 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00e9f0 tx=0x7f3cac00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:38.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.967+0000 7f3cb5600640 1 -- 172.21.15.103:0/47293701 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00cd80 con 0x7f3cb8075500 2024-09-11T01:08:38.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.967+0000 7f3cbe600640 1 -- 172.21.15.103:0/47293701 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb81a15e0 con 0x7f3cb8075500 2024-09-11T01:08:38.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.967+0000 7f3cb5600640 1 -- 172.21.15.103:0/47293701 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cac0054d0 con 0x7f3cb8075500 2024-09-11T01:08:38.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.967+0000 7f3cb5600640 1 -- 172.21.15.103:0/47293701 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac010690 con 0x7f3cb8075500 2024-09-11T01:08:38.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.967+0000 7f3cbe600640 1 -- 172.21.15.103:0/47293701 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb81a7ca0 con 0x7f3cb8075500 2024-09-11T01:08:38.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.971+0000 7f3cc269f740 1 Processor -- start 2024-09-11T01:08:38.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.972+0000 7f3cc269f740 1 -- start start 2024-09-11T01:08:38.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.972+0000 7f3cc269f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7c400 0x555ceaf7c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:38.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.972+0000 7f3cc269f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7cd20 0x555ceaf88770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:38.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.972+0000 7f3cc269f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 0x555ceaf8b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:38.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.972+0000 7f3cc269f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555ceaef3d50 con 0x555ceaf7c400 2024-09-11T01:08:38.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.972+0000 7f3cc269f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555ceaee3180 con 0x555ceaf7cd20 2024-09-11T01:08:38.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.972+0000 7f3cc269f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555ceaee6f90 con 0x555ceaf88cb0 2024-09-11T01:08:38.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.973+0000 7f3cb5600640 1 -- 172.21.15.103:0/47293701 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7f3cac004e90 con 0x7f3cb8075500 2024-09-11T01:08:38.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.973+0000 7f3cbdc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7c400 0x555ceaf7c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:38.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.973+0000 7f3cbdc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7c400 0x555ceaf7c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44022/0 (socket says 172.21.15.103:44022) 2024-09-11T01:08:38.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.973+0000 7f3cbdc00640 1 -- 172.21.15.103:0/2179204285 learned_addr learned my addr 172.21.15.103:0/2179204285 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:38.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.973+0000 7f3cb7e00640 1 --2- 172.21.15.103:0/2179204285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 0x555ceaf8b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:38.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.973+0000 7f3cbd200640 1 --2- 172.21.15.103:0/2179204285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7cd20 0x555ceaf88770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:38.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.973+0000 7f3cb7e00640 1 -- 172.21.15.103:0/2179204285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7cd20 msgr2=0x555ceaf88770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:38.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.973+0000 7f3cb7e00640 1 --2- 172.21.15.103:0/2179204285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7cd20 0x555ceaf88770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.973+0000 7f3cb7e00640 1 -- 172.21.15.103:0/2179204285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7c400 msgr2=0x555ceaf7c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:38.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.973+0000 7f3cb7e00640 1 --2- 172.21.15.103:0/2179204285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7c400 0x555ceaf7c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.973+0000 7f3cb7e00640 1 -- 172.21.15.103:0/2179204285 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ceaeada70 con 0x555ceaf88cb0 2024-09-11T01:08:38.976 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.973+0000 7f3cb7e00640 1 --2- 172.21.15.103:0/2179204285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 0x555ceaf8b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009fd0 tx=0x7f3ca40118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9775fc21284af19 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:38.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.974+0000 7f3caa000640 1 -- 172.21.15.103:0/2179204285 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4004030 con 0x555ceaf88cb0 2024-09-11T01:08:38.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.974+0000 7f3caa000640 1 -- 172.21.15.103:0/2179204285 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ca40054d0 con 0x555ceaf88cb0 2024-09-11T01:08:38.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.974+0000 7f3caa000640 1 -- 172.21.15.103:0/2179204285 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca4004ce0 con 0x555ceaf88cb0 2024-09-11T01:08:38.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.975+0000 7f3cc269f740 1 -- 172.21.15.103:0/2179204285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 msgr2=0x555ceaf8b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:38.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.975+0000 7f3cc269f740 1 --2- 172.21.15.103:0/2179204285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 0x555ceaf8b0a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009fd0 tx=0x7f3ca40118d0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.975+0000 7f3cb5600640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3ca00b5410 0x7f3ca00b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:38.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.975+0000 7f3cb5600640 1 -- 172.21.15.103:0/47293701 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f3cac0e6580 con 0x7f3cb8075500 2024-09-11T01:08:38.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.975+0000 7f3cc269f740 1 -- 172.21.15.103:0/2179204285 shutdown_connections 2024-09-11T01:08:38.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.975+0000 7f3cc269f740 1 --2- 172.21.15.103:0/2179204285 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 0x555ceaf8b0a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.975+0000 7f3cc269f740 1 --2- 172.21.15.103:0/2179204285 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7cd20 0x555ceaf88770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.975+0000 7f3cc269f740 1 --2- 172.21.15.103:0/2179204285 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7c400 0x555ceaf7c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.975+0000 7f3cc269f740 1 -- 172.21.15.103:0/2179204285 >> 172.21.15.103:0/2179204285 conn(0x555ceaf7a230 msgr2=0x555ceaf7b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:38.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.975+0000 7f3cbdc00640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3ca00b5410 0x7f3ca00b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:38.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.975+0000 7f3cc269f740 1 -- 172.21.15.103:0/2179204285 shutdown_connections 2024-09-11T01:08:38.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.975+0000 7f3cc269f740 1 -- 172.21.15.103:0/2179204285 wait complete. 2024-09-11T01:08:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.976+0000 7f3cc269f740 1 -- start start 2024-09-11T01:08:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.976+0000 7f3cbdc00640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3ca00b5410 0x7f3ca00b78d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0005e30 tx=0x7f3cb0005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.976+0000 7f3cc269f740 1 Processor -- start 2024-09-11T01:08:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.976+0000 7f3cc269f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf7c400 0x555ceaf85cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.976+0000 7f3cc269f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7cd20 0x555ceaf86200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.976+0000 7f3cc269f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf88cb0 0x555ceaf86740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.976+0000 7f3cc269f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555cead445f0 con 0x555ceaf7cd20 2024-09-11T01:08:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.976+0000 7f3cc269f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555ceae7e460 con 0x555ceaf88cb0 2024-09-11T01:08:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.976+0000 7f3cc269f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555ceaf8ba00 con 0x555ceaf7c400 2024-09-11T01:08:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.976+0000 7f3cc269f740 10 client.0 _ll_register_callbacks cb 0x555ceae8e210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3cbd200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf7c400 0x555ceaf85cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3cbd200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf7c400 0x555ceaf85cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:44306/0 (socket says 172.21.15.103:44306) 2024-09-11T01:08:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3cbd200640 1 -- 172.21.15.103:0/3402824148 learned_addr learned my addr 172.21.15.103:0/3402824148 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3cbdc00640 1 --2- 172.21.15.103:0/3402824148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf88cb0 0x555ceaf86740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3cb7e00640 1 --2- 172.21.15.103:0/3402824148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7cd20 0x555ceaf86200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3cbd200640 1 -- 172.21.15.103:0/3402824148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf88cb0 msgr2=0x555ceaf86740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3cbd200640 1 --2- 172.21.15.103:0/3402824148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf88cb0 0x555ceaf86740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3cbd200640 1 -- 172.21.15.103:0/3402824148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7cd20 msgr2=0x555ceaf86200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3cbd200640 1 --2- 172.21.15.103:0/3402824148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7cd20 0x555ceaf86200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3cbd200640 1 -- 172.21.15.103:0/3402824148 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ceac41540 con 0x555ceaf7c400 2024-09-11T01:08:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3cbd200640 1 --2- 172.21.15.103:0/3402824148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf7c400 0x555ceaf85cc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00e9c0 tx=0x7f3cac0a8ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee074e278b1e9436 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3c9ea00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:08:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3c9ea00640 1 -- 172.21.15.103:0/3402824148 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0abf40 con 0x555ceaf7c400 2024-09-11T01:08:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3c9ea00640 1 -- 172.21.15.103:0/3402824148 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f3cac0e3d70 con 0x555ceaf7c400 2024-09-11T01:08:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.977+0000 7f3cc269f740 1 -- 172.21.15.103:0/3402824148 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555ceae80a70 con 0x555ceaf7c400 2024-09-11T01:08:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.978+0000 7f3c9ea00640 1 -- 172.21.15.103:0/3402824148 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3cac0ac2e0 con 0x555ceaf7c400 2024-09-11T01:08:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.978+0000 7f3cc269f740 10 client.25351 fetch_fsmap learned FSMap version 26 2024-09-11T01:08:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.978+0000 7f3cc269f740 1 -- 172.21.15.103:0/3402824148 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555ceae9b6f0 con 0x555ceaf7c400 2024-09-11T01:08:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.978+0000 7f3c9ea00640 1 -- 172.21.15.103:0/3402824148 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x555ceae80a70 con 0x555ceaf7c400 2024-09-11T01:08:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.978+0000 7f3c9ea00640 1 -- 172.21.15.103:0/3402824148 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f3cac0b58d0 con 0x555ceaf7c400 2024-09-11T01:08:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.978+0000 7f3cc269f740 10 client.25351 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:08:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.978+0000 7f3cc269f740 10 client.25351 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T01:08:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.978+0000 7f3cc269f740 20 client.25351 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.978+0000 7f3cc269f740 1 --2- 172.21.15.103:0/3402824148 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x555ceaf99a40 0x555ceaf9aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.978+0000 7f3cc269f740 4 client.25351 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:08:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.978+0000 7f3cc269f740 1 -- 172.21.15.103:0/3402824148 --> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ceaef5ca0 con 0x555ceaf99a40 2024-09-11T01:08:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.979+0000 7f3cb7e00640 1 --2- 172.21.15.103:0/3402824148 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x555ceaf99a40 0x555ceaf9aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.979+0000 7f3cb7e00640 1 --2- 172.21.15.103:0/3402824148 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x555ceaf99a40 0x555ceaf9aeb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=911fec294915e0e7 server_cookie=1ba7d65ee137343 in_seq=0 out_seq=0 2024-09-11T01:08:38.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.979+0000 7f3c9ea00640 10 client.25351 ms_handle_connect on v2:172.21.15.117:6836/294794871 2024-09-11T01:08:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.980+0000 7f3c9ea00640 1 -- 172.21.15.103:0/3402824148 <== mds.1 v2:172.21.15.117:6836/294794871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555ceaef5ca0 con 0x555ceaf99a40 2024-09-11T01:08:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.980+0000 7f3c9ea00640 10 client.25351 handle_command_reply: tid=0 2024-09-11T01:08:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.980+0000 7f3cc269f740 1 client.25351 shutdown 2024-09-11T01:08:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.980+0000 7f3cc269f740 1 -- 172.21.15.103:0/3402824148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf7c400 msgr2=0x555ceaf85cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.980+0000 7f3cc269f740 1 --2- 172.21.15.103:0/3402824148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf7c400 0x555ceaf85cc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00e9c0 tx=0x7f3cac0a8ee0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.980+0000 7f3cc269f740 1 -- 172.21.15.103:0/3402824148 shutdown_connections 2024-09-11T01:08:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.980+0000 7f3cc269f740 1 --2- 172.21.15.103:0/3402824148 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x555ceaf99a40 0x555ceaf9aeb0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.980+0000 7f3cc269f740 1 --2- 172.21.15.103:0/3402824148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf88cb0 0x555ceaf86740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.980+0000 7f3cc269f740 1 --2- 172.21.15.103:0/3402824148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7cd20 0x555ceaf86200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.980+0000 7f3cc269f740 1 --2- 172.21.15.103:0/3402824148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf7c400 0x555ceaf85cc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.980+0000 7f3c9ea00640 0 client.25351 ms_handle_reset on v2:172.21.15.117:6836/294794871 2024-09-11T01:08:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.980+0000 7f3cc269f740 1 -- 172.21.15.103:0/3402824148 >> 172.21.15.103:0/3402824148 conn(0x555ceaf7a230 msgr2=0x555ceaf7fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.980+0000 7f3cc269f740 1 -- 172.21.15.103:0/3402824148 shutdown_connections 2024-09-11T01:08:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.980+0000 7f3cc269f740 1 -- 172.21.15.103:0/3402824148 wait complete. 2024-09-11T01:08:38.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:38.981+0000 7f3cc269f740 20 client.25351 trim_cache size 0 max 16384 2024-09-11T01:08:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.000+0000 7f3cc269f740 1 Processor -- start 2024-09-11T01:08:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.000+0000 7f3cc269f740 1 -- start start 2024-09-11T01:08:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.000+0000 7f3cc269f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7c400 0x555ceaf9a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cc269f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7cd20 0x555ceaf98910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cc269f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 0x555ceaf80500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cc269f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555ceaf991f0 con 0x555ceaf7cd20 2024-09-11T01:08:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cc269f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555ceaf998c0 con 0x555ceaf7c400 2024-09-11T01:08:39.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cc269f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555ceaf99f90 con 0x555ceaf88cb0 2024-09-11T01:08:39.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cbd200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7c400 0x555ceaf9a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:39.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cbd200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7c400 0x555ceaf9a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:55404/0 (socket says 172.21.15.103:55404) 2024-09-11T01:08:39.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cb7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7cd20 0x555ceaf98910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:39.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cbd200640 1 -- 172.21.15.103:0/3602912464 learned_addr learned my addr 172.21.15.103:0/3602912464 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:39.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cbdc00640 1 --2- 172.21.15.103:0/3602912464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 0x555ceaf80500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:39.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cbd200640 1 -- 172.21.15.103:0/3602912464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 msgr2=0x555ceaf80500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:39.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cbd200640 1 --2- 172.21.15.103:0/3602912464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 0x555ceaf80500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cbd200640 1 -- 172.21.15.103:0/3602912464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7cd20 msgr2=0x555ceaf98910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:39.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cbd200640 1 --2- 172.21.15.103:0/3602912464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7cd20 0x555ceaf98910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.001+0000 7f3cbd200640 1 -- 172.21.15.103:0/3602912464 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ceaf7b5f0 con 0x555ceaf7c400 2024-09-11T01:08:39.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.002+0000 7f3cbd200640 1 --2- 172.21.15.103:0/3602912464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7c400 0x555ceaf9a110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00cfd0 tx=0x7f3cac0a8f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2373bd70f9663d54 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:39.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.002+0000 7f3ca9600640 1 -- 172.21.15.103:0/3602912464 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0abf40 con 0x555ceaf7c400 2024-09-11T01:08:39.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.002+0000 7f3ca9600640 1 -- 172.21.15.103:0/3602912464 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cac0aced0 con 0x555ceaf7c400 2024-09-11T01:08:39.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.002+0000 7f3ca9600640 1 -- 172.21.15.103:0/3602912464 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0adb00 con 0x555ceaf7c400 2024-09-11T01:08:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.003+0000 7f3cc269f740 1 -- 172.21.15.103:0/3602912464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7c400 msgr2=0x555ceaf9a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.003+0000 7f3cc269f740 1 --2- 172.21.15.103:0/3602912464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7c400 0x555ceaf9a110 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00cfd0 tx=0x7f3cac0a8f50 comp rx=0 tx=0).stop 2024-09-11T01:08:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.003+0000 7f3cc269f740 1 -- 172.21.15.103:0/3602912464 shutdown_connections 2024-09-11T01:08:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.003+0000 7f3cc269f740 1 --2- 172.21.15.103:0/3602912464 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 0x555ceaf80500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.003+0000 7f3cc269f740 1 --2- 172.21.15.103:0/3602912464 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7cd20 0x555ceaf98910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.003+0000 7f3cc269f740 1 --2- 172.21.15.103:0/3602912464 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7c400 0x555ceaf9a110 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.003+0000 7f3cc269f740 1 -- 172.21.15.103:0/3602912464 >> 172.21.15.103:0/3602912464 conn(0x555ceaf7a230 msgr2=0x555ceaf84540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:39.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.003+0000 7f3cc269f740 1 -- 172.21.15.103:0/3602912464 shutdown_connections 2024-09-11T01:08:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.003+0000 7f3cc269f740 1 -- 172.21.15.103:0/3602912464 wait complete. 2024-09-11T01:08:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.003+0000 7f3cc269f740 1 -- start start 2024-09-11T01:08:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.004+0000 7f3cc269f740 1 Processor -- start 2024-09-11T01:08:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.004+0000 7f3cc269f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7c400 0x555ceaf9d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.004+0000 7f3cc269f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7cd20 0x555ceaf9df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.004+0000 7f3cc269f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 0x555ceafa2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.004+0000 7f3cc269f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555ceaf9ad30 con 0x555ceaf7c400 2024-09-11T01:08:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.004+0000 7f3cc269f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555ceaf9a660 con 0x555ceaf7cd20 2024-09-11T01:08:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.004+0000 7f3cc269f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555ceaf9b400 con 0x555ceaf88cb0 2024-09-11T01:08:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.004+0000 7f3cc269f740 10 client.0 _ll_register_callbacks cb 0x7f3cac0e9e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.004+0000 7f3cb7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7cd20 0x555ceaf9df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:39.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.004+0000 7f3cb7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7cd20 0x555ceaf9df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:55418/0 (socket says 172.21.15.103:55418) 2024-09-11T01:08:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.004+0000 7f3cb7e00640 1 -- 172.21.15.103:0/4105953943 learned_addr learned my addr 172.21.15.103:0/4105953943 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.004+0000 7f3cbd200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7c400 0x555ceaf9d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.004+0000 7f3cbdc00640 1 --2- 172.21.15.103:0/4105953943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 0x555ceafa2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.005+0000 7f3cb7e00640 1 -- 172.21.15.103:0/4105953943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 msgr2=0x555ceafa2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.005+0000 7f3cb7e00640 1 --2- 172.21.15.103:0/4105953943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 0x555ceafa2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.005+0000 7f3cb7e00640 1 -- 172.21.15.103:0/4105953943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7c400 msgr2=0x555ceaf9d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.005+0000 7f3cb7e00640 1 --2- 172.21.15.103:0/4105953943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7c400 0x555ceaf9d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.005+0000 7f3cb7e00640 1 -- 172.21.15.103:0/4105953943 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ceafa3610 con 0x555ceaf7cd20 2024-09-11T01:08:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.005+0000 7f3cbd200640 1 --2- 172.21.15.103:0/4105953943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7c400 0x555ceaf9d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:08:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.005+0000 7f3cb7e00640 1 --2- 172.21.15.103:0/4105953943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7cd20 0x555ceaf9df70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4011dd0 tx=0x7f3ca400fbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfb4c99aed6f69a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.005+0000 7f3c9ea00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:08:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.005+0000 7f3c9ea00640 1 -- 172.21.15.103:0/4105953943 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ca400fce0 con 0x555ceaf7cd20 2024-09-11T01:08:39.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.005+0000 7f3cc269f740 1 -- 172.21.15.103:0/4105953943 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cac0aced0 con 0x555ceaf7cd20 2024-09-11T01:08:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.005+0000 7f3c9ea00640 1 -- 172.21.15.103:0/4105953943 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f3ca4016040 con 0x555ceaf7cd20 2024-09-11T01:08:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.005+0000 7f3c9ea00640 1 -- 172.21.15.103:0/4105953943 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3ca400fe80 con 0x555ceaf7cd20 2024-09-11T01:08:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.006+0000 7f3cc269f740 10 client.25382 fetch_fsmap learned FSMap version 26 2024-09-11T01:08:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.006+0000 7f3cc269f740 1 -- 172.21.15.103:0/4105953943 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555ceb006e00 con 0x555ceaf7cd20 2024-09-11T01:08:39.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.006+0000 7f3c9ea00640 1 -- 172.21.15.103:0/4105953943 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3cac0aced0 con 0x555ceaf7cd20 2024-09-11T01:08:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.006+0000 7f3c9ea00640 1 -- 172.21.15.103:0/4105953943 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f3cac0051b0 con 0x555ceaf7cd20 2024-09-11T01:08:39.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.006+0000 7f3cc269f740 10 client.25382 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:08:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.006+0000 7f3cc269f740 10 client.25382 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-11T01:08:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.006+0000 7f3cc269f740 20 client.25382 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.006+0000 7f3cc269f740 1 --2- 172.21.15.103:0/4105953943 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x555ceb00b7b0 0x555ceb00a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.006+0000 7f3cc269f740 4 client.25382 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T01:08:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.006+0000 7f3cc269f740 1 -- 172.21.15.103:0/4105953943 --> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] -- command(tid 0: {"prefix": "status"}) -- 0x555ceaef1750 con 0x555ceb00b7b0 2024-09-11T01:08:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.006+0000 7f3cbd200640 1 --2- 172.21.15.103:0/4105953943 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x555ceb00b7b0 0x555ceb00a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.007+0000 7f3cbd200640 1 --2- 172.21.15.103:0/4105953943 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x555ceb00b7b0 0x555ceb00a4c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=97abdb0b48c69af2 server_cookie=688d2c73f68fe905 in_seq=0 out_seq=0 2024-09-11T01:08:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.007+0000 7f3c9ea00640 10 client.25382 ms_handle_connect on v2:172.21.15.117:6836/294794871 2024-09-11T01:08:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.007+0000 7f3c9ea00640 1 -- 172.21.15.103:0/4105953943 <== mds.1 v2:172.21.15.117:6836/294794871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x555ceaef1750 con 0x555ceb00b7b0 2024-09-11T01:08:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.007+0000 7f3c9ea00640 10 client.25382 handle_command_reply: tid=0 2024-09-11T01:08:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.007+0000 7f3cc269f740 1 client.25382 shutdown 2024-09-11T01:08:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.007+0000 7f3cc269f740 1 -- 172.21.15.103:0/4105953943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7cd20 msgr2=0x555ceaf9df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:39.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.007+0000 7f3cc269f740 1 --2- 172.21.15.103:0/4105953943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7cd20 0x555ceaf9df70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4011dd0 tx=0x7f3ca400fbf0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.007+0000 7f3cc269f740 1 -- 172.21.15.103:0/4105953943 shutdown_connections 2024-09-11T01:08:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.007+0000 7f3cc269f740 1 --2- 172.21.15.103:0/4105953943 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x555ceb00b7b0 0x555ceb00a4c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.007+0000 7f3cc269f740 1 --2- 172.21.15.103:0/4105953943 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555ceaf88cb0 0x555ceafa2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.007+0000 7f3cc269f740 1 --2- 172.21.15.103:0/4105953943 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555ceaf7cd20 0x555ceaf9df70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.007+0000 7f3cc269f740 1 --2- 172.21.15.103:0/4105953943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555ceaf7c400 0x555ceaf9d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.007+0000 7f3cc269f740 1 -- 172.21.15.103:0/4105953943 >> 172.21.15.103:0/4105953943 conn(0x555ceaf7a230 msgr2=0x555ceaf872f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.008+0000 7f3c9ea00640 0 client.25382 ms_handle_reset on v2:172.21.15.117:6836/294794871 2024-09-11T01:08:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.008+0000 7f3cc269f740 1 -- 172.21.15.103:0/4105953943 shutdown_connections 2024-09-11T01:08:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.008+0000 7f3cc269f740 1 -- 172.21.15.103:0/4105953943 wait complete. 2024-09-11T01:08:39.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.008+0000 7f3cc269f740 20 client.25382 trim_cache size 0 max 16384 2024-09-11T01:08:39.013 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:08:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "917288bc-6fd8-11ef-bcea-c7b262605968", 2024-09-11T01:08:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-09-11T01:08:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24629, 2024-09-11T01:08:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-11T01:08:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-11T01:08:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-11T01:08:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 140.38776150999999, 2024-09-11T01:08:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 26, 2024-09-11T01:08:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-09-11T01:08:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 89, 2024-09-11T01:08:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 211.50765998099999 2024-09-11T01:08:39.014 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:08:39.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.009+0000 7f3cbe600640 1 -- 172.21.15.103:0/47293701 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3ca00b5410 msgr2=0x7f3ca00b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:39.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.009+0000 7f3cbe600640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3ca00b5410 0x7f3ca00b78d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0005e30 tx=0x7f3cb0005d80 comp rx=0 tx=0).stop 2024-09-11T01:08:39.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.009+0000 7f3cbe600640 1 -- 172.21.15.103:0/47293701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb8075500 msgr2=0x7f3cb819b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:39.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.009+0000 7f3cbe600640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb8075500 0x7f3cb819b240 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00e9f0 tx=0x7f3cac00edf0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.009+0000 7f3cbe600640 1 -- 172.21.15.103:0/47293701 shutdown_connections 2024-09-11T01:08:39.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.009+0000 7f3cbe600640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f3ca00b5410 0x7f3ca00b78d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.009+0000 7f3cbe600640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cb810f1e0 0x7f3cb81a0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.009+0000 7f3cbe600640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cb8075e20 0x7f3cb819b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.009+0000 7f3cbe600640 1 --2- 172.21.15.103:0/47293701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3cb8075500 0x7f3cb819b240 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:39.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.009+0000 7f3cbe600640 1 -- 172.21.15.103:0/47293701 >> 172.21.15.103:0/47293701 conn(0x7f3cb80fe6c0 msgr2=0x7f3cb8106c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:39.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.009+0000 7f3cbe600640 1 -- 172.21.15.103:0/47293701 shutdown_connections 2024-09-11T01:08:39.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:39.009+0000 7f3cbe600640 1 -- 172.21.15.103:0/47293701 wait complete. 2024-09-11T01:08:39.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:38 smithi117 ceph-mon[35358]: pgmap v408: 129 pgs: 129 active+clean; 662 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 2.2 KiB/s wr, 9 op/s 2024-09-11T01:08:39.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:08:40.008 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell mds.b status 2024-09-11T01:08:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:08:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:08:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:39 smithi103 ceph-mon[30562]: pgmap v409: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-11T01:08:40.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:08:40.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:08:40.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:39 smithi117 ceph-mon[35358]: pgmap v409: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-11T01:08:40.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:08:40.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:08:40.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:08:40.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:39 smithi183 ceph-mon[34992]: pgmap v409: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-11T01:08:40.417 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:41.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.048+0000 7faf37200640 1 -- 172.21.15.103:0/4240675990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf38108fa0 msgr2=0x7faf3810f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:41.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.048+0000 7faf37200640 1 --2- 172.21.15.103:0/4240675990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf38108fa0 0x7faf3810f7a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7faf30009900 tx=0x7faf3002a410 comp rx=0 tx=0).stop 2024-09-11T01:08:41.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.048+0000 7faf37200640 1 -- 172.21.15.103:0/4240675990 shutdown_connections 2024-09-11T01:08:41.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.048+0000 7faf37200640 1 --2- 172.21.15.103:0/4240675990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf38108fa0 0x7faf3810f7a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.048+0000 7faf37200640 1 --2- 172.21.15.103:0/4240675990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf38108620 0x7faf38108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.048+0000 7faf37200640 1 --2- 172.21.15.103:0/4240675990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf38102c10 0x7faf38102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.048+0000 7faf37200640 1 -- 172.21.15.103:0/4240675990 >> 172.21.15.103:0/4240675990 conn(0x7faf380fe660 msgr2=0x7faf38100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:41.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.048+0000 7faf37200640 1 -- 172.21.15.103:0/4240675990 shutdown_connections 2024-09-11T01:08:41.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.048+0000 7faf37200640 1 -- 172.21.15.103:0/4240675990 wait complete. 2024-09-11T01:08:41.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.049+0000 7faf37200640 1 Processor -- start 2024-09-11T01:08:41.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.050+0000 7faf37200640 1 -- start start 2024-09-11T01:08:41.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.050+0000 7faf37200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf38102c10 0x7faf38199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.050+0000 7faf37200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf38108620 0x7faf38199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.050+0000 7faf37200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf38108fa0 0x7faf3819e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.050+0000 7faf37200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faf38112cb0 con 0x7faf38108620 2024-09-11T01:08:41.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.050+0000 7faf37200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faf38112b30 con 0x7faf38108fa0 2024-09-11T01:08:41.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.050+0000 7faf37200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faf38112e30 con 0x7faf38102c10 2024-09-11T01:08:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.050+0000 7faf35e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf38102c10 0x7faf38199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.050+0000 7faf35e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf38102c10 0x7faf38199020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:56038/0 (socket says 172.21.15.103:56038) 2024-09-11T01:08:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.050+0000 7faf35e00640 1 -- 172.21.15.103:0/1034819841 learned_addr learned my addr 172.21.15.103:0/1034819841 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.051+0000 7faf36800640 1 --2- 172.21.15.103:0/1034819841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf38108fa0 0x7faf3819e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.051+0000 7faf2d400640 1 --2- 172.21.15.103:0/1034819841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf38108620 0x7faf38199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.051+0000 7faf35e00640 1 -- 172.21.15.103:0/1034819841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf38108fa0 msgr2=0x7faf3819e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.051+0000 7faf35e00640 1 --2- 172.21.15.103:0/1034819841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf38108fa0 0x7faf3819e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.051+0000 7faf35e00640 1 -- 172.21.15.103:0/1034819841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf38108620 msgr2=0x7faf38199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.051+0000 7faf35e00640 1 --2- 172.21.15.103:0/1034819841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf38108620 0x7faf38199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.051+0000 7faf35e00640 1 -- 172.21.15.103:0/1034819841 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3819f0d0 con 0x7faf38102c10 2024-09-11T01:08:41.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.051+0000 7faf35e00640 1 --2- 172.21.15.103:0/1034819841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf38102c10 0x7faf38199020 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf2800e9f0 tx=0x7faf2800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:41.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.052+0000 7faf2f400640 1 -- 172.21.15.103:0/1034819841 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2800cd80 con 0x7faf38102c10 2024-09-11T01:08:41.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.052+0000 7faf37200640 1 -- 172.21.15.103:0/1034819841 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3819f3c0 con 0x7faf38102c10 2024-09-11T01:08:41.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.052+0000 7faf37200640 1 -- 172.21.15.103:0/1034819841 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf381a5c50 con 0x7faf38102c10 2024-09-11T01:08:41.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.052+0000 7faf2f400640 1 -- 172.21.15.103:0/1034819841 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf280108e0 con 0x7faf38102c10 2024-09-11T01:08:41.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.052+0000 7faf2f400640 1 -- 172.21.15.103:0/1034819841 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28018980 con 0x7faf38102c10 2024-09-11T01:08:41.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.055+0000 7faf3fc35740 1 Processor -- start 2024-09-11T01:08:41.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.055+0000 7faf3fc35740 1 -- start start 2024-09-11T01:08:41.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf3fc35740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb18739810 0x55bb18739bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf3fc35740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb1873a130 0x55bb18745b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf3fc35740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 0x55bb187484b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf3fc35740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bb186acd50 con 0x55bb1873a130 2024-09-11T01:08:41.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf3fc35740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bb1869c180 con 0x55bb187460c0 2024-09-11T01:08:41.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf3fc35740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bb1869ff90 con 0x55bb18739810 2024-09-11T01:08:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf2d400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 0x55bb187484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf2d400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 0x55bb187484b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:48550/0 (socket says 172.21.15.103:48550) 2024-09-11T01:08:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf2d400640 1 -- 172.21.15.103:0/1419693249 learned_addr learned my addr 172.21.15.103:0/1419693249 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf36800640 1 --2- 172.21.15.103:0/1419693249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb18739810 0x55bb18739bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf2d400640 1 -- 172.21.15.103:0/1419693249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb18739810 msgr2=0x55bb18739bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf2d400640 1 --2- 172.21.15.103:0/1419693249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb18739810 0x55bb18739bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf2d400640 1 -- 172.21.15.103:0/1419693249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb1873a130 msgr2=0x55bb18745b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:08:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf2d400640 1 --2- 172.21.15.103:0/1419693249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb1873a130 0x55bb18745b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.056+0000 7faf2d400640 1 -- 172.21.15.103:0/1419693249 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb18666a70 con 0x55bb187460c0 2024-09-11T01:08:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.057+0000 7faf2d400640 1 --2- 172.21.15.103:0/1419693249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 0x55bb187484b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faf200103d0 tx=0x7faf20010890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ecd987ebc77835f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.057+0000 7faf27400640 1 -- 172.21.15.103:0/1419693249 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20003b70 con 0x55bb187460c0 2024-09-11T01:08:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.057+0000 7faf27400640 1 -- 172.21.15.103:0/1419693249 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf20003d10 con 0x55bb187460c0 2024-09-11T01:08:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.057+0000 7faf27400640 1 -- 172.21.15.103:0/1419693249 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf20011b30 con 0x55bb187460c0 2024-09-11T01:08:41.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.057+0000 7faf2f400640 1 -- 172.21.15.103:0/1034819841 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7faf28010430 con 0x7faf38102c10 2024-09-11T01:08:41.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.058+0000 7faf3fc35740 1 -- 172.21.15.103:0/1419693249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 msgr2=0x55bb187484b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:41.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.058+0000 7faf3fc35740 1 --2- 172.21.15.103:0/1419693249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 0x55bb187484b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7faf200103d0 tx=0x7faf20010890 comp rx=0 tx=0).stop 2024-09-11T01:08:41.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.058+0000 7faf3fc35740 1 -- 172.21.15.103:0/1419693249 shutdown_connections 2024-09-11T01:08:41.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.058+0000 7faf3fc35740 1 --2- 172.21.15.103:0/1419693249 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 0x55bb187484b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.058+0000 7faf3fc35740 1 --2- 172.21.15.103:0/1419693249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb1873a130 0x55bb18745b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.058+0000 7faf3fc35740 1 --2- 172.21.15.103:0/1419693249 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb18739810 0x55bb18739bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.058+0000 7faf3fc35740 1 -- 172.21.15.103:0/1419693249 >> 172.21.15.103:0/1419693249 conn(0x55bb18737640 msgr2=0x55bb187387e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:41.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.058+0000 7faf3fc35740 1 -- 172.21.15.103:0/1419693249 shutdown_connections 2024-09-11T01:08:41.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.058+0000 7faf3fc35740 1 -- 172.21.15.103:0/1419693249 wait complete. 2024-09-11T01:08:41.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.059+0000 7faf3fc35740 1 -- start start 2024-09-11T01:08:41.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.059+0000 7faf3fc35740 1 Processor -- start 2024-09-11T01:08:41.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.059+0000 7faf2f400640 1 --2- 172.21.15.103:0/1034819841 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faf1c0b53a0 0x7faf1c0b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.059+0000 7faf2f400640 1 -- 172.21.15.103:0/1034819841 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7faf280e6220 con 0x7faf38102c10 2024-09-11T01:08:41.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.059+0000 7faf36800640 1 --2- 172.21.15.103:0/1034819841 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faf1c0b53a0 0x7faf1c0b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.060+0000 7faf3fc35740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb18739810 0x55bb18743080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.060+0000 7faf3fc35740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb1873a130 0x55bb187435c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.060+0000 7faf3fc35740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 0x55bb18743b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.060+0000 7faf3fc35740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bb184fd5f0 con 0x55bb18739810 2024-09-11T01:08:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.060+0000 7faf3fc35740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bb18637460 con 0x55bb187460c0 2024-09-11T01:08:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.060+0000 7faf3fc35740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bb18748de0 con 0x55bb1873a130 2024-09-11T01:08:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.060+0000 7faf3fc35740 10 client.0 _ll_register_callbacks cb 0x55bb18647210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.060+0000 7faf2d400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb1873a130 0x55bb187435c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.060+0000 7faf2d400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb1873a130 0x55bb187435c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:56062/0 (socket says 172.21.15.103:56062) 2024-09-11T01:08:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.060+0000 7faf2d400640 1 -- 172.21.15.103:0/2967816533 learned_addr learned my addr 172.21.15.103:0/2967816533 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.060+0000 7faf35e00640 1 --2- 172.21.15.103:0/2967816533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb18739810 0x55bb18743080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.060+0000 7faf36800640 1 --2- 172.21.15.103:0/1034819841 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faf1c0b53a0 0x7faf1c0b7860 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faf30006010 tx=0x7faf30005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.060+0000 7faf36800640 1 --2- 172.21.15.103:0/2967816533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 0x55bb18743b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.061+0000 7faf2d400640 1 -- 172.21.15.103:0/2967816533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 msgr2=0x55bb18743b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:41.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.061+0000 7faf2d400640 1 --2- 172.21.15.103:0/2967816533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 0x55bb18743b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.061+0000 7faf2d400640 1 -- 172.21.15.103:0/2967816533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb18739810 msgr2=0x55bb18743080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:41.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.061+0000 7faf2d400640 1 --2- 172.21.15.103:0/2967816533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb18739810 0x55bb18743080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.061+0000 7faf2d400640 1 -- 172.21.15.103:0/2967816533 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb183fa540 con 0x55bb1873a130 2024-09-11T01:08:41.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.061+0000 7faf35e00640 1 --2- 172.21.15.103:0/2967816533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb18739810 0x55bb18743080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:41.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.061+0000 7faf2d400640 1 --2- 172.21.15.103:0/2967816533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb1873a130 0x55bb187435c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faf20011670 tx=0x7faf20011540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3b83194b4a0599c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:41.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.061+0000 7faf1be00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:08:41.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.062+0000 7faf1be00640 1 -- 172.21.15.103:0/2967816533 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2002b060 con 0x55bb1873a130 2024-09-11T01:08:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.062+0000 7faf3fc35740 1 -- 172.21.15.103:0/2967816533 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bb18639a70 con 0x55bb1873a130 2024-09-11T01:08:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.062+0000 7faf1be00640 1 -- 172.21.15.103:0/2967816533 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7faf2001b630 con 0x55bb1873a130 2024-09-11T01:08:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.062+0000 7faf1be00640 1 -- 172.21.15.103:0/2967816533 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faf20032050 con 0x55bb1873a130 2024-09-11T01:08:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.062+0000 7faf3fc35740 10 client.25369 fetch_fsmap learned FSMap version 26 2024-09-11T01:08:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.062+0000 7faf3fc35740 1 -- 172.21.15.103:0/2967816533 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bb186546f0 con 0x55bb1873a130 2024-09-11T01:08:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.063+0000 7faf1be00640 1 -- 172.21.15.103:0/2967816533 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55bb18639a70 con 0x55bb1873a130 2024-09-11T01:08:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.063+0000 7faf1be00640 1 -- 172.21.15.103:0/2967816533 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7faf2001a810 con 0x55bb1873a130 2024-09-11T01:08:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.063+0000 7faf3fc35740 10 client.25369 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:08:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.063+0000 7faf3fc35740 10 client.25369 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T01:08:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.063+0000 7faf3fc35740 20 client.25369 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.063+0000 7faf3fc35740 1 --2- 172.21.15.103:0/2967816533 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bb18756a10 0x55bb18757e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.063+0000 7faf3fc35740 4 client.25369 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:08:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.063+0000 7faf3fc35740 1 -- 172.21.15.103:0/2967816533 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb186aeca0 con 0x55bb18756a10 2024-09-11T01:08:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.063+0000 7faf35e00640 1 --2- 172.21.15.103:0/2967816533 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bb18756a10 0x55bb18757e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.064+0000 7faf35e00640 1 --2- 172.21.15.103:0/2967816533 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bb18756a10 0x55bb18757e80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30cd85fec6faee12 server_cookie=e9eb557b8ac8aa47 in_seq=0 out_seq=0 2024-09-11T01:08:41.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.064+0000 7faf1be00640 10 client.25369 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:41.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.064+0000 7faf1be00640 1 -- 172.21.15.103:0/2967816533 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bb186aeca0 con 0x55bb18756a10 2024-09-11T01:08:41.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.064+0000 7faf1be00640 10 client.25369 handle_command_reply: tid=0 2024-09-11T01:08:41.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.065+0000 7faf3fc35740 1 client.25369 shutdown 2024-09-11T01:08:41.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.065+0000 7faf3fc35740 1 -- 172.21.15.103:0/2967816533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb1873a130 msgr2=0x55bb187435c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:41.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.065+0000 7faf3fc35740 1 --2- 172.21.15.103:0/2967816533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb1873a130 0x55bb187435c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faf20011670 tx=0x7faf20011540 comp rx=0 tx=0).stop 2024-09-11T01:08:41.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.065+0000 7faf3fc35740 1 -- 172.21.15.103:0/2967816533 shutdown_connections 2024-09-11T01:08:41.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.065+0000 7faf3fc35740 1 --2- 172.21.15.103:0/2967816533 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 0x55bb18743b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.065+0000 7faf3fc35740 1 --2- 172.21.15.103:0/2967816533 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bb18756a10 0x55bb18757e80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.065+0000 7faf3fc35740 1 --2- 172.21.15.103:0/2967816533 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb1873a130 0x55bb187435c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.065+0000 7faf3fc35740 1 --2- 172.21.15.103:0/2967816533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb18739810 0x55bb18743080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.065+0000 7faf3fc35740 1 -- 172.21.15.103:0/2967816533 >> 172.21.15.103:0/2967816533 conn(0x55bb18737640 msgr2=0x55bb18732350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:41.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.065+0000 7faf1be00640 0 client.25369 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:41.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.065+0000 7faf3fc35740 1 -- 172.21.15.103:0/2967816533 shutdown_connections 2024-09-11T01:08:41.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.065+0000 7faf3fc35740 1 -- 172.21.15.103:0/2967816533 wait complete. 2024-09-11T01:08:41.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.065+0000 7faf3fc35740 20 client.25369 trim_cache size 0 max 16384 2024-09-11T01:08:41.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.084+0000 7faf3fc35740 1 Processor -- start 2024-09-11T01:08:41.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.084+0000 7faf3fc35740 1 -- start start 2024-09-11T01:08:41.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.085+0000 7faf3fc35740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb18739810 0x55bb18756340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.085+0000 7faf3fc35740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb1873a130 0x55bb187577b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.085+0000 7faf3fc35740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 0x55bb18755be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.085+0000 7faf3fc35740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bb187561c0 con 0x55bb18739810 2024-09-11T01:08:41.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.085+0000 7faf3fc35740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bb18756890 con 0x55bb187460c0 2024-09-11T01:08:41.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.085+0000 7faf3fc35740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bb18756f60 con 0x55bb1873a130 2024-09-11T01:08:41.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.085+0000 7faf35e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb18739810 0x55bb18756340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.085+0000 7faf2d400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb1873a130 0x55bb187577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.085+0000 7faf35e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb18739810 0x55bb18756340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40170/0 (socket says 172.21.15.103:40170) 2024-09-11T01:08:41.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.085+0000 7faf35e00640 1 -- 172.21.15.103:0/2091285356 learned_addr learned my addr 172.21.15.103:0/2091285356 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:41.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.085+0000 7faf36800640 1 --2- 172.21.15.103:0/2091285356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 0x55bb18755be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.086+0000 7faf2d400640 1 -- 172.21.15.103:0/2091285356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 msgr2=0x55bb18755be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:41.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.086+0000 7faf2d400640 1 --2- 172.21.15.103:0/2091285356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 0x55bb18755be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.086+0000 7faf2d400640 1 -- 172.21.15.103:0/2091285356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb18739810 msgr2=0x55bb18756340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:41.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.086+0000 7faf2d400640 1 --2- 172.21.15.103:0/2091285356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb18739810 0x55bb18756340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.086+0000 7faf2d400640 1 -- 172.21.15.103:0/2091285356 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb187380c0 con 0x55bb1873a130 2024-09-11T01:08:41.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.086+0000 7faf35e00640 1 --2- 172.21.15.103:0/2091285356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb18739810 0x55bb18756340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:41.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.086+0000 7faf2d400640 1 --2- 172.21.15.103:0/2091285356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb1873a130 0x55bb187577b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faf2000a010 tx=0x7faf200115b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf12f42c0e707d9d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:41.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.086+0000 7faf26a00640 1 -- 172.21.15.103:0/2091285356 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2002b030 con 0x55bb1873a130 2024-09-11T01:08:41.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.086+0000 7faf26a00640 1 -- 172.21.15.103:0/2091285356 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf20005bd0 con 0x55bb1873a130 2024-09-11T01:08:41.089 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.086+0000 7faf26a00640 1 -- 172.21.15.103:0/2091285356 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2001a570 con 0x55bb1873a130 2024-09-11T01:08:41.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.087+0000 7faf3fc35740 1 -- 172.21.15.103:0/2091285356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb1873a130 msgr2=0x55bb187577b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:41.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.087+0000 7faf3fc35740 1 --2- 172.21.15.103:0/2091285356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb1873a130 0x55bb187577b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faf2000a010 tx=0x7faf200115b0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.088+0000 7faf3fc35740 1 -- 172.21.15.103:0/2091285356 shutdown_connections 2024-09-11T01:08:41.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.088+0000 7faf3fc35740 1 --2- 172.21.15.103:0/2091285356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb187460c0 0x55bb18755be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.088+0000 7faf3fc35740 1 --2- 172.21.15.103:0/2091285356 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb1873a130 0x55bb187577b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.088+0000 7faf3fc35740 1 --2- 172.21.15.103:0/2091285356 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb18739810 0x55bb18756340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.088+0000 7faf3fc35740 1 -- 172.21.15.103:0/2091285356 >> 172.21.15.103:0/2091285356 conn(0x55bb18737640 msgr2=0x55bb18741900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:41.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.088+0000 7faf3fc35740 1 -- 172.21.15.103:0/2091285356 shutdown_connections 2024-09-11T01:08:41.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.088+0000 7faf3fc35740 1 -- 172.21.15.103:0/2091285356 wait complete. 2024-09-11T01:08:41.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.088+0000 7faf3fc35740 1 -- start start 2024-09-11T01:08:41.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.089+0000 7faf3fc35740 1 Processor -- start 2024-09-11T01:08:41.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.089+0000 7faf3fc35740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb18739810 0x55bb18760840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.089+0000 7faf3fc35740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb1873a130 0x55bb1875a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.089+0000 7faf3fc35740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb187460c0 0x55bb1875a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.089+0000 7faf3fc35740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bb18757d00 con 0x55bb1873a130 2024-09-11T01:08:41.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.089+0000 7faf3fc35740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bb18757630 con 0x55bb18739810 2024-09-11T01:08:41.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.089+0000 7faf3fc35740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bb187583d0 con 0x55bb187460c0 2024-09-11T01:08:41.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.089+0000 7faf3fc35740 10 client.0 _ll_register_callbacks cb 0x7faf20011c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:41.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.090+0000 7faf2d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb1873a130 0x55bb1875a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.090+0000 7faf35e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb18739810 0x55bb18760840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.090+0000 7faf36800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb187460c0 0x55bb1875a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.090+0000 7faf35e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb18739810 0x55bb18760840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:48576/0 (socket says 172.21.15.103:48576) 2024-09-11T01:08:41.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.090+0000 7faf35e00640 1 -- 172.21.15.103:0/1907083449 learned_addr learned my addr 172.21.15.103:0/1907083449 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:41.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.090+0000 7faf35e00640 1 -- 172.21.15.103:0/1907083449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb187460c0 msgr2=0x55bb1875a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:41.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.090+0000 7faf35e00640 1 --2- 172.21.15.103:0/1907083449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb187460c0 0x55bb1875a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.090+0000 7faf35e00640 1 -- 172.21.15.103:0/1907083449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb1873a130 msgr2=0x55bb1875a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:41.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.090+0000 7faf35e00640 1 --2- 172.21.15.103:0/1907083449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb1873a130 0x55bb1875a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.090+0000 7faf35e00640 1 -- 172.21.15.103:0/1907083449 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb1872e8c0 con 0x55bb18739810 2024-09-11T01:08:41.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.090+0000 7faf35e00640 1 --2- 172.21.15.103:0/1907083449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb18739810 0x55bb18760840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faf2800e9c0 tx=0x7faf280a8c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=948ae03500e2523b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:41.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.090+0000 7faf1be00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:08:41.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.090+0000 7faf1be00640 1 -- 172.21.15.103:0/1907083449 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28018420 con 0x55bb18739810 2024-09-11T01:08:41.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.091+0000 7faf3fc35740 1 -- 172.21.15.103:0/1907083449 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf20005bd0 con 0x55bb18739810 2024-09-11T01:08:41.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.091+0000 7faf1be00640 1 -- 172.21.15.103:0/1907083449 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7faf280d3170 con 0x55bb18739810 2024-09-11T01:08:41.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.091+0000 7faf1be00640 1 -- 172.21.15.103:0/1907083449 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7faf280acbd0 con 0x55bb18739810 2024-09-11T01:08:41.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.091+0000 7faf3fc35740 10 client.25400 fetch_fsmap learned FSMap version 26 2024-09-11T01:08:41.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.091+0000 7faf3fc35740 1 -- 172.21.15.103:0/1907083449 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bb187428a0 con 0x55bb18739810 2024-09-11T01:08:41.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.091+0000 7faf1be00640 1 -- 172.21.15.103:0/1907083449 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faf20005bd0 con 0x55bb18739810 2024-09-11T01:08:41.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.091+0000 7faf1be00640 1 -- 172.21.15.103:0/1907083449 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7faf28093040 con 0x55bb18739810 2024-09-11T01:08:41.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.091+0000 7faf3fc35740 10 client.25400 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:08:41.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.091+0000 7faf3fc35740 10 client.25400 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-11T01:08:41.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.091+0000 7faf3fc35740 20 client.25400 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:41.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.091+0000 7faf3fc35740 1 --2- 172.21.15.103:0/1907083449 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bb187c7fe0 0x55bb187c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:41.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.091+0000 7faf3fc35740 4 client.25400 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-11T01:08:41.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.091+0000 7faf3fc35740 1 -- 172.21.15.103:0/1907083449 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "status"}) -- 0x55bb186aa750 con 0x55bb187c7fe0 2024-09-11T01:08:41.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.092+0000 7faf2d400640 1 --2- 172.21.15.103:0/1907083449 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bb187c7fe0 0x55bb187c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:41.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.092+0000 7faf2d400640 1 --2- 172.21.15.103:0/1907083449 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bb187c7fe0 0x55bb187c6cf0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad3dbc812b513f2e server_cookie=d5e550c92ca3e2a4 in_seq=0 out_seq=0 2024-09-11T01:08:41.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.092+0000 7faf1be00640 10 client.25400 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:41.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf1be00640 1 -- 172.21.15.103:0/1907083449 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55bb186aa750 con 0x55bb187c7fe0 2024-09-11T01:08:41.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf1be00640 10 client.25400 handle_command_reply: tid=0 2024-09-11T01:08:41.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf3fc35740 1 client.25400 shutdown 2024-09-11T01:08:41.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf3fc35740 1 -- 172.21.15.103:0/1907083449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb18739810 msgr2=0x55bb18760840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:41.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf3fc35740 1 --2- 172.21.15.103:0/1907083449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb18739810 0x55bb18760840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faf2800e9c0 tx=0x7faf280a8c50 comp rx=0 tx=0).stop 2024-09-11T01:08:41.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf3fc35740 1 -- 172.21.15.103:0/1907083449 shutdown_connections 2024-09-11T01:08:41.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf3fc35740 1 --2- 172.21.15.103:0/1907083449 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bb187c7fe0 0x55bb187c6cf0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf3fc35740 1 --2- 172.21.15.103:0/1907083449 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bb187460c0 0x55bb1875a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf3fc35740 1 --2- 172.21.15.103:0/1907083449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bb1873a130 0x55bb1875a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf3fc35740 1 --2- 172.21.15.103:0/1907083449 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bb18739810 0x55bb18760840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf3fc35740 1 -- 172.21.15.103:0/1907083449 >> 172.21.15.103:0/1907083449 conn(0x55bb18737640 msgr2=0x55bb187446b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:41.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf1be00640 0 client.25400 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:41.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf3fc35740 1 -- 172.21.15.103:0/1907083449 shutdown_connections 2024-09-11T01:08:41.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf3fc35740 1 -- 172.21.15.103:0/1907083449 wait complete. 2024-09-11T01:08:41.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.093+0000 7faf3fc35740 20 client.25400 trim_cache size 0 max 16384 2024-09-11T01:08:41.098 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:08:41.098 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "917288bc-6fd8-11ef-bcea-c7b262605968", 2024-09-11T01:08:41.098 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-09-11T01:08:41.098 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24665, 2024-09-11T01:08:41.098 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-09-11T01:08:41.098 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-09-11T01:08:41.098 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-09-11T01:08:41.098 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 187.41793392100001, 2024-09-11T01:08:41.099 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 26, 2024-09-11T01:08:41.099 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-09-11T01:08:41.099 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 89, 2024-09-11T01:08:41.099 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 201.246331766 2024-09-11T01:08:41.099 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:08:41.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.094+0000 7faf37200640 1 -- 172.21.15.103:0/1034819841 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faf1c0b53a0 msgr2=0x7faf1c0b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:41.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.094+0000 7faf37200640 1 --2- 172.21.15.103:0/1034819841 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faf1c0b53a0 0x7faf1c0b7860 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7faf30006010 tx=0x7faf30005a40 comp rx=0 tx=0).stop 2024-09-11T01:08:41.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.094+0000 7faf37200640 1 -- 172.21.15.103:0/1034819841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf38102c10 msgr2=0x7faf38199020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:41.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.094+0000 7faf37200640 1 --2- 172.21.15.103:0/1034819841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf38102c10 0x7faf38199020 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faf2800e9f0 tx=0x7faf2800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.094+0000 7faf37200640 1 -- 172.21.15.103:0/1034819841 shutdown_connections 2024-09-11T01:08:41.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.094+0000 7faf37200640 1 --2- 172.21.15.103:0/1034819841 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faf1c0b53a0 0x7faf1c0b7860 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.094+0000 7faf37200640 1 --2- 172.21.15.103:0/1034819841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faf38108fa0 0x7faf3819e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.094+0000 7faf37200640 1 --2- 172.21.15.103:0/1034819841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faf38108620 0x7faf38199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.094+0000 7faf37200640 1 --2- 172.21.15.103:0/1034819841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faf38102c10 0x7faf38199020 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:41.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.094+0000 7faf37200640 1 -- 172.21.15.103:0/1034819841 >> 172.21.15.103:0/1034819841 conn(0x7faf380fe660 msgr2=0x7faf38101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:41.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.094+0000 7faf37200640 1 -- 172.21.15.103:0/1034819841 shutdown_connections 2024-09-11T01:08:41.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:41.095+0000 7faf37200640 1 -- 172.21.15.103:0/1034819841 wait complete. 2024-09-11T01:08:42.171 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-11T01:08:42.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:42 smithi117 ceph-mon[35358]: pgmap v410: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-11T01:08:42.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:42 smithi183 ceph-mon[34992]: pgmap v410: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-11T01:08:43.081 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:42 smithi103 ceph-mon[30562]: pgmap v410: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-11T01:08:44.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:44 smithi117 ceph-mon[35358]: pgmap v411: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-11T01:08:44.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:44 smithi183 ceph-mon[34992]: pgmap v411: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-11T01:08:45.081 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:44 smithi103 ceph-mon[30562]: pgmap v411: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 2.5 KiB/s wr, 11 op/s 2024-09-11T01:08:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.458+0000 7fbc7f200640 1 -- 172.21.15.103:0/1169907593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc80076f90 msgr2=0x7fbc800755e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.458+0000 7fbc7f200640 1 --2- 172.21.15.103:0/1169907593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc80076f90 0x7fbc800755e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbc70009ca0 tx=0x7fbc7002a8c0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.458+0000 7fbc7f200640 1 -- 172.21.15.103:0/1169907593 shutdown_connections 2024-09-11T01:08:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.458+0000 7fbc7f200640 1 --2- 172.21.15.103:0/1169907593 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc801062a0 0x7fbc80110f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.458+0000 7fbc7f200640 1 --2- 172.21.15.103:0/1169907593 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc80075b20 0x7fbc80075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.458+0000 7fbc7f200640 1 --2- 172.21.15.103:0/1169907593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc80076f90 0x7fbc800755e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.458+0000 7fbc7f200640 1 -- 172.21.15.103:0/1169907593 >> 172.21.15.103:0/1169907593 conn(0x7fbc800fe030 msgr2=0x7fbc80100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.458+0000 7fbc7f200640 1 -- 172.21.15.103:0/1169907593 shutdown_connections 2024-09-11T01:08:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.458+0000 7fbc7f200640 1 -- 172.21.15.103:0/1169907593 wait complete. 2024-09-11T01:08:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.459+0000 7fbc7f200640 1 Processor -- start 2024-09-11T01:08:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.459+0000 7fbc7f200640 1 -- start start 2024-09-11T01:08:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.459+0000 7fbc7f200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc80075b20 0x7fbc8019f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.459+0000 7fbc7f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc80076f90 0x7fbc8019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.459+0000 7fbc7f200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc801a0440 0x7fbc801a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.459+0000 7fbc7f200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbc80114a60 con 0x7fbc80076f90 2024-09-11T01:08:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.459+0000 7fbc7f200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc801148e0 con 0x7fbc801a0440 2024-09-11T01:08:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.459+0000 7fbc7f200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbc80114be0 con 0x7fbc80075b20 2024-09-11T01:08:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.460+0000 7fbc7d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc80076f90 0x7fbc8019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.460+0000 7fbc7d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc80076f90 0x7fbc8019f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40182/0 (socket says 172.21.15.103:40182) 2024-09-11T01:08:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.460+0000 7fbc7d400640 1 -- 172.21.15.103:0/2654225698 learned_addr learned my addr 172.21.15.103:0/2654225698 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.460+0000 7fbc7de00640 1 --2- 172.21.15.103:0/2654225698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc80075b20 0x7fbc8019f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.460+0000 7fbc7e800640 1 --2- 172.21.15.103:0/2654225698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc801a0440 0x7fbc801a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.460+0000 7fbc7d400640 1 -- 172.21.15.103:0/2654225698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc80075b20 msgr2=0x7fbc8019f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.460+0000 7fbc7d400640 1 --2- 172.21.15.103:0/2654225698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc80075b20 0x7fbc8019f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.460+0000 7fbc7d400640 1 -- 172.21.15.103:0/2654225698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc801a0440 msgr2=0x7fbc801a08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.460+0000 7fbc7d400640 1 --2- 172.21.15.103:0/2654225698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc801a0440 0x7fbc801a08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.460+0000 7fbc7d400640 1 -- 172.21.15.103:0/2654225698 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc801a10f0 con 0x7fbc80076f90 2024-09-11T01:08:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.460+0000 7fbc7d400640 1 --2- 172.21.15.103:0/2654225698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc80076f90 0x7fbc8019f810 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00e9f0 tx=0x7fbc6c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.461+0000 7fbc76a00640 1 -- 172.21.15.103:0/2654225698 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c00ccc0 con 0x7fbc80076f90 2024-09-11T01:08:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.461+0000 7fbc76a00640 1 -- 172.21.15.103:0/2654225698 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc6c00ce60 con 0x7fbc80076f90 2024-09-11T01:08:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.461+0000 7fbc7f200640 1 -- 172.21.15.103:0/2654225698 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc801a74e0 con 0x7fbc80076f90 2024-09-11T01:08:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.461+0000 7fbc76a00640 1 -- 172.21.15.103:0/2654225698 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c010430 con 0x7fbc80076f90 2024-09-11T01:08:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.461+0000 7fbc7f200640 1 -- 172.21.15.103:0/2654225698 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc801a79d0 con 0x7fbc80076f90 2024-09-11T01:08:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.464+0000 7fbc87e81740 1 Processor -- start 2024-09-11T01:08:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.464+0000 7fbc87e81740 1 -- start start 2024-09-11T01:08:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc87e81740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f1b970 0x555687f1dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc87e81740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1e2a0 0x555687f20690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc76a00640 1 -- 172.21.15.103:0/2654225698 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7fbc6c0046c0 con 0x7fbc80076f90 2024-09-11T01:08:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc87e81740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f20ce0 0x555687f231a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc87e81740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555687e8e6b0 con 0x555687f1b970 2024-09-11T01:08:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc87e81740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555687e7dae0 con 0x555687f20ce0 2024-09-11T01:08:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc87e81740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555687e818f0 con 0x555687f1e2a0 2024-09-11T01:08:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc7e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f1b970 0x555687f1dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc7d400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f20ce0 0x555687f231a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc7de00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1e2a0 0x555687f20690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc7e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f1b970 0x555687f1dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40194/0 (socket says 172.21.15.103:40194) 2024-09-11T01:08:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc7e800640 1 -- 172.21.15.103:0/1611463246 learned_addr learned my addr 172.21.15.103:0/1611463246 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc7de00640 1 -- 172.21.15.103:0/1611463246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f20ce0 msgr2=0x555687f231a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc7de00640 1 --2- 172.21.15.103:0/1611463246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f20ce0 0x555687f231a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc7de00640 1 -- 172.21.15.103:0/1611463246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f1b970 msgr2=0x555687f1dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.465+0000 7fbc7de00640 1 --2- 172.21.15.103:0/1611463246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f1b970 0x555687f1dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.470 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.466+0000 7fbc7de00640 1 -- 172.21.15.103:0/1611463246 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555687e4a780 con 0x555687f1e2a0 2024-09-11T01:08:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.466+0000 7fbc7e800640 1 --2- 172.21.15.103:0/1611463246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f1b970 0x555687f1dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.466+0000 7fbc7de00640 1 --2- 172.21.15.103:0/1611463246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1e2a0 0x555687f20690 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbc7002aeb0 tx=0x7fbc70005f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13478e6f30924e83 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.466+0000 7fbc6b400640 1 -- 172.21.15.103:0/1611463246 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc70031650 con 0x555687f1e2a0 2024-09-11T01:08:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.466+0000 7fbc6b400640 1 -- 172.21.15.103:0/1611463246 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc70036030 con 0x555687f1e2a0 2024-09-11T01:08:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.466+0000 7fbc6b400640 1 -- 172.21.15.103:0/1611463246 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc70004650 con 0x555687f1e2a0 2024-09-11T01:08:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.467+0000 7fbc76a00640 1 --2- 172.21.15.103:0/2654225698 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbc640b53f0 0x7fbc640b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.467+0000 7fbc76a00640 1 -- 172.21.15.103:0/2654225698 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fbc6c0e6390 con 0x7fbc80076f90 2024-09-11T01:08:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.467+0000 7fbc7e800640 1 --2- 172.21.15.103:0/2654225698 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbc640b53f0 0x7fbc640b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.467+0000 7fbc87e81740 1 -- 172.21.15.103:0/1611463246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1e2a0 msgr2=0x555687f20690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.467+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1611463246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1e2a0 0x555687f20690 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbc7002aeb0 tx=0x7fbc70005f60 comp rx=0 tx=0).stop 2024-09-11T01:08:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.467+0000 7fbc87e81740 1 -- 172.21.15.103:0/1611463246 shutdown_connections 2024-09-11T01:08:45.471 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.467+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1611463246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f20ce0 0x555687f231a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.467+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1611463246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1e2a0 0x555687f20690 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.467+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1611463246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f1b970 0x555687f1dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.467+0000 7fbc87e81740 1 -- 172.21.15.103:0/1611463246 >> 172.21.15.103:0/1611463246 conn(0x555687f16ac0 msgr2=0x555687f17850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.467+0000 7fbc87e81740 1 -- 172.21.15.103:0/1611463246 shutdown_connections 2024-09-11T01:08:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.468+0000 7fbc87e81740 1 -- 172.21.15.103:0/1611463246 wait complete. 2024-09-11T01:08:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.468+0000 7fbc7e800640 1 --2- 172.21.15.103:0/2654225698 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbc640b53f0 0x7fbc640b78b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbc78009a50 tx=0x7fbc78005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.468+0000 7fbc87e81740 1 -- start start 2024-09-11T01:08:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.468+0000 7fbc87e81740 1 Processor -- start 2024-09-11T01:08:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc87e81740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1b970 0x555687f24e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc87e81740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f1e2a0 0x555687f254b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc87e81740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f20ce0 0x555687f26080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc87e81740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555687db5ab0 con 0x555687f1e2a0 2024-09-11T01:08:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc87e81740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555687e24570 con 0x555687f1b970 2024-09-11T01:08:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc87e81740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555687f23ae0 con 0x555687f20ce0 2024-09-11T01:08:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc87e81740 10 client.0 _ll_register_callbacks cb 0x555687e33100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc7d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f1e2a0 0x555687f254b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc7d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f1e2a0 0x555687f254b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40210/0 (socket says 172.21.15.103:40210) 2024-09-11T01:08:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc7d400640 1 -- 172.21.15.103:0/1796784043 learned_addr learned my addr 172.21.15.103:0/1796784043 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc7de00640 1 --2- 172.21.15.103:0/1796784043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1b970 0x555687f24e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc7e800640 1 --2- 172.21.15.103:0/1796784043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f20ce0 0x555687f26080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc7d400640 1 -- 172.21.15.103:0/1796784043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f20ce0 msgr2=0x555687f26080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc7d400640 1 --2- 172.21.15.103:0/1796784043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f20ce0 0x555687f26080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc7d400640 1 -- 172.21.15.103:0/1796784043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1b970 msgr2=0x555687f24e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc7d400640 1 --2- 172.21.15.103:0/1796784043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1b970 0x555687f24e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.469+0000 7fbc7d400640 1 -- 172.21.15.103:0/1796784043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555687bdf790 con 0x555687f1e2a0 2024-09-11T01:08:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.470+0000 7fbc7d400640 1 --2- 172.21.15.103:0/1796784043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f1e2a0 0x555687f254b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0a8cb0 tx=0x7fbc6c0acce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83597cbbc2b452f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.470+0000 7fbc5fe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:08:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.470+0000 7fbc5fe00640 1 -- 172.21.15.103:0/1796784043 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0a8580 con 0x555687f1e2a0 2024-09-11T01:08:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.470+0000 7fbc5fe00640 1 -- 172.21.15.103:0/1796784043 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fbc6c0abb50 con 0x555687f1e2a0 2024-09-11T01:08:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.470+0000 7fbc87e81740 1 -- 172.21.15.103:0/1796784043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc70036030 con 0x555687f1e2a0 2024-09-11T01:08:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.470+0000 7fbc5fe00640 1 -- 172.21.15.103:0/1796784043 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbc6c0abe50 con 0x555687f1e2a0 2024-09-11T01:08:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.470+0000 7fbc87e81740 10 client.15402 fetch_fsmap learned FSMap version 26 2024-09-11T01:08:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.470+0000 7fbc87e81740 1 -- 172.21.15.103:0/1796784043 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555687c58620 con 0x555687f1e2a0 2024-09-11T01:08:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.470+0000 7fbc5fe00640 1 -- 172.21.15.103:0/1796784043 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc70036030 con 0x555687f1e2a0 2024-09-11T01:08:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.471+0000 7fbc5fe00640 1 -- 172.21.15.103:0/1796784043 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fbc6c0ab3b0 con 0x555687f1e2a0 2024-09-11T01:08:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.471+0000 7fbc87e81740 10 client.15402 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:08:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.471+0000 7fbc87e81740 10 client.15402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:08:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.471+0000 7fbc87e81740 20 client.15402 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.471+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1796784043 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555687f30770 0x555687f32b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.471+0000 7fbc87e81740 4 client.15402 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:08:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.471+0000 7fbc87e81740 1 -- 172.21.15.103:0/1796784043 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555687e90600 con 0x555687f30770 2024-09-11T01:08:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.471+0000 7fbc7de00640 1 --2- 172.21.15.103:0/1796784043 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555687f30770 0x555687f32b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.472+0000 7fbc7de00640 1 --2- 172.21.15.103:0/1796784043 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555687f30770 0x555687f32b60 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c07e98e86cfc9df server_cookie=b6e8a8516d6524de in_seq=0 out_seq=0 2024-09-11T01:08:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.472+0000 7fbc5fe00640 10 client.15402 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.472+0000 7fbc5fe00640 1 -- 172.21.15.103:0/1796784043 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555687e90600 con 0x555687f30770 2024-09-11T01:08:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.473+0000 7fbc5fe00640 10 client.15402 handle_command_reply: tid=0 2024-09-11T01:08:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.473+0000 7fbc87e81740 1 client.15402 shutdown 2024-09-11T01:08:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.473+0000 7fbc87e81740 1 -- 172.21.15.103:0/1796784043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f1e2a0 msgr2=0x555687f254b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.473+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1796784043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f1e2a0 0x555687f254b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0a8cb0 tx=0x7fbc6c0acce0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.473+0000 7fbc87e81740 1 -- 172.21.15.103:0/1796784043 shutdown_connections 2024-09-11T01:08:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.473+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1796784043 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555687f30770 0x555687f32b60 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.473+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1796784043 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f20ce0 0x555687f26080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.473+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1796784043 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f1e2a0 0x555687f254b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.473+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1796784043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1b970 0x555687f24e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.473+0000 7fbc87e81740 1 -- 172.21.15.103:0/1796784043 >> 172.21.15.103:0/1796784043 conn(0x555687f16ac0 msgr2=0x555687f15bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.473+0000 7fbc5fe00640 0 client.15402 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.473+0000 7fbc87e81740 1 -- 172.21.15.103:0/1796784043 shutdown_connections 2024-09-11T01:08:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.473+0000 7fbc87e81740 1 -- 172.21.15.103:0/1796784043 wait complete. 2024-09-11T01:08:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.473+0000 7fbc87e81740 20 client.15402 trim_cache size 0 max 16384 2024-09-11T01:08:45.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.489+0000 7fbc87e81740 1 Processor -- start 2024-09-11T01:08:45.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.489+0000 7fbc87e81740 1 -- start start 2024-09-11T01:08:45.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.489+0000 7fbc87e81740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1b970 0x555687f32780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.489+0000 7fbc87e81740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1e2a0 0x555687f1add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.489+0000 7fbc87e81740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f20ce0 0x555687f1b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.489+0000 7fbc87e81740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbc801b42c0 con 0x555687f20ce0 2024-09-11T01:08:45.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.489+0000 7fbc87e81740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc801b1b90 con 0x555687f1e2a0 2024-09-11T01:08:45.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.489+0000 7fbc87e81740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbc801af9e0 con 0x555687f1b970 2024-09-11T01:08:45.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.489+0000 7fbc7d400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1e2a0 0x555687f1add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.489+0000 7fbc7d400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1e2a0 0x555687f1add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:48626/0 (socket says 172.21.15.103:48626) 2024-09-11T01:08:45.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.489+0000 7fbc7e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f20ce0 0x555687f1b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.493 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.489+0000 7fbc7d400640 1 -- 172.21.15.103:0/889597024 learned_addr learned my addr 172.21.15.103:0/889597024 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:45.493 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.489+0000 7fbc7de00640 1 --2- 172.21.15.103:0/889597024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1b970 0x555687f32780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.490+0000 7fbc7d400640 1 -- 172.21.15.103:0/889597024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1b970 msgr2=0x555687f32780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.490+0000 7fbc7d400640 1 --2- 172.21.15.103:0/889597024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1b970 0x555687f32780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.490+0000 7fbc7d400640 1 -- 172.21.15.103:0/889597024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f20ce0 msgr2=0x555687f1b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.490+0000 7fbc7d400640 1 --2- 172.21.15.103:0/889597024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f20ce0 0x555687f1b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.490+0000 7fbc7d400640 1 -- 172.21.15.103:0/889597024 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555687f24910 con 0x555687f1e2a0 2024-09-11T01:08:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.490+0000 7fbc7d400640 1 --2- 172.21.15.103:0/889597024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1e2a0 0x555687f1add0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0b1130 tx=0x7fbc6c0e3ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44b0d055d5b94645 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.490+0000 7fbc6aa00640 1 -- 172.21.15.103:0/889597024 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0ac030 con 0x555687f1e2a0 2024-09-11T01:08:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.490+0000 7fbc6aa00640 1 -- 172.21.15.103:0/889597024 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc6c0ac1f0 con 0x555687f1e2a0 2024-09-11T01:08:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.490+0000 7fbc6aa00640 1 -- 172.21.15.103:0/889597024 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0ac4b0 con 0x555687f1e2a0 2024-09-11T01:08:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.491+0000 7fbc87e81740 1 -- 172.21.15.103:0/889597024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1e2a0 msgr2=0x555687f1add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.491+0000 7fbc87e81740 1 --2- 172.21.15.103:0/889597024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1e2a0 0x555687f1add0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0b1130 tx=0x7fbc6c0e3ad0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.491+0000 7fbc87e81740 1 -- 172.21.15.103:0/889597024 shutdown_connections 2024-09-11T01:08:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.491+0000 7fbc87e81740 1 --2- 172.21.15.103:0/889597024 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f20ce0 0x555687f1b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.491+0000 7fbc87e81740 1 --2- 172.21.15.103:0/889597024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1e2a0 0x555687f1add0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.491+0000 7fbc87e81740 1 --2- 172.21.15.103:0/889597024 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1b970 0x555687f32780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.491+0000 7fbc87e81740 1 -- 172.21.15.103:0/889597024 >> 172.21.15.103:0/889597024 conn(0x555687f16ac0 msgr2=0x555687f19b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.492+0000 7fbc87e81740 1 -- 172.21.15.103:0/889597024 shutdown_connections 2024-09-11T01:08:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.492+0000 7fbc87e81740 1 -- 172.21.15.103:0/889597024 wait complete. 2024-09-11T01:08:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.492+0000 7fbc87e81740 1 -- start start 2024-09-11T01:08:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.492+0000 7fbc87e81740 1 Processor -- start 2024-09-11T01:08:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.493+0000 7fbc87e81740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1b970 0x555687f2bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.493+0000 7fbc87e81740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1e2a0 0x555687f2c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.493+0000 7fbc87e81740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f20ce0 0x555687f2a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.493+0000 7fbc87e81740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbc801b0050 con 0x555687f20ce0 2024-09-11T01:08:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.493+0000 7fbc87e81740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fbc801b14c0 con 0x555687f1b970 2024-09-11T01:08:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.493+0000 7fbc87e81740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fbc801b0720 con 0x555687f1e2a0 2024-09-11T01:08:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.493+0000 7fbc87e81740 10 client.0 _ll_register_callbacks cb 0x7fbc6c0e9c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.493+0000 7fbc7de00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1b970 0x555687f2bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.493+0000 7fbc7de00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1b970 0x555687f2bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:48640/0 (socket says 172.21.15.103:48640) 2024-09-11T01:08:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.493+0000 7fbc7de00640 1 -- 172.21.15.103:0/1404508962 learned_addr learned my addr 172.21.15.103:0/1404508962 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.493+0000 7fbc7e800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f20ce0 0x555687f2a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.493+0000 7fbc7d400640 1 --2- 172.21.15.103:0/1404508962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1e2a0 0x555687f2c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.494+0000 7fbc7de00640 1 -- 172.21.15.103:0/1404508962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1e2a0 msgr2=0x555687f2c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.494+0000 7fbc7de00640 1 --2- 172.21.15.103:0/1404508962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1e2a0 0x555687f2c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.494+0000 7fbc7de00640 1 -- 172.21.15.103:0/1404508962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f20ce0 msgr2=0x555687f2a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.494+0000 7fbc7de00640 1 --2- 172.21.15.103:0/1404508962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f20ce0 0x555687f2a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.494+0000 7fbc7de00640 1 -- 172.21.15.103:0/1404508962 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555687f2ad60 con 0x555687f1b970 2024-09-11T01:08:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.494+0000 7fbc7de00640 1 --2- 172.21.15.103:0/1404508962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1b970 0x555687f2bc40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbc7002f470 tx=0x7fbc70009960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aa94ada963f7a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.494+0000 7fbc5fe00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:08:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.494+0000 7fbc5fe00640 1 -- 172.21.15.103:0/1404508962 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7005c060 con 0x555687f1b970 2024-09-11T01:08:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.494+0000 7fbc87e81740 1 -- 172.21.15.103:0/1404508962 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc6c0ac1f0 con 0x555687f1b970 2024-09-11T01:08:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.494+0000 7fbc5fe00640 1 -- 172.21.15.103:0/1404508962 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fbc70031550 con 0x555687f1b970 2024-09-11T01:08:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.494+0000 7fbc5fe00640 1 -- 172.21.15.103:0/1404508962 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fbc70031750 con 0x555687f1b970 2024-09-11T01:08:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.494+0000 7fbc87e81740 10 client.25418 fetch_fsmap learned FSMap version 26 2024-09-11T01:08:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.494+0000 7fbc87e81740 1 -- 172.21.15.103:0/1404508962 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555687f9dd80 con 0x555687f1b970 2024-09-11T01:08:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.495+0000 7fbc5fe00640 1 -- 172.21.15.103:0/1404508962 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbc6c0ac1f0 con 0x555687f1b970 2024-09-11T01:08:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.495+0000 7fbc5fe00640 1 -- 172.21.15.103:0/1404508962 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fbc70043070 con 0x555687f1b970 2024-09-11T01:08:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.495+0000 7fbc87e81740 10 client.25418 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:08:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.495+0000 7fbc87e81740 10 client.25418 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:08:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.495+0000 7fbc87e81740 20 client.25418 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.495+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1404508962 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555687f9e450 0x555687fa0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.495+0000 7fbc87e81740 4 client.25418 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:08:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.495+0000 7fbc87e81740 1 -- 172.21.15.103:0/1404508962 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555687f16890 con 0x555687f9e450 2024-09-11T01:08:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.495+0000 7fbc7d400640 1 --2- 172.21.15.103:0/1404508962 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555687f9e450 0x555687fa0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.496+0000 7fbc7d400640 1 --2- 172.21.15.103:0/1404508962 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555687f9e450 0x555687fa0840 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ea4a29fdacfa5ce server_cookie=4ba39857944023fa in_seq=0 out_seq=0 2024-09-11T01:08:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.496+0000 7fbc5fe00640 10 client.25418 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc5fe00640 1 -- 172.21.15.103:0/1404508962 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555687f16890 con 0x555687f9e450 2024-09-11T01:08:45.508 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc5fe00640 10 client.25418 handle_command_reply: tid=0 2024-09-11T01:08:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc87e81740 1 client.25418 shutdown 2024-09-11T01:08:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc87e81740 1 -- 172.21.15.103:0/1404508962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1b970 msgr2=0x555687f2bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1404508962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1b970 0x555687f2bc40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbc7002f470 tx=0x7fbc70009960 comp rx=0 tx=0).stop 2024-09-11T01:08:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc87e81740 1 -- 172.21.15.103:0/1404508962 shutdown_connections 2024-09-11T01:08:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1404508962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555687f20ce0 0x555687f2a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1404508962 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555687f9e450 0x555687fa0840 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1404508962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555687f1e2a0 0x555687f2c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc87e81740 1 --2- 172.21.15.103:0/1404508962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555687f1b970 0x555687f2bc40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc5fe00640 0 client.25418 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:45.509 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc87e81740 1 -- 172.21.15.103:0/1404508962 >> 172.21.15.103:0/1404508962 conn(0x555687f16ac0 msgr2=0x555687f1a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc87e81740 1 -- 172.21.15.103:0/1404508962 shutdown_connections 2024-09-11T01:08:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc87e81740 1 -- 172.21.15.103:0/1404508962 wait complete. 2024-09-11T01:08:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.504+0000 7fbc87e81740 20 client.25418 trim_cache size 0 max 16384 2024-09-11T01:08:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:08:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:08:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:08:45.510 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:08:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.505+0000 7fbc7f200640 1 -- 172.21.15.103:0/2654225698 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbc640b53f0 msgr2=0x7fbc640b78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.505+0000 7fbc7f200640 1 --2- 172.21.15.103:0/2654225698 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbc640b53f0 0x7fbc640b78b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbc78009a50 tx=0x7fbc78005f90 comp rx=0 tx=0).stop 2024-09-11T01:08:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.505+0000 7fbc7f200640 1 -- 172.21.15.103:0/2654225698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc80076f90 msgr2=0x7fbc8019f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.505+0000 7fbc7f200640 1 --2- 172.21.15.103:0/2654225698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc80076f90 0x7fbc8019f810 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00e9f0 tx=0x7fbc6c00edf0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.505+0000 7fbc7f200640 1 -- 172.21.15.103:0/2654225698 shutdown_connections 2024-09-11T01:08:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.505+0000 7fbc7f200640 1 --2- 172.21.15.103:0/2654225698 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fbc640b53f0 0x7fbc640b78b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.505+0000 7fbc7f200640 1 --2- 172.21.15.103:0/2654225698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbc801a0440 0x7fbc801a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.505+0000 7fbc7f200640 1 --2- 172.21.15.103:0/2654225698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbc80076f90 0x7fbc8019f810 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.505+0000 7fbc7f200640 1 --2- 172.21.15.103:0/2654225698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fbc80075b20 0x7fbc8019f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.505+0000 7fbc7f200640 1 -- 172.21.15.103:0/2654225698 >> 172.21.15.103:0/2654225698 conn(0x7fbc800fe030 msgr2=0x7fbc80100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.505+0000 7fbc7f200640 1 -- 172.21.15.103:0/2654225698 shutdown_connections 2024-09-11T01:08:45.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:45.505+0000 7fbc7f200640 1 -- 172.21.15.103:0/2654225698 wait complete. 2024-09-11T01:08:46.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:46 smithi117 ceph-mon[35358]: pgmap v412: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-11T01:08:46.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:46 smithi183 ceph-mon[34992]: pgmap v412: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-11T01:08:47.081 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:46 smithi103 ceph-mon[30562]: pgmap v412: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.1 KiB/s wr, 9 op/s 2024-09-11T01:08:48.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:48 smithi103 ceph-mon[30562]: pgmap v413: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-11T01:08:48.624 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:48 smithi117 ceph-mon[35358]: pgmap v413: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-11T01:08:48.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:48 smithi183 ceph-mon[34992]: pgmap v413: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-11T01:08:50.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:50 smithi117 ceph-mon[35358]: pgmap v414: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-11T01:08:50.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:50 smithi183 ceph-mon[34992]: pgmap v414: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-11T01:08:51.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:50 smithi103 ceph-mon[30562]: pgmap v414: 129 pgs: 129 active+clean; 662 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2024-09-11T01:08:52.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:52 smithi117 ceph-mon[35358]: pgmap v415: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T01:08:52.920 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:52 smithi183 ceph-mon[34992]: pgmap v415: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T01:08:53.081 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:52 smithi103 ceph-mon[30562]: pgmap v415: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T01:08:54.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:54 smithi117 ceph-mon[35358]: pgmap v416: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T01:08:54.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:54 smithi183 ceph-mon[34992]: pgmap v416: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T01:08:55.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:54 smithi103 ceph-mon[30562]: pgmap v416: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T01:08:56.884 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:56 smithi103 ceph-mon[30562]: pgmap v417: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T01:08:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:56 smithi183 ceph-mon[34992]: pgmap v417: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T01:08:57.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:56 smithi117 ceph-mon[35358]: pgmap v417: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T01:08:57.172 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.2 2024-09-11T01:08:57.172 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:08:57.606 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:08:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.353+0000 7f1a6ea00640 1 -- 172.21.15.103:0/672167396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a68108fa0 msgr2=0x7f1a6810f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.353+0000 7f1a6ea00640 1 --2- 172.21.15.103:0/672167396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a68108fa0 0x7f1a6810f7a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009be0 tx=0x7f1a6002a6c0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.354+0000 7f1a6ea00640 1 -- 172.21.15.103:0/672167396 shutdown_connections 2024-09-11T01:08:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.354+0000 7f1a6ea00640 1 --2- 172.21.15.103:0/672167396 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a68108fa0 0x7f1a6810f7a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.354+0000 7f1a6ea00640 1 --2- 172.21.15.103:0/672167396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a68108620 0x7f1a68108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.354+0000 7f1a6ea00640 1 --2- 172.21.15.103:0/672167396 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a68102c10 0x7f1a68102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.354+0000 7f1a6ea00640 1 -- 172.21.15.103:0/672167396 >> 172.21.15.103:0/672167396 conn(0x7f1a680fe660 msgr2=0x7f1a68100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:58.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.354+0000 7f1a6ea00640 1 -- 172.21.15.103:0/672167396 shutdown_connections 2024-09-11T01:08:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.354+0000 7f1a6ea00640 1 -- 172.21.15.103:0/672167396 wait complete. 2024-09-11T01:08:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.355+0000 7f1a6ea00640 1 Processor -- start 2024-09-11T01:08:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.356+0000 7f1a6ea00640 1 -- start start 2024-09-11T01:08:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.356+0000 7f1a6ea00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a68102c10 0x7f1a6819b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.356+0000 7f1a6ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a68108620 0x7f1a6819b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.356+0000 7f1a6ea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a68108fa0 0x7f1a681a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.356+0000 7f1a6ea00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1a68112c30 con 0x7f1a68108620 2024-09-11T01:08:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.356+0000 7f1a6ea00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1a68112ab0 con 0x7f1a68108fa0 2024-09-11T01:08:58.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.356+0000 7f1a6ea00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1a68112db0 con 0x7f1a68102c10 2024-09-11T01:08:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.357+0000 7f1a6d600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a68102c10 0x7f1a6819b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.357+0000 7f1a6d600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a68102c10 0x7f1a6819b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:33440/0 (socket says 172.21.15.103:33440) 2024-09-11T01:08:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.357+0000 7f1a6d600640 1 -- 172.21.15.103:0/49668271 learned_addr learned my addr 172.21.15.103:0/49668271 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.357+0000 7f1a6e000640 1 --2- 172.21.15.103:0/49668271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a68108fa0 0x7f1a681a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.357+0000 7f1a6cc00640 1 --2- 172.21.15.103:0/49668271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a68108620 0x7f1a6819b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.357+0000 7f1a6e000640 1 -- 172.21.15.103:0/49668271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a68102c10 msgr2=0x7f1a6819b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.358+0000 7f1a6e000640 1 --2- 172.21.15.103:0/49668271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a68102c10 0x7f1a6819b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.358+0000 7f1a6e000640 1 -- 172.21.15.103:0/49668271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a68108620 msgr2=0x7f1a6819b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.358+0000 7f1a6e000640 1 --2- 172.21.15.103:0/49668271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a68108620 0x7f1a6819b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.358+0000 7f1a6e000640 1 -- 172.21.15.103:0/49668271 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a681a1370 con 0x7f1a68108fa0 2024-09-11T01:08:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.358+0000 7f1a6e000640 1 --2- 172.21.15.103:0/49668271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a68108fa0 0x7f1a681a0ba0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009b30 tx=0x7f1a60003c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.358+0000 7f1a66000640 1 -- 172.21.15.103:0/49668271 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60041020 con 0x7f1a68108fa0 2024-09-11T01:08:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.358+0000 7f1a66000640 1 -- 172.21.15.103:0/49668271 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a600318f0 con 0x7f1a68108fa0 2024-09-11T01:08:58.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.358+0000 7f1a66000640 1 -- 172.21.15.103:0/49668271 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60036040 con 0x7f1a68108fa0 2024-09-11T01:08:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.359+0000 7f1a6ea00640 1 -- 172.21.15.103:0/49668271 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a681a1600 con 0x7f1a68108fa0 2024-09-11T01:08:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.359+0000 7f1a6ea00640 1 -- 172.21.15.103:0/49668271 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a681a7d20 con 0x7f1a68108fa0 2024-09-11T01:08:58.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.361+0000 7f1a6ea00640 1 -- 172.21.15.103:0/49668271 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a68102ff0 con 0x7f1a68108fa0 2024-09-11T01:08:58.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.364+0000 7f1a66000640 1 -- 172.21.15.103:0/49668271 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7f1a60030b00 con 0x7f1a68108fa0 2024-09-11T01:08:58.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.367+0000 7f1a66000640 1 --2- 172.21.15.103:0/49668271 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f1a500b5490 0x7f1a500b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.367+0000 7f1a66000640 1 -- 172.21.15.103:0/49668271 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f1a60106930 con 0x7f1a68108fa0 2024-09-11T01:08:58.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.367+0000 7f1a6d600640 1 --2- 172.21.15.103:0/49668271 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f1a500b5490 0x7f1a500b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.369+0000 7f1a6d600640 1 --2- 172.21.15.103:0/49668271 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f1a500b5490 0x7f1a500b7950 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c005fd0 tx=0x7f1a5c00b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:58.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.370+0000 7f1a66000640 1 -- 172.21.15.103:0/49668271 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f1a6004b070 con 0x7f1a68108fa0 2024-09-11T01:08:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.695+0000 7fb1bbe00640 1 -- 172.21.15.103:0/2290105996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1bc102790 msgr2=0x7fb1bc102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.695+0000 7fb1bbe00640 1 --2- 172.21.15.103:0/2290105996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1bc102790 0x7fb1bc102b90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac009900 tx=0x7fb1ac02a400 comp rx=0 tx=0).stop 2024-09-11T01:08:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.696+0000 7fb1bbe00640 1 -- 172.21.15.103:0/2290105996 shutdown_connections 2024-09-11T01:08:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.696+0000 7fb1bbe00640 1 --2- 172.21.15.103:0/2290105996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1bc1042a0 0x7fb1bc10ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.696+0000 7fb1bbe00640 1 --2- 172.21.15.103:0/2290105996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc1038e0 0x7fb1bc103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.696+0000 7fb1bbe00640 1 --2- 172.21.15.103:0/2290105996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1bc102790 0x7fb1bc102b90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.699 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.696+0000 7fb1bbe00640 1 -- 172.21.15.103:0/2290105996 >> 172.21.15.103:0/2290105996 conn(0x7fb1bc0fe030 msgr2=0x7fb1bc100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.696+0000 7fb1bbe00640 1 -- 172.21.15.103:0/2290105996 shutdown_connections 2024-09-11T01:08:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.696+0000 7fb1bbe00640 1 -- 172.21.15.103:0/2290105996 wait complete. 2024-09-11T01:08:58.700 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.698+0000 7fb1bbe00640 1 Processor -- start 2024-09-11T01:08:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.698+0000 7fb1bbe00640 1 -- start start 2024-09-11T01:08:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.698+0000 7fb1bbe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1bc102790 0x7fb1bc19f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.699+0000 7fb1bbe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1bc1038e0 0x7fb1bc19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.699+0000 7fb1bbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc1042a0 0x7fb1bc1a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.699+0000 7fb1bbe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc0766e0 con 0x7fb1bc1042a0 2024-09-11T01:08:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.699+0000 7fb1bbe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc076560 con 0x7fb1bc102790 2024-09-11T01:08:58.701 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.699+0000 7fb1bbe00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc076860 con 0x7fb1bc1038e0 2024-09-11T01:08:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.699+0000 7fb1ba000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1bc1038e0 0x7fb1bc19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.699+0000 7fb1baa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1bc102790 0x7fb1bc19f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.699+0000 7fb1ba000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1bc1038e0 0x7fb1bc19f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:33452/0 (socket says 172.21.15.103:33452) 2024-09-11T01:08:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.699+0000 7fb1ba000640 1 -- 172.21.15.103:0/981715357 learned_addr learned my addr 172.21.15.103:0/981715357 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:58.702 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.700+0000 7fb1bb400640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc1042a0 0x7fb1bc1a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.700+0000 7fb1baa00640 1 -- 172.21.15.103:0/981715357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1bc1038e0 msgr2=0x7fb1bc19f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.700+0000 7fb1baa00640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1bc1038e0 0x7fb1bc19f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.700+0000 7fb1baa00640 1 -- 172.21.15.103:0/981715357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc1042a0 msgr2=0x7fb1bc1a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.700+0000 7fb1baa00640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc1042a0 0x7fb1bc1a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.700+0000 7fb1baa00640 1 -- 172.21.15.103:0/981715357 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1bc1a0ce0 con 0x7fb1bc102790 2024-09-11T01:08:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.700+0000 7fb1ba000640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1bc1038e0 0x7fb1bc19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.700+0000 7fb1bb400640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc1042a0 0x7fb1bc1a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:08:58.703 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.700+0000 7fb1baa00640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1bc102790 0x7fb1bc19f1b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac02a920 tx=0x7fb1ac003c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:58.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.701+0000 7fb1b3400640 1 -- 172.21.15.103:0/981715357 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac03f070 con 0x7fb1bc102790 2024-09-11T01:08:58.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.701+0000 7fb1b3400640 1 -- 172.21.15.103:0/981715357 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1ac031df0 con 0x7fb1bc102790 2024-09-11T01:08:58.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.701+0000 7fb1b3400640 1 -- 172.21.15.103:0/981715357 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac035030 con 0x7fb1bc102790 2024-09-11T01:08:58.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.701+0000 7fb1bbe00640 1 -- 172.21.15.103:0/981715357 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1bc1a0f70 con 0x7fb1bc102790 2024-09-11T01:08:58.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.701+0000 7fb1bbe00640 1 -- 172.21.15.103:0/981715357 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1bc1a74c0 con 0x7fb1bc102790 2024-09-11T01:08:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.706+0000 7fb1c49e9740 1 Processor -- start 2024-09-11T01:08:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.706+0000 7fb1c49e9740 1 -- start start 2024-09-11T01:08:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.707+0000 7fb1c49e9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d1980 0x562ad25d3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.707+0000 7fb1c49e9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d42b0 0x562ad25d66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.707+0000 7fb1c49e9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25d6cf0 0x562ad25d91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.707+0000 7fb1c49e9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562ad25336b0 con 0x562ad25d42b0 2024-09-11T01:08:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.707+0000 7fb1c49e9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562ad2522ae0 con 0x562ad25d6cf0 2024-09-11T01:08:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.707+0000 7fb1c49e9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562ad25268f0 con 0x562ad25d1980 2024-09-11T01:08:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.707+0000 7fb1bb400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d1980 0x562ad25d3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.707+0000 7fb1bb400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d1980 0x562ad25d3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:33468/0 (socket says 172.21.15.103:33468) 2024-09-11T01:08:58.711 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.707+0000 7fb1bb400640 1 -- 172.21.15.103:0/2358105987 learned_addr learned my addr 172.21.15.103:0/2358105987 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.708+0000 7fb1ba000640 1 --2- 172.21.15.103:0/2358105987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25d6cf0 0x562ad25d91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.708+0000 7fb1bb400640 1 -- 172.21.15.103:0/2358105987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25d6cf0 msgr2=0x562ad25d91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.708+0000 7fb1bb400640 1 --2- 172.21.15.103:0/2358105987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25d6cf0 0x562ad25d91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.708+0000 7fb1bb400640 1 -- 172.21.15.103:0/2358105987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d42b0 msgr2=0x562ad25d66a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:08:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.708+0000 7fb1bb400640 1 --2- 172.21.15.103:0/2358105987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d42b0 0x562ad25d66a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.708+0000 7fb1bb400640 1 -- 172.21.15.103:0/2358105987 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad24ef780 con 0x562ad25d1980 2024-09-11T01:08:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.709+0000 7fb1b3400640 1 -- 172.21.15.103:0/981715357 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7fb1ac03b460 con 0x7fb1bc102790 2024-09-11T01:08:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.709+0000 7fb1bb400640 1 --2- 172.21.15.103:0/2358105987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d1980 0x562ad25d3d70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009e70 tx=0x7fb1b4031740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18c40c1a7add6a37 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.709+0000 7fb1a7e00640 1 -- 172.21.15.103:0/2358105987 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4004d20 con 0x562ad25d1980 2024-09-11T01:08:58.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.710+0000 7fb1a7e00640 1 -- 172.21.15.103:0/2358105987 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1b40054d0 con 0x562ad25d1980 2024-09-11T01:08:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.710+0000 7fb1a7e00640 1 -- 172.21.15.103:0/2358105987 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40338e0 con 0x562ad25d1980 2024-09-11T01:08:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.710+0000 7fb1c49e9740 1 -- 172.21.15.103:0/2358105987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d1980 msgr2=0x562ad25d3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:58.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.710+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/2358105987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d1980 0x562ad25d3d70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009e70 tx=0x7fb1b4031740 comp rx=0 tx=0).stop 2024-09-11T01:08:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.711+0000 7fb1b3400640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb1a00b5470 0x7fb1a00b7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.714 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.712+0000 7fb1b3400640 1 -- 172.21.15.103:0/981715357 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fb1ac106ba0 con 0x7fb1bc102790 2024-09-11T01:08:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.713+0000 7fb1bb400640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb1a00b5470 0x7fb1a00b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.713+0000 7fb1c49e9740 1 -- 172.21.15.103:0/2358105987 shutdown_connections 2024-09-11T01:08:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.713+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/2358105987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25d6cf0 0x562ad25d91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.713+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/2358105987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d42b0 0x562ad25d66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.713+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/2358105987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d1980 0x562ad25d3d70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.713+0000 7fb1c49e9740 1 -- 172.21.15.103:0/2358105987 >> 172.21.15.103:0/2358105987 conn(0x562ad25bbac0 msgr2=0x562ad25bc850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:58.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.713+0000 7fb1c49e9740 1 -- 172.21.15.103:0/2358105987 shutdown_connections 2024-09-11T01:08:58.717 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.715+0000 7fb1c49e9740 1 -- 172.21.15.103:0/2358105987 wait complete. 2024-09-11T01:08:58.718 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.715+0000 7fb1bb400640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb1a00b5470 0x7fb1a00b7930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4032010 tx=0x7fb1b4031f10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:58.718 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.715+0000 7fb1c49e9740 1 -- start start 2024-09-11T01:08:58.718 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.716+0000 7fb1c49e9740 1 Processor -- start 2024-09-11T01:08:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.716+0000 7fb1c49e9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25d1980 0x562ad25c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.716+0000 7fb1c49e9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d42b0 0x562ad25c2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.717+0000 7fb1baa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25d1980 0x562ad25c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.717+0000 7fb1c49e9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d6cf0 0x562ad25c3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.717+0000 7fb1baa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25d1980 0x562ad25c1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:56850/0 (socket says 172.21.15.103:56850) 2024-09-11T01:08:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.717+0000 7fb1baa00640 1 -- 172.21.15.103:0/1595777928 learned_addr learned my addr 172.21.15.103:0/1595777928 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.717+0000 7fb1c49e9740 1 -- 172.21.15.103:0/1595777928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562ad245aab0 con 0x562ad25d42b0 2024-09-11T01:08:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.717+0000 7fb1c49e9740 1 -- 172.21.15.103:0/1595777928 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562ad24c9570 con 0x562ad25d1980 2024-09-11T01:08:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.717+0000 7fb1c49e9740 1 -- 172.21.15.103:0/1595777928 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562ad25c0bb0 con 0x562ad25d6cf0 2024-09-11T01:08:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.717+0000 7fb1c49e9740 10 client.0 _ll_register_callbacks cb 0x562ad24d8100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.717+0000 7fb1ba000640 1 --2- 172.21.15.103:0/1595777928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d42b0 0x562ad25c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.720 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.718+0000 7fb1ba000640 1 -- 172.21.15.103:0/1595777928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d6cf0 msgr2=0x562ad25c3260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T01:08:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.718+0000 7fb1ba000640 1 --2- 172.21.15.103:0/1595777928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d6cf0 0x562ad25c3260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.718+0000 7fb1ba000640 1 -- 172.21.15.103:0/1595777928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25d1980 msgr2=0x562ad25c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.718+0000 7fb1ba000640 1 --2- 172.21.15.103:0/1595777928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25d1980 0x562ad25c1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.718+0000 7fb1ba000640 1 -- 172.21.15.103:0/1595777928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad2284790 con 0x562ad25d42b0 2024-09-11T01:08:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.718+0000 7fb1baa00640 1 --2- 172.21.15.103:0/1595777928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25d1980 0x562ad25c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:58.721 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.719+0000 7fb1ba000640 1 --2- 172.21.15.103:0/1595777928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d42b0 0x562ad25c2690 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8012d20 tx=0x7fb1a800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84ef1322c4260f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.719+0000 7fb1a4c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:08:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.719+0000 7fb1a4c00640 1 -- 172.21.15.103:0/1595777928 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1a8012110 con 0x562ad25d42b0 2024-09-11T01:08:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.719+0000 7fb1a4c00640 1 -- 172.21.15.103:0/1595777928 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fb1a8004050 con 0x562ad25d42b0 2024-09-11T01:08:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.719+0000 7fb1c49e9740 1 -- 172.21.15.103:0/1595777928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb1b40054d0 con 0x562ad25d42b0 2024-09-11T01:08:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.720+0000 7fb1a4c00640 1 -- 172.21.15.103:0/1595777928 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb1a8025050 con 0x562ad25d42b0 2024-09-11T01:08:58.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.720+0000 7fb1c49e9740 10 client.15420 fetch_fsmap learned FSMap version 26 2024-09-11T01:08:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.720+0000 7fb1c49e9740 1 -- 172.21.15.103:0/1595777928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562ad22fd620 con 0x562ad25d42b0 2024-09-11T01:08:58.723 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.720+0000 7fb1a4c00640 1 -- 172.21.15.103:0/1595777928 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb1b40054d0 con 0x562ad25d42b0 2024-09-11T01:08:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.721+0000 7fb1a4c00640 1 -- 172.21.15.103:0/1595777928 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb1a80035f0 con 0x562ad25d42b0 2024-09-11T01:08:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.722+0000 7fb1c49e9740 10 client.15420 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:08:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.722+0000 7fb1c49e9740 10 client.15420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:08:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.722+0000 7fb1c49e9740 20 client.15420 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.722+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/1595777928 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562ad25cd990 0x562ad25cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.724 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.722+0000 7fb1c49e9740 4 client.15420 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:08:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.722+0000 7fb1c49e9740 1 -- 172.21.15.103:0/1595777928 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ad2535600 con 0x562ad25cd990 2024-09-11T01:08:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.722+0000 7fb1baa00640 1 --2- 172.21.15.103:0/1595777928 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562ad25cd990 0x562ad25cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.723+0000 7fb1baa00640 1 --2- 172.21.15.103:0/1595777928 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562ad25cd990 0x562ad25cfdd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3267d975b684dc8 server_cookie=392a0227853f93da in_seq=0 out_seq=0 2024-09-11T01:08:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.723+0000 7fb1a4c00640 10 client.15420 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.724+0000 7fb1a4c00640 1 -- 172.21.15.103:0/1595777928 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562ad2535600 con 0x562ad25cd990 2024-09-11T01:08:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.724+0000 7fb1a4c00640 10 client.15420 handle_command_reply: tid=0 2024-09-11T01:08:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.724+0000 7fb1c49e9740 1 client.15420 shutdown 2024-09-11T01:08:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.724+0000 7fb1c49e9740 1 -- 172.21.15.103:0/1595777928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d42b0 msgr2=0x562ad25c2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.724+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/1595777928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d42b0 0x562ad25c2690 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8012d20 tx=0x7fb1a800f790 comp rx=0 tx=0).stop 2024-09-11T01:08:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.725+0000 7fb1c49e9740 1 -- 172.21.15.103:0/1595777928 shutdown_connections 2024-09-11T01:08:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.725+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/1595777928 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562ad25cd990 0x562ad25cfdd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.725+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/1595777928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d6cf0 0x562ad25c3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.725+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/1595777928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d42b0 0x562ad25c2690 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.725+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/1595777928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25d1980 0x562ad25c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.725+0000 7fb1c49e9740 1 -- 172.21.15.103:0/1595777928 >> 172.21.15.103:0/1595777928 conn(0x562ad25bbac0 msgr2=0x562ad25babc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.725+0000 7fb1a4c00640 0 client.15420 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.725+0000 7fb1c49e9740 1 -- 172.21.15.103:0/1595777928 shutdown_connections 2024-09-11T01:08:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.725+0000 7fb1c49e9740 1 -- 172.21.15.103:0/1595777928 wait complete. 2024-09-11T01:08:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.726+0000 7fb1c49e9740 20 client.15420 trim_cache size 0 max 16384 2024-09-11T01:08:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.755+0000 7fb1c49e9740 1 Processor -- start 2024-09-11T01:08:58.758 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.756+0000 7fb1c49e9740 1 -- start start 2024-09-11T01:08:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.756+0000 7fb1c49e9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d1980 0x562ad25bfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.756+0000 7fb1c49e9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d6cf0 0x562ad25c03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.756+0000 7fb1c49e9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25c1ff0 0x562ad25c2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.756+0000 7fb1c49e9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc1abb80 con 0x562ad25d6cf0 2024-09-11T01:08:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.756+0000 7fb1c49e9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc1a9450 con 0x562ad25c1ff0 2024-09-11T01:08:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.756+0000 7fb1c49e9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc119820 con 0x562ad25d1980 2024-09-11T01:08:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.757+0000 7fb1baa00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d1980 0x562ad25bfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.757+0000 7fb1bb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25c1ff0 0x562ad25c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.757+0000 7fb1bb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25c1ff0 0x562ad25c2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:56856/0 (socket says 172.21.15.103:56856) 2024-09-11T01:08:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.757+0000 7fb1bb400640 1 -- 172.21.15.103:0/58566300 learned_addr learned my addr 172.21.15.103:0/58566300 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.757+0000 7fb1ba000640 1 --2- 172.21.15.103:0/58566300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d6cf0 0x562ad25c03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.757+0000 7fb1baa00640 1 -- 172.21.15.103:0/58566300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25c1ff0 msgr2=0x562ad25c2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.757+0000 7fb1baa00640 1 --2- 172.21.15.103:0/58566300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25c1ff0 0x562ad25c2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.758+0000 7fb1baa00640 1 -- 172.21.15.103:0/58566300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d6cf0 msgr2=0x562ad25c03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.758+0000 7fb1baa00640 1 --2- 172.21.15.103:0/58566300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d6cf0 0x562ad25c03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.758+0000 7fb1baa00640 1 -- 172.21.15.103:0/58566300 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ad25c3f90 con 0x562ad25d1980 2024-09-11T01:08:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.758+0000 7fb1baa00640 1 --2- 172.21.15.103:0/58566300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d1980 0x562ad25bfe60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0ccd80 tx=0x7fb1ac02a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5802b413d2efaaa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.759+0000 7fb1a7400640 1 -- 172.21.15.103:0/58566300 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac0b8020 con 0x562ad25d1980 2024-09-11T01:08:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.759+0000 7fb1a7400640 1 -- 172.21.15.103:0/58566300 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562ad2535600 con 0x562ad25d1980 2024-09-11T01:08:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.759+0000 7fb1a7400640 1 -- 172.21.15.103:0/58566300 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac049040 con 0x562ad25d1980 2024-09-11T01:08:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.760+0000 7fb1c49e9740 1 -- 172.21.15.103:0/58566300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d1980 msgr2=0x562ad25bfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.760+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/58566300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d1980 0x562ad25bfe60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0ccd80 tx=0x7fb1ac02a400 comp rx=0 tx=0).stop 2024-09-11T01:08:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.760+0000 7fb1c49e9740 1 -- 172.21.15.103:0/58566300 shutdown_connections 2024-09-11T01:08:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.760+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/58566300 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25c1ff0 0x562ad25c2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.760+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/58566300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d6cf0 0x562ad25c03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.760+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/58566300 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25d1980 0x562ad25bfe60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.760+0000 7fb1c49e9740 1 -- 172.21.15.103:0/58566300 >> 172.21.15.103:0/58566300 conn(0x562ad25bbac0 msgr2=0x562ad25cf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.760+0000 7fb1c49e9740 1 -- 172.21.15.103:0/58566300 shutdown_connections 2024-09-11T01:08:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.760+0000 7fb1c49e9740 1 -- 172.21.15.103:0/58566300 wait complete. 2024-09-11T01:08:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.761+0000 7fb1c49e9740 1 -- start start 2024-09-11T01:08:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.761+0000 7fb1c49e9740 1 Processor -- start 2024-09-11T01:08:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.762+0000 7fb1c49e9740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25c1ff0 0x562ad25c6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.762+0000 7fb1c49e9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d6cf0 0x562ad25c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.762+0000 7fb1c49e9740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25c7600 0x562ad25c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.764 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.762+0000 7fb1c49e9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc1a7950 con 0x562ad25d6cf0 2024-09-11T01:08:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.762+0000 7fb1c49e9740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc1a8d80 con 0x562ad25c1ff0 2024-09-11T01:08:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.762+0000 7fb1c49e9740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb1bc1a7fe0 con 0x562ad25c7600 2024-09-11T01:08:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.762+0000 7fb1c49e9740 10 client.0 _ll_register_callbacks cb 0x7fb1a8009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:08:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.762+0000 7fb1baa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25c1ff0 0x562ad25c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.762+0000 7fb1baa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25c1ff0 0x562ad25c6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:56866/0 (socket says 172.21.15.103:56866) 2024-09-11T01:08:58.765 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.763+0000 7fb1baa00640 1 -- 172.21.15.103:0/436463956 learned_addr learned my addr 172.21.15.103:0/436463956 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:08:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.763+0000 7fb1ba000640 1 --2- 172.21.15.103:0/436463956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d6cf0 0x562ad25c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.763+0000 7fb1bb400640 1 --2- 172.21.15.103:0/436463956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25c7600 0x562ad25c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.763+0000 7fb1baa00640 1 -- 172.21.15.103:0/436463956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25c7600 msgr2=0x562ad25c7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.763+0000 7fb1baa00640 1 --2- 172.21.15.103:0/436463956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25c7600 0x562ad25c7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.763+0000 7fb1baa00640 1 -- 172.21.15.103:0/436463956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d6cf0 msgr2=0x562ad25c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:08:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.763+0000 7fb1baa00640 1 --2- 172.21.15.103:0/436463956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d6cf0 0x562ad25c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.763+0000 7fb1baa00640 1 -- 172.21.15.103:0/436463956 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ad25c82b0 con 0x562ad25c1ff0 2024-09-11T01:08:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.763+0000 7fb1ba000640 1 --2- 172.21.15.103:0/436463956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d6cf0 0x562ad25c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:08:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.764+0000 7fb1baa00640 1 --2- 172.21.15.103:0/436463956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25c1ff0 0x562ad25c6400 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0ccd80 tx=0x7fb1ac03b870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8340bb1f10794623 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:08:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.764+0000 7fb1a4c00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:08:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.764+0000 7fb1a4c00640 1 -- 172.21.15.103:0/436463956 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac049070 con 0x562ad25c1ff0 2024-09-11T01:08:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.764+0000 7fb1c49e9740 1 -- 172.21.15.103:0/436463956 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562ad2535600 con 0x562ad25c1ff0 2024-09-11T01:08:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.764+0000 7fb1a4c00640 1 -- 172.21.15.103:0/436463956 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fb1ac0cd250 con 0x562ad25c1ff0 2024-09-11T01:08:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.765+0000 7fb1a4c00640 1 -- 172.21.15.103:0/436463956 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb1ac0b8040 con 0x562ad25c1ff0 2024-09-11T01:08:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.765+0000 7fb1c49e9740 10 client.25442 fetch_fsmap learned FSMap version 26 2024-09-11T01:08:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.765+0000 7fb1c49e9740 1 -- 172.21.15.103:0/436463956 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x562ad25c95c0 con 0x562ad25c1ff0 2024-09-11T01:08:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.765+0000 7fb1a4c00640 1 -- 172.21.15.103:0/436463956 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x562ad2535600 con 0x562ad25c1ff0 2024-09-11T01:08:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.765+0000 7fb1a4c00640 1 -- 172.21.15.103:0/436463956 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb1ac0d5ef0 con 0x562ad25c1ff0 2024-09-11T01:08:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.765+0000 7fb1c49e9740 10 client.25442 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:08:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.766+0000 7fb1c49e9740 10 client.25442 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:08:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.766+0000 7fb1c49e9740 20 client.25442 populate_metadata read hostname 'smithi103' 2024-09-11T01:08:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.766+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/436463956 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562ad25c9d40 0x562ad2645cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:08:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.766+0000 7fb1c49e9740 4 client.25442 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:08:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.766+0000 7fb1c49e9740 1 -- 172.21.15.103:0/436463956 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562ad25310b0 con 0x562ad25c9d40 2024-09-11T01:08:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.766+0000 7fb1ba000640 1 --2- 172.21.15.103:0/436463956 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562ad25c9d40 0x562ad2645cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:08:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.767+0000 7fb1ba000640 1 --2- 172.21.15.103:0/436463956 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562ad25c9d40 0x562ad2645cd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abc7354297d92a1d server_cookie=d434132cfce0fc2a in_seq=0 out_seq=0 2024-09-11T01:08:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.767+0000 7fb1a4c00640 10 client.25442 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.771+0000 7fb1a4c00640 1 -- 172.21.15.103:0/436463956 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562ad25310b0 con 0x562ad25c9d40 2024-09-11T01:08:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.771+0000 7fb1a4c00640 10 client.25442 handle_command_reply: tid=0 2024-09-11T01:08:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.771+0000 7fb1c49e9740 1 client.25442 shutdown 2024-09-11T01:08:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.771+0000 7fb1c49e9740 1 -- 172.21.15.103:0/436463956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25c1ff0 msgr2=0x562ad25c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.771+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/436463956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25c1ff0 0x562ad25c6400 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac0ccd80 tx=0x7fb1ac03b870 comp rx=0 tx=0).stop 2024-09-11T01:08:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.772+0000 7fb1c49e9740 1 -- 172.21.15.103:0/436463956 shutdown_connections 2024-09-11T01:08:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.772+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/436463956 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562ad25c9d40 0x562ad2645cd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.772+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/436463956 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562ad25c7600 0x562ad25c7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.772+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/436463956 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562ad25d6cf0 0x562ad25c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.772+0000 7fb1c49e9740 1 --2- 172.21.15.103:0/436463956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562ad25c1ff0 0x562ad25c6400 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.772+0000 7fb1c49e9740 1 -- 172.21.15.103:0/436463956 >> 172.21.15.103:0/436463956 conn(0x562ad25bbac0 msgr2=0x562ad25bc620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.772+0000 7fb1a4c00640 0 client.25442 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:08:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.772+0000 7fb1c49e9740 1 -- 172.21.15.103:0/436463956 shutdown_connections 2024-09-11T01:08:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.772+0000 7fb1c49e9740 1 -- 172.21.15.103:0/436463956 wait complete. 2024-09-11T01:08:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.772+0000 7fb1c49e9740 20 client.25442 trim_cache size 0 max 16384 2024-09-11T01:08:58.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:08:58.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:08:58.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:08:58.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:08:58.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.773+0000 7fb1bbe00640 1 -- 172.21.15.103:0/981715357 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb1a00b5470 msgr2=0x7fb1a00b7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.773+0000 7fb1bbe00640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb1a00b5470 0x7fb1a00b7930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4032010 tx=0x7fb1b4031f10 comp rx=0 tx=0).stop 2024-09-11T01:08:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.773+0000 7fb1bbe00640 1 -- 172.21.15.103:0/981715357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1bc102790 msgr2=0x7fb1bc19f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.773+0000 7fb1bbe00640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1bc102790 0x7fb1bc19f1b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac02a920 tx=0x7fb1ac003c80 comp rx=0 tx=0).stop 2024-09-11T01:08:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.774+0000 7fb1bbe00640 1 -- 172.21.15.103:0/981715357 shutdown_connections 2024-09-11T01:08:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.774+0000 7fb1bbe00640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb1a00b5470 0x7fb1a00b7930 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.774+0000 7fb1bbe00640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1bc1042a0 0x7fb1bc1a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.774+0000 7fb1bbe00640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb1bc1038e0 0x7fb1bc19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.774+0000 7fb1bbe00640 1 --2- 172.21.15.103:0/981715357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb1bc102790 0x7fb1bc19f1b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.774+0000 7fb1bbe00640 1 -- 172.21.15.103:0/981715357 >> 172.21.15.103:0/981715357 conn(0x7fb1bc0fe030 msgr2=0x7fb1bc0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:58.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.777+0000 7fb1bbe00640 1 -- 172.21.15.103:0/981715357 shutdown_connections 2024-09-11T01:08:58.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:08:58.777+0000 7fb1bbe00640 1 -- 172.21.15.103:0/981715357 wait complete. 2024-09-11T01:08:58.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.796+0000 7f1a6ea00640 1 -- 172.21.15.103:0/49668271 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a681a7f20 con 0x7f1a68108fa0 2024-09-11T01:08:58.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.797+0000 7f1a66000640 1 -- 172.21.15.103:0/49668271 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11930 (secure 0 0 0) 0x7f1a600cd280 con 0x7f1a68108fa0 2024-09-11T01:08:58.802 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:08:58.802 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-09-11T01:08:18:615937+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:08:18.524092+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24629,24619]},"id":1}]} 2024-09-11T01:08:58.802 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-09-11T01:08:58.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.801+0000 7f1a6ea00640 1 -- 172.21.15.103:0/49668271 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f1a500b5490 msgr2=0x7f1a500b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:58.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.801+0000 7f1a6ea00640 1 --2- 172.21.15.103:0/49668271 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f1a500b5490 0x7f1a500b7950 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c005fd0 tx=0x7f1a5c00b480 comp rx=0 tx=0).stop 2024-09-11T01:08:58.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.801+0000 7f1a6ea00640 1 -- 172.21.15.103:0/49668271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a68108fa0 msgr2=0x7f1a681a0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:08:58.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.801+0000 7f1a6ea00640 1 --2- 172.21.15.103:0/49668271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a68108fa0 0x7f1a681a0ba0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009b30 tx=0x7f1a60003c30 comp rx=0 tx=0).stop 2024-09-11T01:08:58.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.801+0000 7f1a6ea00640 1 -- 172.21.15.103:0/49668271 shutdown_connections 2024-09-11T01:08:58.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.801+0000 7f1a6ea00640 1 --2- 172.21.15.103:0/49668271 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f1a500b5490 0x7f1a500b7950 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.801+0000 7f1a6ea00640 1 --2- 172.21.15.103:0/49668271 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a68108fa0 0x7f1a681a0ba0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.801+0000 7f1a6ea00640 1 --2- 172.21.15.103:0/49668271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a68108620 0x7f1a6819b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.801+0000 7f1a6ea00640 1 --2- 172.21.15.103:0/49668271 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a68102c10 0x7f1a6819b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:08:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.801+0000 7f1a6ea00640 1 -- 172.21.15.103:0/49668271 >> 172.21.15.103:0/49668271 conn(0x7f1a680fe660 msgr2=0x7f1a68075380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:08:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.802+0000 7f1a6ea00640 1 -- 172.21.15.103:0/49668271 shutdown_connections 2024-09-11T01:08:58.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:08:58.803+0000 7f1a6ea00640 1 -- 172.21.15.103:0/49668271 wait complete. 2024-09-11T01:08:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:58 smithi183 ceph-mon[34992]: pgmap v418: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-11T01:08:59.088 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:58 smithi103 ceph-mon[30562]: pgmap v418: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-11T01:08:59.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:58 smithi117 ceph-mon[35358]: pgmap v418: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-11T01:08:59.806 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24665 quiesce db / --timeout 90 --expiration 145.2 --await-for 45.0' 2024-09-11T01:08:59.806 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24665 quiesce db / --timeout 90 --expiration 145.2 --await-for 45.0 2024-09-11T01:08:59.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:59 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/49668271' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:59.895 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:08:59 smithi103 ceph-mon[30562]: pgmap v419: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T01:08:59.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:59 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/49668271' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:08:59.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:08:59 smithi183 ceph-mon[34992]: pgmap v419: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T01:09:00.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:59 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/49668271' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:09:00.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:08:59 smithi117 ceph-mon[35358]: pgmap v419: 129 pgs: 129 active+clean; 663 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 938 B/s wr, 8 op/s 2024-09-11T01:09:00.437 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:09:01.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.116+0000 7f5e18e00640 1 -- 172.21.15.103:0/1148996177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e14108610 msgr2=0x7f5e14108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:01.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.116+0000 7f5e18e00640 1 --2- 172.21.15.103:0/1148996177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e14108610 0x7f5e14108a50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009900 tx=0x7f5dfc02a3f0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.117+0000 7f5e18e00640 1 -- 172.21.15.103:0/1148996177 shutdown_connections 2024-09-11T01:09:01.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.117+0000 7f5e18e00640 1 --2- 172.21.15.103:0/1148996177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14108f90 0x7f5e1410f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.117+0000 7f5e18e00640 1 --2- 172.21.15.103:0/1148996177 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e14108610 0x7f5e14108a50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.117+0000 7f5e18e00640 1 --2- 172.21.15.103:0/1148996177 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e14102c00 0x7f5e14102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.117+0000 7f5e18e00640 1 -- 172.21.15.103:0/1148996177 >> 172.21.15.103:0/1148996177 conn(0x7f5e140fe6d0 msgr2=0x7f5e14100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:01.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.117+0000 7f5e18e00640 1 -- 172.21.15.103:0/1148996177 shutdown_connections 2024-09-11T01:09:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.117+0000 7f5e18e00640 1 -- 172.21.15.103:0/1148996177 wait complete. 2024-09-11T01:09:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.119+0000 7f5e18e00640 1 Processor -- start 2024-09-11T01:09:01.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.119+0000 7f5e18e00640 1 -- start start 2024-09-11T01:09:01.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.119+0000 7f5e18e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e14102c00 0x7f5e140754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.120+0000 7f5e18e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e14108610 0x7f5e140759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.120+0000 7f5e18e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14108f90 0x7f5e14075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.120+0000 7f5e18e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14112ca0 con 0x7f5e14108f90 2024-09-11T01:09:01.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.120+0000 7f5e18e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14112b20 con 0x7f5e14102c00 2024-09-11T01:09:01.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.120+0000 7f5e18e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14112e20 con 0x7f5e14108610 2024-09-11T01:09:01.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.120+0000 7f5e0be00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e14108610 0x7f5e140759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.120+0000 7f5e13e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14108f90 0x7f5e14075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.120+0000 7f5e13e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14108f90 0x7f5e14075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53484/0 (socket says 172.21.15.103:53484) 2024-09-11T01:09:01.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.120+0000 7f5e13e00640 1 -- 172.21.15.103:0/453737274 learned_addr learned my addr 172.21.15.103:0/453737274 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:01.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.120+0000 7f5e13400640 1 --2- 172.21.15.103:0/453737274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e14102c00 0x7f5e140754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.121+0000 7f5e13e00640 1 -- 172.21.15.103:0/453737274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e14108610 msgr2=0x7f5e140759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:01.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.121+0000 7f5e13e00640 1 --2- 172.21.15.103:0/453737274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e14108610 0x7f5e140759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.121+0000 7f5e13e00640 1 -- 172.21.15.103:0/453737274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e14102c00 msgr2=0x7f5e140754a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:01.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.121+0000 7f5e13e00640 1 --2- 172.21.15.103:0/453737274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e14102c00 0x7f5e140754a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.121+0000 7f5e13e00640 1 -- 172.21.15.103:0/453737274 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e141a7430 con 0x7f5e14108f90 2024-09-11T01:09:01.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.121+0000 7f5e13400640 1 --2- 172.21.15.103:0/453737274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e14102c00 0x7f5e140754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:01.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.122+0000 7f5e13e00640 1 --2- 172.21.15.103:0/453737274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14108f90 0x7f5e14075f20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00eaa0 tx=0x7f5e0c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.122+0000 7f5e10c00640 1 -- 172.21.15.103:0/453737274 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c00cdb0 con 0x7f5e14108f90 2024-09-11T01:09:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.122+0000 7f5e18e00640 1 -- 172.21.15.103:0/453737274 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e141a7720 con 0x7f5e14108f90 2024-09-11T01:09:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.122+0000 7f5e18e00640 1 -- 172.21.15.103:0/453737274 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e141a7c30 con 0x7f5e14108f90 2024-09-11T01:09:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.123+0000 7f5e10c00640 1 -- 172.21.15.103:0/453737274 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e0c005020 con 0x7f5e14108f90 2024-09-11T01:09:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.123+0000 7f5e10c00640 1 -- 172.21.15.103:0/453737274 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c0116d0 con 0x7f5e14108f90 2024-09-11T01:09:01.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.127+0000 7f5e1d06d740 1 Processor -- start 2024-09-11T01:09:01.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.128+0000 7f5e10c00640 1 -- 172.21.15.103:0/453737274 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7f5e0c00f040 con 0x7f5e14108f90 2024-09-11T01:09:01.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.129+0000 7f5e1d06d740 1 -- start start 2024-09-11T01:09:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.129+0000 7f5e1d06d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8d46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.129+0000 7f5e1d06d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d4c10 0x56091e8e8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.129+0000 7f5e1d06d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8e93b0 0x56091e8eb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.129+0000 7f5e1d06d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56091e849ca0 con 0x56091e8d42f0 2024-09-11T01:09:01.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.129+0000 7f5e1d06d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56091e8390d0 con 0x56091e8e93b0 2024-09-11T01:09:01.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.129+0000 7f5e1d06d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56091e83cee0 con 0x56091e8d4c10 2024-09-11T01:09:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.130+0000 7f5e0be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8d46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.130+0000 7f5e0be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8d46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53494/0 (socket says 172.21.15.103:53494) 2024-09-11T01:09:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.130+0000 7f5e0be00640 1 -- 172.21.15.103:0/555592463 learned_addr learned my addr 172.21.15.103:0/555592463 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.130+0000 7f5e13400640 1 --2- 172.21.15.103:0/555592463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d4c10 0x56091e8e8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.130+0000 7f5e0be00640 1 --2- 172.21.15.103:0/555592463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8e93b0 0x56091e8eb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.131+0000 7f5e13400640 1 -- 172.21.15.103:0/555592463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8e93b0 msgr2=0x56091e8eb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.131+0000 7f5e13400640 1 --2- 172.21.15.103:0/555592463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8e93b0 0x56091e8eb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.131+0000 7f5e13400640 1 -- 172.21.15.103:0/555592463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 msgr2=0x56091e8d46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.131+0000 7f5e13400640 1 --2- 172.21.15.103:0/555592463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8d46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.131+0000 7f5e13400640 1 -- 172.21.15.103:0/555592463 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56091e7eb400 con 0x56091e8d4c10 2024-09-11T01:09:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.131+0000 7f5e0be00640 1 --2- 172.21.15.103:0/555592463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8d46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:01.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.131+0000 7f5e10c00640 1 --2- 172.21.15.103:0/453737274 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5df80b5490 0x7f5df80b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.131+0000 7f5e13400640 1 --2- 172.21.15.103:0/555592463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d4c10 0x56091e8e8e70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009fd0 tx=0x7f5e040118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=933c8442072e63a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:01.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.132+0000 7f5e10c00640 1 -- 172.21.15.103:0/453737274 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5e0c0e5c70 con 0x7f5e14108f90 2024-09-11T01:09:01.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.132+0000 7f5e08c00640 1 -- 172.21.15.103:0/555592463 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04004030 con 0x56091e8d4c10 2024-09-11T01:09:01.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.132+0000 7f5e08c00640 1 -- 172.21.15.103:0/555592463 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e040054d0 con 0x56091e8d4c10 2024-09-11T01:09:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.132+0000 7f5e0be00640 1 --2- 172.21.15.103:0/453737274 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5df80b5490 0x7f5df80b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.132+0000 7f5e08c00640 1 -- 172.21.15.103:0/555592463 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e04004030 con 0x56091e8d4c10 2024-09-11T01:09:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.133+0000 7f5e1d06d740 1 -- 172.21.15.103:0/555592463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d4c10 msgr2=0x56091e8e8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.133+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/555592463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d4c10 0x56091e8e8e70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5e04009fd0 tx=0x7f5e040118d0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.133+0000 7f5e0be00640 1 --2- 172.21.15.103:0/453737274 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5df80b5490 0x7f5df80b7950 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009230 tx=0x7f5dfc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.133+0000 7f5e1d06d740 1 -- 172.21.15.103:0/555592463 shutdown_connections 2024-09-11T01:09:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.133+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/555592463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8e93b0 0x56091e8eb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.133+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/555592463 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d4c10 0x56091e8e8e70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.133+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/555592463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8d46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.133+0000 7f5e1d06d740 1 -- 172.21.15.103:0/555592463 >> 172.21.15.103:0/555592463 conn(0x56091e8d2120 msgr2=0x56091e8d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.134+0000 7f5e1d06d740 1 -- 172.21.15.103:0/555592463 shutdown_connections 2024-09-11T01:09:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.134+0000 7f5e1d06d740 1 -- 172.21.15.103:0/555592463 wait complete. 2024-09-11T01:09:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.134+0000 7f5e1d06d740 1 -- start start 2024-09-11T01:09:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.135+0000 7f5e1d06d740 1 Processor -- start 2024-09-11T01:09:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.135+0000 7f5e1d06d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8e8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.135+0000 7f5e1d06d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8d4c10 0x56091e8e6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.135+0000 7f5e1d06d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8e93b0 0x56091e8e65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.135+0000 7f5e1d06d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56091e69a7a0 con 0x56091e8d42f0 2024-09-11T01:09:01.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.135+0000 7f5e1d06d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56091e7dea10 con 0x56091e8d4c10 2024-09-11T01:09:01.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.135+0000 7f5e1d06d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56091e8ec030 con 0x56091e8e93b0 2024-09-11T01:09:01.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.136+0000 7f5e1d06d740 10 client.0 _ll_register_callbacks cb 0x56091e7eebe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:01.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.136+0000 7f5e0be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8d4c10 0x56091e8e6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.136+0000 7f5e13400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8e8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.136+0000 7f5e0be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8d4c10 0x56091e8e6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:44682/0 (socket says 172.21.15.103:44682) 2024-09-11T01:09:01.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.136+0000 7f5e0be00640 1 -- 172.21.15.103:0/1080262518 learned_addr learned my addr 172.21.15.103:0/1080262518 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:01.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.136+0000 7f5e13e00640 1 --2- 172.21.15.103:0/1080262518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8e93b0 0x56091e8e65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.137+0000 7f5e0be00640 1 -- 172.21.15.103:0/1080262518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8e93b0 msgr2=0x56091e8e65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:01.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.137+0000 7f5e0be00640 1 --2- 172.21.15.103:0/1080262518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8e93b0 0x56091e8e65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.137+0000 7f5e0be00640 1 -- 172.21.15.103:0/1080262518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 msgr2=0x56091e8e8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:01.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.137+0000 7f5e0be00640 1 --2- 172.21.15.103:0/1080262518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8e8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.137+0000 7f5e0be00640 1 -- 172.21.15.103:0/1080262518 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56091e5a6b90 con 0x56091e8d4c10 2024-09-11T01:09:01.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.137+0000 7f5e13400640 1 --2- 172.21.15.103:0/1080262518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8e8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:01.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.137+0000 7f5e0be00640 1 --2- 172.21.15.103:0/1080262518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8d4c10 0x56091e8e6070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0049a0 tx=0x7f5dfc02a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=378d5f49e6a125ac server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:01.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.137+0000 7f5e01600640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:09:01.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.138+0000 7f5e01600640 1 -- 172.21.15.103:0/1080262518 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc04e070 con 0x56091e8d4c10 2024-09-11T01:09:01.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.138+0000 7f5e01600640 1 -- 172.21.15.103:0/1080262518 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5dfc0318b0 con 0x56091e8d4c10 2024-09-11T01:09:01.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.138+0000 7f5e1d06d740 1 -- 172.21.15.103:0/1080262518 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e040054d0 con 0x56091e8d4c10 2024-09-11T01:09:01.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.138+0000 7f5e01600640 1 -- 172.21.15.103:0/1080262518 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5dfc035040 con 0x56091e8d4c10 2024-09-11T01:09:01.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.138+0000 7f5e1d06d740 10 client.25454 fetch_fsmap learned FSMap version 26 2024-09-11T01:09:01.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.138+0000 7f5e1d06d740 1 -- 172.21.15.103:0/1080262518 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56091e8f7930 con 0x56091e8d4c10 2024-09-11T01:09:01.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.139+0000 7f5e01600640 1 -- 172.21.15.103:0/1080262518 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5e040054d0 con 0x56091e8d4c10 2024-09-11T01:09:01.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.139+0000 7f5e01600640 1 -- 172.21.15.103:0/1080262518 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5dfc03bb80 con 0x56091e8d4c10 2024-09-11T01:09:01.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.139+0000 7f5e1d06d740 10 client.25454 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:09:01.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.139+0000 7f5e1d06d740 10 client.25454 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:09:01.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.139+0000 7f5e1d06d740 20 client.25454 populate_metadata read hostname 'smithi103' 2024-09-11T01:09:01.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.139+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/1080262518 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56091e8f8e10 0x56091e8fb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.139+0000 7f5e1d06d740 4 client.25454 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:09:01.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.139+0000 7f5e1d06d740 1 -- 172.21.15.103:0/1080262518 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56091e84bbf0 con 0x56091e8f8e10 2024-09-11T01:09:01.143 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.139+0000 7f5e13400640 1 --2- 172.21.15.103:0/1080262518 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56091e8f8e10 0x56091e8fb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.140+0000 7f5e13400640 1 --2- 172.21.15.103:0/1080262518 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56091e8f8e10 0x56091e8fb2b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3c8a4b5844b3228 server_cookie=761f6cc639c0c64a in_seq=0 out_seq=0 2024-09-11T01:09:01.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.140+0000 7f5e01600640 10 client.25454 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:01.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.141+0000 7f5e01600640 1 -- 172.21.15.103:0/1080262518 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56091e84bbf0 con 0x56091e8f8e10 2024-09-11T01:09:01.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.141+0000 7f5e01600640 10 client.25454 handle_command_reply: tid=0 2024-09-11T01:09:01.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.141+0000 7f5e1d06d740 1 client.25454 shutdown 2024-09-11T01:09:01.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.141+0000 7f5e1d06d740 1 -- 172.21.15.103:0/1080262518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8d4c10 msgr2=0x56091e8e6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:01.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.141+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/1080262518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8d4c10 0x56091e8e6070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc0049a0 tx=0x7f5dfc02a3f0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.142+0000 7f5e1d06d740 1 -- 172.21.15.103:0/1080262518 shutdown_connections 2024-09-11T01:09:01.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.142+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/1080262518 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56091e8f8e10 0x56091e8fb2b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.142+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/1080262518 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8e93b0 0x56091e8e65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.142+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/1080262518 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8d4c10 0x56091e8e6070 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.142+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/1080262518 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8e8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.142+0000 7f5e1d06d740 1 -- 172.21.15.103:0/1080262518 >> 172.21.15.103:0/1080262518 conn(0x56091e8d2120 msgr2=0x56091e8d7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.142+0000 7f5e01600640 0 client.25454 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.142+0000 7f5e1d06d740 1 -- 172.21.15.103:0/1080262518 shutdown_connections 2024-09-11T01:09:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.142+0000 7f5e1d06d740 1 -- 172.21.15.103:0/1080262518 wait complete. 2024-09-11T01:09:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.142+0000 7f5e1d06d740 20 client.25454 trim_cache size 0 max 16384 2024-09-11T01:09:01.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.178+0000 7f5e1d06d740 1 Processor -- start 2024-09-11T01:09:01.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.178+0000 7f5e1d06d740 1 -- start start 2024-09-11T01:09:01.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.178+0000 7f5e1d06d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d42f0 0x56091e8f52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.178+0000 7f5e1d06d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8d4c10 0x56091e8eb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.178+0000 7f5e1d06d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8e93b0 0x56091e8eb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.178+0000 7f5e1d06d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5df0012500 con 0x56091e8e93b0 2024-09-11T01:09:01.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.178+0000 7f5e1d06d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5df000fdd0 con 0x56091e8d4c10 2024-09-11T01:09:01.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.178+0000 7f5e1d06d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5df000dc20 con 0x56091e8d42f0 2024-09-11T01:09:01.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.179+0000 7f5e0be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8d4c10 0x56091e8eb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.179+0000 7f5e13400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d42f0 0x56091e8f52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.179+0000 7f5e13400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d42f0 0x56091e8f52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:54892/0 (socket says 172.21.15.103:54892) 2024-09-11T01:09:01.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.179+0000 7f5e13400640 1 -- 172.21.15.103:0/2556753822 learned_addr learned my addr 172.21.15.103:0/2556753822 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:01.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.179+0000 7f5e13e00640 1 --2- 172.21.15.103:0/2556753822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8e93b0 0x56091e8eb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.180+0000 7f5e0be00640 1 -- 172.21.15.103:0/2556753822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d42f0 msgr2=0x56091e8f52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:01.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.180+0000 7f5e0be00640 1 --2- 172.21.15.103:0/2556753822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d42f0 0x56091e8f52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.180+0000 7f5e0be00640 1 -- 172.21.15.103:0/2556753822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8e93b0 msgr2=0x56091e8eb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:01.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.180+0000 7f5e0be00640 1 --2- 172.21.15.103:0/2556753822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8e93b0 0x56091e8eb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.180+0000 7f5e0be00640 1 -- 172.21.15.103:0/2556753822 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56091e8e6860 con 0x56091e8d4c10 2024-09-11T01:09:01.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.180+0000 7f5e13400640 1 --2- 172.21.15.103:0/2556753822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d42f0 0x56091e8f52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:01.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.180+0000 7f5e0be00640 1 --2- 172.21.15.103:0/2556753822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8d4c10 0x56091e8eb0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc04a3e0 tx=0x7f5dfc0052a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fb73267a9c4678 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:01.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.180+0000 7f5e03e00640 1 -- 172.21.15.103:0/2556753822 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc04e040 con 0x56091e8d4c10 2024-09-11T01:09:01.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.181+0000 7f5e03e00640 1 -- 172.21.15.103:0/2556753822 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dfc043040 con 0x56091e8d4c10 2024-09-11T01:09:01.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.181+0000 7f5e03e00640 1 -- 172.21.15.103:0/2556753822 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc031d00 con 0x56091e8d4c10 2024-09-11T01:09:01.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.182+0000 7f5e1d06d740 1 -- 172.21.15.103:0/2556753822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8d4c10 msgr2=0x56091e8eb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:01.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.182+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/2556753822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8d4c10 0x56091e8eb0d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc04a3e0 tx=0x7f5dfc0052a0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.182+0000 7f5e1d06d740 1 -- 172.21.15.103:0/2556753822 shutdown_connections 2024-09-11T01:09:01.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.182+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/2556753822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8e93b0 0x56091e8eb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.182+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/2556753822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8d4c10 0x56091e8eb0d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.182+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/2556753822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d42f0 0x56091e8f52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.182+0000 7f5e1d06d740 1 -- 172.21.15.103:0/2556753822 >> 172.21.15.103:0/2556753822 conn(0x56091e8d2120 msgr2=0x56091e8ea100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:01.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.183+0000 7f5e1d06d740 1 -- 172.21.15.103:0/2556753822 shutdown_connections 2024-09-11T01:09:01.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.183+0000 7f5e1d06d740 1 -- 172.21.15.103:0/2556753822 wait complete. 2024-09-11T01:09:01.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.183+0000 7f5e1d06d740 1 -- start start 2024-09-11T01:09:01.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.183+0000 7f5e1d06d740 1 Processor -- start 2024-09-11T01:09:01.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.184+0000 7f5e1d06d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8f1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.184+0000 7f5e1d06d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d4c10 0x56091e8f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.184+0000 7f5e1d06d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8e93b0 0x56091e8ee320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.184+0000 7f5e1d06d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5df000e290 con 0x56091e8d42f0 2024-09-11T01:09:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.184+0000 7f5e1d06d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5df000f700 con 0x56091e8e93b0 2024-09-11T01:09:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.184+0000 7f5e1d06d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5df000e960 con 0x56091e8d4c10 2024-09-11T01:09:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.184+0000 7f5e1d06d740 10 client.0 _ll_register_callbacks cb 0x7f5dfc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.185+0000 7f5e0be00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d4c10 0x56091e8f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.185+0000 7f5e13400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.185+0000 7f5e0be00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d4c10 0x56091e8f1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:54902/0 (socket says 172.21.15.103:54902) 2024-09-11T01:09:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.185+0000 7f5e0be00640 1 -- 172.21.15.103:0/3548257068 learned_addr learned my addr 172.21.15.103:0/3548257068 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.185+0000 7f5e0be00640 1 -- 172.21.15.103:0/3548257068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8e93b0 msgr2=0x56091e8ee320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T01:09:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.185+0000 7f5e0be00640 1 --2- 172.21.15.103:0/3548257068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8e93b0 0x56091e8ee320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.185+0000 7f5e0be00640 1 -- 172.21.15.103:0/3548257068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 msgr2=0x56091e8f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.186+0000 7f5e0be00640 1 --2- 172.21.15.103:0/3548257068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8f1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.186+0000 7f5e0be00640 1 -- 172.21.15.103:0/3548257068 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56091e8ee960 con 0x56091e8d4c10 2024-09-11T01:09:01.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.186+0000 7f5e13400640 1 --2- 172.21.15.103:0/3548257068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:01.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.187+0000 7f5e0be00640 1 --2- 172.21.15.103:0/3548257068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d4c10 0x56091e8f1a70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc031440 tx=0x7f5dfc004ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3d6d986cd6d69a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:01.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.187+0000 7f5e01600640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:09:01.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.187+0000 7f5e01600640 1 -- 172.21.15.103:0/3548257068 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc062020 con 0x56091e8d4c10 2024-09-11T01:09:01.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.187+0000 7f5e01600640 1 -- 172.21.15.103:0/3548257068 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5dfc03b930 con 0x56091e8d4c10 2024-09-11T01:09:01.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.187+0000 7f5e1d06d740 1 -- 172.21.15.103:0/3548257068 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dfc043040 con 0x56091e8d4c10 2024-09-11T01:09:01.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.188+0000 7f5e01600640 1 -- 172.21.15.103:0/3548257068 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5dfc04e040 con 0x56091e8d4c10 2024-09-11T01:09:01.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.188+0000 7f5e1d06d740 10 client.25432 fetch_fsmap learned FSMap version 26 2024-09-11T01:09:01.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.188+0000 7f5e1d06d740 1 -- 172.21.15.103:0/3548257068 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56091e9666f0 con 0x56091e8d4c10 2024-09-11T01:09:01.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.188+0000 7f5e01600640 1 -- 172.21.15.103:0/3548257068 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5dfc043040 con 0x56091e8d4c10 2024-09-11T01:09:01.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.188+0000 7f5e01600640 1 -- 172.21.15.103:0/3548257068 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5dfc05e440 con 0x56091e8d4c10 2024-09-11T01:09:01.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.188+0000 7f5e1d06d740 10 client.25432 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:09:01.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.188+0000 7f5e1d06d740 10 client.25432 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:09:01.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.188+0000 7f5e1d06d740 20 client.25432 populate_metadata read hostname 'smithi103' 2024-09-11T01:09:01.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.188+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/3548257068 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56091e966ce0 0x56091e969100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:01.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.188+0000 7f5e1d06d740 4 client.25432 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.2, "await_for": 45.0}] 2024-09-11T01:09:01.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.189+0000 7f5e1d06d740 1 -- 172.21.15.103:0/3548257068 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.2, "await_for": 45.0}) -- 0x56091e8476a0 con 0x56091e966ce0 2024-09-11T01:09:01.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.189+0000 7f5e13400640 1 --2- 172.21.15.103:0/3548257068 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56091e966ce0 0x56091e969100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:01.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.190+0000 7f5e13400640 1 --2- 172.21.15.103:0/3548257068 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56091e966ce0 0x56091e969100 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=930aaf00f8a8474 server_cookie=baaa54629e6dda48 in_seq=0 out_seq=0 2024-09-11T01:09:01.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.190+0000 7f5e01600640 10 client.25432 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:01.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.200+0000 7f5e01600640 1 -- 172.21.15.103:0/3548257068 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56091e8476a0 con 0x56091e966ce0 2024-09-11T01:09:01.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.200+0000 7f5e01600640 10 client.25432 handle_command_reply: tid=0 2024-09-11T01:09:01.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.200+0000 7f5e1d06d740 1 client.25432 shutdown 2024-09-11T01:09:01.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.200+0000 7f5e1d06d740 1 -- 172.21.15.103:0/3548257068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d4c10 msgr2=0x56091e8f1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:01.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.200+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/3548257068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d4c10 0x56091e8f1a70 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc031440 tx=0x7f5dfc004ee0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.201+0000 7f5e1d06d740 1 -- 172.21.15.103:0/3548257068 shutdown_connections 2024-09-11T01:09:01.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.201+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/3548257068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56091e8e93b0 0x56091e8ee320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.201+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/3548257068 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56091e966ce0 0x56091e969100 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.201+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/3548257068 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56091e8d4c10 0x56091e8f1a70 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.201+0000 7f5e1d06d740 1 --2- 172.21.15.103:0/3548257068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56091e8d42f0 0x56091e8f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.201+0000 7f5e1d06d740 1 -- 172.21.15.103:0/3548257068 >> 172.21.15.103:0/3548257068 conn(0x56091e8d2120 msgr2=0x56091e8ea100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:01.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.201+0000 7f5e01600640 0 client.25432 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:01.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.201+0000 7f5e1d06d740 1 -- 172.21.15.103:0/3548257068 shutdown_connections 2024-09-11T01:09:01.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.201+0000 7f5e1d06d740 1 -- 172.21.15.103:0/3548257068 wait complete. 2024-09-11T01:09:01.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.202+0000 7f5e1d06d740 20 client.25432 trim_cache size 0 max 16384 2024-09-11T01:09:01.206 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:09:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 26, 2024-09-11T01:09:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24665, 2024-09-11T01:09:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 2, 2024-09-11T01:09:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-09-11T01:09:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: "ee7d2312": { 2024-09-11T01:09:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 2, 2024-09-11T01:09:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-09-11T01:09:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:09:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCED", 2024-09-11T01:09:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:09:01.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:09:01.207 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-09-11T01:09:01.207 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 145.2, 2024-09-11T01:09:01.207 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-09-11T01:09:01.207 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-09-11T01:09:01.207 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-09-11T01:09:01.207 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:09:01.207 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCED", 2024-09-11T01:09:01.207 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:09:01.207 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:09:01.207 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:09:01.207 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:09:01.208 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:09:01.208 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:09:01.208 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:09:01.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.203+0000 7f5e18e00640 1 -- 172.21.15.103:0/453737274 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5df80b5490 msgr2=0x7f5df80b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:01.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.203+0000 7f5e18e00640 1 --2- 172.21.15.103:0/453737274 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5df80b5490 0x7f5df80b7950 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc009230 tx=0x7f5dfc005fd0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.203+0000 7f5e18e00640 1 -- 172.21.15.103:0/453737274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14108f90 msgr2=0x7f5e14075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:01.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.203+0000 7f5e18e00640 1 --2- 172.21.15.103:0/453737274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14108f90 0x7f5e14075f20 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00eaa0 tx=0x7f5e0c00ef60 comp rx=0 tx=0).stop 2024-09-11T01:09:01.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.204+0000 7f5e18e00640 1 -- 172.21.15.103:0/453737274 shutdown_connections 2024-09-11T01:09:01.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.204+0000 7f5e18e00640 1 --2- 172.21.15.103:0/453737274 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5df80b5490 0x7f5df80b7950 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.204+0000 7f5e18e00640 1 --2- 172.21.15.103:0/453737274 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e14108f90 0x7f5e14075f20 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.204+0000 7f5e18e00640 1 --2- 172.21.15.103:0/453737274 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5e14108610 0x7f5e140759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.204+0000 7f5e18e00640 1 --2- 172.21.15.103:0/453737274 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5e14102c00 0x7f5e140754a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:01.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.204+0000 7f5e18e00640 1 -- 172.21.15.103:0/453737274 >> 172.21.15.103:0/453737274 conn(0x7f5e140fe6d0 msgr2=0x7f5e14101b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:01.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.204+0000 7f5e18e00640 1 -- 172.21.15.103:0/453737274 shutdown_connections 2024-09-11T01:09:01.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:01.204+0000 7f5e18e00640 1 -- 172.21.15.103:0/453737274 wait complete. 2024-09-11T01:09:02.045 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'ee7d2312', quiesce took 4.9 seconds. Will release after: 20.299999999999997 2024-09-11T01:09:02.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:02 smithi183 ceph-mon[34992]: pgmap v420: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-11T01:09:03.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:02 smithi103 ceph-mon[30562]: pgmap v420: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-11T01:09:03.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:02 smithi117 ceph-mon[35358]: pgmap v420: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 8 op/s 2024-09-11T01:09:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:04 smithi183 ceph-mon[34992]: pgmap v421: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:09:05.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:04 smithi103 ceph-mon[30562]: pgmap v421: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:09:05.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:04 smithi117 ceph-mon[35358]: pgmap v421: 129 pgs: 129 active+clean; 664 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:09:06.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:06 smithi183 ceph-mon[34992]: pgmap v422: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-11T01:09:07.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:06 smithi103 ceph-mon[30562]: pgmap v422: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-11T01:09:07.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:06 smithi117 ceph-mon[35358]: pgmap v422: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-11T01:09:08.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:08 smithi183 ceph-mon[34992]: pgmap v423: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-11T01:09:09.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:08 smithi103 ceph-mon[30562]: pgmap v423: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-11T01:09:09.124 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:08 smithi117 ceph-mon[35358]: pgmap v423: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 767 B/s wr, 5 op/s 2024-09-11T01:09:10.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:10 smithi183 ceph-mon[34992]: pgmap v424: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-11T01:09:11.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:10 smithi103 ceph-mon[30562]: pgmap v424: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-11T01:09:11.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:10 smithi117 ceph-mon[35358]: pgmap v424: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-11T01:09:11.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.969+0000 7fc797e00640 1 -- 172.21.15.103:0/129365991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc798075ac0 msgr2=0x7fc798075f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:11.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.969+0000 7fc797e00640 1 --2- 172.21.15.103:0/129365991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc798075ac0 0x7fc798075f40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc784009900 tx=0x7fc78402a3f0 comp rx=0 tx=0).stop 2024-09-11T01:09:11.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.969+0000 7fc797e00640 1 -- 172.21.15.103:0/129365991 shutdown_connections 2024-09-11T01:09:11.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.969+0000 7fc797e00640 1 --2- 172.21.15.103:0/129365991 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc79810a710 0x7fc79810cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:11.972 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.969+0000 7fc797e00640 1 --2- 172.21.15.103:0/129365991 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc798075ac0 0x7fc798075f40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:11.972 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.969+0000 7fc797e00640 1 --2- 172.21.15.103:0/129365991 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc798076f30 0x7fc798075580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:11.972 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.969+0000 7fc797e00640 1 -- 172.21.15.103:0/129365991 >> 172.21.15.103:0/129365991 conn(0x7fc7980fe030 msgr2=0x7fc798100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:11.972 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.969+0000 7fc797e00640 1 -- 172.21.15.103:0/129365991 shutdown_connections 2024-09-11T01:09:11.972 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.969+0000 7fc797e00640 1 -- 172.21.15.103:0/129365991 wait complete. 2024-09-11T01:09:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.971+0000 7fc797e00640 1 Processor -- start 2024-09-11T01:09:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.971+0000 7fc797e00640 1 -- start start 2024-09-11T01:09:11.973 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.971+0000 7fc797e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc798075ac0 0x7fc798071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:11.974 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.971+0000 7fc797e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc798076f30 0x7fc798072310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:11.974 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.971+0000 7fc797e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc79810a710 0x7fc798072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:11.974 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.971+0000 7fc797e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc798110630 con 0x7fc798075ac0 2024-09-11T01:09:11.974 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.971+0000 7fc797e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc7981104b0 con 0x7fc79810a710 2024-09-11T01:09:11.974 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.971+0000 7fc797e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc7981107b0 con 0x7fc798076f30 2024-09-11T01:09:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.972+0000 7fc796a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc798075ac0 0x7fc798071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.972+0000 7fc796a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc798075ac0 0x7fc798071cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33888/0 (socket says 172.21.15.103:33888) 2024-09-11T01:09:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.972+0000 7fc796a00640 1 -- 172.21.15.103:0/230618939 learned_addr learned my addr 172.21.15.103:0/230618939 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.972+0000 7fc797400640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc79810a710 0x7fc798072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.972+0000 7fc796000640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc798076f30 0x7fc798072310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:11.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.973+0000 7fc796a00640 1 -- 172.21.15.103:0/230618939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc798076f30 msgr2=0x7fc798072310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.973+0000 7fc796a00640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc798076f30 0x7fc798072310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.973+0000 7fc796a00640 1 -- 172.21.15.103:0/230618939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc79810a710 msgr2=0x7fc798072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.973+0000 7fc796a00640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc79810a710 0x7fc798072f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:11.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.973+0000 7fc796a00640 1 -- 172.21.15.103:0/230618939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc798073800 con 0x7fc798075ac0 2024-09-11T01:09:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.973+0000 7fc797400640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc79810a710 0x7fc798072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.973+0000 7fc796a00640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc798075ac0 0x7fc798071cc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc78800e9f0 tx=0x7fc78800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.974+0000 7fc79ca00640 1 -- 172.21.15.103:0/230618939 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc78800cd80 con 0x7fc798075ac0 2024-09-11T01:09:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.974+0000 7fc79ca00640 1 -- 172.21.15.103:0/230618939 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7880108e0 con 0x7fc798075ac0 2024-09-11T01:09:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.974+0000 7fc797e00640 1 -- 172.21.15.103:0/230618939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc798073af0 con 0x7fc798075ac0 2024-09-11T01:09:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.974+0000 7fc79ca00640 1 -- 172.21.15.103:0/230618939 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc788018980 con 0x7fc798075ac0 2024-09-11T01:09:11.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.974+0000 7fc797e00640 1 -- 172.21.15.103:0/230618939 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc798074190 con 0x7fc798075ac0 2024-09-11T01:09:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.979+0000 7fc7a0c6d740 1 Processor -- start 2024-09-11T01:09:11.980 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.979+0000 7fc7a0c6d740 1 -- start start 2024-09-11T01:09:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.980+0000 7fc79ca00640 1 -- 172.21.15.103:0/230618939 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7fc788010430 con 0x7fc798075ac0 2024-09-11T01:09:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.980+0000 7fc7a0c6d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe85970 0x55f8afe87d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.980+0000 7fc7a0c6d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe8a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.980+0000 7fc7a0c6d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe8ace0 0x55f8afe8d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.980+0000 7fc7a0c6d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f8afdf86b0 con 0x55f8afe882a0 2024-09-11T01:09:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.981+0000 7fc7a0c6d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f8afde7ae0 con 0x55f8afe85970 2024-09-11T01:09:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.981+0000 7fc7a0c6d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f8afdeb8f0 con 0x55f8afe8ace0 2024-09-11T01:09:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.981+0000 7fc797400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe85970 0x55f8afe87d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.981+0000 7fc797400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe85970 0x55f8afe87d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:57324/0 (socket says 172.21.15.103:57324) 2024-09-11T01:09:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.981+0000 7fc797400640 1 -- 172.21.15.103:0/1080428465 learned_addr learned my addr 172.21.15.103:0/1080428465 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.981+0000 7fc796000640 1 --2- 172.21.15.103:0/1080428465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe8ace0 0x55f8afe8d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.981+0000 7fc796a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe8a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.982+0000 7fc797400640 1 -- 172.21.15.103:0/1080428465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe8ace0 msgr2=0x55f8afe8d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.982+0000 7fc797400640 1 --2- 172.21.15.103:0/1080428465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe8ace0 0x55f8afe8d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.982+0000 7fc797400640 1 -- 172.21.15.103:0/1080428465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 msgr2=0x55f8afe8a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.982+0000 7fc797400640 1 --2- 172.21.15.103:0/1080428465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe8a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.982+0000 7fc797400640 1 -- 172.21.15.103:0/1080428465 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8afdb4780 con 0x55f8afe85970 2024-09-11T01:09:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.982+0000 7fc79ca00640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc77c0b54c0 0x7fc77c0b7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.983+0000 7fc797400640 1 --2- 172.21.15.103:0/1080428465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe85970 0x55f8afe87d60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc7900117a0 tx=0x7fc790011c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=143c72e1c84331bd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.983+0000 7fc79ca00640 1 -- 172.21.15.103:0/230618939 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fc7880e6610 con 0x7fc798075ac0 2024-09-11T01:09:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.983+0000 7fc796a00640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc77c0b54c0 0x7fc77c0b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.983+0000 7fc783e00640 1 -- 172.21.15.103:0/1080428465 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc790011220 con 0x55f8afe85970 2024-09-11T01:09:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.983+0000 7fc783e00640 1 -- 172.21.15.103:0/1080428465 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc79000f9a0 con 0x55f8afe85970 2024-09-11T01:09:11.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.983+0000 7fc783e00640 1 -- 172.21.15.103:0/1080428465 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7900045d0 con 0x55f8afe85970 2024-09-11T01:09:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.984+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/1080428465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe85970 msgr2=0x55f8afe87d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.984+0000 7fc796a00640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc77c0b54c0 0x7fc77c0b7980 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc7880a8e90 tx=0x7fc7880ec530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.984+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/1080428465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe85970 0x55f8afe87d60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc7900117a0 tx=0x7fc790011c60 comp rx=0 tx=0).stop 2024-09-11T01:09:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.984+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/1080428465 shutdown_connections 2024-09-11T01:09:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.984+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/1080428465 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe8ace0 0x55f8afe8d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.984+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/1080428465 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe8a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.984+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/1080428465 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe85970 0x55f8afe87d60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.984+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/1080428465 >> 172.21.15.103:0/1080428465 conn(0x55f8afe80ac0 msgr2=0x55f8afe81850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.985+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/1080428465 shutdown_connections 2024-09-11T01:09:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.985+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/1080428465 wait complete. 2024-09-11T01:09:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.985+0000 7fc7a0c6d740 1 -- start start 2024-09-11T01:09:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.985+0000 7fc7a0c6d740 1 Processor -- start 2024-09-11T01:09:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.986+0000 7fc7a0c6d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe85970 0x55f8afe8f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.986+0000 7fc7a0c6d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe8f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.986+0000 7fc7a0c6d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe8ace0 0x55f8afe90340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.986+0000 7fc7a0c6d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f8afd1fab0 con 0x55f8afe882a0 2024-09-11T01:09:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.986+0000 7fc7a0c6d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f8afd8e570 con 0x55f8afe8ace0 2024-09-11T01:09:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.986+0000 7fc7a0c6d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f8afe8dcc0 con 0x55f8afe85970 2024-09-11T01:09:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.986+0000 7fc7a0c6d740 10 client.0 _ll_register_callbacks cb 0x55f8afd9d100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.986+0000 7fc797400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe85970 0x55f8afe8f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.987+0000 7fc797400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe85970 0x55f8afe8f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:52952/0 (socket says 172.21.15.103:52952) 2024-09-11T01:09:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.987+0000 7fc797400640 1 -- 172.21.15.103:0/1298287618 learned_addr learned my addr 172.21.15.103:0/1298287618 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.987+0000 7fc796000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe8f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.987+0000 7fc797400640 1 --2- 172.21.15.103:0/1298287618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe8ace0 0x55f8afe90340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.987+0000 7fc796000640 1 -- 172.21.15.103:0/1298287618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe85970 msgr2=0x55f8afe8f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.987+0000 7fc796000640 1 --2- 172.21.15.103:0/1298287618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe85970 0x55f8afe8f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.987+0000 7fc796000640 1 -- 172.21.15.103:0/1298287618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe8ace0 msgr2=0x55f8afe90340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.987+0000 7fc796000640 1 --2- 172.21.15.103:0/1298287618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe8ace0 0x55f8afe90340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.987+0000 7fc796000640 1 -- 172.21.15.103:0/1298287618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8afb49790 con 0x55f8afe882a0 2024-09-11T01:09:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.987+0000 7fc797400640 1 --2- 172.21.15.103:0/1298287618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe85970 0x55f8afe8f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.988+0000 7fc796000640 1 --2- 172.21.15.103:0/1298287618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe8f770 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc78402a9e0 tx=0x7fc7840043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be31efe688355e0f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.988+0000 7fc780c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:09:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.988+0000 7fc780c00640 1 -- 172.21.15.103:0/1298287618 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc784035040 con 0x55f8afe882a0 2024-09-11T01:09:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.988+0000 7fc780c00640 1 -- 172.21.15.103:0/1298287618 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fc784003a00 con 0x55f8afe882a0 2024-09-11T01:09:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.988+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/1298287618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc79000f9a0 con 0x55f8afe882a0 2024-09-11T01:09:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.989+0000 7fc780c00640 1 -- 172.21.15.103:0/1298287618 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc784003c00 con 0x55f8afe882a0 2024-09-11T01:09:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.989+0000 7fc7a0c6d740 10 client.15456 fetch_fsmap learned FSMap version 26 2024-09-11T01:09:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.989+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/1298287618 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f8afbc2620 con 0x55f8afe882a0 2024-09-11T01:09:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.989+0000 7fc780c00640 1 -- 172.21.15.103:0/1298287618 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc79000f9a0 con 0x55f8afe882a0 2024-09-11T01:09:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.990+0000 7fc780c00640 1 -- 172.21.15.103:0/1298287618 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc78403c440 con 0x55f8afe882a0 2024-09-11T01:09:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.990+0000 7fc7a0c6d740 10 client.15456 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:09:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.990+0000 7fc7a0c6d740 10 client.15456 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:09:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.991+0000 7fc7a0c6d740 20 client.15456 populate_metadata read hostname 'smithi103' 2024-09-11T01:09:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.991+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/1298287618 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f8afe9aa20 0x55f8afe9ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.991+0000 7fc7a0c6d740 4 client.15456 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:09:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.991+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/1298287618 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8afdfa600 con 0x55f8afe9aa20 2024-09-11T01:09:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.991+0000 7fc797400640 1 --2- 172.21.15.103:0/1298287618 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f8afe9aa20 0x55f8afe9ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.992+0000 7fc797400640 1 --2- 172.21.15.103:0/1298287618 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f8afe9aa20 0x55f8afe9ce10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4cbf07b3f05cee8 server_cookie=edc35a2c31a05abd in_seq=0 out_seq=0 2024-09-11T01:09:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.992+0000 7fc780c00640 10 client.15456 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.993+0000 7fc780c00640 1 -- 172.21.15.103:0/1298287618 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f8afdfa600 con 0x55f8afe9aa20 2024-09-11T01:09:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.993+0000 7fc780c00640 10 client.15456 handle_command_reply: tid=0 2024-09-11T01:09:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.993+0000 7fc7a0c6d740 1 client.15456 shutdown 2024-09-11T01:09:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.993+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/1298287618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 msgr2=0x55f8afe8f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.993+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/1298287618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe8f770 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc78402a9e0 tx=0x7fc7840043b0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.993+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/1298287618 shutdown_connections 2024-09-11T01:09:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.993+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/1298287618 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe8ace0 0x55f8afe90340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.993+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/1298287618 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe8f770 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.993+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/1298287618 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f8afe9aa20 0x55f8afe9ce10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.993+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/1298287618 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe85970 0x55f8afe8f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.993+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/1298287618 >> 172.21.15.103:0/1298287618 conn(0x55f8afe80ac0 msgr2=0x55f8afe7fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.993+0000 7fc780c00640 0 client.15456 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.993+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/1298287618 shutdown_connections 2024-09-11T01:09:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.994+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/1298287618 wait complete. 2024-09-11T01:09:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:11.994+0000 7fc7a0c6d740 20 client.15456 trim_cache size 0 max 16384 2024-09-11T01:09:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.024+0000 7fc7a0c6d740 1 Processor -- start 2024-09-11T01:09:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.024+0000 7fc7a0c6d740 1 -- start start 2024-09-11T01:09:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.024+0000 7fc7a0c6d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe85970 0x55f8afe8f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.024+0000 7fc7a0c6d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe882a0 0x55f8afe8e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.024+0000 7fc7a0c6d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe8ace0 0x55f8afe8e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.024+0000 7fc7a0c6d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc7981b8750 con 0x55f8afe85970 2024-09-11T01:09:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.024+0000 7fc7a0c6d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc7981b6020 con 0x55f8afe8ace0 2024-09-11T01:09:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.024+0000 7fc7a0c6d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc7981b3e70 con 0x55f8afe882a0 2024-09-11T01:09:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.024+0000 7fc797400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe85970 0x55f8afe8f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.025+0000 7fc797400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe85970 0x55f8afe8f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33916/0 (socket says 172.21.15.103:33916) 2024-09-11T01:09:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.025+0000 7fc797400640 1 -- 172.21.15.103:0/3460616146 learned_addr learned my addr 172.21.15.103:0/3460616146 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.025+0000 7fc796000640 1 --2- 172.21.15.103:0/3460616146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe882a0 0x55f8afe8e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.025+0000 7fc797400640 1 --2- 172.21.15.103:0/3460616146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe8ace0 0x55f8afe8e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.025+0000 7fc797400640 1 -- 172.21.15.103:0/3460616146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe882a0 msgr2=0x55f8afe8e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.025+0000 7fc797400640 1 --2- 172.21.15.103:0/3460616146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe882a0 0x55f8afe8e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.025+0000 7fc797400640 1 -- 172.21.15.103:0/3460616146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe8ace0 msgr2=0x55f8afe8e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.025+0000 7fc797400640 1 --2- 172.21.15.103:0/3460616146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe8ace0 0x55f8afe8e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.025+0000 7fc797400640 1 -- 172.21.15.103:0/3460616146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8afe880d0 con 0x55f8afe85970 2024-09-11T01:09:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.025+0000 7fc796000640 1 --2- 172.21.15.103:0/3460616146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe882a0 0x55f8afe8e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:12.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.026+0000 7fc797400640 1 --2- 172.21.15.103:0/3460616146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe85970 0x55f8afe8f7e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc790005cc0 tx=0x7fc790011c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b65ae94f3ccc5a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.026+0000 7fc783400640 1 -- 172.21.15.103:0/3460616146 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79001e040 con 0x55f8afe85970 2024-09-11T01:09:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.026+0000 7fc783400640 1 -- 172.21.15.103:0/3460616146 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc790005050 con 0x55f8afe85970 2024-09-11T01:09:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.026+0000 7fc783400640 1 -- 172.21.15.103:0/3460616146 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc790031680 con 0x55f8afe85970 2024-09-11T01:09:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.027+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/3460616146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe85970 msgr2=0x55f8afe8f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.027+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/3460616146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe85970 0x55f8afe8f7e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc790005cc0 tx=0x7fc790011c60 comp rx=0 tx=0).stop 2024-09-11T01:09:12.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.027+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/3460616146 shutdown_connections 2024-09-11T01:09:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.027+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/3460616146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe8ace0 0x55f8afe8e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.027+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/3460616146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe882a0 0x55f8afe8e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.027+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/3460616146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe85970 0x55f8afe8f7e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.027+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/3460616146 >> 172.21.15.103:0/3460616146 conn(0x55f8afe80ac0 msgr2=0x55f8afe8f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.027+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/3460616146 shutdown_connections 2024-09-11T01:09:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.027+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/3460616146 wait complete. 2024-09-11T01:09:12.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.028+0000 7fc7a0c6d740 1 -- start start 2024-09-11T01:09:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.028+0000 7fc7a0c6d740 1 Processor -- start 2024-09-11T01:09:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.029+0000 7fc7a0c6d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe85970 0x55f8afe96ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.029+0000 7fc7a0c6d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe95d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:12.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.029+0000 7fc7a0c6d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe8ace0 0x55f8afe96420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.029+0000 7fc7a0c6d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc7981b44e0 con 0x55f8afe882a0 2024-09-11T01:09:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.029+0000 7fc7a0c6d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc7981b5950 con 0x55f8afe85970 2024-09-11T01:09:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.029+0000 7fc7a0c6d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc7981b4bb0 con 0x55f8afe8ace0 2024-09-11T01:09:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.029+0000 7fc7a0c6d740 10 client.0 _ll_register_callbacks cb 0x7fc784009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.029+0000 7fc796000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe95d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.029+0000 7fc796000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe95d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33920/0 (socket says 172.21.15.103:33920) 2024-09-11T01:09:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.029+0000 7fc796000640 1 -- 172.21.15.103:0/4132618148 learned_addr learned my addr 172.21.15.103:0/4132618148 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.029+0000 7fc797400640 1 --2- 172.21.15.103:0/4132618148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe85970 0x55f8afe96ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.029+0000 7fc797400640 1 --2- 172.21.15.103:0/4132618148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe8ace0 0x55f8afe96420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:12.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.030+0000 7fc796000640 1 -- 172.21.15.103:0/4132618148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe8ace0 msgr2=0x55f8afe96420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:12.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.030+0000 7fc796000640 1 --2- 172.21.15.103:0/4132618148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe8ace0 0x55f8afe96420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.030+0000 7fc796000640 1 -- 172.21.15.103:0/4132618148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe85970 msgr2=0x55f8afe96ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:12.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.030+0000 7fc796000640 1 --2- 172.21.15.103:0/4132618148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe85970 0x55f8afe96ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.030+0000 7fc796000640 1 -- 172.21.15.103:0/4132618148 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8afe94770 con 0x55f8afe882a0 2024-09-11T01:09:12.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.030+0000 7fc797400640 1 --2- 172.21.15.103:0/4132618148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe85970 0x55f8afe96ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:12.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.030+0000 7fc796000640 1 --2- 172.21.15.103:0/4132618148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe95d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc78402a9e0 tx=0x7fc78403c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63cacad39e97ac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:12.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.030+0000 7fc780c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:09:12.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.031+0000 7fc780c00640 1 -- 172.21.15.103:0/4132618148 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc784035040 con 0x55f8afe882a0 2024-09-11T01:09:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.031+0000 7fc780c00640 1 -- 172.21.15.103:0/4132618148 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fc78403cc90 con 0x55f8afe882a0 2024-09-11T01:09:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.031+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/4132618148 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc790005050 con 0x55f8afe882a0 2024-09-11T01:09:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.031+0000 7fc780c00640 1 -- 172.21.15.103:0/4132618148 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc78405d050 con 0x55f8afe882a0 2024-09-11T01:09:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.031+0000 7fc7a0c6d740 10 client.15462 fetch_fsmap learned FSMap version 26 2024-09-11T01:09:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.031+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/4132618148 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f8aff10510 con 0x55f8afe882a0 2024-09-11T01:09:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.032+0000 7fc780c00640 1 -- 172.21.15.103:0/4132618148 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc790005050 con 0x55f8afe882a0 2024-09-11T01:09:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.032+0000 7fc780c00640 1 -- 172.21.15.103:0/4132618148 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc784031a50 con 0x55f8afe882a0 2024-09-11T01:09:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.032+0000 7fc7a0c6d740 10 client.15462 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:09:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.032+0000 7fc7a0c6d740 10 client.15462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:09:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.032+0000 7fc7a0c6d740 20 client.15462 populate_metadata read hostname 'smithi103' 2024-09-11T01:09:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.032+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/4132618148 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f8aff10ef0 0x55f8aff13310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.032+0000 7fc7a0c6d740 4 client.15462 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:09:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.032+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/4132618148 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f8afdf60b0 con 0x55f8aff10ef0 2024-09-11T01:09:12.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.032+0000 7fc797400640 1 --2- 172.21.15.103:0/4132618148 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f8aff10ef0 0x55f8aff13310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.033+0000 7fc797400640 1 --2- 172.21.15.103:0/4132618148 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f8aff10ef0 0x55f8aff13310 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=884d04d1cfbcf069 server_cookie=4ad2d13301fee517 in_seq=0 out_seq=0 2024-09-11T01:09:12.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.033+0000 7fc780c00640 10 client.15462 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.041+0000 7fc780c00640 1 -- 172.21.15.103:0/4132618148 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f8afdf60b0 con 0x55f8aff10ef0 2024-09-11T01:09:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.041+0000 7fc780c00640 10 client.15462 handle_command_reply: tid=0 2024-09-11T01:09:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.041+0000 7fc7a0c6d740 1 client.15462 shutdown 2024-09-11T01:09:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.041+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/4132618148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 msgr2=0x55f8afe95d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:12.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.041+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/4132618148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe95d30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc78402a9e0 tx=0x7fc78403c670 comp rx=0 tx=0).stop 2024-09-11T01:09:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.042+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/4132618148 shutdown_connections 2024-09-11T01:09:12.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.042+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/4132618148 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f8aff10ef0 0x55f8aff13310 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.042+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/4132618148 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f8afe8ace0 0x55f8afe96420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.042+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/4132618148 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f8afe882a0 0x55f8afe95d30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.042+0000 7fc7a0c6d740 1 --2- 172.21.15.103:0/4132618148 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f8afe85970 0x55f8afe96ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.042+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/4132618148 >> 172.21.15.103:0/4132618148 conn(0x55f8afe80ac0 msgr2=0x55f8afe8e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.042+0000 7fc780c00640 0 client.15462 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.042+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/4132618148 shutdown_connections 2024-09-11T01:09:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.042+0000 7fc7a0c6d740 1 -- 172.21.15.103:0/4132618148 wait complete. 2024-09-11T01:09:12.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.043+0000 7fc7a0c6d740 20 client.15462 trim_cache size 0 max 16384 2024-09-11T01:09:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:09:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:09:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:09:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:09:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.043+0000 7fc797e00640 1 -- 172.21.15.103:0/230618939 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc77c0b54c0 msgr2=0x7fc77c0b7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:12.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.043+0000 7fc797e00640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc77c0b54c0 0x7fc77c0b7980 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc7880a8e90 tx=0x7fc7880ec530 comp rx=0 tx=0).stop 2024-09-11T01:09:12.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.043+0000 7fc797e00640 1 -- 172.21.15.103:0/230618939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc798075ac0 msgr2=0x7fc798071cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:12.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.043+0000 7fc797e00640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc798075ac0 0x7fc798071cc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc78800e9f0 tx=0x7fc78800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.044+0000 7fc797e00640 1 -- 172.21.15.103:0/230618939 shutdown_connections 2024-09-11T01:09:12.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.044+0000 7fc797e00640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc77c0b54c0 0x7fc77c0b7980 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.044+0000 7fc797e00640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc79810a710 0x7fc798072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.044+0000 7fc797e00640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc798076f30 0x7fc798072310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.044+0000 7fc797e00640 1 --2- 172.21.15.103:0/230618939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc798075ac0 0x7fc798071cc0 secure :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc78800e9f0 tx=0x7fc78800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:09:12.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.044+0000 7fc797e00640 1 -- 172.21.15.103:0/230618939 >> 172.21.15.103:0/230618939 conn(0x7fc7980fe030 msgr2=0x7fc798100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:12.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.044+0000 7fc797e00640 1 -- 172.21.15.103:0/230618939 shutdown_connections 2024-09-11T01:09:12.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:12.044+0000 7fc797e00640 1 -- 172.21.15.103:0/230618939 wait complete. 2024-09-11T01:09:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:12 smithi183 ceph-mon[34992]: pgmap v425: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-11T01:09:13.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:12 smithi103 ceph-mon[30562]: pgmap v425: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-11T01:09:13.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:12 smithi117 ceph-mon[35358]: pgmap v425: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-11T01:09:13.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:13 smithi183 ceph-mon[34992]: pgmap v426: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T01:09:14.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:13 smithi103 ceph-mon[30562]: pgmap v426: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T01:09:14.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:13 smithi117 ceph-mon[35358]: pgmap v426: 129 pgs: 129 active+clean; 669 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 6 op/s 2024-09-11T01:09:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:16 smithi183 ceph-mon[34992]: pgmap v427: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-11T01:09:17.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:16 smithi103 ceph-mon[30562]: pgmap v427: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-11T01:09:17.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:16 smithi117 ceph-mon[35358]: pgmap v427: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-11T01:09:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:18 smithi183 ceph-mon[34992]: pgmap v428: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-11T01:09:19.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:18 smithi103 ceph-mon[30562]: pgmap v428: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-11T01:09:19.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:18 smithi117 ceph-mon[35358]: pgmap v428: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 853 B/s wr, 6 op/s 2024-09-11T01:09:20.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:20 smithi183 ceph-mon[34992]: pgmap v429: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-11T01:09:21.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:20 smithi103 ceph-mon[30562]: pgmap v429: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-11T01:09:21.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:20 smithi117 ceph-mon[35358]: pgmap v429: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-11T01:09:22.346 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:09:22.776 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:09:22.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:22 smithi103 ceph-mon[30562]: pgmap v430: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-11T01:09:22.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:22 smithi183 ceph-mon[34992]: pgmap v430: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-11T01:09:23.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:22 smithi117 ceph-mon[35358]: pgmap v430: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 853 B/s wr, 8 op/s 2024-09-11T01:09:23.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.447+0000 7f489ca00640 1 -- 172.21.15.103:0/820455336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4898075e00 msgr2=0x7f489810ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:23.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.447+0000 7f489ca00640 1 --2- 172.21.15.103:0/820455336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4898075e00 0x7f489810ecc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f4884009900 tx=0x7f488402a3f0 comp rx=0 tx=0).stop 2024-09-11T01:09:23.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.447+0000 7f489ca00640 1 -- 172.21.15.103:0/820455336 shutdown_connections 2024-09-11T01:09:23.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.447+0000 7f489ca00640 1 --2- 172.21.15.103:0/820455336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f489810f200 0x7f48981115f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:23.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.447+0000 7f489ca00640 1 --2- 172.21.15.103:0/820455336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4898075e00 0x7f489810ecc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:23.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.447+0000 7f489ca00640 1 --2- 172.21.15.103:0/820455336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48980754e0 0x7f48980758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:23.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.447+0000 7f489ca00640 1 -- 172.21.15.103:0/820455336 >> 172.21.15.103:0/820455336 conn(0x7f48980fe660 msgr2=0x7f4898100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:23.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.447+0000 7f489ca00640 1 -- 172.21.15.103:0/820455336 shutdown_connections 2024-09-11T01:09:23.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.447+0000 7f489ca00640 1 -- 172.21.15.103:0/820455336 wait complete. 2024-09-11T01:09:23.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.448+0000 7f489ca00640 1 Processor -- start 2024-09-11T01:09:23.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.448+0000 7f489ca00640 1 -- start start 2024-09-11T01:09:23.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.449+0000 7f489ca00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48980754e0 0x7f489819b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:23.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.449+0000 7f489ca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4898075e00 0x7f489819b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:23.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.449+0000 7f489ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f489810f200 0x7f48981a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:23.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.449+0000 7f489ca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4898114e30 con 0x7f489810f200 2024-09-11T01:09:23.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.449+0000 7f489ca00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4898114cb0 con 0x7f4898075e00 2024-09-11T01:09:23.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.449+0000 7f489ca00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4898114fb0 con 0x7f48980754e0 2024-09-11T01:09:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.449+0000 7f4897400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48980754e0 0x7f489819b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.449+0000 7f4897400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48980754e0 0x7f489819b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:46606/0 (socket says 172.21.15.103:46606) 2024-09-11T01:09:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.449+0000 7f4897400640 1 -- 172.21.15.103:0/3402021370 learned_addr learned my addr 172.21.15.103:0/3402021370 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.450+0000 7f4897400640 1 -- 172.21.15.103:0/3402021370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4898075e00 msgr2=0x7f489819b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.450+0000 7f4897400640 1 --2- 172.21.15.103:0/3402021370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4898075e00 0x7f489819b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.450+0000 7f4897400640 1 -- 172.21.15.103:0/3402021370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f489810f200 msgr2=0x7f48981a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.450+0000 7f4897400640 1 --2- 172.21.15.103:0/3402021370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f489810f200 0x7f48981a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.450+0000 7f4897400640 1 -- 172.21.15.103:0/3402021370 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48981a1330 con 0x7f48980754e0 2024-09-11T01:09:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.450+0000 7f4897400640 1 --2- 172.21.15.103:0/3402021370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48980754e0 0x7f489819b280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f488800ea60 tx=0x7f488800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:23.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.450+0000 7f488fe00640 1 -- 172.21.15.103:0/3402021370 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488800cde0 con 0x7f48980754e0 2024-09-11T01:09:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.450+0000 7f488fe00640 1 -- 172.21.15.103:0/3402021370 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48880035f0 con 0x7f48980754e0 2024-09-11T01:09:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.450+0000 7f489ca00640 1 -- 172.21.15.103:0/3402021370 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48981a1620 con 0x7f48980754e0 2024-09-11T01:09:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.450+0000 7f489ca00640 1 -- 172.21.15.103:0/3402021370 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48981a7eb0 con 0x7f48980754e0 2024-09-11T01:09:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.451+0000 7f488fe00640 1 -- 172.21.15.103:0/3402021370 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888010690 con 0x7f48980754e0 2024-09-11T01:09:23.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.452+0000 7f489ca00640 1 -- 172.21.15.103:0/3402021370 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48980758c0 con 0x7f48980754e0 2024-09-11T01:09:23.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.456+0000 7f488fe00640 1 -- 172.21.15.103:0/3402021370 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7f4888004000 con 0x7f48980754e0 2024-09-11T01:09:23.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.458+0000 7f488fe00640 1 --2- 172.21.15.103:0/3402021370 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f487c0b5490 0x7f487c0b7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:23.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.459+0000 7f488fe00640 1 -- 172.21.15.103:0/3402021370 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f48880e6690 con 0x7f48980754e0 2024-09-11T01:09:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.459+0000 7f488fe00640 1 -- 172.21.15.103:0/3402021370 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f48880e6b10 con 0x7f48980754e0 2024-09-11T01:09:23.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.459+0000 7f4896a00640 1 --2- 172.21.15.103:0/3402021370 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f487c0b5490 0x7f487c0b7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:23.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.460+0000 7f4896a00640 1 --2- 172.21.15.103:0/3402021370 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f487c0b5490 0x7f487c0b7950 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f488402a910 tx=0x7f4884031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:23.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.728+0000 7f489ca00640 1 -- 172.21.15.103:0/3402021370 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f489819c3b0 con 0x7f48980754e0 2024-09-11T01:09:23.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.729+0000 7f488fe00640 1 -- 172.21.15.103:0/3402021370 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11930 (secure 0 0 0) 0x7f48880acfe0 con 0x7f48980754e0 2024-09-11T01:09:23.731 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:09:23.732 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-09-11T01:08:18:615937+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:08:18.524092+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24629,24619]},"id":1}]} 2024-09-11T01:09:23.732 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-09-11T01:09:23.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.732+0000 7f489ca00640 1 -- 172.21.15.103:0/3402021370 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f487c0b5490 msgr2=0x7f487c0b7950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:23.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.732+0000 7f489ca00640 1 --2- 172.21.15.103:0/3402021370 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f487c0b5490 0x7f487c0b7950 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f488402a910 tx=0x7f4884031400 comp rx=0 tx=0).stop 2024-09-11T01:09:23.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.732+0000 7f489ca00640 1 -- 172.21.15.103:0/3402021370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48980754e0 msgr2=0x7f489819b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:23.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.732+0000 7f489ca00640 1 --2- 172.21.15.103:0/3402021370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48980754e0 0x7f489819b280 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f488800ea60 tx=0x7f488800ef20 comp rx=0 tx=0).stop 2024-09-11T01:09:23.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.732+0000 7f489ca00640 1 -- 172.21.15.103:0/3402021370 shutdown_connections 2024-09-11T01:09:23.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.733+0000 7f489ca00640 1 --2- 172.21.15.103:0/3402021370 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f487c0b5490 0x7f487c0b7950 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:23.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.733+0000 7f489ca00640 1 --2- 172.21.15.103:0/3402021370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f489810f200 0x7f48981a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:23.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.733+0000 7f489ca00640 1 --2- 172.21.15.103:0/3402021370 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4898075e00 0x7f489819b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:23.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.733+0000 7f489ca00640 1 --2- 172.21.15.103:0/3402021370 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48980754e0 0x7f489819b280 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:23.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.733+0000 7f489ca00640 1 -- 172.21.15.103:0/3402021370 >> 172.21.15.103:0/3402021370 conn(0x7f48980fe660 msgr2=0x7f48980feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:23.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.734+0000 7f489ca00640 1 -- 172.21.15.103:0/3402021370 shutdown_connections 2024-09-11T01:09:23.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:23.734+0000 7f489ca00640 1 -- 172.21.15.103:0/3402021370 wait complete. 2024-09-11T01:09:24.561 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24665 quiesce db --set-id ee7d2312 --release --await' 2024-09-11T01:09:24.562 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24665 quiesce db --set-id ee7d2312 --release --await 2024-09-11T01:09:24.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:24 smithi103 ceph-mon[30562]: pgmap v431: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T01:09:24.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:24 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3402021370' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:09:24.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:24 smithi183 ceph-mon[34992]: pgmap v431: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T01:09:24.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:24 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3402021370' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:09:24.998 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:09:25.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:24 smithi117 ceph-mon[35358]: pgmap v431: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T01:09:25.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:24 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3402021370' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:09:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.170+0000 7f0650c00640 1 -- 172.21.15.103:0/2448281142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f064c06b3d0 msgr2=0x7f064c105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.170+0000 7f0650c00640 1 --2- 172.21.15.103:0/2448281142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f064c06b3d0 0x7f064c105400 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f063c009900 tx=0x7f063c02a3f0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.170+0000 7f0650c00640 1 -- 172.21.15.103:0/2448281142 shutdown_connections 2024-09-11T01:09:25.172 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.170+0000 7f0650c00640 1 --2- 172.21.15.103:0/2448281142 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f064c1084b0 0x7f064c10a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.170+0000 7f0650c00640 1 --2- 172.21.15.103:0/2448281142 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f064c105940 0x7f064c107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.170+0000 7f0650c00640 1 --2- 172.21.15.103:0/2448281142 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f064c06b3d0 0x7f064c105400 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.170+0000 7f0650c00640 1 -- 172.21.15.103:0/2448281142 >> 172.21.15.103:0/2448281142 conn(0x7f064c0fcf30 msgr2=0x7f064c0ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.171+0000 7f0650c00640 1 -- 172.21.15.103:0/2448281142 shutdown_connections 2024-09-11T01:09:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.171+0000 7f0650c00640 1 -- 172.21.15.103:0/2448281142 wait complete. 2024-09-11T01:09:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.172+0000 7f0650c00640 1 Processor -- start 2024-09-11T01:09:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.172+0000 7f0650c00640 1 -- start start 2024-09-11T01:09:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.173+0000 7f0650c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f064c06b3d0 0x7f064c198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.173+0000 7f0650c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f064c105940 0x7f064c199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.173+0000 7f0650c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f064c1084b0 0x7f064c199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.173+0000 7f0650c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f064c10e480 con 0x7f064c1084b0 2024-09-11T01:09:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.173+0000 7f0650c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f064c10e300 con 0x7f064c06b3d0 2024-09-11T01:09:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.173+0000 7f0650c00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f064c10e600 con 0x7f064c105940 2024-09-11T01:09:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.173+0000 7f064b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f064c06b3d0 0x7f064c198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.173+0000 7f064b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f064c06b3d0 0x7f064c198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:54380/0 (socket says 172.21.15.103:54380) 2024-09-11T01:09:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.173+0000 7f064b400640 1 -- 172.21.15.103:0/3942128525 learned_addr learned my addr 172.21.15.103:0/3942128525 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.173+0000 7f064be00640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f064c1084b0 0x7f064c199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.173+0000 7f064aa00640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f064c105940 0x7f064c199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.174+0000 7f064aa00640 1 -- 172.21.15.103:0/3942128525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f064c06b3d0 msgr2=0x7f064c198bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.174+0000 7f064aa00640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f064c06b3d0 0x7f064c198bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.174+0000 7f064aa00640 1 -- 172.21.15.103:0/3942128525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f064c1084b0 msgr2=0x7f064c199e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.174+0000 7f064aa00640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f064c1084b0 0x7f064c199e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.174+0000 7f064aa00640 1 -- 172.21.15.103:0/3942128525 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064c19a6f0 con 0x7f064c105940 2024-09-11T01:09:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.174+0000 7f064be00640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f064c1084b0 0x7f064c199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.174+0000 7f064aa00640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f064c105940 0x7f064c199200 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f063800d6a0 tx=0x7f063800db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.174+0000 7f0643e00640 1 -- 172.21.15.103:0/3942128525 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638017070 con 0x7f064c105940 2024-09-11T01:09:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.175+0000 7f0643e00640 1 -- 172.21.15.103:0/3942128525 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0638009820 con 0x7f064c105940 2024-09-11T01:09:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.175+0000 7f0650c00640 1 -- 172.21.15.103:0/3942128525 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064c19a9e0 con 0x7f064c105940 2024-09-11T01:09:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.175+0000 7f0643e00640 1 -- 172.21.15.103:0/3942128525 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0638004c40 con 0x7f064c105940 2024-09-11T01:09:25.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.175+0000 7f0650c00640 1 -- 172.21.15.103:0/3942128525 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f064c1a10b0 con 0x7f064c105940 2024-09-11T01:09:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.180+0000 7f06551fa740 1 Processor -- start 2024-09-11T01:09:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.180+0000 7f06551fa740 1 -- start start 2024-09-11T01:09:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.180+0000 7f06551fa740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a2d80 0x55dfc57a5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.180+0000 7f06551fa740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a56b0 0x55dfc57a7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.180+0000 7f06551fa740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a80f0 0x55dfc57aa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.180+0000 7f06551fa740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55dfc57116b0 con 0x55dfc57a56b0 2024-09-11T01:09:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.180+0000 7f06551fa740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55dfc5700ae0 con 0x55dfc57a2d80 2024-09-11T01:09:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.180+0000 7f06551fa740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55dfc57048f0 con 0x55dfc57a80f0 2024-09-11T01:09:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.181+0000 7f064b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a56b0 0x55dfc57a7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.181+0000 7f064be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a2d80 0x55dfc57a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.181+0000 7f064b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a56b0 0x55dfc57a7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39602/0 (socket says 172.21.15.103:39602) 2024-09-11T01:09:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.181+0000 7f064b400640 1 -- 172.21.15.103:0/2448051599 learned_addr learned my addr 172.21.15.103:0/2448051599 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.181+0000 7f0643e00640 1 -- 172.21.15.103:0/3942128525 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7f0638005220 con 0x7f064c105940 2024-09-11T01:09:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.181+0000 7f064be00640 1 -- 172.21.15.103:0/2448051599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a80f0 msgr2=0x55dfc57aa5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T01:09:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.181+0000 7f064be00640 1 --2- 172.21.15.103:0/2448051599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a80f0 0x55dfc57aa5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.181+0000 7f064be00640 1 -- 172.21.15.103:0/2448051599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a56b0 msgr2=0x55dfc57a7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.181+0000 7f064be00640 1 --2- 172.21.15.103:0/2448051599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a56b0 0x55dfc57a7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.181+0000 7f064be00640 1 -- 172.21.15.103:0/2448051599 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfc56cd780 con 0x55dfc57a2d80 2024-09-11T01:09:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.182+0000 7f064be00640 1 --2- 172.21.15.103:0/2448051599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a2d80 0x55dfc57a5170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f064c199930 tx=0x7f0644011bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=409297c9ae0d4594 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.182+0000 7f0637e00640 1 -- 172.21.15.103:0/2448051599 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0644004d20 con 0x55dfc57a2d80 2024-09-11T01:09:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.182+0000 7f0637e00640 1 -- 172.21.15.103:0/2448051599 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f064400f970 con 0x55dfc57a2d80 2024-09-11T01:09:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.182+0000 7f0637e00640 1 -- 172.21.15.103:0/2448051599 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0644004450 con 0x55dfc57a2d80 2024-09-11T01:09:25.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.183+0000 7f06551fa740 1 -- 172.21.15.103:0/2448051599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a2d80 msgr2=0x55dfc57a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.183+0000 7f06551fa740 1 --2- 172.21.15.103:0/2448051599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a2d80 0x55dfc57a5170 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f064c199930 tx=0x7f0644011bf0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.183+0000 7f06551fa740 1 -- 172.21.15.103:0/2448051599 shutdown_connections 2024-09-11T01:09:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.183+0000 7f06551fa740 1 --2- 172.21.15.103:0/2448051599 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a80f0 0x55dfc57aa5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.183+0000 7f06551fa740 1 --2- 172.21.15.103:0/2448051599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a56b0 0x55dfc57a7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.183+0000 7f06551fa740 1 --2- 172.21.15.103:0/2448051599 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a2d80 0x55dfc57a5170 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.183+0000 7f06551fa740 1 -- 172.21.15.103:0/2448051599 >> 172.21.15.103:0/2448051599 conn(0x55dfc5799ac0 msgr2=0x55dfc579a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.183+0000 7f06551fa740 1 -- 172.21.15.103:0/2448051599 shutdown_connections 2024-09-11T01:09:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.183+0000 7f06551fa740 1 -- 172.21.15.103:0/2448051599 wait complete. 2024-09-11T01:09:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.183+0000 7f0643e00640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f06300b5300 0x7f06300b77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.184+0000 7f0643e00640 1 -- 172.21.15.103:0/3942128525 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f06380e5950 con 0x7f064c105940 2024-09-11T01:09:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.184+0000 7f06551fa740 1 -- start start 2024-09-11T01:09:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.184+0000 7f064b400640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f06300b5300 0x7f06300b77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.184+0000 7f06551fa740 1 Processor -- start 2024-09-11T01:09:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.185+0000 7f06551fa740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a2d80 0x55dfc57ac510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.185+0000 7f064b400640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f06300b5300 0x7f06300b77c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f063c000c00 tx=0x7f063c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.185+0000 7f06551fa740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a56b0 0x55dfc57acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.185+0000 7f06551fa740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a80f0 0x55dfc57ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.185+0000 7f06551fa740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55dfc5638ab0 con 0x55dfc57a2d80 2024-09-11T01:09:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.185+0000 7f06551fa740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55dfc56a7570 con 0x55dfc57a80f0 2024-09-11T01:09:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.185+0000 7f06551fa740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55dfc57ab0d0 con 0x55dfc57a56b0 2024-09-11T01:09:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.185+0000 7f06551fa740 10 client.0 _ll_register_callbacks cb 0x55dfc56b6100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.185+0000 7f064b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a2d80 0x55dfc57ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.185+0000 7f064b400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a2d80 0x55dfc57ac510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39614/0 (socket says 172.21.15.103:39614) 2024-09-11T01:09:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.185+0000 7f064b400640 1 -- 172.21.15.103:0/1361476229 learned_addr learned my addr 172.21.15.103:0/1361476229 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.185+0000 7f064aa00640 1 --2- 172.21.15.103:0/1361476229 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a56b0 0x55dfc57acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.185+0000 7f064be00640 1 --2- 172.21.15.103:0/1361476229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a80f0 0x55dfc57ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.186+0000 7f064b400640 1 -- 172.21.15.103:0/1361476229 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a56b0 msgr2=0x55dfc57acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.186+0000 7f064b400640 1 --2- 172.21.15.103:0/1361476229 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a56b0 0x55dfc57acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.186+0000 7f064b400640 1 -- 172.21.15.103:0/1361476229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a80f0 msgr2=0x55dfc57ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.186+0000 7f064b400640 1 --2- 172.21.15.103:0/1361476229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a80f0 0x55dfc57ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.186+0000 7f064b400640 1 -- 172.21.15.103:0/1361476229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfc5462790 con 0x55dfc57a2d80 2024-09-11T01:09:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.186+0000 7f064be00640 1 --2- 172.21.15.103:0/1361476229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a80f0 0x55dfc57ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.186+0000 7f064b400640 1 --2- 172.21.15.103:0/1361476229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a2d80 0x55dfc57ac510 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f063c003670 tx=0x7f063c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c06e65aa9df2f8a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.186+0000 7f0634c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:09:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.186+0000 7f0634c00640 1 -- 172.21.15.103:0/1361476229 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c035070 con 0x55dfc57a2d80 2024-09-11T01:09:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.187+0000 7f06551fa740 1 -- 172.21.15.103:0/1361476229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f064400f970 con 0x55dfc57a2d80 2024-09-11T01:09:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.187+0000 7f0634c00640 1 -- 172.21.15.103:0/1361476229 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f063c0317a0 con 0x55dfc57a2d80 2024-09-11T01:09:25.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.187+0000 7f0634c00640 1 -- 172.21.15.103:0/1361476229 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f063c0319a0 con 0x55dfc57a2d80 2024-09-11T01:09:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.187+0000 7f06551fa740 10 client.15477 fetch_fsmap learned FSMap version 26 2024-09-11T01:09:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.187+0000 7f06551fa740 1 -- 172.21.15.103:0/1361476229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55dfc54db620 con 0x55dfc57a2d80 2024-09-11T01:09:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.187+0000 7f0634c00640 1 -- 172.21.15.103:0/1361476229 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f064400f970 con 0x55dfc57a2d80 2024-09-11T01:09:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.187+0000 7f0634c00640 1 -- 172.21.15.103:0/1361476229 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f063c043030 con 0x55dfc57a2d80 2024-09-11T01:09:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.188+0000 7f06551fa740 10 client.15477 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:09:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.188+0000 7f06551fa740 10 client.15477 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:09:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.188+0000 7f06551fa740 20 client.15477 populate_metadata read hostname 'smithi103' 2024-09-11T01:09:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.188+0000 7f06551fa740 1 --2- 172.21.15.103:0/1361476229 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55dfc579ff10 0x55dfc57a2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.188+0000 7f06551fa740 4 client.15477 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:09:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.188+0000 7f06551fa740 1 -- 172.21.15.103:0/1361476229 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfc5713600 con 0x55dfc579ff10 2024-09-11T01:09:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.188+0000 7f064aa00640 1 --2- 172.21.15.103:0/1361476229 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55dfc579ff10 0x55dfc57a2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.188+0000 7f064aa00640 1 --2- 172.21.15.103:0/1361476229 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55dfc579ff10 0x55dfc57a2360 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f474d1d5f128f6bf server_cookie=f6af6d3f13a0a062 in_seq=0 out_seq=0 2024-09-11T01:09:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.188+0000 7f0634c00640 10 client.15477 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.189+0000 7f0634c00640 1 -- 172.21.15.103:0/1361476229 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55dfc5713600 con 0x55dfc579ff10 2024-09-11T01:09:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.189+0000 7f0634c00640 10 client.15477 handle_command_reply: tid=0 2024-09-11T01:09:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.189+0000 7f06551fa740 1 client.15477 shutdown 2024-09-11T01:09:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.189+0000 7f06551fa740 1 -- 172.21.15.103:0/1361476229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a2d80 msgr2=0x55dfc57ac510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.189+0000 7f06551fa740 1 --2- 172.21.15.103:0/1361476229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a2d80 0x55dfc57ac510 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f063c003670 tx=0x7f063c009260 comp rx=0 tx=0).stop 2024-09-11T01:09:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.190+0000 7f06551fa740 1 -- 172.21.15.103:0/1361476229 shutdown_connections 2024-09-11T01:09:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.190+0000 7f06551fa740 1 --2- 172.21.15.103:0/1361476229 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a80f0 0x55dfc57ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.190+0000 7f06551fa740 1 --2- 172.21.15.103:0/1361476229 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55dfc579ff10 0x55dfc57a2360 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.190+0000 7f06551fa740 1 --2- 172.21.15.103:0/1361476229 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a56b0 0x55dfc57acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.190+0000 7f06551fa740 1 --2- 172.21.15.103:0/1361476229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a2d80 0x55dfc57ac510 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.190+0000 7f06551fa740 1 -- 172.21.15.103:0/1361476229 >> 172.21.15.103:0/1361476229 conn(0x55dfc5799ac0 msgr2=0x55dfc5798bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.190+0000 7f0634c00640 0 client.15477 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.190+0000 7f06551fa740 1 -- 172.21.15.103:0/1361476229 shutdown_connections 2024-09-11T01:09:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.190+0000 7f06551fa740 1 -- 172.21.15.103:0/1361476229 wait complete. 2024-09-11T01:09:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.190+0000 7f06551fa740 20 client.15477 trim_cache size 0 max 16384 2024-09-11T01:09:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.216+0000 7f06551fa740 1 Processor -- start 2024-09-11T01:09:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.216+0000 7f06551fa740 1 -- start start 2024-09-11T01:09:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.216+0000 7f06551fa740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a2d80 0x55dfc5794db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.216+0000 7f06551fa740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a56b0 0x55dfc579def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.216+0000 7f06551fa740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a80f0 0x55dfc579e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.217+0000 7f06551fa740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f064c1abb80 con 0x55dfc57a80f0 2024-09-11T01:09:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.217+0000 7f06551fa740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f064c1a9450 con 0x55dfc57a56b0 2024-09-11T01:09:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.217+0000 7f06551fa740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f064c1a72a0 con 0x55dfc57a2d80 2024-09-11T01:09:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.217+0000 7f064be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a80f0 0x55dfc579e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.217+0000 7f064be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a80f0 0x55dfc579e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39622/0 (socket says 172.21.15.103:39622) 2024-09-11T01:09:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.217+0000 7f064be00640 1 -- 172.21.15.103:0/2449831968 learned_addr learned my addr 172.21.15.103:0/2449831968 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.217+0000 7f064b400640 1 --2- 172.21.15.103:0/2449831968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a2d80 0x55dfc5794db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.217+0000 7f064aa00640 1 --2- 172.21.15.103:0/2449831968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a56b0 0x55dfc579def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.217+0000 7f064be00640 1 -- 172.21.15.103:0/2449831968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a2d80 msgr2=0x55dfc5794db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.217+0000 7f064be00640 1 --2- 172.21.15.103:0/2449831968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a2d80 0x55dfc5794db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.217+0000 7f064be00640 1 -- 172.21.15.103:0/2449831968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a56b0 msgr2=0x55dfc579def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.217+0000 7f064be00640 1 --2- 172.21.15.103:0/2449831968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a56b0 0x55dfc579def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.217+0000 7f064be00640 1 -- 172.21.15.103:0/2449831968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfc57a54e0 con 0x55dfc57a80f0 2024-09-11T01:09:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.218+0000 7f064be00640 1 --2- 172.21.15.103:0/2449831968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a80f0 0x55dfc579e430 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0644014020 tx=0x7f0644009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b2686afb02a184 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.218+0000 7f0637400640 1 -- 172.21.15.103:0/2449831968 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0644029070 con 0x55dfc57a80f0 2024-09-11T01:09:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.218+0000 7f0637400640 1 -- 172.21.15.103:0/2449831968 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f064401f040 con 0x55dfc57a80f0 2024-09-11T01:09:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.218+0000 7f0637400640 1 -- 172.21.15.103:0/2449831968 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06440052d0 con 0x55dfc57a80f0 2024-09-11T01:09:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.219+0000 7f06551fa740 1 -- 172.21.15.103:0/2449831968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a80f0 msgr2=0x55dfc579e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.219+0000 7f06551fa740 1 --2- 172.21.15.103:0/2449831968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a80f0 0x55dfc579e430 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0644014020 tx=0x7f0644009f90 comp rx=0 tx=0).stop 2024-09-11T01:09:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.219+0000 7f06551fa740 1 -- 172.21.15.103:0/2449831968 shutdown_connections 2024-09-11T01:09:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.219+0000 7f06551fa740 1 --2- 172.21.15.103:0/2449831968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a80f0 0x55dfc579e430 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.219+0000 7f06551fa740 1 --2- 172.21.15.103:0/2449831968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a56b0 0x55dfc579def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.219+0000 7f06551fa740 1 --2- 172.21.15.103:0/2449831968 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a2d80 0x55dfc5794db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.219+0000 7f06551fa740 1 -- 172.21.15.103:0/2449831968 >> 172.21.15.103:0/2449831968 conn(0x55dfc5799ac0 msgr2=0x55dfc579a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.219+0000 7f06551fa740 1 -- 172.21.15.103:0/2449831968 shutdown_connections 2024-09-11T01:09:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.219+0000 7f06551fa740 1 -- 172.21.15.103:0/2449831968 wait complete. 2024-09-11T01:09:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.220+0000 7f06551fa740 1 -- start start 2024-09-11T01:09:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.220+0000 7f06551fa740 1 Processor -- start 2024-09-11T01:09:25.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.220+0000 7f06551fa740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a2d80 0x55dfc57b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f06551fa740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a56b0 0x55dfc57b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f06551fa740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a80f0 0x55dfc57b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f06551fa740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f064c1a7910 con 0x55dfc57a56b0 2024-09-11T01:09:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f06551fa740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f064c1a8d80 con 0x55dfc57a2d80 2024-09-11T01:09:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f06551fa740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f064c1a7fe0 con 0x55dfc57a80f0 2024-09-11T01:09:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f06551fa740 10 client.0 _ll_register_callbacks cb 0x7f063c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f064be00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a80f0 0x55dfc57b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f064b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a2d80 0x55dfc57b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f064be00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a80f0 0x55dfc57b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:46668/0 (socket says 172.21.15.103:46668) 2024-09-11T01:09:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f064be00640 1 -- 172.21.15.103:0/3543011462 learned_addr learned my addr 172.21.15.103:0/3543011462 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f064aa00640 1 --2- 172.21.15.103:0/3543011462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a56b0 0x55dfc57b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f064be00640 1 -- 172.21.15.103:0/3543011462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a2d80 msgr2=0x55dfc57b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f064be00640 1 --2- 172.21.15.103:0/3543011462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a2d80 0x55dfc57b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.225 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f064be00640 1 -- 172.21.15.103:0/3543011462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a56b0 msgr2=0x55dfc57b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f064be00640 1 --2- 172.21.15.103:0/3543011462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a56b0 0x55dfc57b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.221+0000 7f064be00640 1 -- 172.21.15.103:0/3543011462 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfc57b2fb0 con 0x55dfc57a80f0 2024-09-11T01:09:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.222+0000 7f064b400640 1 --2- 172.21.15.103:0/3543011462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a2d80 0x55dfc57b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.222+0000 7f064aa00640 1 --2- 172.21.15.103:0/3543011462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a56b0 0x55dfc57b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.222+0000 7f064be00640 1 --2- 172.21.15.103:0/3543011462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a80f0 0x55dfc57b2780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0644003ea0 tx=0x7f0644003ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59ee940c94ba93f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.222+0000 7f0634c00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:09:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.222+0000 7f0634c00640 1 -- 172.21.15.103:0/3543011462 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0644032060 con 0x55dfc57a80f0 2024-09-11T01:09:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.222+0000 7f06551fa740 1 -- 172.21.15.103:0/3543011462 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f064401f040 con 0x55dfc57a80f0 2024-09-11T01:09:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.222+0000 7f0634c00640 1 -- 172.21.15.103:0/3543011462 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f0644011050 con 0x55dfc57a80f0 2024-09-11T01:09:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.223+0000 7f0634c00640 1 -- 172.21.15.103:0/3543011462 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0644039050 con 0x55dfc57a80f0 2024-09-11T01:09:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.223+0000 7f06551fa740 10 client.25471 fetch_fsmap learned FSMap version 26 2024-09-11T01:09:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.223+0000 7f06551fa740 1 -- 172.21.15.103:0/3543011462 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55dfc57b4320 con 0x55dfc57a80f0 2024-09-11T01:09:25.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.223+0000 7f0634c00640 1 -- 172.21.15.103:0/3543011462 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f064401f040 con 0x55dfc57a80f0 2024-09-11T01:09:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.223+0000 7f0634c00640 1 -- 172.21.15.103:0/3543011462 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0644018070 con 0x55dfc57a80f0 2024-09-11T01:09:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.223+0000 7f06551fa740 10 client.25471 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:09:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.223+0000 7f06551fa740 10 client.25471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:09:25.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.223+0000 7f06551fa740 20 client.25471 populate_metadata read hostname 'smithi103' 2024-09-11T01:09:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.223+0000 7f06551fa740 1 --2- 172.21.15.103:0/3543011462 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55dfc58294f0 0x55dfc582b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.223+0000 7f06551fa740 4 client.25471 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:09:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.223+0000 7f06551fa740 1 -- 172.21.15.103:0/3543011462 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dfc570f0b0 con 0x55dfc58294f0 2024-09-11T01:09:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.224+0000 7f064b400640 1 --2- 172.21.15.103:0/3543011462 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55dfc58294f0 0x55dfc582b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.224+0000 7f064b400640 1 --2- 172.21.15.103:0/3543011462 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55dfc58294f0 0x55dfc582b8e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87968a393a417619 server_cookie=cbbaf7211084b401 in_seq=0 out_seq=0 2024-09-11T01:09:25.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.224+0000 7f0634c00640 10 client.25471 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.228+0000 7f0634c00640 1 -- 172.21.15.103:0/3543011462 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dfc570f0b0 con 0x55dfc58294f0 2024-09-11T01:09:25.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.228+0000 7f0634c00640 10 client.25471 handle_command_reply: tid=0 2024-09-11T01:09:25.230 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.229+0000 7f06551fa740 1 client.25471 shutdown 2024-09-11T01:09:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.229+0000 7f06551fa740 1 -- 172.21.15.103:0/3543011462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a80f0 msgr2=0x55dfc57b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.229+0000 7f06551fa740 1 --2- 172.21.15.103:0/3543011462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a80f0 0x55dfc57b2780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0644003ea0 tx=0x7f0644003ed0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.229+0000 7f06551fa740 1 -- 172.21.15.103:0/3543011462 shutdown_connections 2024-09-11T01:09:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.229+0000 7f06551fa740 1 --2- 172.21.15.103:0/3543011462 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55dfc58294f0 0x55dfc582b8e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.229+0000 7f06551fa740 1 --2- 172.21.15.103:0/3543011462 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55dfc57a80f0 0x55dfc57b2780 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.229+0000 7f06551fa740 1 --2- 172.21.15.103:0/3543011462 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55dfc57a56b0 0x55dfc57b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.229+0000 7f0634c00640 0 client.25471 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.229+0000 7f06551fa740 1 --2- 172.21.15.103:0/3543011462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55dfc57a2d80 0x55dfc57b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.229+0000 7f06551fa740 1 -- 172.21.15.103:0/3543011462 >> 172.21.15.103:0/3543011462 conn(0x55dfc5799ac0 msgr2=0x55dfc579a320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.229+0000 7f06551fa740 1 -- 172.21.15.103:0/3543011462 shutdown_connections 2024-09-11T01:09:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.229+0000 7f06551fa740 1 -- 172.21.15.103:0/3543011462 wait complete. 2024-09-11T01:09:25.231 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.229+0000 7f06551fa740 20 client.25471 trim_cache size 0 max 16384 2024-09-11T01:09:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:09:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:09:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:09:25.232 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:09:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.230+0000 7f0650c00640 1 -- 172.21.15.103:0/3942128525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f06300b5300 msgr2=0x7f06300b77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.230+0000 7f0650c00640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f06300b5300 0x7f06300b77c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f063c000c00 tx=0x7f063c005a20 comp rx=0 tx=0).stop 2024-09-11T01:09:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.230+0000 7f0650c00640 1 -- 172.21.15.103:0/3942128525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f064c105940 msgr2=0x7f064c199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.230+0000 7f0650c00640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f064c105940 0x7f064c199200 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f063800d6a0 tx=0x7f063800db60 comp rx=0 tx=0).stop 2024-09-11T01:09:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.230+0000 7f0650c00640 1 -- 172.21.15.103:0/3942128525 shutdown_connections 2024-09-11T01:09:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.230+0000 7f0650c00640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f06300b5300 0x7f06300b77c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.230+0000 7f0650c00640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f064c1084b0 0x7f064c199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.230+0000 7f0650c00640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f064c105940 0x7f064c199200 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.230+0000 7f0650c00640 1 --2- 172.21.15.103:0/3942128525 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f064c06b3d0 0x7f064c198bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.230+0000 7f0650c00640 1 -- 172.21.15.103:0/3942128525 >> 172.21.15.103:0/3942128525 conn(0x7f064c0fcf30 msgr2=0x7f064c103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.230+0000 7f0650c00640 1 -- 172.21.15.103:0/3942128525 shutdown_connections 2024-09-11T01:09:25.233 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:25.230+0000 7f0650c00640 1 -- 172.21.15.103:0/3942128525 wait complete. 2024-09-11T01:09:25.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.673+0000 7fdbc1800640 1 -- 172.21.15.103:0/742455140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbbc075540 msgr2=0x7fdbbc075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.673+0000 7fdbc1800640 1 --2- 172.21.15.103:0/742455140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbbc075540 0x7fdbbc075920 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fdbac009860 tx=0x7fdbac02a340 comp rx=0 tx=0).stop 2024-09-11T01:09:25.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.673+0000 7fdbc1800640 1 -- 172.21.15.103:0/742455140 shutdown_connections 2024-09-11T01:09:25.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.673+0000 7fdbc1800640 1 --2- 172.21.15.103:0/742455140 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbbc10f3b0 0x7fdbbc1117a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.673+0000 7fdbc1800640 1 --2- 172.21.15.103:0/742455140 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc075f40 0x7fdbbc10ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.673+0000 7fdbc1800640 1 --2- 172.21.15.103:0/742455140 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbbc075540 0x7fdbbc075920 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.673+0000 7fdbc1800640 1 -- 172.21.15.103:0/742455140 >> 172.21.15.103:0/742455140 conn(0x7fdbbc0fe820 msgr2=0x7fdbbc100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:25.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.673+0000 7fdbc1800640 1 -- 172.21.15.103:0/742455140 shutdown_connections 2024-09-11T01:09:25.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.673+0000 7fdbc1800640 1 -- 172.21.15.103:0/742455140 wait complete. 2024-09-11T01:09:25.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.674+0000 7fdbc1800640 1 Processor -- start 2024-09-11T01:09:25.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.675+0000 7fdbc1800640 1 -- start start 2024-09-11T01:09:25.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.675+0000 7fdbc1800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbbc075540 0x7fdbbc19b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.675+0000 7fdbc1800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbbc075f40 0x7fdbbc19b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.675+0000 7fdbc1800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc10f3b0 0x7fdbbc1a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.675+0000 7fdbc1800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc114f60 con 0x7fdbbc10f3b0 2024-09-11T01:09:25.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.675+0000 7fdbc1800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc114de0 con 0x7fdbbc075540 2024-09-11T01:09:25.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.675+0000 7fdbc1800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1150e0 con 0x7fdbbc075f40 2024-09-11T01:09:25.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.675+0000 7fdbba000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbbc075f40 0x7fdbbc19b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.675+0000 7fdbba000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbbc075f40 0x7fdbbc19b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:46684/0 (socket says 172.21.15.103:46684) 2024-09-11T01:09:25.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.675+0000 7fdbbaa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbbc075540 0x7fdbbc19b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.675+0000 7fdbba000640 1 -- 172.21.15.103:0/3166702161 learned_addr learned my addr 172.21.15.103:0/3166702161 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:25.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.675+0000 7fdbbb400640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc10f3b0 0x7fdbbc1a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.676+0000 7fdbba000640 1 -- 172.21.15.103:0/3166702161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbbc075540 msgr2=0x7fdbbc19b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.676+0000 7fdbba000640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbbc075540 0x7fdbbc19b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.676+0000 7fdbba000640 1 -- 172.21.15.103:0/3166702161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc10f3b0 msgr2=0x7fdbbc1a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.676+0000 7fdbba000640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc10f3b0 0x7fdbbc1a0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.676+0000 7fdbba000640 1 -- 172.21.15.103:0/3166702161 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbbc1a1540 con 0x7fdbbc075f40 2024-09-11T01:09:25.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.676+0000 7fdbbb400640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc10f3b0 0x7fdbbc1a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:25.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.676+0000 7fdbbaa00640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbbc075540 0x7fdbbc19b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:25.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.676+0000 7fdbba000640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbbc075f40 0x7fdbbc19b9d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdba8016fd0 tx=0x7fdba800c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:25.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.677+0000 7fdbb3400640 1 -- 172.21.15.103:0/3166702161 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba8005220 con 0x7fdbbc075f40 2024-09-11T01:09:25.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.677+0000 7fdbb3400640 1 -- 172.21.15.103:0/3166702161 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdba8015e20 con 0x7fdbbc075f40 2024-09-11T01:09:25.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.677+0000 7fdbb3400640 1 -- 172.21.15.103:0/3166702161 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba801e700 con 0x7fdbbc075f40 2024-09-11T01:09:25.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.677+0000 7fdbc1800640 1 -- 172.21.15.103:0/3166702161 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbbc1a1830 con 0x7fdbbc075f40 2024-09-11T01:09:25.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.677+0000 7fdbc1800640 1 -- 172.21.15.103:0/3166702161 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbbc102970 con 0x7fdbbc075f40 2024-09-11T01:09:25.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.681+0000 7fdbc43c1740 1 Processor -- start 2024-09-11T01:09:25.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.681+0000 7fdbc43c1740 1 -- start start 2024-09-11T01:09:25.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.681+0000 7fdbc43c1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a0ff0 0x55b8033a13d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.681+0000 7fdbc43c1740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a1910 0x55b8033ad360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.681+0000 7fdbc43c1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 0x55b8033afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.681+0000 7fdbc43c1740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b803318290 con 0x55b8033a1910 2024-09-11T01:09:25.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.681+0000 7fdbc43c1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b8033076c0 con 0x55b8033ad8a0 2024-09-11T01:09:25.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.681+0000 7fdbc43c1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b80330b4d0 con 0x55b8033a0ff0 2024-09-11T01:09:25.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.682+0000 7fdbbaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a1910 0x55b8033ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.682+0000 7fdbbaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a1910 0x55b8033ad360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39662/0 (socket says 172.21.15.103:39662) 2024-09-11T01:09:25.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.682+0000 7fdbbaa00640 1 -- 172.21.15.103:0/996176135 learned_addr learned my addr 172.21.15.103:0/996176135 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:25.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.682+0000 7fdbbb400640 1 --2- 172.21.15.103:0/996176135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a0ff0 0x55b8033a13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.682+0000 7fdbbb400640 1 -- 172.21.15.103:0/996176135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 msgr2=0x55b8033afc90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:09:25.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.682+0000 7fdbbb400640 1 --2- 172.21.15.103:0/996176135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 0x55b8033afc90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.682+0000 7fdbb3400640 1 -- 172.21.15.103:0/3166702161 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7fdba801e8a0 con 0x7fdbbc075f40 2024-09-11T01:09:25.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.682+0000 7fdbbb400640 1 -- 172.21.15.103:0/996176135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a1910 msgr2=0x55b8033ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:25.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.682+0000 7fdbbb400640 1 --2- 172.21.15.103:0/996176135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a1910 0x55b8033ad360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.682+0000 7fdbbb400640 1 -- 172.21.15.103:0/996176135 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b803294460 con 0x55b8033a0ff0 2024-09-11T01:09:25.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.682+0000 7fdbbaa00640 1 --2- 172.21.15.103:0/996176135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a1910 0x55b8033ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:25.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.683+0000 7fdbbb400640 1 --2- 172.21.15.103:0/996176135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a0ff0 0x55b8033a13d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4005fd0 tx=0x7fdbb4011bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17ca5597ea49dffe server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:25.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.683+0000 7fdba7e00640 1 -- 172.21.15.103:0/996176135 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4004d20 con 0x55b8033a0ff0 2024-09-11T01:09:25.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.683+0000 7fdba7e00640 1 -- 172.21.15.103:0/996176135 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbb400f9a0 con 0x55b8033a0ff0 2024-09-11T01:09:25.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.683+0000 7fdba7e00640 1 -- 172.21.15.103:0/996176135 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40043e0 con 0x55b8033a0ff0 2024-09-11T01:09:25.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.684+0000 7fdbc43c1740 1 -- 172.21.15.103:0/996176135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a0ff0 msgr2=0x55b8033a13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.684+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/996176135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a0ff0 0x55b8033a13d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4005fd0 tx=0x7fdbb4011bf0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.684+0000 7fdbb3400640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fdba00b5370 0x7fdba00b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.684+0000 7fdbc43c1740 1 -- 172.21.15.103:0/996176135 shutdown_connections 2024-09-11T01:09:25.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.684+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/996176135 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 0x55b8033afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.684+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/996176135 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a1910 0x55b8033ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.684+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/996176135 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a0ff0 0x55b8033a13d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.684+0000 7fdbc43c1740 1 -- 172.21.15.103:0/996176135 >> 172.21.15.103:0/996176135 conn(0x55b80339ee20 msgr2=0x55b80339ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:25.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.684+0000 7fdbb3400640 1 -- 172.21.15.103:0/3166702161 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fdba80ee360 con 0x7fdbbc075f40 2024-09-11T01:09:25.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.684+0000 7fdbbaa00640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fdba00b5370 0x7fdba00b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.685+0000 7fdbc43c1740 1 -- 172.21.15.103:0/996176135 shutdown_connections 2024-09-11T01:09:25.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.685+0000 7fdbc43c1740 1 -- 172.21.15.103:0/996176135 wait complete. 2024-09-11T01:09:25.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.685+0000 7fdbbaa00640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fdba00b5370 0x7fdba00b7830 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0057c0 tx=0x7fdbac02c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:25.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.685+0000 7fdbc43c1740 1 -- start start 2024-09-11T01:09:25.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.686+0000 7fdbc43c1740 1 Processor -- start 2024-09-11T01:09:25.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.686+0000 7fdbc43c1740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a0ff0 0x55b8033aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.686+0000 7fdbc43c1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033a1910 0x55b8033aae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.686+0000 7fdbc43c1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033ad8a0 0x55b8033ab360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.686+0000 7fdbc43c1740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b803168bb0 con 0x55b8033a0ff0 2024-09-11T01:09:25.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.686+0000 7fdbc43c1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b8032a26c0 con 0x55b8033a1910 2024-09-11T01:09:25.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.686+0000 7fdbc43c1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b8033b0550 con 0x55b8033ad8a0 2024-09-11T01:09:25.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.687+0000 7fdbc43c1740 10 client.0 _ll_register_callbacks cb 0x55b8032bd490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:25.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.687+0000 7fdbbaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a0ff0 0x55b8033aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.687+0000 7fdbbaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a0ff0 0x55b8033aa8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39664/0 (socket says 172.21.15.103:39664) 2024-09-11T01:09:25.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.687+0000 7fdbbaa00640 1 -- 172.21.15.103:0/4066528081 learned_addr learned my addr 172.21.15.103:0/4066528081 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:25.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.687+0000 7fdbbb400640 1 --2- 172.21.15.103:0/4066528081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033ad8a0 0x55b8033ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.687+0000 7fdbba000640 1 --2- 172.21.15.103:0/4066528081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033a1910 0x55b8033aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.687+0000 7fdbba000640 1 -- 172.21.15.103:0/4066528081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033ad8a0 msgr2=0x55b8033ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:25.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.687+0000 7fdbba000640 1 --2- 172.21.15.103:0/4066528081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033ad8a0 0x55b8033ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.687+0000 7fdbba000640 1 -- 172.21.15.103:0/4066528081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a0ff0 msgr2=0x55b8033aa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:25.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.687+0000 7fdbba000640 1 --2- 172.21.15.103:0/4066528081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a0ff0 0x55b8033aa8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.687+0000 7fdbba000640 1 -- 172.21.15.103:0/4066528081 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b803065b00 con 0x55b8033a1910 2024-09-11T01:09:25.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.687+0000 7fdbbb400640 1 --2- 172.21.15.103:0/4066528081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033ad8a0 0x55b8033ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:25.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.688+0000 7fdbba000640 1 --2- 172.21.15.103:0/4066528081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033a1910 0x55b8033aae20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdba80eb960 tx=0x7fdba80ebde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=853e25f651662f53 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:25.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.688+0000 7fdba4c00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:09:25.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.688+0000 7fdba4c00640 1 -- 172.21.15.103:0/4066528081 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba80b90f0 con 0x55b8033a1910 2024-09-11T01:09:25.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.688+0000 7fdba4c00640 1 -- 172.21.15.103:0/4066528081 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fdba801ebc0 con 0x55b8033a1910 2024-09-11T01:09:25.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.688+0000 7fdbc43c1740 1 -- 172.21.15.103:0/4066528081 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbb400f9a0 con 0x55b8033a1910 2024-09-11T01:09:25.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.693+0000 7fdba4c00640 1 -- 172.21.15.103:0/4066528081 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdba801ee20 con 0x55b8033a1910 2024-09-11T01:09:25.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.693+0000 7fdbc43c1740 10 client.25505 fetch_fsmap learned FSMap version 26 2024-09-11T01:09:25.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.693+0000 7fdbc43c1740 1 -- 172.21.15.103:0/4066528081 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b8030dc960 con 0x55b8033a1910 2024-09-11T01:09:25.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.693+0000 7fdba4c00640 1 -- 172.21.15.103:0/4066528081 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbb400f9a0 con 0x55b8033a1910 2024-09-11T01:09:25.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.693+0000 7fdba4c00640 1 -- 172.21.15.103:0/4066528081 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdba80b3390 con 0x55b8033a1910 2024-09-11T01:09:25.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.693+0000 7fdbc43c1740 10 client.25505 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:09:25.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.693+0000 7fdbc43c1740 10 client.25505 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:09:25.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.693+0000 7fdbc43c1740 20 client.25505 populate_metadata read hostname 'smithi103' 2024-09-11T01:09:25.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.693+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/4066528081 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b8033bd5a0 0x55b8033bf990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.693+0000 7fdbc43c1740 4 client.25505 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:09:25.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.693+0000 7fdbc43c1740 1 -- 172.21.15.103:0/4066528081 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b80331a1e0 con 0x55b8033bd5a0 2024-09-11T01:09:25.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.694+0000 7fdbbaa00640 1 --2- 172.21.15.103:0/4066528081 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b8033bd5a0 0x55b8033bf990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.694+0000 7fdbbaa00640 1 --2- 172.21.15.103:0/4066528081 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b8033bd5a0 0x55b8033bf990 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2292b6b091e5c748 server_cookie=ee6e20384656008a in_seq=0 out_seq=0 2024-09-11T01:09:25.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.694+0000 7fdba4c00640 10 client.25505 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:25.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.695+0000 7fdba4c00640 1 -- 172.21.15.103:0/4066528081 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b80331a1e0 con 0x55b8033bd5a0 2024-09-11T01:09:25.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.695+0000 7fdba4c00640 10 client.25505 handle_command_reply: tid=0 2024-09-11T01:09:25.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.695+0000 7fdbc43c1740 1 client.25505 shutdown 2024-09-11T01:09:25.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.696+0000 7fdbc43c1740 1 -- 172.21.15.103:0/4066528081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033a1910 msgr2=0x55b8033aae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.696+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/4066528081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033a1910 0x55b8033aae20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdba80eb960 tx=0x7fdba80ebde0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.696+0000 7fdbc43c1740 1 -- 172.21.15.103:0/4066528081 shutdown_connections 2024-09-11T01:09:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.696+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/4066528081 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b8033bd5a0 0x55b8033bf990 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.696+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/4066528081 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033ad8a0 0x55b8033ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.696+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/4066528081 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033a1910 0x55b8033aae20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.696+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/4066528081 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a0ff0 0x55b8033aa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.696+0000 7fdbc43c1740 1 -- 172.21.15.103:0/4066528081 >> 172.21.15.103:0/4066528081 conn(0x55b80339ee20 msgr2=0x55b8033a49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.696+0000 7fdba4c00640 0 client.25505 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.696+0000 7fdbc43c1740 1 -- 172.21.15.103:0/4066528081 shutdown_connections 2024-09-11T01:09:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.696+0000 7fdbc43c1740 1 -- 172.21.15.103:0/4066528081 wait complete. 2024-09-11T01:09:25.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.696+0000 7fdbc43c1740 20 client.25505 trim_cache size 0 max 16384 2024-09-11T01:09:25.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.714+0000 7fdbc43c1740 1 Processor -- start 2024-09-11T01:09:25.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.714+0000 7fdbc43c1740 1 -- start start 2024-09-11T01:09:25.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.715+0000 7fdbc43c1740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a0ff0 0x55b8033a5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.715+0000 7fdbc43c1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a1910 0x55b8033ac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.715+0000 7fdbc43c1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 0x55b8033a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.715+0000 7fdbc43c1740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1b0220 con 0x55b8033a0ff0 2024-09-11T01:09:25.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.715+0000 7fdbc43c1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1adaf0 con 0x55b8033ad8a0 2024-09-11T01:09:25.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.715+0000 7fdbc43c1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1ab960 con 0x55b8033a1910 2024-09-11T01:09:25.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.715+0000 7fdbbaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a0ff0 0x55b8033a5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.715+0000 7fdbbb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 0x55b8033a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.715+0000 7fdbbb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 0x55b8033a7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:54454/0 (socket says 172.21.15.103:54454) 2024-09-11T01:09:25.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.715+0000 7fdbbb400640 1 -- 172.21.15.103:0/3799907944 learned_addr learned my addr 172.21.15.103:0/3799907944 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:25.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.715+0000 7fdbba000640 1 --2- 172.21.15.103:0/3799907944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a1910 0x55b8033ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.716+0000 7fdbbb400640 1 -- 172.21.15.103:0/3799907944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a1910 msgr2=0x55b8033ac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:25.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.716+0000 7fdbbb400640 1 --2- 172.21.15.103:0/3799907944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a1910 0x55b8033ac580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.716+0000 7fdbbb400640 1 -- 172.21.15.103:0/3799907944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a0ff0 msgr2=0x55b8033a5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:25.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.716+0000 7fdbbb400640 1 --2- 172.21.15.103:0/3799907944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a0ff0 0x55b8033a5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.716+0000 7fdbbb400640 1 -- 172.21.15.103:0/3799907944 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8033a0500 con 0x55b8033ad8a0 2024-09-11T01:09:25.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.716+0000 7fdbba000640 1 --2- 172.21.15.103:0/3799907944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a1910 0x55b8033ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:25.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.716+0000 7fdbbb400640 1 --2- 172.21.15.103:0/3799907944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 0x55b8033a7af0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400f790 tx=0x7fdbb4009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a960ad016e945b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:25.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.716+0000 7fdba7400640 1 -- 172.21.15.103:0/3799907944 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4028020 con 0x55b8033ad8a0 2024-09-11T01:09:25.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.716+0000 7fdba7400640 1 -- 172.21.15.103:0/3799907944 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbb400f9a0 con 0x55b8033ad8a0 2024-09-11T01:09:25.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.716+0000 7fdba7400640 1 -- 172.21.15.103:0/3799907944 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4004580 con 0x55b8033ad8a0 2024-09-11T01:09:25.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.717+0000 7fdbc43c1740 1 -- 172.21.15.103:0/3799907944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 msgr2=0x55b8033a7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.717+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/3799907944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 0x55b8033a7af0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400f790 tx=0x7fdbb4009f90 comp rx=0 tx=0).stop 2024-09-11T01:09:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.717+0000 7fdbc43c1740 1 -- 172.21.15.103:0/3799907944 shutdown_connections 2024-09-11T01:09:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.717+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/3799907944 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 0x55b8033a7af0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.717+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/3799907944 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a1910 0x55b8033ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.717+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/3799907944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a0ff0 0x55b8033a5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.717+0000 7fdbc43c1740 1 -- 172.21.15.103:0/3799907944 >> 172.21.15.103:0/3799907944 conn(0x55b80339ee20 msgr2=0x55b8033b8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.717+0000 7fdbc43c1740 1 -- 172.21.15.103:0/3799907944 shutdown_connections 2024-09-11T01:09:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.717+0000 7fdbc43c1740 1 -- 172.21.15.103:0/3799907944 wait complete. 2024-09-11T01:09:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.718+0000 7fdbc43c1740 1 -- start start 2024-09-11T01:09:25.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.718+0000 7fdbc43c1740 1 Processor -- start 2024-09-11T01:09:25.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.719+0000 7fdbc43c1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a0ff0 0x55b8033b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.719+0000 7fdbc43c1740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a1910 0x55b8033b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.719+0000 7fdbc43c1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 0x55b803423d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.719+0000 7fdbc43c1740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1abfb0 con 0x55b8033a1910 2024-09-11T01:09:25.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.719+0000 7fdbc43c1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1ad420 con 0x55b8033ad8a0 2024-09-11T01:09:25.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.719+0000 7fdbc43c1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1ac680 con 0x55b8033a0ff0 2024-09-11T01:09:25.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.719+0000 7fdbc43c1740 10 client.0 _ll_register_callbacks cb 0x7fdba8004eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:25.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.719+0000 7fdbba000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a1910 0x55b8033b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.719+0000 7fdbba000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a1910 0x55b8033b60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39680/0 (socket says 172.21.15.103:39680) 2024-09-11T01:09:25.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.719+0000 7fdbba000640 1 -- 172.21.15.103:0/2776145965 learned_addr learned my addr 172.21.15.103:0/2776145965 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:25.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.719+0000 7fdbbaa00640 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a0ff0 0x55b8033b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.719+0000 7fdbbb400640 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 0x55b803423d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.720+0000 7fdbba000640 1 -- 172.21.15.103:0/2776145965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a0ff0 msgr2=0x55b8033b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:25.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.720+0000 7fdbba000640 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a0ff0 0x55b8033b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.720+0000 7fdbba000640 1 -- 172.21.15.103:0/2776145965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 msgr2=0x55b803423d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:25.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.720+0000 7fdbba000640 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 0x55b803423d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.720+0000 7fdbba000640 1 -- 172.21.15.103:0/2776145965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b803424540 con 0x55b8033a1910 2024-09-11T01:09:25.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.720+0000 7fdbbaa00640 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a0ff0 0x55b8033b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:25.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.720+0000 7fdbbb400640 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 0x55b803423d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:25.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.720+0000 7fdbba000640 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a1910 0x55b8033b60e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdba800cce0 tx=0x7fdba80055d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f94257db00314f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:25.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.720+0000 7fdba4c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:09:25.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.720+0000 7fdba4c00640 1 -- 172.21.15.103:0/2776145965 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba800ce10 con 0x55b8033a1910 2024-09-11T01:09:25.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.720+0000 7fdba4c00640 1 -- 172.21.15.103:0/2776145965 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fdba80cf3c0 con 0x55b8033a1910 2024-09-11T01:09:25.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.720+0000 7fdbc43c1740 1 -- 172.21.15.103:0/2776145965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbb400f9a0 con 0x55b8033a1910 2024-09-11T01:09:25.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.721+0000 7fdba4c00640 1 -- 172.21.15.103:0/2776145965 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdba80641a0 con 0x55b8033a1910 2024-09-11T01:09:25.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.721+0000 7fdbc43c1740 10 client.15501 fetch_fsmap learned FSMap version 26 2024-09-11T01:09:25.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.721+0000 7fdbc43c1740 1 -- 172.21.15.103:0/2776145965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b80343c080 con 0x55b8033a1910 2024-09-11T01:09:25.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.721+0000 7fdba4c00640 1 -- 172.21.15.103:0/2776145965 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbb400f9a0 con 0x55b8033a1910 2024-09-11T01:09:25.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.721+0000 7fdba4c00640 1 -- 172.21.15.103:0/2776145965 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdba80b0210 con 0x55b8033a1910 2024-09-11T01:09:25.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.721+0000 7fdbc43c1740 10 client.15501 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:09:25.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.721+0000 7fdbc43c1740 10 client.15501 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:09:25.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.721+0000 7fdbc43c1740 20 client.15501 populate_metadata read hostname 'smithi103' 2024-09-11T01:09:25.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.721+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b80343c870 0x55b80343ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:25.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.721+0000 7fdbc43c1740 4 client.15501 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ee7d2312", "release": true, "await": true}] 2024-09-11T01:09:25.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.721+0000 7fdbc43c1740 1 -- 172.21.15.103:0/2776145965 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ee7d2312", "release": true, "await": true}) -- 0x55b803315c90 con 0x55b80343c870 2024-09-11T01:09:25.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.722+0000 7fdbbaa00640 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b80343c870 0x55b80343ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:25.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.722+0000 7fdba4c00640 10 client.15501 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:25.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.722+0000 7fdbbaa00640 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b80343c870 0x55b80343ec90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ee928f9bf6034d0 server_cookie=997db8233393cdc0 in_seq=0 out_seq=0 2024-09-11T01:09:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.725+0000 7fdba4c00640 1 -- 172.21.15.103:0/2776145965 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b803315c90 con 0x55b80343c870 2024-09-11T01:09:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.725+0000 7fdba4c00640 10 client.15501 handle_command_reply: tid=0 2024-09-11T01:09:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.725+0000 7fdbc43c1740 1 client.15501 shutdown 2024-09-11T01:09:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.725+0000 7fdbc43c1740 1 -- 172.21.15.103:0/2776145965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a1910 msgr2=0x55b8033b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.725+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a1910 0x55b8033b60e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdba800cce0 tx=0x7fdba80055d0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.725+0000 7fdbc43c1740 1 -- 172.21.15.103:0/2776145965 shutdown_connections 2024-09-11T01:09:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.725+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b8033ad8a0 0x55b803423d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.725+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8033a1910 0x55b8033b60e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.725+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b80343c870 0x55b80343ec90 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.725+0000 7fdbc43c1740 1 --2- 172.21.15.103:0/2776145965 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b8033a0ff0 0x55b8033b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.725+0000 7fdbc43c1740 1 -- 172.21.15.103:0/2776145965 >> 172.21.15.103:0/2776145965 conn(0x55b80339ee20 msgr2=0x55b8033a9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.725+0000 7fdba4c00640 0 client.15501 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:25.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.725+0000 7fdbc43c1740 1 -- 172.21.15.103:0/2776145965 shutdown_connections 2024-09-11T01:09:25.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.726+0000 7fdbc43c1740 1 -- 172.21.15.103:0/2776145965 wait complete. 2024-09-11T01:09:25.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.726+0000 7fdbc43c1740 20 client.15501 trim_cache size 0 max 16384 2024-09-11T01:09:25.729 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:09:25.729 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 26, 2024-09-11T01:09:25.729 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24665, 2024-09-11T01:09:25.729 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 4, 2024-09-11T01:09:25.729 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-09-11T01:09:25.729 INFO:teuthology.orchestra.run.smithi103.stdout: "ee7d2312": { 2024-09-11T01:09:25.729 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 4, 2024-09-11T01:09:25.729 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-09-11T01:09:25.729 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:09:25.729 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RELEASED", 2024-09-11T01:09:25.729 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:09:25.729 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:09:25.729 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-09-11T01:09:25.730 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 145.2, 2024-09-11T01:09:25.730 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-09-11T01:09:25.730 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-09-11T01:09:25.730 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-09-11T01:09:25.730 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:09:25.730 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RELEASED", 2024-09-11T01:09:25.730 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:09:25.730 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:09:25.730 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:09:25.730 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:09:25.730 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:09:25.730 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:09:25.730 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:09:25.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.726+0000 7fdbc1800640 1 -- 172.21.15.103:0/3166702161 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fdba00b5370 msgr2=0x7fdba00b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.726+0000 7fdbc1800640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fdba00b5370 0x7fdba00b7830 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0057c0 tx=0x7fdbac02c040 comp rx=0 tx=0).stop 2024-09-11T01:09:25.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.726+0000 7fdbc1800640 1 -- 172.21.15.103:0/3166702161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbbc075f40 msgr2=0x7fdbbc19b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:25.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.726+0000 7fdbc1800640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbbc075f40 0x7fdbbc19b9d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdba8016fd0 tx=0x7fdba800c7e0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.727+0000 7fdbc1800640 1 -- 172.21.15.103:0/3166702161 shutdown_connections 2024-09-11T01:09:25.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.727+0000 7fdbc1800640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fdba00b5370 0x7fdba00b7830 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.727+0000 7fdbc1800640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc10f3b0 0x7fdbbc1a0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.727+0000 7fdbc1800640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fdbbc075f40 0x7fdbbc19b9d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.727+0000 7fdbc1800640 1 --2- 172.21.15.103:0/3166702161 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdbbc075540 0x7fdbbc19b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:25.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.727+0000 7fdbc1800640 1 -- 172.21.15.103:0/3166702161 >> 172.21.15.103:0/3166702161 conn(0x7fdbbc0fe820 msgr2=0x7fdbbc0ff480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:25.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.727+0000 7fdbc1800640 1 -- 172.21.15.103:0/3166702161 shutdown_connections 2024-09-11T01:09:25.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:09:25.727+0000 7fdbc1800640 1 -- 172.21.15.103:0/3166702161 wait complete. 2024-09-11T01:09:26.024 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:25 smithi117 ceph-mon[35358]: pgmap v432: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T01:09:26.055 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:25 smithi103 ceph-mon[30562]: pgmap v432: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T01:09:26.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:25 smithi183 ceph-mon[34992]: pgmap v432: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-11T01:09:26.912 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'ee7d2312', total seconds elapsed: 29.7 2024-09-11T01:09:28.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:28 smithi183 ceph-mon[34992]: pgmap v433: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:09:29.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:28 smithi103 ceph-mon[30562]: pgmap v433: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:09:29.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:28 smithi117 ceph-mon[35358]: pgmap v433: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-11T01:09:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:30 smithi183 ceph-mon[34992]: pgmap v434: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:09:31.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:30 smithi103 ceph-mon[30562]: pgmap v434: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:09:31.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:30 smithi117 ceph-mon[35358]: pgmap v434: 129 pgs: 129 active+clean; 670 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-09-11T01:09:32.709 INFO:tasks.workunit.client.0.smithi103.stderr:Updating files: 65% (7909/12088) Updating files: 66% (7979/12088) Updating files: 67% (8099/12088) Updating files: 68% (8220/12088) Updating files: 69% (8341/12088) Updating files: 70% (8462/12088) Updating files: 71% (8583/12088) Updating files: 72% (8704/12088) Updating files: 73% (8825/12088) Updating files: 74% (8946/12088) Updating files: 75% (9066/12088) Updating files: 76% (9187/12088) Updating files: 77% (9308/12088) Updating files: 78% (9429/12088) Updating files: 79% (9550/12088) Updating files: 80% (9671/12088) Updating files: 81% (9792/12088) Updating files: 82% (9913/12088) Updating files: 83% (10034/12088) Updating files: 84% (10154/12088) Updating files: 85% (10275/12088) Updating files: 86% (10396/12088) Updating files: 87% (10517/12088) Updating files: 88% (10638/12088) Updating files: 89% (10759/12088) Updating files: 90% (10880/12088) Updating files: 91% (11001/12088) Updating files: 92% (11121/12088) Updating files: 93% (11242/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-11T01:09:32.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:32 smithi183 ceph-mon[34992]: pgmap v435: 129 pgs: 129 active+clean; 671 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:09:33.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:32 smithi103 ceph-mon[30562]: pgmap v435: 129 pgs: 129 active+clean; 671 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:09:33.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:32 smithi117 ceph-mon[35358]: pgmap v435: 129 pgs: 129 active+clean; 671 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:09:34.023 INFO:tasks.workunit.client.0.smithi103.stderr:Note: switching to '8f219c476cb4f26fc5719c661c0323719a45cb30'. 2024-09-11T01:09:34.024 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-11T01:09:34.024 INFO:tasks.workunit.client.0.smithi103.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-11T01:09:34.024 INFO:tasks.workunit.client.0.smithi103.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-11T01:09:34.024 INFO:tasks.workunit.client.0.smithi103.stderr:state without impacting any branches by switching back to a branch. 2024-09-11T01:09:34.024 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-11T01:09:34.024 INFO:tasks.workunit.client.0.smithi103.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-11T01:09:34.024 INFO:tasks.workunit.client.0.smithi103.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-11T01:09:34.024 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-11T01:09:34.024 INFO:tasks.workunit.client.0.smithi103.stderr: git switch -c 2024-09-11T01:09:34.024 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-11T01:09:34.024 INFO:tasks.workunit.client.0.smithi103.stderr:Or undo this operation with: 2024-09-11T01:09:34.024 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-11T01:09:34.025 INFO:tasks.workunit.client.0.smithi103.stderr: git switch - 2024-09-11T01:09:34.025 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-11T01:09:34.025 INFO:tasks.workunit.client.0.smithi103.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-11T01:09:34.025 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-09-11T01:09:34.025 INFO:tasks.workunit.client.0.smithi103.stderr:HEAD is now at 8f219c476cb Merge branch 'mgr-vol-mod-disable' of https://github.com/rishabh-d-dave/ceph into wip-hemanth-testing-2024-09-10-0723 2024-09-11T01:09:34.035 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-11T01:09:34.080 INFO:tasks.workunit.client.0.smithi103.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-11T01:09:34.085 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T01:09:34.085 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-11T01:09:34.803 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-11T01:09:34.905 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-11T01:09:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:34 smithi183 ceph-mon[34992]: pgmap v436: 129 pgs: 129 active+clean; 671 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:09:34.970 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-11T01:09:34.974 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T01:09:34.974 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-11T01:09:35.039 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-11T01:09:35.046 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T01:09:35.046 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-11T01:09:35.082 INFO:tasks.workunit:Running workunits matching suites/ffsb.sh on client.0... 2024-09-11T01:09:35.083 INFO:tasks.workunit:Running workunit suites/ffsb.sh... 2024-09-11T01:09:35.083 DEBUG:teuthology.orchestra.run.smithi103:workunit test suites/ffsb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8f219c476cb4f26fc5719c661c0323719a45cb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-11T01:09:35.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:34 smithi103 ceph-mon[30562]: pgmap v436: 129 pgs: 129 active+clean; 671 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:09:35.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:34 smithi117 ceph-mon[35358]: pgmap v436: 129 pgs: 129 active+clean; 671 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:09:35.172 INFO:tasks.workunit.client.0.smithi103.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh 2024-09-11T01:09:35.173 INFO:tasks.workunit.client.0.smithi103.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/suites 2024-09-11T01:09:35.173 INFO:tasks.workunit.client.0.smithi103.stderr:+ trap -- retry EXIT 2024-09-11T01:09:35.173 INFO:tasks.workunit.client.0.smithi103.stderr:+ rm -rf ffsb 2024-09-11T01:09:35.175 INFO:tasks.workunit.client.0.smithi103.stderr:+ timeout 1800 git clone https://git.ceph.com/ffsb.git --depth 1 2024-09-11T01:09:35.181 INFO:tasks.workunit.client.0.smithi103.stderr:Cloning into 'ffsb'... 2024-09-11T01:09:36.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:35 smithi103 ceph-mon[30562]: pgmap v437: 129 pgs: 129 active+clean; 671 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:09:36.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:35 smithi117 ceph-mon[35358]: pgmap v437: 129 pgs: 129 active+clean; 671 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:09:36.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:35 smithi183 ceph-mon[34992]: pgmap v437: 129 pgs: 129 active+clean; 671 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-11T01:09:36.170 INFO:tasks.workunit.client.0.smithi103.stderr:+ trap - EXIT 2024-09-11T01:09:36.170 INFO:tasks.workunit.client.0.smithi103.stderr:+ cd ffsb 2024-09-11T01:09:36.170 INFO:tasks.workunit.client.0.smithi103.stderr:+ ./configure 2024-09-11T01:09:36.423 INFO:tasks.workunit.client.0.smithi103.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-11T01:09:37.436 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether build environment is sane... yes 2024-09-11T01:09:37.454 INFO:tasks.workunit.client.0.smithi103.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-11T01:09:37.454 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gawk... gawk 2024-09-11T01:09:37.479 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether make sets $(MAKE)... yes 2024-09-11T01:09:37.547 INFO:tasks.workunit.client.0.smithi103.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-11T01:09:37.547 INFO:tasks.workunit.client.0.smithi103.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-11T01:09:37.562 INFO:tasks.workunit.client.0.smithi103.stdout:checking for style of include used by make... GNU 2024-09-11T01:09:37.567 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc... gcc 2024-09-11T01:09:37.663 INFO:tasks.workunit.client.0.smithi103.stdout:checking for C compiler default output file name... a.out 2024-09-11T01:09:37.667 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether the C compiler works... yes 2024-09-11T01:09:37.670 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are cross compiling... no 2024-09-11T01:09:37.731 INFO:tasks.workunit.client.0.smithi103.stdout:checking for suffix of executables... 2024-09-11T01:09:37.788 INFO:tasks.workunit.client.0.smithi103.stdout:checking for suffix of object files... o 2024-09-11T01:09:37.841 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are using the GNU C compiler... yes 2024-09-11T01:09:37.896 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether gcc accepts -g... yes 2024-09-11T01:09:38.017 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-11T01:09:38.169 INFO:tasks.workunit.client.0.smithi103.stdout:checking dependency style of gcc... gcc3 2024-09-11T01:09:38.265 INFO:tasks.workunit.client.0.smithi103.stdout:checking how to run the C preprocessor... gcc -E 2024-09-11T01:09:38.342 INFO:tasks.workunit.client.0.smithi103.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-11T01:09:38.345 INFO:tasks.workunit.client.0.smithi103.stdout:checking for egrep... /usr/bin/grep -E 2024-09-11T01:09:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.347+0000 7f21efc00640 1 -- 172.21.15.103:0/3529483720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21e8103ae0 msgr2=0x7f21e8103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.347+0000 7f21efc00640 1 --2- 172.21.15.103:0/3529483720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21e8103ae0 0x7f21e8103f60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f21d4009890 tx=0x7f21d402a360 comp rx=0 tx=0).stop 2024-09-11T01:09:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.347+0000 7f21efc00640 1 -- 172.21.15.103:0/3529483720 shutdown_connections 2024-09-11T01:09:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.347+0000 7f21efc00640 1 --2- 172.21.15.103:0/3529483720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21e81044a0 0x7f21e810ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.347+0000 7f21efc00640 1 --2- 172.21.15.103:0/3529483720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21e8103ae0 0x7f21e8103f60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.347+0000 7f21efc00640 1 --2- 172.21.15.103:0/3529483720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e8102990 0x7f21e8102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.347+0000 7f21efc00640 1 -- 172.21.15.103:0/3529483720 >> 172.21.15.103:0/3529483720 conn(0x7f21e80fe250 msgr2=0x7f21e8100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.347+0000 7f21efc00640 1 -- 172.21.15.103:0/3529483720 shutdown_connections 2024-09-11T01:09:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.347+0000 7f21efc00640 1 -- 172.21.15.103:0/3529483720 wait complete. 2024-09-11T01:09:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.348+0000 7f21efc00640 1 Processor -- start 2024-09-11T01:09:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.348+0000 7f21efc00640 1 -- start start 2024-09-11T01:09:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.348+0000 7f21efc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21e8102990 0x7f21e8198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.348+0000 7f21efc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21e8103ae0 0x7f21e8199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.348+0000 7f21efc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e81044a0 0x7f21e819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.348+0000 7f21efc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f21e810e600 con 0x7f21e8103ae0 2024-09-11T01:09:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.348+0000 7f21efc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f21e810e480 con 0x7f21e81044a0 2024-09-11T01:09:38.353 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.348+0000 7f21efc00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f21e810e780 con 0x7f21e8102990 2024-09-11T01:09:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.349+0000 7f21e7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21e8103ae0 0x7f21e8199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.349+0000 7f21e7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21e8103ae0 0x7f21e8199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33320/0 (socket says 172.21.15.103:33320) 2024-09-11T01:09:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.349+0000 7f21e7e00640 1 -- 172.21.15.103:0/832969972 learned_addr learned my addr 172.21.15.103:0/832969972 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.349+0000 7f21ed200640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21e8102990 0x7f21e8198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.349+0000 7f21edc00640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e81044a0 0x7f21e819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.349+0000 7f21e7e00640 1 -- 172.21.15.103:0/832969972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21e8102990 msgr2=0x7f21e8198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.349+0000 7f21e7e00640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21e8102990 0x7f21e8198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.349+0000 7f21e7e00640 1 -- 172.21.15.103:0/832969972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e81044a0 msgr2=0x7f21e819a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.349+0000 7f21e7e00640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e81044a0 0x7f21e819a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.349+0000 7f21e7e00640 1 -- 172.21.15.103:0/832969972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e819a8f0 con 0x7f21e8103ae0 2024-09-11T01:09:38.354 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.349+0000 7f21edc00640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e81044a0 0x7f21e819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.349+0000 7f21e7e00640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21e8103ae0 0x7f21e8199400 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f21d4032d80 tx=0x7f21d4032db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.350+0000 7f21e5600640 1 -- 172.21.15.103:0/832969972 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4037040 con 0x7f21e8103ae0 2024-09-11T01:09:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.350+0000 7f21e5600640 1 -- 172.21.15.103:0/832969972 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21d4041070 con 0x7f21e8103ae0 2024-09-11T01:09:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.350+0000 7f21efc00640 1 -- 172.21.15.103:0/832969972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e819ab80 con 0x7f21e8103ae0 2024-09-11T01:09:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.350+0000 7f21e5600640 1 -- 172.21.15.103:0/832969972 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4003850 con 0x7f21e8103ae0 2024-09-11T01:09:38.355 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.350+0000 7f21efc00640 1 -- 172.21.15.103:0/832969972 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e81a12b0 con 0x7f21e8103ae0 2024-09-11T01:09:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.353+0000 7f21f2c14740 1 Processor -- start 2024-09-11T01:09:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.353+0000 7f21f2c14740 1 -- start start 2024-09-11T01:09:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.353+0000 7f21f2c14740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf4790 0x55a451bf6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.353+0000 7f21f2c14740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451bf94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.357 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.353+0000 7f21f2c14740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf9b00 0x55a451bfbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.354+0000 7f21f2c14740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a451b676b0 con 0x55a451bf9b00 2024-09-11T01:09:38.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.354+0000 7f21f2c14740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a451b56ae0 con 0x55a451bf70c0 2024-09-11T01:09:38.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.354+0000 7f21f2c14740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a451b5a8f0 con 0x55a451bf4790 2024-09-11T01:09:38.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.354+0000 7f21edc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf4790 0x55a451bf6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.354+0000 7f21edc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf4790 0x55a451bf6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:35568/0 (socket says 172.21.15.103:35568) 2024-09-11T01:09:38.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.354+0000 7f21edc00640 1 -- 172.21.15.103:0/3955966769 learned_addr learned my addr 172.21.15.103:0/3955966769 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:38.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.354+0000 7f21ed200640 1 --2- 172.21.15.103:0/3955966769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451bf94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.354+0000 7f21edc00640 1 -- 172.21.15.103:0/3955966769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 msgr2=0x55a451bf94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:38.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.354+0000 7f21edc00640 1 --2- 172.21.15.103:0/3955966769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451bf94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.354+0000 7f21edc00640 1 -- 172.21.15.103:0/3955966769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf9b00 msgr2=0x55a451bfbfc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:09:38.358 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.354+0000 7f21edc00640 1 --2- 172.21.15.103:0/3955966769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf9b00 0x55a451bfbfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.354+0000 7f21edc00640 1 -- 172.21.15.103:0/3955966769 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a451b23780 con 0x55a451bf4790 2024-09-11T01:09:38.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.354+0000 7f21ed200640 1 --2- 172.21.15.103:0/3955966769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451bf94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:09:38.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.354+0000 7f21edc00640 1 --2- 172.21.15.103:0/3955966769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf4790 0x55a451bf6b80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f21e00117a0 tx=0x7f21e0011c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0617e5d5fdb21a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:38.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.355+0000 7f21e5600640 1 -- 172.21.15.103:0/832969972 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 153302+0+0 (secure 0 0 0) 0x7f21d4030520 con 0x7f21e8103ae0 2024-09-11T01:09:38.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.355+0000 7f21da000640 1 -- 172.21.15.103:0/3955966769 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e0011220 con 0x55a451bf4790 2024-09-11T01:09:38.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.355+0000 7f21da000640 1 -- 172.21.15.103:0/3955966769 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21e000f9a0 con 0x55a451bf4790 2024-09-11T01:09:38.359 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.355+0000 7f21da000640 1 -- 172.21.15.103:0/3955966769 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e0004530 con 0x55a451bf4790 2024-09-11T01:09:38.364 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.356+0000 7f21f2c14740 1 -- 172.21.15.103:0/3955966769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf4790 msgr2=0x55a451bf6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:38.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.356+0000 7f21f2c14740 1 --2- 172.21.15.103:0/3955966769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf4790 0x55a451bf6b80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f21e00117a0 tx=0x7f21e0011c60 comp rx=0 tx=0).stop 2024-09-11T01:09:38.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.356+0000 7f21f2c14740 1 -- 172.21.15.103:0/3955966769 shutdown_connections 2024-09-11T01:09:38.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.356+0000 7f21f2c14740 1 --2- 172.21.15.103:0/3955966769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf9b00 0x55a451bfbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.356+0000 7f21f2c14740 1 --2- 172.21.15.103:0/3955966769 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451bf94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.356+0000 7f21f2c14740 1 --2- 172.21.15.103:0/3955966769 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf4790 0x55a451bf6b80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.356+0000 7f21f2c14740 1 -- 172.21.15.103:0/3955966769 >> 172.21.15.103:0/3955966769 conn(0x55a451bef8e0 msgr2=0x55a451bf0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:38.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.356+0000 7f21f2c14740 1 -- 172.21.15.103:0/3955966769 shutdown_connections 2024-09-11T01:09:38.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.356+0000 7f21f2c14740 1 -- 172.21.15.103:0/3955966769 wait complete. 2024-09-11T01:09:38.365 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.357+0000 7f21f2c14740 1 -- start start 2024-09-11T01:09:38.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.357+0000 7f21e5600640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f21d00b5320 0x7f21d00b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.357+0000 7f21f2c14740 1 Processor -- start 2024-09-11T01:09:38.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.357+0000 7f21e5600640 1 -- 172.21.15.103:0/832969972 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f21d4105c50 con 0x7f21e8103ae0 2024-09-11T01:09:38.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.357+0000 7f21edc00640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f21d00b5320 0x7f21d00b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21f2c14740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf4790 0x55a451c022e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21f2c14740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451c02980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21f2c14740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf9b00 0x55a451c03550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21f2c14740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a451a8eab0 con 0x55a451bf4790 2024-09-11T01:09:38.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21f2c14740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a451afd570 con 0x55a451bf70c0 2024-09-11T01:09:38.366 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21f2c14740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a451bfcae0 con 0x55a451bf9b00 2024-09-11T01:09:38.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21f2c14740 10 client.0 _ll_register_callbacks cb 0x55a451b0c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:38.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21edc00640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f21d00b5320 0x7f21d00b77e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f21e000a010 tx=0x7f21e0005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:38.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21ed200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf4790 0x55a451c022e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21edc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf9b00 0x55a451c03550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21ed200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf4790 0x55a451c022e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33322/0 (socket says 172.21.15.103:33322) 2024-09-11T01:09:38.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21ed200640 1 -- 172.21.15.103:0/3231136279 learned_addr learned my addr 172.21.15.103:0/3231136279 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:38.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21e7e00640 1 --2- 172.21.15.103:0/3231136279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451c02980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21ed200640 1 -- 172.21.15.103:0/3231136279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf9b00 msgr2=0x55a451c03550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:38.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21ed200640 1 --2- 172.21.15.103:0/3231136279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf9b00 0x55a451c03550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21ed200640 1 -- 172.21.15.103:0/3231136279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 msgr2=0x55a451c02980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:38.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21ed200640 1 --2- 172.21.15.103:0/3231136279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451c02980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.358+0000 7f21ed200640 1 -- 172.21.15.103:0/3231136279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4518b8790 con 0x55a451bf4790 2024-09-11T01:09:38.367 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.359+0000 7f21ed200640 1 --2- 172.21.15.103:0/3231136279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf4790 0x55a451c022e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f21dc011730 tx=0x7f21dc011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d956ff66d7daf833 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:38.368 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.359+0000 7f21cea00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:09:38.368 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.359+0000 7f21cea00640 1 -- 172.21.15.103:0/3231136279 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc00fb30 con 0x55a451bf4790 2024-09-11T01:09:38.368 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.359+0000 7f21cea00640 1 -- 172.21.15.103:0/3231136279 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f21dc00fcd0 con 0x55a451bf4790 2024-09-11T01:09:38.368 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.359+0000 7f21f2c14740 1 -- 172.21.15.103:0/3231136279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21e000f9a0 con 0x55a451bf4790 2024-09-11T01:09:38.368 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.359+0000 7f21cea00640 1 -- 172.21.15.103:0/3231136279 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f21dc027050 con 0x55a451bf4790 2024-09-11T01:09:38.368 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.359+0000 7f21f2c14740 10 client.15510 fetch_fsmap learned FSMap version 26 2024-09-11T01:09:38.368 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.359+0000 7f21f2c14740 1 -- 172.21.15.103:0/3231136279 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a451931620 con 0x55a451bf4790 2024-09-11T01:09:38.368 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.359+0000 7f21cea00640 1 -- 172.21.15.103:0/3231136279 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21e000f9a0 con 0x55a451bf4790 2024-09-11T01:09:38.368 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.360+0000 7f21cea00640 1 -- 172.21.15.103:0/3231136279 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f21dc022030 con 0x55a451bf4790 2024-09-11T01:09:38.369 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.360+0000 7f21f2c14740 10 client.15510 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:09:38.369 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.360+0000 7f21f2c14740 10 client.15510 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:09:38.369 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.360+0000 7f21f2c14740 20 client.15510 populate_metadata read hostname 'smithi103' 2024-09-11T01:09:38.369 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.360+0000 7f21f2c14740 1 --2- 172.21.15.103:0/3231136279 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55a451c0dd10 0x55a451c10120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.369 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.360+0000 7f21f2c14740 4 client.15510 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:09:38.369 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.360+0000 7f21f2c14740 1 -- 172.21.15.103:0/3231136279 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a451b69600 con 0x55a451c0dd10 2024-09-11T01:09:38.369 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.360+0000 7f21e7e00640 1 --2- 172.21.15.103:0/3231136279 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55a451c0dd10 0x55a451c10120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.369 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.360+0000 7f21cea00640 10 client.15510 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:38.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.360+0000 7f21e7e00640 1 --2- 172.21.15.103:0/3231136279 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55a451c0dd10 0x55a451c10120 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81239dab0dfc6470 server_cookie=cb26d82919dad7b9 in_seq=0 out_seq=0 2024-09-11T01:09:38.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.361+0000 7f21cea00640 1 -- 172.21.15.103:0/3231136279 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a451b69600 con 0x55a451c0dd10 2024-09-11T01:09:38.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.361+0000 7f21cea00640 10 client.15510 handle_command_reply: tid=0 2024-09-11T01:09:38.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.361+0000 7f21f2c14740 1 client.15510 shutdown 2024-09-11T01:09:38.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.361+0000 7f21f2c14740 1 -- 172.21.15.103:0/3231136279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf4790 msgr2=0x55a451c022e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:38.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.361+0000 7f21f2c14740 1 --2- 172.21.15.103:0/3231136279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf4790 0x55a451c022e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f21dc011730 tx=0x7f21dc011bf0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.361+0000 7f21f2c14740 1 -- 172.21.15.103:0/3231136279 shutdown_connections 2024-09-11T01:09:38.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.361+0000 7f21f2c14740 1 --2- 172.21.15.103:0/3231136279 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55a451c0dd10 0x55a451c10120 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.362+0000 7f21f2c14740 1 --2- 172.21.15.103:0/3231136279 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf9b00 0x55a451c03550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.362+0000 7f21f2c14740 1 --2- 172.21.15.103:0/3231136279 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451c02980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.362+0000 7f21f2c14740 1 --2- 172.21.15.103:0/3231136279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf4790 0x55a451c022e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.362+0000 7f21f2c14740 1 -- 172.21.15.103:0/3231136279 >> 172.21.15.103:0/3231136279 conn(0x55a451bef8e0 msgr2=0x55a451beea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.362+0000 7f21cea00640 0 client.15510 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.362+0000 7f21f2c14740 1 -- 172.21.15.103:0/3231136279 shutdown_connections 2024-09-11T01:09:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.362+0000 7f21f2c14740 1 -- 172.21.15.103:0/3231136279 wait complete. 2024-09-11T01:09:38.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.362+0000 7f21f2c14740 20 client.15510 trim_cache size 0 max 16384 2024-09-11T01:09:38.372 INFO:tasks.workunit.client.0.smithi103.stdout:checking for AIX... no 2024-09-11T01:09:38.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21f2c14740 1 Processor -- start 2024-09-11T01:09:38.383 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21f2c14740 1 -- start start 2024-09-11T01:09:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21f2c14740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf4790 0x55a451bea960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21f2c14740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451c0a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21f2c14740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf9b00 0x55a451bf2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21f2c14740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f21e81abd30 con 0x55a451bf4790 2024-09-11T01:09:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21f2c14740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f21e81a9600 con 0x55a451bf70c0 2024-09-11T01:09:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21f2c14740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f21e81a7450 con 0x55a451bf9b00 2024-09-11T01:09:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21e7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451c0a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21e7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451c0a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:47920/0 (socket says 172.21.15.103:47920) 2024-09-11T01:09:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21e7e00640 1 -- 172.21.15.103:0/1751865503 learned_addr learned my addr 172.21.15.103:0/1751865503 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21ed200640 1 --2- 172.21.15.103:0/1751865503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf4790 0x55a451bea960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21edc00640 1 --2- 172.21.15.103:0/1751865503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf9b00 0x55a451bf2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21e7e00640 1 -- 172.21.15.103:0/1751865503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf9b00 msgr2=0x55a451bf2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:38.384 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21e7e00640 1 --2- 172.21.15.103:0/1751865503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf9b00 0x55a451bf2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.380+0000 7f21e7e00640 1 -- 172.21.15.103:0/1751865503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf4790 msgr2=0x55a451bea960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.381+0000 7f21e7e00640 1 --2- 172.21.15.103:0/1751865503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf4790 0x55a451bea960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.381+0000 7f21e7e00640 1 -- 172.21.15.103:0/1751865503 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a451bf6ef0 con 0x55a451bf70c0 2024-09-11T01:09:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.381+0000 7f21ed200640 1 --2- 172.21.15.103:0/1751865503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf4790 0x55a451bea960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.381+0000 7f21e7e00640 1 --2- 172.21.15.103:0/1751865503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451c0a570 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f21d40c9110 tx=0x7f21d402af30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c777e3560214169 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.381+0000 7f21d9600640 1 -- 172.21.15.103:0/1751865503 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d40cb610 con 0x55a451bf70c0 2024-09-11T01:09:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.381+0000 7f21d9600640 1 -- 172.21.15.103:0/1751865503 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21d40328f0 con 0x55a451bf70c0 2024-09-11T01:09:38.385 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.381+0000 7f21d9600640 1 -- 172.21.15.103:0/1751865503 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4103440 con 0x55a451bf70c0 2024-09-11T01:09:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.382+0000 7f21f2c14740 1 -- 172.21.15.103:0/1751865503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 msgr2=0x55a451c0a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.382+0000 7f21f2c14740 1 --2- 172.21.15.103:0/1751865503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451c0a570 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f21d40c9110 tx=0x7f21d402af30 comp rx=0 tx=0).stop 2024-09-11T01:09:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.382+0000 7f21f2c14740 1 -- 172.21.15.103:0/1751865503 shutdown_connections 2024-09-11T01:09:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.382+0000 7f21f2c14740 1 --2- 172.21.15.103:0/1751865503 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf9b00 0x55a451bf2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.382+0000 7f21f2c14740 1 --2- 172.21.15.103:0/1751865503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf70c0 0x55a451c0a570 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.382+0000 7f21f2c14740 1 --2- 172.21.15.103:0/1751865503 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf4790 0x55a451bea960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.382+0000 7f21f2c14740 1 -- 172.21.15.103:0/1751865503 >> 172.21.15.103:0/1751865503 conn(0x55a451bef8e0 msgr2=0x55a451bf3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.382+0000 7f21f2c14740 1 -- 172.21.15.103:0/1751865503 shutdown_connections 2024-09-11T01:09:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.382+0000 7f21f2c14740 1 -- 172.21.15.103:0/1751865503 wait complete. 2024-09-11T01:09:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.382+0000 7f21f2c14740 1 -- start start 2024-09-11T01:09:38.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.382+0000 7f21f2c14740 1 Processor -- start 2024-09-11T01:09:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21f2c14740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf4790 0x55a451c0a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21f2c14740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf70c0 0x55a451c09060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21f2c14740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf9b00 0x55a451c096e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21f2c14740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f21e81a7ac0 con 0x55a451bf9b00 2024-09-11T01:09:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21f2c14740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f21e81a8f30 con 0x55a451bf4790 2024-09-11T01:09:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21f2c14740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f21e81a8190 con 0x55a451bf70c0 2024-09-11T01:09:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21f2c14740 10 client.0 _ll_register_callbacks cb 0x7f21dc009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21ed200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf4790 0x55a451c0a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21ed200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf4790 0x55a451c0a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:47934/0 (socket says 172.21.15.103:47934) 2024-09-11T01:09:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21ed200640 1 -- 172.21.15.103:0/602639173 learned_addr learned my addr 172.21.15.103:0/602639173 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21edc00640 1 --2- 172.21.15.103:0/602639173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf9b00 0x55a451c096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21e7e00640 1 --2- 172.21.15.103:0/602639173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf70c0 0x55a451c09060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21ed200640 1 -- 172.21.15.103:0/602639173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf70c0 msgr2=0x55a451c09060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:38.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21ed200640 1 --2- 172.21.15.103:0/602639173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf70c0 0x55a451c09060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21ed200640 1 -- 172.21.15.103:0/602639173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf9b00 msgr2=0x55a451c096e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21ed200640 1 --2- 172.21.15.103:0/602639173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf9b00 0x55a451c096e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21ed200640 1 -- 172.21.15.103:0/602639173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a451c07b80 con 0x55a451bf4790 2024-09-11T01:09:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.383+0000 7f21edc00640 1 --2- 172.21.15.103:0/602639173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf9b00 0x55a451c096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.384+0000 7f21ed200640 1 --2- 172.21.15.103:0/602639173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf4790 0x55a451c0a360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21dc011730 tx=0x7f21dc019480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d982fccee751edc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.384+0000 7f21cea00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:09:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.384+0000 7f21cea00640 1 -- 172.21.15.103:0/602639173 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21dc02f030 con 0x55a451bf4790 2024-09-11T01:09:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.384+0000 7f21f2c14740 1 -- 172.21.15.103:0/602639173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21d40328f0 con 0x55a451bf4790 2024-09-11T01:09:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.384+0000 7f21cea00640 1 -- 172.21.15.103:0/602639173 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f21dc017040 con 0x55a451bf4790 2024-09-11T01:09:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.384+0000 7f21cea00640 1 -- 172.21.15.103:0/602639173 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f21dc011040 con 0x55a451bf4790 2024-09-11T01:09:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.384+0000 7f21f2c14740 10 client.25529 fetch_fsmap learned FSMap version 26 2024-09-11T01:09:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.384+0000 7f21f2c14740 1 -- 172.21.15.103:0/602639173 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55a451c7ae50 con 0x55a451bf4790 2024-09-11T01:09:38.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.384+0000 7f21cea00640 1 -- 172.21.15.103:0/602639173 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f21d40328f0 con 0x55a451bf4790 2024-09-11T01:09:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.384+0000 7f21cea00640 1 -- 172.21.15.103:0/602639173 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f21dc022040 con 0x55a451bf4790 2024-09-11T01:09:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.384+0000 7f21f2c14740 10 client.25529 fetch_fsmap finished waiting for FSMap version 26 2024-09-11T01:09:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.384+0000 7f21f2c14740 10 client.25529 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:09:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.384+0000 7f21f2c14740 20 client.25529 populate_metadata read hostname 'smithi103' 2024-09-11T01:09:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.385+0000 7f21f2c14740 1 --2- 172.21.15.103:0/602639173 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55a451c7b880 0x55a451c7dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.385+0000 7f21f2c14740 4 client.25529 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:09:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.385+0000 7f21f2c14740 1 -- 172.21.15.103:0/602639173 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a451b650b0 con 0x55a451c7b880 2024-09-11T01:09:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.385+0000 7f21e7e00640 1 --2- 172.21.15.103:0/602639173 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55a451c7b880 0x55a451c7dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.385+0000 7f21e7e00640 1 --2- 172.21.15.103:0/602639173 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55a451c7b880 0x55a451c7dca0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d6a6c5ab637ac32 server_cookie=334c345252ce0f44 in_seq=0 out_seq=0 2024-09-11T01:09:38.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.385+0000 7f21cea00640 10 client.25529 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:38.415 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc... (cached) gcc 2024-09-11T01:09:38.464 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-11T01:09:38.466 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-11T01:09:38.467 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-11T01:09:38.468 INFO:tasks.workunit.client.0.smithi103.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-11T01:09:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21cea00640 1 -- 172.21.15.103:0/602639173 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a451b650b0 con 0x55a451c7b880 2024-09-11T01:09:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21cea00640 10 client.25529 handle_command_reply: tid=0 2024-09-11T01:09:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21f2c14740 1 client.25529 shutdown 2024-09-11T01:09:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21f2c14740 1 -- 172.21.15.103:0/602639173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf4790 msgr2=0x55a451c0a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21f2c14740 1 --2- 172.21.15.103:0/602639173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf4790 0x55a451c0a360 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21dc011730 tx=0x7f21dc019480 comp rx=0 tx=0).stop 2024-09-11T01:09:38.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21f2c14740 1 -- 172.21.15.103:0/602639173 shutdown_connections 2024-09-11T01:09:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21f2c14740 1 --2- 172.21.15.103:0/602639173 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a451bf9b00 0x55a451c096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21f2c14740 1 --2- 172.21.15.103:0/602639173 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55a451c7b880 0x55a451c7dca0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21f2c14740 1 --2- 172.21.15.103:0/602639173 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a451bf70c0 0x55a451c09060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21f2c14740 1 --2- 172.21.15.103:0/602639173 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a451bf4790 0x55a451c0a360 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21f2c14740 1 -- 172.21.15.103:0/602639173 >> 172.21.15.103:0/602639173 conn(0x55a451bef8e0 msgr2=0x55a451bf3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21cea00640 0 client.25529 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21f2c14740 1 -- 172.21.15.103:0/602639173 shutdown_connections 2024-09-11T01:09:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21f2c14740 1 -- 172.21.15.103:0/602639173 wait complete. 2024-09-11T01:09:38.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.519+0000 7f21f2c14740 20 client.25529 trim_cache size 0 max 16384 2024-09-11T01:09:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:09:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:09:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:09:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:09:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.520+0000 7f21efc00640 1 -- 172.21.15.103:0/832969972 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f21d00b5320 msgr2=0x7f21d00b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.520+0000 7f21efc00640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f21d00b5320 0x7f21d00b77e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f21e000a010 tx=0x7f21e0005bd0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.520+0000 7f21efc00640 1 -- 172.21.15.103:0/832969972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21e8103ae0 msgr2=0x7f21e8199400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.520+0000 7f21efc00640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21e8103ae0 0x7f21e8199400 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f21d4032d80 tx=0x7f21d4032db0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.520+0000 7f21efc00640 1 -- 172.21.15.103:0/832969972 shutdown_connections 2024-09-11T01:09:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.520+0000 7f21efc00640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f21d00b5320 0x7f21d00b77e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.520+0000 7f21efc00640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f21e81044a0 0x7f21e819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.520+0000 7f21efc00640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f21e8103ae0 0x7f21e8199400 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.520+0000 7f21efc00640 1 --2- 172.21.15.103:0/832969972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f21e8102990 0x7f21e8198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.520+0000 7f21efc00640 1 -- 172.21.15.103:0/832969972 >> 172.21.15.103:0/832969972 conn(0x7f21e80fe250 msgr2=0x7f21e8106ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.521+0000 7f21efc00640 1 -- 172.21.15.103:0/832969972 shutdown_connections 2024-09-11T01:09:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:38.521+0000 7f21efc00640 1 -- 172.21.15.103:0/832969972 wait complete. 2024-09-11T01:09:38.585 INFO:tasks.workunit.client.0.smithi103.stdout:checking for main in -lm... yes 2024-09-11T01:09:38.670 INFO:tasks.workunit.client.0.smithi103.stdout:checking for main in -lpthread... yes 2024-09-11T01:09:38.916 INFO:tasks.workunit.client.0.smithi103.stdout:checking for ANSI C header files... yes 2024-09-11T01:09:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:38 smithi183 ceph-mon[34992]: pgmap v438: 129 pgs: 129 active+clean; 671 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-11T01:09:39.019 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-11T01:09:39.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:38 smithi103 ceph-mon[30562]: pgmap v438: 129 pgs: 129 active+clean; 671 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-11T01:09:39.093 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/types.h... yes 2024-09-11T01:09:39.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:38 smithi117 ceph-mon[35358]: pgmap v438: 129 pgs: 129 active+clean; 671 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-11T01:09:39.173 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/stat.h... yes 2024-09-11T01:09:39.251 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stdlib.h... yes 2024-09-11T01:09:39.331 INFO:tasks.workunit.client.0.smithi103.stdout:checking for string.h... yes 2024-09-11T01:09:39.412 INFO:tasks.workunit.client.0.smithi103.stdout:checking for memory.h... yes 2024-09-11T01:09:39.492 INFO:tasks.workunit.client.0.smithi103.stdout:checking for strings.h... yes 2024-09-11T01:09:39.580 INFO:tasks.workunit.client.0.smithi103.stdout:checking for inttypes.h... yes 2024-09-11T01:09:39.667 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stdint.h... yes 2024-09-11T01:09:39.758 INFO:tasks.workunit.client.0.smithi103.stdout:checking for unistd.h... yes 2024-09-11T01:09:39.865 INFO:tasks.workunit.client.0.smithi103.stdout:checking pthread.h usability... yes 2024-09-11T01:09:39.905 INFO:tasks.workunit.client.0.smithi103.stdout:checking pthread.h presence... yes 2024-09-11T01:09:39.906 INFO:tasks.workunit.client.0.smithi103.stdout:checking for pthread.h... yes 2024-09-11T01:09:39.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:39 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:09:39.996 INFO:tasks.workunit.client.0.smithi103.stdout:checking fcntl.h usability... yes 2024-09-11T01:09:40.036 INFO:tasks.workunit.client.0.smithi103.stdout:checking fcntl.h presence... yes 2024-09-11T01:09:40.038 INFO:tasks.workunit.client.0.smithi103.stdout:checking for fcntl.h... yes 2024-09-11T01:09:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:39 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:09:40.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:39 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:09:40.124 INFO:tasks.workunit.client.0.smithi103.stdout:checking limits.h usability... yes 2024-09-11T01:09:40.161 INFO:tasks.workunit.client.0.smithi103.stdout:checking limits.h presence... yes 2024-09-11T01:09:40.162 INFO:tasks.workunit.client.0.smithi103.stdout:checking for limits.h... yes 2024-09-11T01:09:40.186 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stdint.h... (cached) yes 2024-09-11T01:09:40.281 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/time.h usability... yes 2024-09-11T01:09:40.320 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/time.h presence... yes 2024-09-11T01:09:40.321 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/time.h... yes 2024-09-11T01:09:40.344 INFO:tasks.workunit.client.0.smithi103.stdout:checking for unistd.h... (cached) yes 2024-09-11T01:09:40.429 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/vfs.h usability... yes 2024-09-11T01:09:40.465 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/vfs.h presence... yes 2024-09-11T01:09:40.466 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/vfs.h... yes 2024-09-11T01:09:40.542 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/limits.h usability... no 2024-09-11T01:09:40.702 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/limits.h presence... no 2024-09-11T01:09:40.703 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/limits.h... no 2024-09-11T01:09:40.814 INFO:tasks.workunit.client.0.smithi103.stdout:checking for an ANSI C-conforming const... yes 2024-09-11T01:09:40.906 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-11T01:09:40.911 INFO:tasks.workunit.client.0.smithi103.stdout:checking for function prototypes... yes 2024-09-11T01:09:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:40 smithi183 ceph-mon[34992]: pgmap v439: 129 pgs: 129 active+clean; 671 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.6 KiB/s wr, 19 op/s 2024-09-11T01:09:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:09:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:09:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:09:40.987 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether setvbuf arguments are reversed... no 2024-09-11T01:09:41.082 INFO:tasks.workunit.client.0.smithi103.stdout:checking for system... yes 2024-09-11T01:09:41.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:40 smithi103 ceph-mon[30562]: pgmap v439: 129 pgs: 129 active+clean; 671 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.6 KiB/s wr, 19 op/s 2024-09-11T01:09:41.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:09:41.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:09:41.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:09:41.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:40 smithi117 ceph-mon[35358]: pgmap v439: 129 pgs: 129 active+clean; 671 KiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.6 KiB/s wr, 19 op/s 2024-09-11T01:09:41.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:09:41.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:09:41.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:09:41.186 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gettimeofday... yes 2024-09-11T01:09:41.288 INFO:tasks.workunit.client.0.smithi103.stdout:checking for mkdir... yes 2024-09-11T01:09:41.391 INFO:tasks.workunit.client.0.smithi103.stdout:checking for strerror... yes 2024-09-11T01:09:41.494 INFO:tasks.workunit.client.0.smithi103.stdout:checking for open64... yes 2024-09-11T01:09:41.598 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stat64... yes 2024-09-11T01:09:41.703 INFO:tasks.workunit.client.0.smithi103.stdout:checking for fseeko64... yes 2024-09-11T01:09:41.808 INFO:tasks.workunit.client.0.smithi103.stdout:checking for lrand48_r... yes 2024-09-11T01:09:41.911 INFO:tasks.workunit.client.0.smithi103.stdout:checking for srand48_r... yes 2024-09-11T01:09:41.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:41 smithi183 ceph-mon[34992]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:09:41.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:41 smithi183 ceph-mon[34992]: pgmap v440: 129 pgs: 129 active+clean; 2.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 190 KiB/s wr, 51 op/s 2024-09-11T01:09:41.952 INFO:tasks.workunit.client.0.smithi103.stdout:configure: creating ./config.status 2024-09-11T01:09:42.081 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:41 smithi103 ceph-mon[30562]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:09:42.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:41 smithi103 ceph-mon[30562]: pgmap v440: 129 pgs: 129 active+clean; 2.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 190 KiB/s wr, 51 op/s 2024-09-11T01:09:42.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:41 smithi117 ceph-mon[35358]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:09:42.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:41 smithi117 ceph-mon[35358]: pgmap v440: 129 pgs: 129 active+clean; 2.7 MiB data, 384 MiB used, 1.0 TiB / 1.0 TiB avail; 161 KiB/s rd, 190 KiB/s wr, 51 op/s 2024-09-11T01:09:42.149 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: creating Makefile 2024-09-11T01:09:42.178 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: creating config.h 2024-09-11T01:09:42.211 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: executing depfiles commands 2024-09-11T01:09:42.304 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: executing default commands 2024-09-11T01:09:42.365 INFO:tasks.workunit.client.0.smithi103.stderr:+ make 2024-09-11T01:09:42.374 INFO:tasks.workunit.client.0.smithi103.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run aclocal-1.10 2024-09-11T01:09:42.378 INFO:tasks.workunit.client.0.smithi103.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: aclocal-1.10: command not found 2024-09-11T01:09:42.380 INFO:tasks.workunit.client.0.smithi103.stderr:WARNING: `aclocal-1.10' is missing on your system. You should only need it if 2024-09-11T01:09:42.380 INFO:tasks.workunit.client.0.smithi103.stderr: you modified `acinclude.m4' or `configure.in'. You might want 2024-09-11T01:09:42.380 INFO:tasks.workunit.client.0.smithi103.stderr: to install the `Automake' and `Perl' packages. Grab them from 2024-09-11T01:09:42.380 INFO:tasks.workunit.client.0.smithi103.stderr: any GNU archive site. 2024-09-11T01:09:42.384 INFO:tasks.workunit.client.0.smithi103.stdout: cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run automake-1.10 --gnu 2024-09-11T01:09:42.387 INFO:tasks.workunit.client.0.smithi103.stderr:/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing: line 46: automake-1.10: command not found 2024-09-11T01:09:42.389 INFO:tasks.workunit.client.0.smithi103.stderr:WARNING: `automake-1.10' is missing on your system. You should only need it if 2024-09-11T01:09:42.389 INFO:tasks.workunit.client.0.smithi103.stderr: you modified `Makefile.am', `acinclude.m4' or `configure.in'. 2024-09-11T01:09:42.389 INFO:tasks.workunit.client.0.smithi103.stderr: You might want to install the `Automake' and `Perl' packages. 2024-09-11T01:09:42.389 INFO:tasks.workunit.client.0.smithi103.stderr: Grab them from any GNU archive site. 2024-09-11T01:09:42.465 INFO:tasks.workunit.client.0.smithi103.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoconf 2024-09-11T01:09:42.861 INFO:tasks.workunit.client.0.smithi103.stderr:aclocal.m4:16: warning: this file was generated for autoconf 2.61. 2024-09-11T01:09:42.861 INFO:tasks.workunit.client.0.smithi103.stderr:You have another version of autoconf. It may work, but is not guaranteed to. 2024-09-11T01:09:42.861 INFO:tasks.workunit.client.0.smithi103.stderr:If you have problems, you may need to regenerate the build system entirely. 2024-09-11T01:09:42.861 INFO:tasks.workunit.client.0.smithi103.stderr:To do so, use the procedure documented by the package, typically `autoreconf'. 2024-09-11T01:09:42.984 INFO:tasks.workunit.client.0.smithi103.stdout:/bin/sh ./config.status --recheck 2024-09-11T01:09:43.095 INFO:tasks.workunit.client.0.smithi103.stdout:running CONFIG_SHELL=/bin/sh /bin/sh ./configure --no-create --no-recursion 2024-09-11T01:09:43.280 INFO:tasks.workunit.client.0.smithi103.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2024-09-11T01:09:43.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:43 smithi183 ceph-mon[34992]: mgrmap e20: x(active, since 12m), standbys: z, y 2024-09-11T01:09:43.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:43 smithi183 ceph-mon[34992]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:09:43.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:43 smithi183 ceph-mon[34992]: pgmap v441: 129 pgs: 129 active+clean; 3.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 335 KiB/s wr, 131 op/s 2024-09-11T01:09:44.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:43 smithi103 ceph-mon[30562]: mgrmap e20: x(active, since 12m), standbys: z, y 2024-09-11T01:09:44.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:43 smithi103 ceph-mon[30562]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:09:44.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:43 smithi103 ceph-mon[30562]: pgmap v441: 129 pgs: 129 active+clean; 3.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 335 KiB/s wr, 131 op/s 2024-09-11T01:09:44.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:43 smithi117 ceph-mon[35358]: mgrmap e20: x(active, since 12m), standbys: z, y 2024-09-11T01:09:44.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:43 smithi117 ceph-mon[35358]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:09:44.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:43 smithi117 ceph-mon[35358]: pgmap v441: 129 pgs: 129 active+clean; 3.8 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 335 KiB/s wr, 131 op/s 2024-09-11T01:09:44.294 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether build environment is sane... yes 2024-09-11T01:09:44.304 INFO:tasks.workunit.client.0.smithi103.stdout:checking for a thread-safe mkdir -p... /usr/bin/mkdir -p 2024-09-11T01:09:44.304 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gawk... gawk 2024-09-11T01:09:44.327 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether make sets $(MAKE)... yes 2024-09-11T01:09:44.392 INFO:tasks.workunit.client.0.smithi103.stdout:checking build system type... x86_64-unknown-linux-gnu 2024-09-11T01:09:44.392 INFO:tasks.workunit.client.0.smithi103.stdout:checking host system type... x86_64-unknown-linux-gnu 2024-09-11T01:09:44.409 INFO:tasks.workunit.client.0.smithi103.stdout:checking for style of include used by make... GNU 2024-09-11T01:09:44.415 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc... gcc 2024-09-11T01:09:44.550 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether the C compiler works... yes 2024-09-11T01:09:44.550 INFO:tasks.workunit.client.0.smithi103.stdout:checking for C compiler default output file name... a.out 2024-09-11T01:09:44.610 INFO:tasks.workunit.client.0.smithi103.stdout:checking for suffix of executables... 2024-09-11T01:09:44.673 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are cross compiling... no 2024-09-11T01:09:44.731 INFO:tasks.workunit.client.0.smithi103.stdout:checking for suffix of object files... o 2024-09-11T01:09:44.774 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are using the GNU C compiler... yes 2024-09-11T01:09:44.817 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether gcc accepts -g... yes 2024-09-11T01:09:44.881 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc option to accept ISO C89... none needed 2024-09-11T01:09:45.012 INFO:tasks.workunit.client.0.smithi103.stdout:checking dependency style of gcc... gcc3 2024-09-11T01:09:45.084 INFO:tasks.workunit.client.0.smithi103.stdout:checking how to run the C preprocessor... gcc -E 2024-09-11T01:09:45.161 INFO:tasks.workunit.client.0.smithi103.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2024-09-11T01:09:45.163 INFO:tasks.workunit.client.0.smithi103.stdout:checking for egrep... /usr/bin/grep -E 2024-09-11T01:09:45.355 INFO:tasks.workunit.client.0.smithi103.stdout:checking for ANSI C header files... yes 2024-09-11T01:09:45.413 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/types.h... yes 2024-09-11T01:09:45.480 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/stat.h... yes 2024-09-11T01:09:45.546 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stdlib.h... yes 2024-09-11T01:09:45.615 INFO:tasks.workunit.client.0.smithi103.stdout:checking for string.h... yes 2024-09-11T01:09:45.683 INFO:tasks.workunit.client.0.smithi103.stdout:checking for memory.h... yes 2024-09-11T01:09:45.750 INFO:tasks.workunit.client.0.smithi103.stdout:checking for strings.h... yes 2024-09-11T01:09:45.818 INFO:tasks.workunit.client.0.smithi103.stdout:checking for inttypes.h... yes 2024-09-11T01:09:45.886 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stdint.h... yes 2024-09-11T01:09:45.956 INFO:tasks.workunit.client.0.smithi103.stdout:checking for unistd.h... yes 2024-09-11T01:09:46.026 INFO:tasks.workunit.client.0.smithi103.stdout:checking minix/config.h usability... no 2024-09-11T01:09:46.068 INFO:tasks.workunit.client.0.smithi103.stdout:checking minix/config.h presence... no 2024-09-11T01:09:46.068 INFO:tasks.workunit.client.0.smithi103.stdout:checking for minix/config.h... no 2024-09-11T01:09:46.124 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether it is safe to define __EXTENSIONS__... yes 2024-09-11T01:09:46.124 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc... (cached) gcc 2024-09-11T01:09:46.177 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-09-11T01:09:46.177 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether gcc accepts -g... (cached) yes 2024-09-11T01:09:46.177 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-09-11T01:09:46.177 INFO:tasks.workunit.client.0.smithi103.stdout:checking dependency style of gcc... (cached) gcc3 2024-09-11T01:09:46.246 INFO:tasks.workunit.client.0.smithi103.stdout:checking for main in -lm... yes 2024-09-11T01:09:46.317 INFO:tasks.workunit.client.0.smithi103.stdout:checking for main in -lpthread... yes 2024-09-11T01:09:46.319 INFO:tasks.workunit.client.0.smithi103.stdout:checking for ANSI C header files... (cached) yes 2024-09-11T01:09:46.382 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/wait.h that is POSIX.1 compatible... yes 2024-09-11T01:09:46.470 INFO:tasks.workunit.client.0.smithi103.stdout:checking pthread.h usability... yes 2024-09-11T01:09:46.499 INFO:tasks.workunit.client.0.smithi103.stdout:checking pthread.h presence... yes 2024-09-11T01:09:46.500 INFO:tasks.workunit.client.0.smithi103.stdout:checking for pthread.h... yes 2024-09-11T01:09:46.577 INFO:tasks.workunit.client.0.smithi103.stdout:checking fcntl.h usability... yes 2024-09-11T01:09:46.605 INFO:tasks.workunit.client.0.smithi103.stdout:checking fcntl.h presence... yes 2024-09-11T01:09:46.605 INFO:tasks.workunit.client.0.smithi103.stdout:checking for fcntl.h... yes 2024-09-11T01:09:46.703 INFO:tasks.workunit.client.0.smithi103.stdout:checking limits.h usability... yes 2024-09-11T01:09:46.729 INFO:tasks.workunit.client.0.smithi103.stdout:checking limits.h presence... yes 2024-09-11T01:09:46.730 INFO:tasks.workunit.client.0.smithi103.stdout:checking for limits.h... yes 2024-09-11T01:09:46.754 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stdint.h... (cached) yes 2024-09-11T01:09:46.831 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/time.h usability... yes 2024-09-11T01:09:46.858 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/time.h presence... yes 2024-09-11T01:09:46.858 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/time.h... yes 2024-09-11T01:09:46.882 INFO:tasks.workunit.client.0.smithi103.stdout:checking for unistd.h... (cached) yes 2024-09-11T01:09:46.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:46 smithi183 ceph-mon[34992]: pgmap v442: 129 pgs: 129 active+clean; 5.9 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 528 KiB/s wr, 157 op/s 2024-09-11T01:09:46.947 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/vfs.h usability... yes 2024-09-11T01:09:46.973 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/vfs.h presence... yes 2024-09-11T01:09:46.973 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/vfs.h... yes 2024-09-11T01:09:47.051 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/limits.h usability... no 2024-09-11T01:09:47.081 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:46 smithi103 ceph-mon[30562]: pgmap v442: 129 pgs: 129 active+clean; 5.9 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 528 KiB/s wr, 157 op/s 2024-09-11T01:09:47.092 INFO:tasks.workunit.client.0.smithi103.stdout:checking sys/limits.h presence... no 2024-09-11T01:09:47.092 INFO:tasks.workunit.client.0.smithi103.stdout:checking for sys/limits.h... no 2024-09-11T01:09:47.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:46 smithi117 ceph-mon[35358]: pgmap v442: 129 pgs: 129 active+clean; 5.9 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 528 KiB/s wr, 157 op/s 2024-09-11T01:09:47.135 INFO:tasks.workunit.client.0.smithi103.stdout:checking for an ANSI C-conforming const... yes 2024-09-11T01:09:47.183 INFO:tasks.workunit.client.0.smithi103.stdout:checking whether time.h and sys/time.h may both be included... yes 2024-09-11T01:09:47.271 INFO:tasks.workunit.client.0.smithi103.stdout:checking for system... yes 2024-09-11T01:09:47.361 INFO:tasks.workunit.client.0.smithi103.stdout:checking for gettimeofday... yes 2024-09-11T01:09:47.452 INFO:tasks.workunit.client.0.smithi103.stdout:checking for mkdir... yes 2024-09-11T01:09:47.541 INFO:tasks.workunit.client.0.smithi103.stdout:checking for strerror... yes 2024-09-11T01:09:47.631 INFO:tasks.workunit.client.0.smithi103.stdout:checking for open64... yes 2024-09-11T01:09:47.723 INFO:tasks.workunit.client.0.smithi103.stdout:checking for stat64... yes 2024-09-11T01:09:47.816 INFO:tasks.workunit.client.0.smithi103.stdout:checking for fseeko64... yes 2024-09-11T01:09:47.907 INFO:tasks.workunit.client.0.smithi103.stdout:checking for lrand48_r... yes 2024-09-11T01:09:47.995 INFO:tasks.workunit.client.0.smithi103.stdout:checking for srand48_r... yes 2024-09-11T01:09:48.032 INFO:tasks.workunit.client.0.smithi103.stdout:configure: creating ./config.status 2024-09-11T01:09:48.144 INFO:tasks.workunit.client.0.smithi103.stdout: /bin/sh ./config.status 2024-09-11T01:09:48.234 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: creating Makefile 2024-09-11T01:09:48.261 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: creating config.h 2024-09-11T01:09:48.291 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: executing depfiles commands 2024-09-11T01:09:48.320 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: executing default commands 2024-09-11T01:09:48.347 INFO:tasks.workunit.client.0.smithi103.stdout:cd . && /bin/sh /home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb/missing --run autoheader 2024-09-11T01:09:48.566 INFO:tasks.workunit.client.0.smithi103.stdout:rm -f stamp-h1 2024-09-11T01:09:48.569 INFO:tasks.workunit.client.0.smithi103.stdout:touch config.h.in 2024-09-11T01:09:48.572 INFO:tasks.workunit.client.0.smithi103.stdout:cd . && /bin/sh ./config.status config.h 2024-09-11T01:09:48.647 INFO:tasks.workunit.client.0.smithi103.stdout:config.status: creating config.h 2024-09-11T01:09:48.683 INFO:tasks.workunit.client.0.smithi103.stdout:make all-am 2024-09-11T01:09:48.690 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-11T01:09:48.691 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fileops.o -MD -MP -MF .deps/fileops.Tpo -c -o fileops.o fileops.c 2024-09-11T01:09:48.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:48 smithi183 ceph-mon[34992]: pgmap v443: 129 pgs: 129 active+clean; 5.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 528 KiB/s wr, 156 op/s 2024-09-11T01:09:48.919 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/fileops.Tpo .deps/fileops.Po 2024-09-11T01:09:48.923 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rand.o -MD -MP -MF .deps/rand.Tpo -c -o rand.o rand.c 2024-09-11T01:09:49.047 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/rand.Tpo .deps/rand.Po 2024-09-11T01:09:49.052 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT main.o -MD -MP -MF .deps/main.Tpo -c -o main.o main.c 2024-09-11T01:09:49.081 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:48 smithi103 ceph-mon[30562]: pgmap v443: 129 pgs: 129 active+clean; 5.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 528 KiB/s wr, 156 op/s 2024-09-11T01:09:49.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:48 smithi117 ceph-mon[35358]: pgmap v443: 129 pgs: 129 active+clean; 5.9 MiB data, 399 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 528 KiB/s wr, 156 op/s 2024-09-11T01:09:49.164 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/main.Tpo .deps/main.Po 2024-09-11T01:09:49.168 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT fh.o -MD -MP -MF .deps/fh.Tpo -c -o fh.o fh.c 2024-09-11T01:09:49.279 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/fh.Tpo .deps/fh.Po 2024-09-11T01:09:49.284 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT filelist.o -MD -MP -MF .deps/filelist.Tpo -c -o filelist.o filelist.c 2024-09-11T01:09:49.458 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/filelist.Tpo .deps/filelist.Po 2024-09-11T01:09:49.462 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT metaops.o -MD -MP -MF .deps/metaops.Tpo -c -o metaops.o metaops.c 2024-09-11T01:09:49.531 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/metaops.Tpo .deps/metaops.Po 2024-09-11T01:09:49.535 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rwlock.o -MD -MP -MF .deps/rwlock.Tpo -c -o rwlock.o rwlock.c 2024-09-11T01:09:49.595 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/rwlock.Tpo .deps/rwlock.Po 2024-09-11T01:09:49.599 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT cirlist.o -MD -MP -MF .deps/cirlist.Tpo -c -o cirlist.o cirlist.c 2024-09-11T01:09:49.668 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/cirlist.Tpo .deps/cirlist.Po 2024-09-11T01:09:49.672 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT rbt.o -MD -MP -MF .deps/rbt.Tpo -c -o rbt.o rbt.c 2024-09-11T01:09:49.907 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/rbt.Tpo .deps/rbt.Po 2024-09-11T01:09:49.911 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_tg.o -MD -MP -MF .deps/ffsb_tg.Tpo -c -o ffsb_tg.o ffsb_tg.c 2024-09-11T01:09:50.063 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/ffsb_tg.Tpo .deps/ffsb_tg.Po 2024-09-11T01:09:50.067 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fs.o -MD -MP -MF .deps/ffsb_fs.Tpo -c -o ffsb_fs.o ffsb_fs.c 2024-09-11T01:09:50.254 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/ffsb_fs.Tpo .deps/ffsb_fs.Po 2024-09-11T01:09:50.260 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_thread.o -MD -MP -MF .deps/ffsb_thread.Tpo -c -o ffsb_thread.o ffsb_thread.c 2024-09-11T01:09:50.348 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/ffsb_thread.Tpo .deps/ffsb_thread.Po 2024-09-11T01:09:50.352 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_op.o -MD -MP -MF .deps/ffsb_op.Tpo -c -o ffsb_op.o ffsb_op.c 2024-09-11T01:09:50.445 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/ffsb_op.Tpo .deps/ffsb_op.Po 2024-09-11T01:09:50.449 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT util.o -MD -MP -MF .deps/util.Tpo -c -o util.o util.c 2024-09-11T01:09:50.579 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/util.Tpo .deps/util.Po 2024-09-11T01:09:50.584 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT parser.o -MD -MP -MF .deps/parser.Tpo -c -o parser.o parser.c 2024-09-11T01:09:50.626 INFO:tasks.workunit.client.0.smithi103.stderr:In file included from parser.h:22, 2024-09-11T01:09:50.626 INFO:tasks.workunit.client.0.smithi103.stderr: from parser.c:25: 2024-09-11T01:09:50.626 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c: In function ‘init_filesys’: 2024-09-11T01:09:50.627 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T01:09:50.627 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T01:09:50.627 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-11T01:09:50.627 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T01:09:50.627 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T01:09:50.627 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-11T01:09:50.627 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T01:09:50.627 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-11T01:09:50.627 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-11T01:09:50.627 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T01:09:50.627 INFO:tasks.workunit.client.0.smithi103.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T01:09:50.627 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-11T01:09:50.627 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T01:09:50.628 INFO:tasks.workunit.client.0.smithi103.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-11T01:09:50.628 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T01:09:50.628 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T01:09:50.628 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T01:09:50.628 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-11T01:09:50.628 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T01:09:50.628 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T01:09:50.628 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-11T01:09:50.628 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T01:09:50.628 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-11T01:09:50.628 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-11T01:09:50.628 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T01:09:50.628 INFO:tasks.workunit.client.0.smithi103.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T01:09:50.629 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-11T01:09:50.629 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:934:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T01:09:50.629 INFO:tasks.workunit.client.0.smithi103.stderr: 934 | list_for_each_entry(tmp_list, &list_head->list, list) 2024-09-11T01:09:50.629 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T01:09:50.629 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T01:09:50.629 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T01:09:50.629 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-11T01:09:50.629 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T01:09:50.629 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T01:09:50.630 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-11T01:09:50.630 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T01:09:50.630 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-11T01:09:50.630 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-11T01:09:50.630 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T01:09:50.630 INFO:tasks.workunit.client.0.smithi103.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T01:09:50.630 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-11T01:09:50.630 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T01:09:50.630 INFO:tasks.workunit.client.0.smithi103.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-11T01:09:50.630 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T01:09:50.630 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T01:09:50.630 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T01:09:50.630 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-11T01:09:50.631 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T01:09:50.631 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T01:09:50.631 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-11T01:09:50.631 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T01:09:50.631 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-11T01:09:50.631 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-11T01:09:50.631 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T01:09:50.631 INFO:tasks.workunit.client.0.smithi103.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T01:09:50.631 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-11T01:09:50.631 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:941:17: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T01:09:50.631 INFO:tasks.workunit.client.0.smithi103.stderr: 941 | list_for_each_entry(tmp_list, &list_head->list, list) { 2024-09-11T01:09:50.631 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T01:09:50.631 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c: In function ‘init_tg_stats’: 2024-09-11T01:09:50.632 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T01:09:50.632 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T01:09:50.632 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-11T01:09:50.632 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T01:09:50.632 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T01:09:50.633 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-11T01:09:50.633 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T01:09:50.633 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-11T01:09:50.633 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-11T01:09:50.633 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T01:09:50.633 INFO:tasks.workunit.client.0.smithi103.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T01:09:50.633 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-11T01:09:50.633 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T01:09:50.633 INFO:tasks.workunit.client.0.smithi103.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-11T01:09:50.633 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T01:09:50.633 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T01:09:50.633 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T01:09:50.633 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-11T01:09:50.633 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T01:09:50.634 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T01:09:50.634 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-11T01:09:50.634 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T01:09:50.634 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-11T01:09:50.634 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-11T01:09:50.634 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T01:09:50.634 INFO:tasks.workunit.client.0.smithi103.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T01:09:50.634 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-11T01:09:50.634 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:971:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T01:09:50.634 INFO:tasks.workunit.client.0.smithi103.stderr: 971 | list_for_each_entry(tmp_list, 2024-09-11T01:09:50.634 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T01:09:50.634 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T01:09:50.634 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T01:09:50.634 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-11T01:09:50.635 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T01:09:50.635 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T01:09:50.635 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-11T01:09:50.635 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T01:09:50.635 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-11T01:09:50.635 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-11T01:09:50.635 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:39:20: note: in expansion of macro ‘list_entry’ 2024-09-11T01:09:50.635 INFO:tasks.workunit.client.0.smithi103.stderr: 39 | for (pos = list_entry((head)->next, typeof(*pos), member); \ 2024-09-11T01:09:50.635 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-11T01:09:50.635 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T01:09:50.635 INFO:tasks.workunit.client.0.smithi103.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-11T01:09:50.635 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T01:09:50.635 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:29:33: warning: cast from pointer to integer of different size [-Wpointer-to-int-cast] 2024-09-11T01:09:50.636 INFO:tasks.workunit.client.0.smithi103.stderr: 29 | #define offsetof(type, member) ((int) &((type *)0)->member) 2024-09-11T01:09:50.636 INFO:tasks.workunit.client.0.smithi103.stderr: | ^ 2024-09-11T01:09:50.636 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:33:35: note: in expansion of macro ‘offsetof’ 2024-09-11T01:09:50.636 INFO:tasks.workunit.client.0.smithi103.stderr: 33 | (type *)((char *)__mptr - offsetof(type, member)); }) 2024-09-11T01:09:50.636 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~ 2024-09-11T01:09:50.636 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:36:9: note: in expansion of macro ‘container_of’ 2024-09-11T01:09:50.636 INFO:tasks.workunit.client.0.smithi103.stderr: 36 | container_of(ptr, type, member) 2024-09-11T01:09:50.636 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~ 2024-09-11T01:09:50.636 INFO:tasks.workunit.client.0.smithi103.stderr:list.h:41:20: note: in expansion of macro ‘list_entry’ 2024-09-11T01:09:50.636 INFO:tasks.workunit.client.0.smithi103.stderr: 41 | pos = list_entry(pos->member.next, typeof(*pos), member)) 2024-09-11T01:09:50.636 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~ 2024-09-11T01:09:50.636 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:980:41: note: in expansion of macro ‘list_for_each_entry’ 2024-09-11T01:09:50.636 INFO:tasks.workunit.client.0.smithi103.stderr: 980 | list_for_each_entry(tmp_list, 2024-09-11T01:09:50.637 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T01:09:50.678 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c: In function ‘get_optstr’: 2024-09-11T01:09:50.678 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:206:23: warning: ‘strnlen’ specified bound 4095 exceeds source size 1024 [-Wstringop-overread] 2024-09-11T01:09:50.678 INFO:tasks.workunit.client.0.smithi103.stderr: 206 | len = strnlen(temp, 4095) + 1; 2024-09-11T01:09:50.678 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~ 2024-09-11T01:09:50.678 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:200:14: note: source object declared here 2024-09-11T01:09:50.679 INFO:tasks.workunit.client.0.smithi103.stderr: 200 | char temp[BUFSIZE]; 2024-09-11T01:09:50.679 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~ 2024-09-11T01:09:50.685 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c: In function ‘size64_convert’: 2024-09-11T01:09:50.685 INFO:tasks.workunit.client.0.smithi103.stderr:parser.c:119:9: warning: ‘memcpy’ reading 3 bytes from a region of size 2 [-Wstringop-overread] 2024-09-11T01:09:50.685 INFO:tasks.workunit.client.0.smithi103.stderr: 119 | memcpy(unit, "\0", 3); 2024-09-11T01:09:50.685 INFO:tasks.workunit.client.0.smithi103.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2024-09-11T01:09:50.893 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:50 smithi103 ceph-mon[30562]: pgmap v444: 129 pgs: 129 active+clean; 7.0 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 631 KiB/s wr, 163 op/s 2024-09-11T01:09:50.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:50 smithi183 ceph-mon[34992]: pgmap v444: 129 pgs: 129 active+clean; 7.0 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 631 KiB/s wr, 163 op/s 2024-09-11T01:09:51.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:50 smithi117 ceph-mon[35358]: pgmap v444: 129 pgs: 129 active+clean; 7.0 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 473 KiB/s rd, 631 KiB/s wr, 163 op/s 2024-09-11T01:09:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.636+0000 7f1a2c200640 1 -- 172.21.15.103:0/3150980897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a241066b0 msgr2=0x7f1a2410d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.636+0000 7f1a2c200640 1 --2- 172.21.15.103:0/3150980897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a241066b0 0x7f1a2410d030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009ca0 tx=0x7f1a1c02a8c0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.636+0000 7f1a2c200640 1 -- 172.21.15.103:0/3150980897 shutdown_connections 2024-09-11T01:09:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.636+0000 7f1a2c200640 1 --2- 172.21.15.103:0/3150980897 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a241066b0 0x7f1a2410d030 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.636+0000 7f1a2c200640 1 --2- 172.21.15.103:0/3150980897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a24105cf0 0x7f1a24106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.636+0000 7f1a2c200640 1 --2- 172.21.15.103:0/3150980897 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a24104ba0 0x7f1a24104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.636+0000 7f1a2c200640 1 -- 172.21.15.103:0/3150980897 >> 172.21.15.103:0/3150980897 conn(0x7f1a24100460 msgr2=0x7f1a24102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.636+0000 7f1a2c200640 1 -- 172.21.15.103:0/3150980897 shutdown_connections 2024-09-11T01:09:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.636+0000 7f1a2c200640 1 -- 172.21.15.103:0/3150980897 wait complete. 2024-09-11T01:09:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.637+0000 7f1a2c200640 1 Processor -- start 2024-09-11T01:09:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.638+0000 7f1a2c200640 1 -- start start 2024-09-11T01:09:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.638+0000 7f1a2c200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a24104ba0 0x7f1a2419f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.638+0000 7f1a2c200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a24105cf0 0x7f1a2419f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.638+0000 7f1a2c200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a241066b0 0x7f1a241a0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.638+0000 7f1a2c200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1a24110810 con 0x7f1a24105cf0 2024-09-11T01:09:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.638+0000 7f1a2c200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1a24110690 con 0x7f1a241066b0 2024-09-11T01:09:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.638+0000 7f1a2c200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1a24110990 con 0x7f1a24104ba0 2024-09-11T01:09:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.638+0000 7f1a29800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a24104ba0 0x7f1a2419f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.638+0000 7f1a28e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a24105cf0 0x7f1a2419f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.638+0000 7f1a29800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a24104ba0 0x7f1a2419f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:38564/0 (socket says 172.21.15.103:38564) 2024-09-11T01:09:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.638+0000 7f1a29800640 1 -- 172.21.15.103:0/3380139221 learned_addr learned my addr 172.21.15.103:0/3380139221 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.639+0000 7f1a29800640 1 -- 172.21.15.103:0/3380139221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a241066b0 msgr2=0x7f1a241a0590 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T01:09:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.639+0000 7f1a29800640 1 --2- 172.21.15.103:0/3380139221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a241066b0 0x7f1a241a0590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.639+0000 7f1a29800640 1 -- 172.21.15.103:0/3380139221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a24105cf0 msgr2=0x7f1a2419f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.639+0000 7f1a29800640 1 --2- 172.21.15.103:0/3380139221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a24105cf0 0x7f1a2419f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.639+0000 7f1a29800640 1 -- 172.21.15.103:0/3380139221 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a241a0e50 con 0x7f1a24104ba0 2024-09-11T01:09:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.639+0000 7f1a29800640 1 --2- 172.21.15.103:0/3380139221 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a24104ba0 0x7f1a2419f310 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800e9f0 tx=0x7f1a1800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.642+0000 7f1a22000640 1 -- 172.21.15.103:0/3380139221 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1800cd80 con 0x7f1a24104ba0 2024-09-11T01:09:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.642+0000 7f1a22000640 1 -- 172.21.15.103:0/3380139221 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a180054d0 con 0x7f1a24104ba0 2024-09-11T01:09:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.642+0000 7f1a22000640 1 -- 172.21.15.103:0/3380139221 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18010690 con 0x7f1a24104ba0 2024-09-11T01:09:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.642+0000 7f1a2c200640 1 -- 172.21.15.103:0/3380139221 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a241a1140 con 0x7f1a24104ba0 2024-09-11T01:09:51.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.642+0000 7f1a2c200640 1 -- 172.21.15.103:0/3380139221 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a241a7810 con 0x7f1a24104ba0 2024-09-11T01:09:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.646+0000 7f1a2efe5740 1 Processor -- start 2024-09-11T01:09:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.646+0000 7f1a2efe5740 1 -- start start 2024-09-11T01:09:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.646+0000 7f1a2efe5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d6790 0x5641d72d8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.646+0000 7f1a2efe5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72d90c0 0x5641d72db4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.646+0000 7f1a2efe5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72dbb00 0x5641d72ddfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.650 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.646+0000 7f1a2efe5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5641d72496b0 con 0x5641d72d6790 2024-09-11T01:09:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.646+0000 7f1a2efe5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5641d7238ae0 con 0x5641d72dbb00 2024-09-11T01:09:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.646+0000 7f1a2efe5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5641d723c8f0 con 0x5641d72d90c0 2024-09-11T01:09:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.647+0000 7f1a2a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d6790 0x5641d72d8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.647+0000 7f1a2a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d6790 0x5641d72d8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55016/0 (socket says 172.21.15.103:55016) 2024-09-11T01:09:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.647+0000 7f1a2a200640 1 -- 172.21.15.103:0/134624119 learned_addr learned my addr 172.21.15.103:0/134624119 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.647+0000 7f1a22000640 1 -- 172.21.15.103:0/3380139221 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f1a18004e90 con 0x7f1a24104ba0 2024-09-11T01:09:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.647+0000 7f1a28e00640 1 --2- 172.21.15.103:0/134624119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72dbb00 0x5641d72ddfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.647+0000 7f1a2a200640 1 -- 172.21.15.103:0/134624119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72d90c0 msgr2=0x5641d72db4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.647+0000 7f1a2a200640 1 --2- 172.21.15.103:0/134624119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72d90c0 0x5641d72db4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.647+0000 7f1a2a200640 1 -- 172.21.15.103:0/134624119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72dbb00 msgr2=0x5641d72ddfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.647+0000 7f1a2a200640 1 --2- 172.21.15.103:0/134624119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72dbb00 0x5641d72ddfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.647+0000 7f1a2a200640 1 -- 172.21.15.103:0/134624119 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641d7205780 con 0x5641d72d6790 2024-09-11T01:09:51.651 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.647+0000 7f1a28e00640 1 --2- 172.21.15.103:0/134624119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72dbb00 0x5641d72ddfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:09:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.647+0000 7f1a2a200640 1 --2- 172.21.15.103:0/134624119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d6790 0x5641d72d8b80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009360 tx=0x7f1a1c009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e24e9639a1b0a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:51.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.648+0000 7f1a16a00640 1 -- 172.21.15.103:0/134624119 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c031be0 con 0x5641d72d6790 2024-09-11T01:09:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.648+0000 7f1a16a00640 1 -- 172.21.15.103:0/134624119 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a1c03f070 con 0x5641d72d6790 2024-09-11T01:09:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.648+0000 7f1a16a00640 1 -- 172.21.15.103:0/134624119 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c0042a0 con 0x5641d72d6790 2024-09-11T01:09:51.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.649+0000 7f1a22000640 1 --2- 172.21.15.103:0/3380139221 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f1a0c0b5360 0x7f1a0c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.649+0000 7f1a2efe5740 1 -- 172.21.15.103:0/134624119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d6790 msgr2=0x5641d72d8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.649+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/134624119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d6790 0x5641d72d8b80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009360 tx=0x7f1a1c009390 comp rx=0 tx=0).stop 2024-09-11T01:09:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.649+0000 7f1a2efe5740 1 -- 172.21.15.103:0/134624119 shutdown_connections 2024-09-11T01:09:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.649+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/134624119 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72dbb00 0x5641d72ddfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.649+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/134624119 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72d90c0 0x5641d72db4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.649+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/134624119 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d6790 0x5641d72d8b80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.649+0000 7f1a2efe5740 1 -- 172.21.15.103:0/134624119 >> 172.21.15.103:0/134624119 conn(0x5641d72d18e0 msgr2=0x5641d72d2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.649+0000 7f1a22000640 1 -- 172.21.15.103:0/3380139221 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f1a180e63f0 con 0x7f1a24104ba0 2024-09-11T01:09:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.649+0000 7f1a29800640 1 --2- 172.21.15.103:0/3380139221 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f1a0c0b5360 0x7f1a0c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.649+0000 7f1a2efe5740 1 -- 172.21.15.103:0/134624119 shutdown_connections 2024-09-11T01:09:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.649+0000 7f1a2efe5740 1 -- 172.21.15.103:0/134624119 wait complete. 2024-09-11T01:09:51.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.649+0000 7f1a2efe5740 1 -- start start 2024-09-11T01:09:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.649+0000 7f1a29800640 1 --2- 172.21.15.103:0/3380139221 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f1a0c0b5360 0x7f1a0c0b7820 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1a180ac7b0 tx=0x7f1a18021000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.650+0000 7f1a2efe5740 1 Processor -- start 2024-09-11T01:09:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.650+0000 7f1a2efe5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d6790 0x5641d72dfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.650+0000 7f1a2efe5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72d90c0 0x5641d72e0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.650+0000 7f1a2efe5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72dbb00 0x5641d72e1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.650+0000 7f1a2efe5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5641d7170ab0 con 0x5641d72d6790 2024-09-11T01:09:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.650+0000 7f1a2efe5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5641d71df570 con 0x5641d72d90c0 2024-09-11T01:09:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.650+0000 7f1a2efe5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5641d72dea80 con 0x5641d72dbb00 2024-09-11T01:09:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.650+0000 7f1a2efe5740 10 client.0 _ll_register_callbacks cb 0x5641d71ee100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.650+0000 7f1a2a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d6790 0x5641d72dfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.650+0000 7f1a2a200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d6790 0x5641d72dfea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55026/0 (socket says 172.21.15.103:55026) 2024-09-11T01:09:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.650+0000 7f1a2a200640 1 -- 172.21.15.103:0/1376547226 learned_addr learned my addr 172.21.15.103:0/1376547226 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:51.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.651+0000 7f1a28e00640 1 --2- 172.21.15.103:0/1376547226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72d90c0 0x5641d72e0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.651+0000 7f1a2a200640 1 --2- 172.21.15.103:0/1376547226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72dbb00 0x5641d72e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.651+0000 7f1a2a200640 1 -- 172.21.15.103:0/1376547226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72dbb00 msgr2=0x5641d72e1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.651+0000 7f1a2a200640 1 --2- 172.21.15.103:0/1376547226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72dbb00 0x5641d72e1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.651+0000 7f1a2a200640 1 -- 172.21.15.103:0/1376547226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72d90c0 msgr2=0x5641d72e0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.651+0000 7f1a2a200640 1 --2- 172.21.15.103:0/1376547226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72d90c0 0x5641d72e0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.651+0000 7f1a2a200640 1 -- 172.21.15.103:0/1376547226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641d6f9a790 con 0x5641d72d6790 2024-09-11T01:09:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.651+0000 7f1a2a200640 1 --2- 172.21.15.103:0/1376547226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d6790 0x5641d72dfea0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009620 tx=0x7f1a1c02f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f098515bfdad6185 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.651+0000 7f1a0b400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:09:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.651+0000 7f1a0b400640 1 -- 172.21.15.103:0/1376547226 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c04d040 con 0x5641d72d6790 2024-09-11T01:09:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.651+0000 7f1a0b400640 1 -- 172.21.15.103:0/1376547226 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f1a1c004040 con 0x5641d72d6790 2024-09-11T01:09:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.651+0000 7f1a2efe5740 1 -- 172.21.15.103:0/1376547226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a1c03f070 con 0x5641d72d6790 2024-09-11T01:09:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.652+0000 7f1a0b400640 1 -- 172.21.15.103:0/1376547226 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a1c004240 con 0x5641d72d6790 2024-09-11T01:09:51.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.652+0000 7f1a2efe5740 10 client.15528 fetch_fsmap learned FSMap version 28 2024-09-11T01:09:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.652+0000 7f1a2efe5740 1 -- 172.21.15.103:0/1376547226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5641d7013620 con 0x5641d72d6790 2024-09-11T01:09:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.652+0000 7f1a0b400640 1 -- 172.21.15.103:0/1376547226 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a1c03f070 con 0x5641d72d6790 2024-09-11T01:09:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.652+0000 7f1a0b400640 1 -- 172.21.15.103:0/1376547226 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f1a1c02fce0 con 0x5641d72d6790 2024-09-11T01:09:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.652+0000 7f1a2efe5740 10 client.15528 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:09:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.652+0000 7f1a2efe5740 10 client.15528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:09:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.652+0000 7f1a2efe5740 20 client.15528 populate_metadata read hostname 'smithi103' 2024-09-11T01:09:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.652+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/1376547226 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641d72eb340 0x5641d72ed730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.652+0000 7f1a2efe5740 4 client.15528 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:09:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.652+0000 7f1a2efe5740 1 -- 172.21.15.103:0/1376547226 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641d724b600 con 0x5641d72eb340 2024-09-11T01:09:51.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.653+0000 7f1a28e00640 1 --2- 172.21.15.103:0/1376547226 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641d72eb340 0x5641d72ed730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.653+0000 7f1a28e00640 1 --2- 172.21.15.103:0/1376547226 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641d72eb340 0x5641d72ed730 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c7f6a14b01e2a6d server_cookie=7d413618938a36f4 in_seq=0 out_seq=0 2024-09-11T01:09:51.660 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.653+0000 7f1a0b400640 10 client.15528 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.654+0000 7f1a0b400640 1 -- 172.21.15.103:0/1376547226 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5641d724b600 con 0x5641d72eb340 2024-09-11T01:09:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.654+0000 7f1a0b400640 10 client.15528 handle_command_reply: tid=0 2024-09-11T01:09:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.654+0000 7f1a2efe5740 1 client.15528 shutdown 2024-09-11T01:09:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.654+0000 7f1a2efe5740 1 -- 172.21.15.103:0/1376547226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d6790 msgr2=0x5641d72dfea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.654+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/1376547226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d6790 0x5641d72dfea0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009620 tx=0x7f1a1c02f310 comp rx=0 tx=0).stop 2024-09-11T01:09:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.654+0000 7f1a2efe5740 1 -- 172.21.15.103:0/1376547226 shutdown_connections 2024-09-11T01:09:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.654+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/1376547226 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641d72eb340 0x5641d72ed730 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.654+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/1376547226 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72dbb00 0x5641d72e1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.654+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/1376547226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72d90c0 0x5641d72e0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.654+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/1376547226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d6790 0x5641d72dfea0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.661 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.654+0000 7f1a2efe5740 1 -- 172.21.15.103:0/1376547226 >> 172.21.15.103:0/1376547226 conn(0x5641d72d18e0 msgr2=0x5641d72d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.654+0000 7f1a0b400640 0 client.15528 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.654+0000 7f1a2efe5740 1 -- 172.21.15.103:0/1376547226 shutdown_connections 2024-09-11T01:09:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.654+0000 7f1a2efe5740 1 -- 172.21.15.103:0/1376547226 wait complete. 2024-09-11T01:09:51.662 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.655+0000 7f1a2efe5740 20 client.15528 trim_cache size 0 max 16384 2024-09-11T01:09:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.669+0000 7f1a2efe5740 1 Processor -- start 2024-09-11T01:09:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a2efe5740 1 -- start start 2024-09-11T01:09:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a2efe5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72d6790 0x5641d72dfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a2efe5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d90c0 0x5641d72dbee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a2efe5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72dbb00 0x5641d72dc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a2efe5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1a241b44b0 con 0x5641d72d90c0 2024-09-11T01:09:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a2efe5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1a241b1d50 con 0x5641d72d6790 2024-09-11T01:09:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a2efe5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1a241afba0 con 0x5641d72dbb00 2024-09-11T01:09:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a28e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d90c0 0x5641d72dbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a28e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d90c0 0x5641d72dbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55036/0 (socket says 172.21.15.103:55036) 2024-09-11T01:09:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a28e00640 1 -- 172.21.15.103:0/3521732973 learned_addr learned my addr 172.21.15.103:0/3521732973 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a28e00640 1 -- 172.21.15.103:0/3521732973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72dbb00 msgr2=0x5641d72dc420 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T01:09:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a28e00640 1 --2- 172.21.15.103:0/3521732973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72dbb00 0x5641d72dc420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a28e00640 1 -- 172.21.15.103:0/3521732973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72d6790 msgr2=0x5641d72dfc10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T01:09:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a28e00640 1 --2- 172.21.15.103:0/3521732973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72d6790 0x5641d72dfc10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.670+0000 7f1a28e00640 1 -- 172.21.15.103:0/3521732973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641d72db820 con 0x5641d72d90c0 2024-09-11T01:09:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.671+0000 7f1a28e00640 1 --2- 172.21.15.103:0/3521732973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d90c0 0x5641d72dbee0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009c00 tx=0x7f1a10005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a4b9c1ccadb8ff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.671+0000 7f1a16000640 1 -- 172.21.15.103:0/3521732973 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a10003d20 con 0x5641d72d90c0 2024-09-11T01:09:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.671+0000 7f1a16000640 1 -- 172.21.15.103:0/3521732973 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a100258f0 con 0x5641d72d90c0 2024-09-11T01:09:51.675 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.671+0000 7f1a16000640 1 -- 172.21.15.103:0/3521732973 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a10010900 con 0x5641d72d90c0 2024-09-11T01:09:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.671+0000 7f1a2efe5740 1 -- 172.21.15.103:0/3521732973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d90c0 msgr2=0x5641d72dbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.671+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/3521732973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d90c0 0x5641d72dbee0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009c00 tx=0x7f1a10005f90 comp rx=0 tx=0).stop 2024-09-11T01:09:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.672+0000 7f1a2efe5740 1 -- 172.21.15.103:0/3521732973 shutdown_connections 2024-09-11T01:09:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.672+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/3521732973 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72dbb00 0x5641d72dc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.672+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/3521732973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d90c0 0x5641d72dbee0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.672+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/3521732973 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72d6790 0x5641d72dfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.672+0000 7f1a2efe5740 1 -- 172.21.15.103:0/3521732973 >> 172.21.15.103:0/3521732973 conn(0x5641d72d18e0 msgr2=0x5641d72d5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.672+0000 7f1a2efe5740 1 -- 172.21.15.103:0/3521732973 shutdown_connections 2024-09-11T01:09:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.672+0000 7f1a2efe5740 1 -- 172.21.15.103:0/3521732973 wait complete. 2024-09-11T01:09:51.678 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.672+0000 7f1a2efe5740 1 -- start start 2024-09-11T01:09:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.672+0000 7f1a2efe5740 1 Processor -- start 2024-09-11T01:09:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a2efe5740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72d6790 0x5641d72e76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a2efe5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d90c0 0x5641d72e63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a2efe5740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72dbb00 0x5641d72e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a2efe5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1a241b0210 con 0x5641d72d90c0 2024-09-11T01:09:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a2efe5740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f1a241b1680 con 0x5641d72dbb00 2024-09-11T01:09:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a2efe5740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f1a241b08e0 con 0x5641d72d6790 2024-09-11T01:09:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a2efe5740 10 client.0 _ll_register_callbacks cb 0x7f1a18005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:09:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a28e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d90c0 0x5641d72e63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a28e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d90c0 0x5641d72e63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55040/0 (socket says 172.21.15.103:55040) 2024-09-11T01:09:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a28e00640 1 -- 172.21.15.103:0/3181972235 learned_addr learned my addr 172.21.15.103:0/3181972235 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:09:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a2a200640 1 --2- 172.21.15.103:0/3181972235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72dbb00 0x5641d72e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:51.679 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a2a200640 1 --2- 172.21.15.103:0/3181972235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72d6790 0x5641d72e76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a28e00640 1 -- 172.21.15.103:0/3181972235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72d6790 msgr2=0x5641d72e76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a28e00640 1 --2- 172.21.15.103:0/3181972235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72d6790 0x5641d72e76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a28e00640 1 -- 172.21.15.103:0/3181972235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72dbb00 msgr2=0x5641d72e68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:09:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a28e00640 1 --2- 172.21.15.103:0/3181972235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72dbb00 0x5641d72e68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.673+0000 7f1a28e00640 1 -- 172.21.15.103:0/3181972235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641d72e6e20 con 0x5641d72d90c0 2024-09-11T01:09:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.674+0000 7f1a28e00640 1 --2- 172.21.15.103:0/3181972235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d90c0 0x5641d72e63a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1a10004650 tx=0x7f1a100254d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839be826d2df212b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:09:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.674+0000 7f1a0b400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:09:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.674+0000 7f1a0b400640 1 -- 172.21.15.103:0/3181972235 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a10003d20 con 0x5641d72d90c0 2024-09-11T01:09:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.674+0000 7f1a0b400640 1 -- 172.21.15.103:0/3181972235 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f1a10025aa0 con 0x5641d72d90c0 2024-09-11T01:09:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.674+0000 7f1a2efe5740 1 -- 172.21.15.103:0/3181972235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a100258f0 con 0x5641d72d90c0 2024-09-11T01:09:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.674+0000 7f1a0b400640 1 -- 172.21.15.103:0/3181972235 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1a10037050 con 0x5641d72d90c0 2024-09-11T01:09:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.674+0000 7f1a2efe5740 10 client.15534 fetch_fsmap learned FSMap version 28 2024-09-11T01:09:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.674+0000 7f1a2efe5740 1 -- 172.21.15.103:0/3181972235 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5641d72e5d10 con 0x5641d72d90c0 2024-09-11T01:09:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.674+0000 7f1a0b400640 1 -- 172.21.15.103:0/3181972235 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a100258f0 con 0x5641d72d90c0 2024-09-11T01:09:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.675+0000 7f1a0b400640 1 -- 172.21.15.103:0/3181972235 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f1a10023020 con 0x5641d72d90c0 2024-09-11T01:09:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.675+0000 7f1a2efe5740 10 client.15534 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:09:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.675+0000 7f1a2efe5740 10 client.15534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:09:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.675+0000 7f1a2efe5740 20 client.15534 populate_metadata read hostname 'smithi103' 2024-09-11T01:09:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.675+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/3181972235 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641d7358880 0x5641d735aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:09:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.675+0000 7f1a2efe5740 4 client.15534 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:09:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.675+0000 7f1a2efe5740 1 -- 172.21.15.103:0/3181972235 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5641d72470b0 con 0x5641d7358880 2024-09-11T01:09:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.675+0000 7f1a2a200640 1 --2- 172.21.15.103:0/3181972235 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641d7358880 0x5641d735aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:09:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.675+0000 7f1a2a200640 1 --2- 172.21.15.103:0/3181972235 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641d7358880 0x5641d735aca0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12ca23b2deb33fab server_cookie=64c9edbbf7079bf9 in_seq=0 out_seq=0 2024-09-11T01:09:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.675+0000 7f1a0b400640 10 client.15534 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a0b400640 1 -- 172.21.15.103:0/3181972235 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5641d72470b0 con 0x5641d7358880 2024-09-11T01:09:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a0b400640 10 client.15534 handle_command_reply: tid=0 2024-09-11T01:09:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a2efe5740 1 client.15534 shutdown 2024-09-11T01:09:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a2efe5740 1 -- 172.21.15.103:0/3181972235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d90c0 msgr2=0x5641d72e63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/3181972235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d90c0 0x5641d72e63a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1a10004650 tx=0x7f1a100254d0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a2efe5740 1 -- 172.21.15.103:0/3181972235 shutdown_connections 2024-09-11T01:09:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/3181972235 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641d72dbb00 0x5641d72e68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/3181972235 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641d72d90c0 0x5641d72e63a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/3181972235 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641d7358880 0x5641d735aca0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a2efe5740 1 --2- 172.21.15.103:0/3181972235 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641d72d6790 0x5641d72e76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a2efe5740 1 -- 172.21.15.103:0/3181972235 >> 172.21.15.103:0/3181972235 conn(0x5641d72d18e0 msgr2=0x5641d72dbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a0b400640 0 client.15534 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:09:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a2efe5740 1 -- 172.21.15.103:0/3181972235 shutdown_connections 2024-09-11T01:09:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a2efe5740 1 -- 172.21.15.103:0/3181972235 wait complete. 2024-09-11T01:09:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.837+0000 7f1a2efe5740 20 client.15534 trim_cache size 0 max 16384 2024-09-11T01:09:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:09:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:09:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:09:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:09:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.838+0000 7f1a2c200640 1 -- 172.21.15.103:0/3380139221 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f1a0c0b5360 msgr2=0x7f1a0c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.838+0000 7f1a2c200640 1 --2- 172.21.15.103:0/3380139221 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f1a0c0b5360 0x7f1a0c0b7820 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1a180ac7b0 tx=0x7f1a18021000 comp rx=0 tx=0).stop 2024-09-11T01:09:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.838+0000 7f1a2c200640 1 -- 172.21.15.103:0/3380139221 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a24104ba0 msgr2=0x7f1a2419f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:09:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.838+0000 7f1a2c200640 1 --2- 172.21.15.103:0/3380139221 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a24104ba0 0x7f1a2419f310 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800e9f0 tx=0x7f1a1800edf0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.838+0000 7f1a2c200640 1 -- 172.21.15.103:0/3380139221 shutdown_connections 2024-09-11T01:09:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.838+0000 7f1a2c200640 1 --2- 172.21.15.103:0/3380139221 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f1a0c0b5360 0x7f1a0c0b7820 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.838+0000 7f1a2c200640 1 --2- 172.21.15.103:0/3380139221 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1a241066b0 0x7f1a241a0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.838+0000 7f1a2c200640 1 --2- 172.21.15.103:0/3380139221 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a24105cf0 0x7f1a2419f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.838+0000 7f1a2c200640 1 --2- 172.21.15.103:0/3380139221 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f1a24104ba0 0x7f1a2419f310 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:09:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.838+0000 7f1a2c200640 1 -- 172.21.15.103:0/3380139221 >> 172.21.15.103:0/3380139221 conn(0x7f1a24100460 msgr2=0x7f1a240795a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:09:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.838+0000 7f1a2c200640 1 -- 172.21.15.103:0/3380139221 shutdown_connections 2024-09-11T01:09:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:09:51.838+0000 7f1a2c200640 1 -- 172.21.15.103:0/3380139221 wait complete. 2024-09-11T01:09:52.095 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/parser.Tpo .deps/parser.Po 2024-09-11T01:09:52.099 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_fc.o -MD -MP -MF .deps/ffsb_fc.Tpo -c -o ffsb_fc.o ffsb_fc.c 2024-09-11T01:09:52.176 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/ffsb_fc.Tpo .deps/ffsb_fc.Po 2024-09-11T01:09:52.180 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT ffsb_stats.o -MD -MP -MF .deps/ffsb_stats.Tpo -c -o ffsb_stats.o ffsb_stats.c 2024-09-11T01:09:52.292 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/ffsb_stats.Tpo .deps/ffsb_stats.Po 2024-09-11T01:09:52.296 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -DHAVE_CONFIG_H -I. -D_GNU_SOURCE -g -O2 -D_REENTRANT -MT list.o -MD -MP -MF .deps/list.Tpo -c -o list.o list.c 2024-09-11T01:09:52.343 INFO:tasks.workunit.client.0.smithi103.stdout:mv -f .deps/list.Tpo .deps/list.Po 2024-09-11T01:09:52.349 INFO:tasks.workunit.client.0.smithi103.stdout:gcc -D_GNU_SOURCE -g -O2 -D_REENTRANT -o ffsb fileops.o rand.o main.o fh.o filelist.o metaops.o rwlock.o cirlist.o rbt.o ffsb_tg.o ffsb_fs.o ffsb_thread.o ffsb_op.o util.o parser.o ffsb_fc.o ffsb_stats.o list.o -lpthread -lm 2024-09-11T01:09:52.398 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/mnt.0/client.0/tmp/ffsb' 2024-09-11T01:09:52.398 INFO:tasks.workunit.client.0.smithi103.stderr:+ cd .. 2024-09-11T01:09:52.398 INFO:tasks.workunit.client.0.smithi103.stderr:+ mkdir tmp 2024-09-11T01:09:52.402 INFO:tasks.workunit.client.0.smithi103.stderr:+ cd tmp 2024-09-11T01:09:52.402 INFO:tasks.workunit.client.0.smithi103.stderr:+ for f in $mydir/*.ffsb 2024-09-11T01:09:52.402 INFO:tasks.workunit.client.0.smithi103.stderr:+ ../ffsb/ffsb /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/random_write.32.ffsb 2024-09-11T01:09:52.403 INFO:tasks.workunit.client.0.smithi103.stdout:FFSB version 6.0-RC2 started 2024-09-11T01:09:52.403 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:09:52.409 INFO:tasks.workunit.client.0.smithi103.stdout:benchmark time = 300 2024-09-11T01:09:52.410 INFO:tasks.workunit.client.0.smithi103.stdout:ThreadGroup 0 2024-09-11T01:09:52.410 INFO:tasks.workunit.client.0.smithi103.stdout:================ 2024-09-11T01:09:52.410 INFO:tasks.workunit.client.0.smithi103.stdout: num_threads = 32 2024-09-11T01:09:52.410 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:09:52.410 INFO:tasks.workunit.client.0.smithi103.stdout: read_random = off 2024-09-11T01:09:52.410 INFO:tasks.workunit.client.0.smithi103.stdout: read_size = 0 (0B) 2024-09-11T01:09:52.410 INFO:tasks.workunit.client.0.smithi103.stdout: read_blocksize = 0 (0B) 2024-09-11T01:09:52.410 INFO:tasks.workunit.client.0.smithi103.stdout: read_skip = off 2024-09-11T01:09:52.410 INFO:tasks.workunit.client.0.smithi103.stdout: read_skipsize = 0 (0B) 2024-09-11T01:09:52.410 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:09:52.410 INFO:tasks.workunit.client.0.smithi103.stdout: write_random = on 2024-09-11T01:09:52.410 INFO:tasks.workunit.client.0.smithi103.stdout: write_size = 5242880 (5MB) 2024-09-11T01:09:52.410 INFO:tasks.workunit.client.0.smithi103.stdout: fsync_file = 0 2024-09-11T01:09:52.410 INFO:tasks.workunit.client.0.smithi103.stdout: write_blocksize = 4096 (4KB) 2024-09-11T01:09:52.411 INFO:tasks.workunit.client.0.smithi103.stdout: wait time = 0 2024-09-11T01:09:52.411 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:09:52.411 INFO:tasks.workunit.client.0.smithi103.stdout: op weights 2024-09-11T01:09:52.411 INFO:tasks.workunit.client.0.smithi103.stdout: read = 0 (0.00%) 2024-09-11T01:09:52.411 INFO:tasks.workunit.client.0.smithi103.stdout: readall = 0 (0.00%) 2024-09-11T01:09:52.411 INFO:tasks.workunit.client.0.smithi103.stdout: write = 1 (100.00%) 2024-09-11T01:09:52.411 INFO:tasks.workunit.client.0.smithi103.stdout: create = 0 (0.00%) 2024-09-11T01:09:52.411 INFO:tasks.workunit.client.0.smithi103.stdout: append = 0 (0.00%) 2024-09-11T01:09:52.411 INFO:tasks.workunit.client.0.smithi103.stdout: delete = 0 (0.00%) 2024-09-11T01:09:52.411 INFO:tasks.workunit.client.0.smithi103.stdout: metaop = 0 (0.00%) 2024-09-11T01:09:52.411 INFO:tasks.workunit.client.0.smithi103.stdout: createdir = 0 (0.00%) 2024-09-11T01:09:52.411 INFO:tasks.workunit.client.0.smithi103.stdout: stat = 0 (0.00%) 2024-09-11T01:09:52.411 INFO:tasks.workunit.client.0.smithi103.stdout: writeall = 0 (0.00%) 2024-09-11T01:09:52.411 INFO:tasks.workunit.client.0.smithi103.stdout: writeall_fsync = 0 (0.00%) 2024-09-11T01:09:52.412 INFO:tasks.workunit.client.0.smithi103.stdout: open_close = 0 (0.00%) 2024-09-11T01:09:52.412 INFO:tasks.workunit.client.0.smithi103.stdout: write_fsync = 0 (0.00%) 2024-09-11T01:09:52.412 INFO:tasks.workunit.client.0.smithi103.stdout: create_fsync = 0 (0.00%) 2024-09-11T01:09:52.412 INFO:tasks.workunit.client.0.smithi103.stdout: append_fsync = 0 (0.00%) 2024-09-11T01:09:52.412 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:09:52.412 INFO:tasks.workunit.client.0.smithi103.stdout:FileSystem . 2024-09-11T01:09:52.412 INFO:tasks.workunit.client.0.smithi103.stdout:========== 2024-09-11T01:09:52.412 INFO:tasks.workunit.client.0.smithi103.stdout: num_dirs = 0 2024-09-11T01:09:52.412 INFO:tasks.workunit.client.0.smithi103.stdout: starting files = 128 2024-09-11T01:09:52.412 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:09:52.412 INFO:tasks.workunit.client.0.smithi103.stdout: min file size = 104857600 (100MB) 2024-09-11T01:09:52.412 INFO:tasks.workunit.client.0.smithi103.stdout: max file size = 104857600 (100MB) 2024-09-11T01:09:52.412 INFO:tasks.workunit.client.0.smithi103.stdout: directio = off 2024-09-11T01:09:52.412 INFO:tasks.workunit.client.0.smithi103.stdout: alignedio = on 2024-09-11T01:09:52.413 INFO:tasks.workunit.client.0.smithi103.stdout: bufferedio = off 2024-09-11T01:09:52.413 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:09:52.413 INFO:tasks.workunit.client.0.smithi103.stdout: aging is off 2024-09-11T01:09:52.413 INFO:tasks.workunit.client.0.smithi103.stdout: current utilization = 0.04% 2024-09-11T01:09:52.413 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:09:52.413 INFO:tasks.workunit.client.0.smithi103.stdout:checking existing fs: . 2024-09-11T01:09:52.413 INFO:tasks.workunit.client.0.smithi103.stdout:recreating new fileset 2024-09-11T01:09:52.414 INFO:tasks.workunit.client.0.smithi103.stderr:opendir: No such file or directory 2024-09-11T01:09:52.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:52 smithi183 ceph-mon[34992]: pgmap v445: 129 pgs: 129 active+clean; 7.0 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 631 KiB/s wr, 151 op/s 2024-09-11T01:09:53.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:52 smithi103 ceph-mon[30562]: pgmap v445: 129 pgs: 129 active+clean; 7.0 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 631 KiB/s wr, 151 op/s 2024-09-11T01:09:53.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:52 smithi117 ceph-mon[35358]: pgmap v445: 129 pgs: 129 active+clean; 7.0 MiB data, 411 MiB used, 1.0 TiB / 1.0 TiB avail; 482 KiB/s rd, 631 KiB/s wr, 151 op/s 2024-09-11T01:09:53.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:53 smithi183 ceph-mon[34992]: pgmap v446: 129 pgs: 129 active+clean; 8.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 640 KiB/s wr, 193 op/s 2024-09-11T01:09:54.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:53 smithi103 ceph-mon[30562]: pgmap v446: 129 pgs: 129 active+clean; 8.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 640 KiB/s wr, 193 op/s 2024-09-11T01:09:54.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:53 smithi117 ceph-mon[35358]: pgmap v446: 129 pgs: 129 active+clean; 8.7 MiB data, 415 MiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 640 KiB/s wr, 193 op/s 2024-09-11T01:09:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:56 smithi183 ceph-mon[34992]: pgmap v447: 129 pgs: 129 active+clean; 5.3 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 571 KiB/s wr, 160 op/s 2024-09-11T01:09:57.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:56 smithi103 ceph-mon[30562]: pgmap v447: 129 pgs: 129 active+clean; 5.3 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 571 KiB/s wr, 160 op/s 2024-09-11T01:09:57.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:56 smithi117 ceph-mon[35358]: pgmap v447: 129 pgs: 129 active+clean; 5.3 MiB data, 423 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 571 KiB/s wr, 160 op/s 2024-09-11T01:09:58.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:09:57 smithi103 ceph-mon[30562]: pgmap v448: 129 pgs: 129 active+clean; 5.2 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 377 KiB/s wr, 146 op/s 2024-09-11T01:09:58.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:09:57 smithi117 ceph-mon[35358]: pgmap v448: 129 pgs: 129 active+clean; 5.2 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 377 KiB/s wr, 146 op/s 2024-09-11T01:09:58.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:09:57 smithi183 ceph-mon[34992]: pgmap v448: 129 pgs: 129 active+clean; 5.2 MiB data, 422 MiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 377 KiB/s wr, 146 op/s 2024-09-11T01:10:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:00 smithi183 ceph-mon[34992]: pgmap v449: 129 pgs: 129 active+clean; 50 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 4.1 MiB/s wr, 175 op/s 2024-09-11T01:10:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:00 smithi183 ceph-mon[34992]: overall HEALTH_OK 2024-09-11T01:10:01.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:00 smithi103 ceph-mon[30562]: pgmap v449: 129 pgs: 129 active+clean; 50 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 4.1 MiB/s wr, 175 op/s 2024-09-11T01:10:01.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:00 smithi103 ceph-mon[30562]: overall HEALTH_OK 2024-09-11T01:10:01.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:00 smithi117 ceph-mon[35358]: pgmap v449: 129 pgs: 129 active+clean; 50 MiB data, 517 MiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 4.1 MiB/s wr, 175 op/s 2024-09-11T01:10:01.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:00 smithi117 ceph-mon[35358]: overall HEALTH_OK 2024-09-11T01:10:02.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:01 smithi103 ceph-mon[30562]: pgmap v450: 129 pgs: 129 active+clean; 158 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 13 MiB/s wr, 172 op/s 2024-09-11T01:10:02.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:01 smithi117 ceph-mon[35358]: pgmap v450: 129 pgs: 129 active+clean; 158 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 13 MiB/s wr, 172 op/s 2024-09-11T01:10:02.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:01 smithi183 ceph-mon[34992]: pgmap v450: 129 pgs: 129 active+clean; 158 MiB data, 590 MiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 13 MiB/s wr, 172 op/s 2024-09-11T01:10:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:04 smithi183 ceph-mon[34992]: pgmap v451: 129 pgs: 129 active+clean; 859 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 71 MiB/s wr, 197 op/s 2024-09-11T01:10:05.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.075+0000 7f9a00e00640 1 -- 172.21.15.103:0/3321393899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc06b470 msgr2=0x7f99fc105530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:05.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.075+0000 7f9a00e00640 1 --2- 172.21.15.103:0/3321393899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc06b470 0x7f99fc105530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f99ec009900 tx=0x7f99ec02a420 comp rx=0 tx=0).stop 2024-09-11T01:10:05.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.075+0000 7f9a00e00640 1 -- 172.21.15.103:0/3321393899 shutdown_connections 2024-09-11T01:10:05.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.075+0000 7f9a00e00640 1 --2- 172.21.15.103:0/3321393899 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99fc108670 0x7f99fc10ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.075+0000 7f9a00e00640 1 --2- 172.21.15.103:0/3321393899 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99fc105ac0 0x7f99fc107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.075+0000 7f9a00e00640 1 --2- 172.21.15.103:0/3321393899 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc06b470 0x7f99fc105530 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.075+0000 7f9a00e00640 1 -- 172.21.15.103:0/3321393899 >> 172.21.15.103:0/3321393899 conn(0x7f99fc0fd140 msgr2=0x7f99fc0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:05.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.075+0000 7f9a00e00640 1 -- 172.21.15.103:0/3321393899 shutdown_connections 2024-09-11T01:10:05.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.075+0000 7f9a00e00640 1 -- 172.21.15.103:0/3321393899 wait complete. 2024-09-11T01:10:05.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.076+0000 7f9a00e00640 1 Processor -- start 2024-09-11T01:10:05.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.077+0000 7f9a00e00640 1 -- start start 2024-09-11T01:10:05.079 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.077+0000 7f9a00e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99fc06b470 0x7f99fc194170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.077+0000 7f9a00e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc105ac0 0x7f99fc1947c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.077+0000 7f9a00e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99fc108670 0x7f99fc1953f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.077+0000 7f9a00e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc10e670 con 0x7f99fc06b470 2024-09-11T01:10:05.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.077+0000 7f9a00e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc10e4f0 con 0x7f99fc108670 2024-09-11T01:10:05.080 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.077+0000 7f9a00e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f99fc10e7f0 con 0x7f99fc105ac0 2024-09-11T01:10:05.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.077+0000 7f99f9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99fc06b470 0x7f99fc194170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.078+0000 7f99f9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99fc06b470 0x7f99fc194170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44942/0 (socket says 172.21.15.103:44942) 2024-09-11T01:10:05.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.078+0000 7f99f9e00640 1 -- 172.21.15.103:0/4082957831 learned_addr learned my addr 172.21.15.103:0/4082957831 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:05.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.078+0000 7f99f9400640 1 --2- 172.21.15.103:0/4082957831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc105ac0 0x7f99fc1947c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.078+0000 7f99fa800640 1 --2- 172.21.15.103:0/4082957831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99fc108670 0x7f99fc1953f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.079+0000 7f99f9e00640 1 -- 172.21.15.103:0/4082957831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc105ac0 msgr2=0x7f99fc1947c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:05.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.079+0000 7f99f9e00640 1 --2- 172.21.15.103:0/4082957831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc105ac0 0x7f99fc1947c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.081 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.079+0000 7f99f9e00640 1 -- 172.21.15.103:0/4082957831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99fc108670 msgr2=0x7f99fc1953f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:05.082 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.079+0000 7f99f9e00640 1 --2- 172.21.15.103:0/4082957831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99fc108670 0x7f99fc1953f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.082 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.079+0000 7f99f9e00640 1 -- 172.21.15.103:0/4082957831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99fc195cb0 con 0x7f99fc06b470 2024-09-11T01:10:05.082 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.081+0000 7f99f9e00640 1 --2- 172.21.15.103:0/4082957831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99fc06b470 0x7f99fc194170 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f99ec005ab0 tx=0x7f99ec003bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:05.083 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.081+0000 7f99f2a00640 1 -- 172.21.15.103:0/4082957831 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec03f070 con 0x7f99fc06b470 2024-09-11T01:10:05.083 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.082+0000 7f99f2a00640 1 -- 172.21.15.103:0/4082957831 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99ec031c50 con 0x7f99fc06b470 2024-09-11T01:10:05.083 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.082+0000 7f99f2a00640 1 -- 172.21.15.103:0/4082957831 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec035030 con 0x7f99fc06b470 2024-09-11T01:10:05.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:04 smithi103 ceph-mon[30562]: pgmap v451: 129 pgs: 129 active+clean; 859 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 71 MiB/s wr, 197 op/s 2024-09-11T01:10:05.085 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.082+0000 7f9a00e00640 1 -- 172.21.15.103:0/4082957831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99fc195f40 con 0x7f99fc06b470 2024-09-11T01:10:05.085 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.082+0000 7f9a00e00640 1 -- 172.21.15.103:0/4082957831 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99fc196460 con 0x7f99fc06b470 2024-09-11T01:10:05.088 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.086+0000 7f9a03e40740 1 Processor -- start 2024-09-11T01:10:05.088 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.087+0000 7f9a03e40740 1 -- start start 2024-09-11T01:10:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.087+0000 7f9a03e40740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425a8b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.087+0000 7f9a03e40740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425a90c0 0x558d425ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.087+0000 7f9a03e40740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425abb00 0x558d425adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.087+0000 7f9a03e40740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558d425196b0 con 0x558d425abb00 2024-09-11T01:10:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.087+0000 7f9a03e40740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558d42508ae0 con 0x558d425a6790 2024-09-11T01:10:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.087+0000 7f9a03e40740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558d4250c8f0 con 0x558d425a90c0 2024-09-11T01:10:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.087+0000 7f99fa800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425a8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.087+0000 7f99fa800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425a8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:33592/0 (socket says 172.21.15.103:33592) 2024-09-11T01:10:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.087+0000 7f99fa800640 1 -- 172.21.15.103:0/1417219543 learned_addr learned my addr 172.21.15.103:0/1417219543 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.088+0000 7f99fa800640 1 -- 172.21.15.103:0/1417219543 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425a90c0 msgr2=0x558d425ab4b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:10:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.088+0000 7f99fa800640 1 --2- 172.21.15.103:0/1417219543 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425a90c0 0x558d425ab4b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.088+0000 7f99fa800640 1 -- 172.21.15.103:0/1417219543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425abb00 msgr2=0x558d425adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.088+0000 7f99fa800640 1 --2- 172.21.15.103:0/1417219543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425abb00 0x558d425adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.088+0000 7f99fa800640 1 -- 172.21.15.103:0/1417219543 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d424d5780 con 0x558d425a6790 2024-09-11T01:10:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.088+0000 7f99fa800640 1 --2- 172.21.15.103:0/1417219543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425a8b80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f99f4007d60 tx=0x7f99f400c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6e3290d7baf855f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.088+0000 7f99e7400640 1 -- 172.21.15.103:0/1417219543 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f4015020 con 0x558d425a6790 2024-09-11T01:10:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.088+0000 7f99e7400640 1 -- 172.21.15.103:0/1417219543 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99f4011ae0 con 0x558d425a6790 2024-09-11T01:10:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.088+0000 7f99e7400640 1 -- 172.21.15.103:0/1417219543 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99f40109b0 con 0x558d425a6790 2024-09-11T01:10:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.089+0000 7f9a03e40740 1 -- 172.21.15.103:0/1417219543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 msgr2=0x558d425a8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.089+0000 7f9a03e40740 1 --2- 172.21.15.103:0/1417219543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425a8b80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f99f4007d60 tx=0x7f99f400c560 comp rx=0 tx=0).stop 2024-09-11T01:10:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.089+0000 7f9a03e40740 1 -- 172.21.15.103:0/1417219543 shutdown_connections 2024-09-11T01:10:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.089+0000 7f9a03e40740 1 --2- 172.21.15.103:0/1417219543 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425abb00 0x558d425adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.089+0000 7f9a03e40740 1 --2- 172.21.15.103:0/1417219543 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425a90c0 0x558d425ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.089+0000 7f9a03e40740 1 --2- 172.21.15.103:0/1417219543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425a8b80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.092 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.089+0000 7f9a03e40740 1 -- 172.21.15.103:0/1417219543 >> 172.21.15.103:0/1417219543 conn(0x558d425a18e0 msgr2=0x558d425a2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:05.092 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.090+0000 7f99f2a00640 1 -- 172.21.15.103:0/4082957831 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f99ec03b460 con 0x7f99fc06b470 2024-09-11T01:10:05.092 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.091+0000 7f9a03e40740 1 -- 172.21.15.103:0/1417219543 shutdown_connections 2024-09-11T01:10:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.092+0000 7f99f2a00640 1 --2- 172.21.15.103:0/4082957831 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f99e00b52b0 0x7f99e00b7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.092+0000 7f99f2a00640 1 -- 172.21.15.103:0/4082957831 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f99ec106aa0 con 0x7f99fc06b470 2024-09-11T01:10:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.093+0000 7f99f9400640 1 --2- 172.21.15.103:0/4082957831 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f99e00b52b0 0x7f99e00b7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.093+0000 7f9a03e40740 1 -- 172.21.15.103:0/1417219543 wait complete. 2024-09-11T01:10:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.093+0000 7f99f9400640 1 --2- 172.21.15.103:0/4082957831 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f99e00b52b0 0x7f99e00b7770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f99e8005d00 tx=0x7f99e8005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.093+0000 7f9a03e40740 1 -- start start 2024-09-11T01:10:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.094+0000 7f9a03e40740 1 Processor -- start 2024-09-11T01:10:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.094+0000 7f9a03e40740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.094+0000 7f9a03e40740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425abb00 0x558d425b0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.095+0000 7f9a03e40740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425b12c0 0x558d425b1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.095+0000 7f9a03e40740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558d42440ab0 con 0x558d425abb00 2024-09-11T01:10:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.095+0000 7f9a03e40740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558d424af570 con 0x558d425a6790 2024-09-11T01:10:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.095+0000 7f9a03e40740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558d425aeae0 con 0x558d425b12c0 2024-09-11T01:10:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.095+0000 7f9a03e40740 10 client.0 _ll_register_callbacks cb 0x558d424be100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.095+0000 7f99f9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425abb00 0x558d425b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.095+0000 7f99f9400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425abb00 0x558d425b0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44956/0 (socket says 172.21.15.103:44956) 2024-09-11T01:10:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.095+0000 7f99f9400640 1 -- 172.21.15.103:0/3932339434 learned_addr learned my addr 172.21.15.103:0/3932339434 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.095+0000 7f99f9e00640 1 --2- 172.21.15.103:0/3932339434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.095+0000 7f99fa800640 1 --2- 172.21.15.103:0/3932339434 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425b12c0 0x558d425b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.096+0000 7f99f9e00640 1 -- 172.21.15.103:0/3932339434 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425b12c0 msgr2=0x558d425b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.096+0000 7f99f9e00640 1 --2- 172.21.15.103:0/3932339434 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425b12c0 0x558d425b1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.096+0000 7f99f9e00640 1 -- 172.21.15.103:0/3932339434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425abb00 msgr2=0x558d425b0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.096+0000 7f99f9e00640 1 --2- 172.21.15.103:0/3932339434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425abb00 0x558d425b0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.096+0000 7f99f9e00640 1 -- 172.21.15.103:0/3932339434 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d4226a790 con 0x558d425a6790 2024-09-11T01:10:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.096+0000 7f99f9e00640 1 --2- 172.21.15.103:0/3932339434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425b0070 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x558d425a2ef0 tx=0x7f99ec0cc800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecf90f1a72bcb25f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.096+0000 7f99dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:10:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.096+0000 7f99dbe00640 1 -- 172.21.15.103:0/3932339434 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec049070 con 0x558d425a6790 2024-09-11T01:10:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.096+0000 7f99dbe00640 1 -- 172.21.15.103:0/3932339434 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f99ec0d5fb0 con 0x558d425a6790 2024-09-11T01:10:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.096+0000 7f9a03e40740 1 -- 172.21.15.103:0/3932339434 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99f4011ae0 con 0x558d425a6790 2024-09-11T01:10:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.096+0000 7f99dbe00640 1 -- 172.21.15.103:0/3932339434 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f99ec0cc9c0 con 0x558d425a6790 2024-09-11T01:10:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.097+0000 7f9a03e40740 10 client.25550 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.097+0000 7f9a03e40740 1 -- 172.21.15.103:0/3932339434 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558d422e3620 con 0x558d425a6790 2024-09-11T01:10:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.097+0000 7f99dbe00640 1 -- 172.21.15.103:0/3932339434 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99ec0cd5b0 con 0x558d425a6790 2024-09-11T01:10:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.097+0000 7f99dbe00640 1 -- 172.21.15.103:0/3932339434 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f99ec0b41d0 con 0x558d425a6790 2024-09-11T01:10:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.097+0000 7f9a03e40740 10 client.25550 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:05.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.097+0000 7f9a03e40740 10 client.25550 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:10:05.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.097+0000 7f9a03e40740 20 client.25550 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:05.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.097+0000 7f9a03e40740 1 --2- 172.21.15.103:0/3932339434 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558d425bbd90 0x558d425be1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.097+0000 7f9a03e40740 4 client.25550 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:10:05.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.097+0000 7f9a03e40740 1 -- 172.21.15.103:0/3932339434 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f99f4011ae0 con 0x558d425bbd90 2024-09-11T01:10:05.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.098+0000 7f99f9400640 1 --2- 172.21.15.103:0/3932339434 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558d425bbd90 0x558d425be1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.098+0000 7f99f9400640 1 --2- 172.21.15.103:0/3932339434 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558d425bbd90 0x558d425be1b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=232e6566694d28de server_cookie=4a3c1793b5709de1 in_seq=0 out_seq=0 2024-09-11T01:10:05.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.098+0000 7f99dbe00640 10 client.25550 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:05.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.099+0000 7f99dbe00640 1 -- 172.21.15.103:0/3932339434 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f99f4011ae0 con 0x558d425bbd90 2024-09-11T01:10:05.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.099+0000 7f99dbe00640 10 client.25550 handle_command_reply: tid=0 2024-09-11T01:10:05.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.099+0000 7f9a03e40740 1 client.25550 shutdown 2024-09-11T01:10:05.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.099+0000 7f9a03e40740 1 -- 172.21.15.103:0/3932339434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 msgr2=0x558d425b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:05.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.099+0000 7f9a03e40740 1 --2- 172.21.15.103:0/3932339434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425b0070 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x558d425a2ef0 tx=0x7f99ec0cc800 comp rx=0 tx=0).stop 2024-09-11T01:10:05.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.100+0000 7f9a03e40740 1 -- 172.21.15.103:0/3932339434 shutdown_connections 2024-09-11T01:10:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.100+0000 7f9a03e40740 1 --2- 172.21.15.103:0/3932339434 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558d425bbd90 0x558d425be1b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.100+0000 7f9a03e40740 1 --2- 172.21.15.103:0/3932339434 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425b12c0 0x558d425b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.100+0000 7f9a03e40740 1 --2- 172.21.15.103:0/3932339434 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425abb00 0x558d425b0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.100+0000 7f9a03e40740 1 --2- 172.21.15.103:0/3932339434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425b0070 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.100+0000 7f99dbe00640 0 client.25550 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.100+0000 7f9a03e40740 1 -- 172.21.15.103:0/3932339434 >> 172.21.15.103:0/3932339434 conn(0x558d425a18e0 msgr2=0x558d425a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.100+0000 7f9a03e40740 1 -- 172.21.15.103:0/3932339434 shutdown_connections 2024-09-11T01:10:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.100+0000 7f9a03e40740 1 -- 172.21.15.103:0/3932339434 wait complete. 2024-09-11T01:10:05.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.100+0000 7f9a03e40740 20 client.25550 trim_cache size 0 max 16384 2024-09-11T01:10:05.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:04 smithi117 ceph-mon[35358]: pgmap v451: 129 pgs: 129 active+clean; 859 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 71 MiB/s wr, 197 op/s 2024-09-11T01:10:05.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.135+0000 7f9a03e40740 1 Processor -- start 2024-09-11T01:10:05.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.135+0000 7f9a03e40740 1 -- start start 2024-09-11T01:10:05.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.136+0000 7f9a03e40740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425a6790 0x558d425a5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.137+0000 7f9a03e40740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425abb00 0x558d425a2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.137+0000 7f9a03e40740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425b12c0 0x558d425a27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.137+0000 7f9a03e40740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc012490 con 0x558d425abb00 2024-09-11T01:10:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.137+0000 7f9a03e40740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc00fd30 con 0x558d425b12c0 2024-09-11T01:10:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.137+0000 7f9a03e40740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc00db80 con 0x558d425a6790 2024-09-11T01:10:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.140+0000 7f99f9e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425a6790 0x558d425a5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.141+0000 7f99fa800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425b12c0 0x558d425a27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.141+0000 7f99fa800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425b12c0 0x558d425a27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:33618/0 (socket says 172.21.15.103:33618) 2024-09-11T01:10:05.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.141+0000 7f99fa800640 1 -- 172.21.15.103:0/2780642022 learned_addr learned my addr 172.21.15.103:0/2780642022 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.143+0000 7f99f9e00640 1 -- 172.21.15.103:0/2780642022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425b12c0 msgr2=0x558d425a27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.143+0000 7f99f9e00640 1 --2- 172.21.15.103:0/2780642022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425b12c0 0x558d425a27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.143+0000 7f99f9e00640 1 -- 172.21.15.103:0/2780642022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425abb00 msgr2=0x558d425a2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.143+0000 7f99f9e00640 1 --2- 172.21.15.103:0/2780642022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425abb00 0x558d425a2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.143+0000 7f99f9e00640 1 -- 172.21.15.103:0/2780642022 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d425ab820 con 0x558d425a6790 2024-09-11T01:10:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.143+0000 7f99fa800640 1 --2- 172.21.15.103:0/2780642022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425b12c0 0x558d425a27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:10:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.144+0000 7f99f9e00640 1 --2- 172.21.15.103:0/2780642022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425a6790 0x558d425a5d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f99ec02aa10 tx=0x7f99ec0cc930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8183d063e3bffb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.144+0000 7f99e6a00640 1 -- 172.21.15.103:0/2780642022 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec049070 con 0x558d425a6790 2024-09-11T01:10:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.144+0000 7f99e6a00640 1 -- 172.21.15.103:0/2780642022 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99ec0cd5b0 con 0x558d425a6790 2024-09-11T01:10:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.144+0000 7f99e6a00640 1 -- 172.21.15.103:0/2780642022 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0b40b0 con 0x558d425a6790 2024-09-11T01:10:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.146+0000 7f9a03e40740 1 -- 172.21.15.103:0/2780642022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425a6790 msgr2=0x558d425a5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.146+0000 7f9a03e40740 1 --2- 172.21.15.103:0/2780642022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425a6790 0x558d425a5d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f99ec02aa10 tx=0x7f99ec0cc930 comp rx=0 tx=0).stop 2024-09-11T01:10:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.147+0000 7f9a03e40740 1 -- 172.21.15.103:0/2780642022 shutdown_connections 2024-09-11T01:10:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.147+0000 7f9a03e40740 1 --2- 172.21.15.103:0/2780642022 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425b12c0 0x558d425a27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.148+0000 7f9a03e40740 1 --2- 172.21.15.103:0/2780642022 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425abb00 0x558d425a2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.148+0000 7f9a03e40740 1 --2- 172.21.15.103:0/2780642022 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425a6790 0x558d425a5d90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.148+0000 7f9a03e40740 1 -- 172.21.15.103:0/2780642022 >> 172.21.15.103:0/2780642022 conn(0x558d425a18e0 msgr2=0x558d425af210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.148+0000 7f9a03e40740 1 -- 172.21.15.103:0/2780642022 shutdown_connections 2024-09-11T01:10:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.148+0000 7f9a03e40740 1 -- 172.21.15.103:0/2780642022 wait complete. 2024-09-11T01:10:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.149+0000 7f9a03e40740 1 -- start start 2024-09-11T01:10:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.151+0000 7f9a03e40740 1 Processor -- start 2024-09-11T01:10:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.152+0000 7f9a03e40740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425b7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.152+0000 7f9a03e40740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425abb00 0x558d425b6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.152+0000 7f9a03e40740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425b12c0 0x558d425b7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.152+0000 7f9a03e40740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc00e1f0 con 0x558d425b12c0 2024-09-11T01:10:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.152+0000 7f9a03e40740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc00f660 con 0x558d425a6790 2024-09-11T01:10:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.152+0000 7f9a03e40740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc00e8c0 con 0x558d425abb00 2024-09-11T01:10:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.152+0000 7f9a03e40740 10 client.0 _ll_register_callbacks cb 0x7f99ec005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.153+0000 7f99f9e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425b7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.153+0000 7f99f9400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425abb00 0x558d425b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.153+0000 7f99f9400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425abb00 0x558d425b6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:38514/0 (socket says 172.21.15.103:38514) 2024-09-11T01:10:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.153+0000 7f99f9400640 1 -- 172.21.15.103:0/929191830 learned_addr learned my addr 172.21.15.103:0/929191830 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.153+0000 7f99fa800640 1 --2- 172.21.15.103:0/929191830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425b12c0 0x558d425b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.153+0000 7f99f9400640 1 -- 172.21.15.103:0/929191830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 msgr2=0x558d425b7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.153+0000 7f99f9400640 1 --2- 172.21.15.103:0/929191830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425b7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.153+0000 7f99f9400640 1 -- 172.21.15.103:0/929191830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425b12c0 msgr2=0x558d425b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.153+0000 7f99f9400640 1 --2- 172.21.15.103:0/929191830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425b12c0 0x558d425b7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.154+0000 7f99f9400640 1 -- 172.21.15.103:0/929191830 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d425b54c0 con 0x558d425abb00 2024-09-11T01:10:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.154+0000 7f99f9400640 1 --2- 172.21.15.103:0/929191830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425abb00 0x558d425b6990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f99e800fe90 tx=0x7f99e8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aab6f6eff942edad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.154+0000 7f99dbe00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:10:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.155+0000 7f99dbe00640 1 -- 172.21.15.103:0/929191830 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99e8011850 con 0x558d425abb00 2024-09-11T01:10:05.157 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.155+0000 7f99dbe00640 1 -- 172.21.15.103:0/929191830 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f99e80119f0 con 0x558d425abb00 2024-09-11T01:10:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.155+0000 7f9a03e40740 1 -- 172.21.15.103:0/929191830 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99ec0cd5b0 con 0x558d425abb00 2024-09-11T01:10:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.156+0000 7f99dbe00640 1 -- 172.21.15.103:0/929191830 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f99e8020e20 con 0x558d425abb00 2024-09-11T01:10:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.156+0000 7f9a03e40740 10 client.25534 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.156+0000 7f9a03e40740 1 -- 172.21.15.103:0/929191830 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558d4263a000 con 0x558d425abb00 2024-09-11T01:10:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.157+0000 7f99dbe00640 1 -- 172.21.15.103:0/929191830 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f99ec0cd5b0 con 0x558d425abb00 2024-09-11T01:10:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.159+0000 7f99dbe00640 1 -- 172.21.15.103:0/929191830 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f99e802e020 con 0x558d425abb00 2024-09-11T01:10:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.160+0000 7f9a03e40740 10 client.25534 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.160+0000 7f9a03e40740 10 client.25534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:10:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.160+0000 7f9a03e40740 20 client.25534 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.160+0000 7f9a03e40740 1 --2- 172.21.15.103:0/929191830 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558d4263a940 0x558d4263cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.160+0000 7f9a03e40740 4 client.25534 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:10:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.160+0000 7f9a03e40740 1 -- 172.21.15.103:0/929191830 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558d4251b600 con 0x558d4263a940 2024-09-11T01:10:05.164 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.161+0000 7f99f9e00640 1 --2- 172.21.15.103:0/929191830 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558d4263a940 0x558d4263cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.163+0000 7f99f9e00640 1 --2- 172.21.15.103:0/929191830 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558d4263a940 0x558d4263cd60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cd3f2614a4e6118 server_cookie=70be878f1673183a in_seq=0 out_seq=0 2024-09-11T01:10:05.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.163+0000 7f99dbe00640 10 client.25534 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.193+0000 7f99dbe00640 1 -- 172.21.15.103:0/929191830 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558d4251b600 con 0x558d4263a940 2024-09-11T01:10:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.193+0000 7f99dbe00640 10 client.25534 handle_command_reply: tid=0 2024-09-11T01:10:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.196+0000 7f9a03e40740 1 client.25534 shutdown 2024-09-11T01:10:05.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.197+0000 7f9a03e40740 1 -- 172.21.15.103:0/929191830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425abb00 msgr2=0x558d425b6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.197+0000 7f9a03e40740 1 --2- 172.21.15.103:0/929191830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425abb00 0x558d425b6990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f99e800fe90 tx=0x7f99e8004730 comp rx=0 tx=0).stop 2024-09-11T01:10:05.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.198+0000 7f9a03e40740 1 -- 172.21.15.103:0/929191830 shutdown_connections 2024-09-11T01:10:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.198+0000 7f9a03e40740 1 --2- 172.21.15.103:0/929191830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558d425b12c0 0x558d425b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.198+0000 7f9a03e40740 1 --2- 172.21.15.103:0/929191830 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558d4263a940 0x558d4263cd60 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.198+0000 7f9a03e40740 1 --2- 172.21.15.103:0/929191830 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558d425abb00 0x558d425b6990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.198+0000 7f9a03e40740 1 --2- 172.21.15.103:0/929191830 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558d425a6790 0x558d425b7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.198+0000 7f9a03e40740 1 -- 172.21.15.103:0/929191830 >> 172.21.15.103:0/929191830 conn(0x558d425a18e0 msgr2=0x558d425a5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.198+0000 7f99dbe00640 0 client.25534 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.198+0000 7f9a03e40740 1 -- 172.21.15.103:0/929191830 shutdown_connections 2024-09-11T01:10:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.198+0000 7f9a03e40740 1 -- 172.21.15.103:0/929191830 wait complete. 2024-09-11T01:10:05.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.198+0000 7f9a03e40740 20 client.25534 trim_cache size 0 max 16384 2024-09-11T01:10:05.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:10:05.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:10:05.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:10:05.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:10:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.199+0000 7f9a00e00640 1 -- 172.21.15.103:0/4082957831 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f99e00b52b0 msgr2=0x7f99e00b7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.199+0000 7f9a00e00640 1 --2- 172.21.15.103:0/4082957831 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f99e00b52b0 0x7f99e00b7770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f99e8005d00 tx=0x7f99e8005c50 comp rx=0 tx=0).stop 2024-09-11T01:10:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.199+0000 7f9a00e00640 1 -- 172.21.15.103:0/4082957831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99fc06b470 msgr2=0x7f99fc194170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.199+0000 7f9a00e00640 1 --2- 172.21.15.103:0/4082957831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99fc06b470 0x7f99fc194170 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f99ec005ab0 tx=0x7f99ec003bb0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.200+0000 7f9a00e00640 1 -- 172.21.15.103:0/4082957831 shutdown_connections 2024-09-11T01:10:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.200+0000 7f9a00e00640 1 --2- 172.21.15.103:0/4082957831 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f99e00b52b0 0x7f99e00b7770 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.200+0000 7f9a00e00640 1 --2- 172.21.15.103:0/4082957831 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f99fc108670 0x7f99fc1953f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.200+0000 7f9a00e00640 1 --2- 172.21.15.103:0/4082957831 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f99fc105ac0 0x7f99fc1947c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.200+0000 7f9a00e00640 1 --2- 172.21.15.103:0/4082957831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f99fc06b470 0x7f99fc194170 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:05.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.200+0000 7f9a00e00640 1 -- 172.21.15.103:0/4082957831 >> 172.21.15.103:0/4082957831 conn(0x7f99fc0fd140 msgr2=0x7f99fc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:05.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.200+0000 7f9a00e00640 1 -- 172.21.15.103:0/4082957831 shutdown_connections 2024-09-11T01:10:05.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:05.200+0000 7f9a00e00640 1 -- 172.21.15.103:0/4082957831 wait complete. 2024-09-11T01:10:06.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:05 smithi103 ceph-mon[30562]: pgmap v452: 129 pgs: 129 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 108 MiB/s wr, 134 op/s 2024-09-11T01:10:06.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:05 smithi117 ceph-mon[35358]: pgmap v452: 129 pgs: 129 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 108 MiB/s wr, 134 op/s 2024-09-11T01:10:06.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:05 smithi183 ceph-mon[34992]: pgmap v452: 129 pgs: 129 active+clean; 1.3 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 108 MiB/s wr, 134 op/s 2024-09-11T01:10:08.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:07 smithi103 ceph-mon[30562]: pgmap v453: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 114 MiB/s wr, 89 op/s 2024-09-11T01:10:08.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:07 smithi117 ceph-mon[35358]: pgmap v453: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 114 MiB/s wr, 89 op/s 2024-09-11T01:10:08.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:07 smithi183 ceph-mon[34992]: pgmap v453: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 114 MiB/s wr, 89 op/s 2024-09-11T01:10:10.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:09 smithi103 ceph-mon[30562]: pgmap v454: 129 pgs: 129 active+clean; 2.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 194 MiB/s wr, 113 op/s 2024-09-11T01:10:10.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:09 smithi117 ceph-mon[35358]: pgmap v454: 129 pgs: 129 active+clean; 2.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 194 MiB/s wr, 113 op/s 2024-09-11T01:10:10.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:09 smithi183 ceph-mon[34992]: pgmap v454: 129 pgs: 129 active+clean; 2.3 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 194 MiB/s wr, 113 op/s 2024-09-11T01:10:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:12 smithi183 ceph-mon[34992]: pgmap v455: 129 pgs: 129 active+clean; 2.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 213 MiB/s wr, 91 op/s 2024-09-11T01:10:13.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:12 smithi103 ceph-mon[30562]: pgmap v455: 129 pgs: 129 active+clean; 2.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 213 MiB/s wr, 91 op/s 2024-09-11T01:10:13.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:12 smithi117 ceph-mon[35358]: pgmap v455: 129 pgs: 129 active+clean; 2.5 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 213 MiB/s wr, 91 op/s 2024-09-11T01:10:13.713 INFO:tasks.quiescer.fs.[cephfs]:Total duration (41.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T01:10:13.713 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.5 2024-09-11T01:10:13.713 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:10:13.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:13 smithi183 ceph-mon[34992]: pgmap v456: 129 pgs: 129 active+clean; 3.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 277 MiB/s wr, 118 op/s 2024-09-11T01:10:14.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:13 smithi103 ceph-mon[30562]: pgmap v456: 129 pgs: 129 active+clean; 3.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 277 MiB/s wr, 118 op/s 2024-09-11T01:10:14.117 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:10:14.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:13 smithi117 ceph-mon[35358]: pgmap v456: 129 pgs: 129 active+clean; 3.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 277 MiB/s wr, 118 op/s 2024-09-11T01:10:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.856+0000 7febffe00640 1 -- 172.21.15.103:0/1838287256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec00101b00 msgr2=0x7fec00101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.856+0000 7febffe00640 1 --2- 172.21.15.103:0/1838287256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec00101b00 0x7fec00101ee0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7febf0009900 tx=0x7febf002a3f0 comp rx=0 tx=0).stop 2024-09-11T01:10:14.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.856+0000 7febffe00640 1 -- 172.21.15.103:0/1838287256 shutdown_connections 2024-09-11T01:10:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.856+0000 7febffe00640 1 --2- 172.21.15.103:0/1838287256 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec00107e90 0x7fec0010e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.856+0000 7febffe00640 1 --2- 172.21.15.103:0/1838287256 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec00107510 0x7fec00107950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.856+0000 7febffe00640 1 --2- 172.21.15.103:0/1838287256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec00101b00 0x7fec00101ee0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:14.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.856+0000 7febffe00640 1 -- 172.21.15.103:0/1838287256 >> 172.21.15.103:0/1838287256 conn(0x7fec000fd5b0 msgr2=0x7fec000ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:14.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.859+0000 7febffe00640 1 -- 172.21.15.103:0/1838287256 shutdown_connections 2024-09-11T01:10:14.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.859+0000 7febffe00640 1 -- 172.21.15.103:0/1838287256 wait complete. 2024-09-11T01:10:14.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.860+0000 7febffe00640 1 Processor -- start 2024-09-11T01:10:14.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.861+0000 7febffe00640 1 -- start start 2024-09-11T01:10:14.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.861+0000 7febffe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec00101b00 0x7fec00196de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:14.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.861+0000 7febffe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec00107510 0x7fec00197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.862+0000 7febfea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec00101b00 0x7fec00196de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.862+0000 7febfea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec00101b00 0x7fec00196de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:37866/0 (socket says 172.21.15.103:37866) 2024-09-11T01:10:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.862+0000 7febf6000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec00107510 0x7fec00197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.862+0000 7febf6000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec00107510 0x7fec00197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:33590/0 (socket says 172.21.15.103:33590) 2024-09-11T01:10:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.862+0000 7febffe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec00107e90 0x7fec0019c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:14.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.862+0000 7febffe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fec00110a90 con 0x7fec00107e90 2024-09-11T01:10:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.862+0000 7febffe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fec00110910 con 0x7fec00101b00 2024-09-11T01:10:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.862+0000 7febffe00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fec00110c10 con 0x7fec00107510 2024-09-11T01:10:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.862+0000 7febfea00640 1 -- 172.21.15.103:0/331167669 learned_addr learned my addr 172.21.15.103:0/331167669 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.863+0000 7febff400640 1 --2- 172.21.15.103:0/331167669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec00107e90 0x7fec0019c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.863+0000 7febf6000640 1 -- 172.21.15.103:0/331167669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec00101b00 msgr2=0x7fec00196de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.863+0000 7febf6000640 1 --2- 172.21.15.103:0/331167669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec00101b00 0x7fec00196de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:14.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.863+0000 7febf6000640 1 -- 172.21.15.103:0/331167669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec00107e90 msgr2=0x7fec0019c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.863+0000 7febf6000640 1 --2- 172.21.15.103:0/331167669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec00107e90 0x7fec0019c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.863+0000 7febf6000640 1 -- 172.21.15.103:0/331167669 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0019ce90 con 0x7fec00107510 2024-09-11T01:10:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.863+0000 7febf6000640 1 --2- 172.21.15.103:0/331167669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec00107510 0x7fec00197320 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7febe800d720 tx=0x7febe800dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.864+0000 7fec04a00640 1 -- 172.21.15.103:0/331167669 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8017070 con 0x7fec00107510 2024-09-11T01:10:14.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.864+0000 7fec04a00640 1 -- 172.21.15.103:0/331167669 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7febe800de30 con 0x7fec00107510 2024-09-11T01:10:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.864+0000 7fec04a00640 1 -- 172.21.15.103:0/331167669 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febe8004c40 con 0x7fec00107510 2024-09-11T01:10:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.864+0000 7febffe00640 1 -- 172.21.15.103:0/331167669 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0019d180 con 0x7fec00107510 2024-09-11T01:10:14.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.864+0000 7febffe00640 1 -- 172.21.15.103:0/331167669 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec001a3840 con 0x7fec00107510 2024-09-11T01:10:14.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.866+0000 7febffe00640 1 -- 172.21.15.103:0/331167669 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febdc0052c0 con 0x7fec00107510 2024-09-11T01:10:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.870+0000 7fec04a00640 1 -- 172.21.15.103:0/331167669 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7febe8009bd0 con 0x7fec00107510 2024-09-11T01:10:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.871+0000 7fec04a00640 1 --2- 172.21.15.103:0/331167669 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7febe40b9900 0x7febe40bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.871+0000 7fec04a00640 1 -- 172.21.15.103:0/331167669 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7febe80e56f0 con 0x7fec00107510 2024-09-11T01:10:14.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.871+0000 7febfea00640 1 --2- 172.21.15.103:0/331167669 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7febe40b9900 0x7febe40bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:14.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.872+0000 7febfea00640 1 --2- 172.21.15.103:0/331167669 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7febe40b9900 0x7febe40bbdc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7febf00096c0 tx=0x7febf0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:14.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:14.878+0000 7fec04a00640 1 -- 172.21.15.103:0/331167669 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7febe80ac1a0 con 0x7fec00107510 2024-09-11T01:10:15.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:15.276+0000 7febffe00640 1 -- 172.21.15.103:0/331167669 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febdc0055b0 con 0x7fec00107510 2024-09-11T01:10:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:15.280+0000 7fec04a00640 1 -- 172.21.15.103:0/331167669 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11934 (secure 0 0 0) 0x7febe80abaa0 con 0x7fec00107510 2024-09-11T01:10:15.286 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:10:15.286 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"btime":"2024-09-11T01:09:42:655122+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:09:42.508953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24629,24619]},"id":1}]} 2024-09-11T01:10:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2024-09-11T01:10:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:15.287+0000 7febffe00640 1 -- 172.21.15.103:0/331167669 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7febe40b9900 msgr2=0x7febe40bbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:15.287+0000 7febffe00640 1 --2- 172.21.15.103:0/331167669 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7febe40b9900 0x7febe40bbdc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7febf00096c0 tx=0x7febf0005a20 comp rx=0 tx=0).stop 2024-09-11T01:10:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:15.287+0000 7febffe00640 1 -- 172.21.15.103:0/331167669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec00107510 msgr2=0x7fec00197320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:15.287+0000 7febffe00640 1 --2- 172.21.15.103:0/331167669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec00107510 0x7fec00197320 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7febe800d720 tx=0x7febe800dbe0 comp rx=0 tx=0).stop 2024-09-11T01:10:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:15.287+0000 7febffe00640 1 -- 172.21.15.103:0/331167669 shutdown_connections 2024-09-11T01:10:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:15.287+0000 7febffe00640 1 --2- 172.21.15.103:0/331167669 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7febe40b9900 0x7febe40bbdc0 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7febf00096c0 tx=0x7febf0005a20 comp rx=0 tx=0).stop 2024-09-11T01:10:15.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:15.287+0000 7febffe00640 1 --2- 172.21.15.103:0/331167669 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec00107e90 0x7fec0019c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:15.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:15.287+0000 7febffe00640 1 --2- 172.21.15.103:0/331167669 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fec00107510 0x7fec00197320 secure :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7febe800d720 tx=0x7febe800dbe0 comp rx=0 tx=0).stop 2024-09-11T01:10:15.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:15.287+0000 7febffe00640 1 --2- 172.21.15.103:0/331167669 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec00101b00 0x7fec00196de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:15.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:15.287+0000 7febffe00640 1 -- 172.21.15.103:0/331167669 >> 172.21.15.103:0/331167669 conn(0x7fec000fd5b0 msgr2=0x7fec00106c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:15.289+0000 7febffe00640 1 -- 172.21.15.103:0/331167669 shutdown_connections 2024-09-11T01:10:15.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:15.289+0000 7febffe00640 1 -- 172.21.15.103:0/331167669 wait complete. 2024-09-11T01:10:15.586 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:15 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/331167669' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:10:15.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:15 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/331167669' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:10:15.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:15 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/331167669' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:10:16.358 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:16 smithi103 ceph-mon[30562]: pgmap v457: 129 pgs: 129 active+clean; 3.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 263 MiB/s wr, 102 op/s 2024-09-11T01:10:16.368 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24665 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0' 2024-09-11T01:10:16.368 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24665 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0 2024-09-11T01:10:16.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:16 smithi117 ceph-mon[35358]: pgmap v457: 129 pgs: 129 active+clean; 3.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 263 MiB/s wr, 102 op/s 2024-09-11T01:10:16.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:16 smithi183 ceph-mon[34992]: pgmap v457: 129 pgs: 129 active+clean; 3.9 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 263 MiB/s wr, 102 op/s 2024-09-11T01:10:17.071 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:10:17.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.817+0000 7f997ca00640 1 -- 172.21.15.103:0/2268582795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9978102220 msgr2=0x7f99781066f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:17.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.817+0000 7f997ca00640 1 --2- 172.21.15.103:0/2268582795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9978102220 0x7f99781066f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9964009860 tx=0x7f996402a380 comp rx=0 tx=0).stop 2024-09-11T01:10:17.821 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:17 smithi103 ceph-mon[30562]: pgmap v458: 129 pgs: 129 active+clean; 4.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 242 MiB/s wr, 94 op/s 2024-09-11T01:10:17.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.818+0000 7f997ca00640 1 -- 172.21.15.103:0/2268582795 shutdown_connections 2024-09-11T01:10:17.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.818+0000 7f997ca00640 1 --2- 172.21.15.103:0/2268582795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9978106d40 0x7f9978107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.818+0000 7f997ca00640 1 --2- 172.21.15.103:0/2268582795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9978102220 0x7f99781066f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.818+0000 7f997ca00640 1 --2- 172.21.15.103:0/2268582795 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9978101900 0x7f9978101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.818+0000 7f997ca00640 1 -- 172.21.15.103:0/2268582795 >> 172.21.15.103:0/2268582795 conn(0x7f99780fd5b0 msgr2=0x7f99780ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:17.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.818+0000 7f997ca00640 1 -- 172.21.15.103:0/2268582795 shutdown_connections 2024-09-11T01:10:17.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.818+0000 7f997ca00640 1 -- 172.21.15.103:0/2268582795 wait complete. 2024-09-11T01:10:17.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.819+0000 7f997ca00640 1 Processor -- start 2024-09-11T01:10:17.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.820+0000 7f997ca00640 1 -- start start 2024-09-11T01:10:17.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.820+0000 7f997ca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9978101900 0x7f9978074700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.820+0000 7f997ca00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9978102220 0x7f9978074c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.820+0000 7f997ca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9978106d40 0x7f997806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.820+0000 7f997ca00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f99781191b0 con 0x7f9978101900 2024-09-11T01:10:17.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.820+0000 7f997ca00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9978119030 con 0x7f9978106d40 2024-09-11T01:10:17.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.820+0000 7f997ca00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9978119330 con 0x7f9978102220 2024-09-11T01:10:17.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.820+0000 7f9976a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9978102220 0x7f9978074c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.821+0000 7f9976a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9978102220 0x7f9978074c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:33610/0 (socket says 172.21.15.103:33610) 2024-09-11T01:10:17.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.821+0000 7f9976a00640 1 -- 172.21.15.103:0/2498832394 learned_addr learned my addr 172.21.15.103:0/2498832394 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:17.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.821+0000 7f9977400640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9978101900 0x7f9978074700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.821+0000 7f9977e00640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9978106d40 0x7f997806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.821+0000 7f9976a00640 1 -- 172.21.15.103:0/2498832394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9978106d40 msgr2=0x7f997806d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:17.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.821+0000 7f9976a00640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9978106d40 0x7f997806d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.821+0000 7f9976a00640 1 -- 172.21.15.103:0/2498832394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9978101900 msgr2=0x7f9978074700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:17.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.821+0000 7f9976a00640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9978101900 0x7f9978074700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.821+0000 7f9976a00640 1 -- 172.21.15.103:0/2498832394 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997806e2a0 con 0x7f9978102220 2024-09-11T01:10:17.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.821+0000 7f9977400640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9978101900 0x7f9978074700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:10:17.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.822+0000 7f9976a00640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9978102220 0x7f9978074c40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9964000c00 tx=0x7f9964005780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:17.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.823+0000 7f996fe00640 1 -- 172.21.15.103:0/2498832394 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964037050 con 0x7f9978102220 2024-09-11T01:10:17.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.823+0000 7f996fe00640 1 -- 172.21.15.103:0/2498832394 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9964043070 con 0x7f9978102220 2024-09-11T01:10:17.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.823+0000 7f996fe00640 1 -- 172.21.15.103:0/2498832394 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964003a10 con 0x7f9978102220 2024-09-11T01:10:17.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.823+0000 7f997ca00640 1 -- 172.21.15.103:0/2498832394 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f997806e530 con 0x7f9978102220 2024-09-11T01:10:17.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.823+0000 7f997ca00640 1 -- 172.21.15.103:0/2498832394 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9978073540 con 0x7f9978102220 2024-09-11T01:10:17.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.826+0000 7f9980c15740 1 Processor -- start 2024-09-11T01:10:17.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.826+0000 7f9980c15740 1 -- start start 2024-09-11T01:10:17.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.827+0000 7f9980c15740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe5072f0 0x5646fe5076d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.827+0000 7f9980c15740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe507c10 0x5646fe513660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.827+0000 7f9980c15740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe513ba0 0x5646fe515f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.827+0000 7f9977e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe5072f0 0x5646fe5076d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.827+0000 7f9980c15740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5646fe47cca0 con 0x5646fe513ba0 2024-09-11T01:10:17.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.827+0000 7f9980c15740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5646fe46c0d0 con 0x5646fe5072f0 2024-09-11T01:10:17.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.827+0000 7f9977e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe5072f0 0x5646fe5076d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:37898/0 (socket says 172.21.15.103:37898) 2024-09-11T01:10:17.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.827+0000 7f9977e00640 1 -- 172.21.15.103:0/3129989196 learned_addr learned my addr 172.21.15.103:0/3129989196 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:17.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.827+0000 7f9980c15740 1 -- 172.21.15.103:0/3129989196 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5646fe46fee0 con 0x5646fe507c10 2024-09-11T01:10:17.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.828+0000 7f9977e00640 1 -- 172.21.15.103:0/3129989196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe507c10 msgr2=0x5646fe513660 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T01:10:17.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.828+0000 7f9977e00640 1 --2- 172.21.15.103:0/3129989196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe507c10 0x5646fe513660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.828+0000 7f9977e00640 1 -- 172.21.15.103:0/3129989196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe513ba0 msgr2=0x5646fe515f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:10:17.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.828+0000 7f996fe00640 1 -- 172.21.15.103:0/2498832394 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f9964003bb0 con 0x7f9978102220 2024-09-11T01:10:17.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.828+0000 7f9977e00640 1 --2- 172.21.15.103:0/3129989196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe513ba0 0x5646fe515f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.828+0000 7f9977e00640 1 -- 172.21.15.103:0/3129989196 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646fe41e400 con 0x5646fe5072f0 2024-09-11T01:10:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.828+0000 7f9977e00640 1 --2- 172.21.15.103:0/3129989196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe5072f0 0x5646fe5076d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f997000f480 tx=0x7f997000f940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e05b69ce2194b7d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.828+0000 7f9963e00640 1 -- 172.21.15.103:0/3129989196 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997001d070 con 0x5646fe5072f0 2024-09-11T01:10:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.828+0000 7f9963e00640 1 -- 172.21.15.103:0/3129989196 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f997000cb50 con 0x5646fe5072f0 2024-09-11T01:10:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.828+0000 7f9963e00640 1 -- 172.21.15.103:0/3129989196 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970018c80 con 0x5646fe5072f0 2024-09-11T01:10:17.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.829+0000 7f9980c15740 1 -- 172.21.15.103:0/3129989196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe5072f0 msgr2=0x5646fe5076d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.829+0000 7f9980c15740 1 --2- 172.21.15.103:0/3129989196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe5072f0 0x5646fe5076d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f997000f480 tx=0x7f997000f940 comp rx=0 tx=0).stop 2024-09-11T01:10:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.829+0000 7f996fe00640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f995c0b5560 0x7f995c0b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.829+0000 7f996fe00640 1 -- 172.21.15.103:0/2498832394 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f9964106480 con 0x7f9978102220 2024-09-11T01:10:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.830+0000 7f9977e00640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f995c0b5560 0x7f995c0b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.830+0000 7f9980c15740 1 -- 172.21.15.103:0/3129989196 shutdown_connections 2024-09-11T01:10:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.830+0000 7f9980c15740 1 --2- 172.21.15.103:0/3129989196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe513ba0 0x5646fe515f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.830+0000 7f9980c15740 1 --2- 172.21.15.103:0/3129989196 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe507c10 0x5646fe513660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.830+0000 7f9980c15740 1 --2- 172.21.15.103:0/3129989196 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe5072f0 0x5646fe5076d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.830+0000 7f9980c15740 1 -- 172.21.15.103:0/3129989196 >> 172.21.15.103:0/3129989196 conn(0x5646fe505120 msgr2=0x5646fe5062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.831+0000 7f9977e00640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f995c0b5560 0x7f995c0b7a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9970009e70 tx=0x7f9970018880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:17.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.831+0000 7f9980c15740 1 -- 172.21.15.103:0/3129989196 shutdown_connections 2024-09-11T01:10:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.831+0000 7f9980c15740 1 -- 172.21.15.103:0/3129989196 wait complete. 2024-09-11T01:10:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.831+0000 7f9980c15740 1 -- start start 2024-09-11T01:10:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.831+0000 7f9980c15740 1 Processor -- start 2024-09-11T01:10:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.832+0000 7f9980c15740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe5072f0 0x5646fe513570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.832+0000 7f9980c15740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe507c10 0x5646fe5109c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.833+0000 7f9980c15740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe513ba0 0x5646fe5110b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.833+0000 7f9977400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe5072f0 0x5646fe513570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.833+0000 7f9977400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe5072f0 0x5646fe513570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:33632/0 (socket says 172.21.15.103:33632) 2024-09-11T01:10:17.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.833+0000 7f9977400640 1 -- 172.21.15.103:0/3433599713 learned_addr learned my addr 172.21.15.103:0/3433599713 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:17.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.833+0000 7f9980c15740 1 -- 172.21.15.103:0/3433599713 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5646fe2cd7a0 con 0x5646fe513ba0 2024-09-11T01:10:17.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.833+0000 7f9980c15740 1 -- 172.21.15.103:0/3433599713 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5646fe411a10 con 0x5646fe507c10 2024-09-11T01:10:17.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.833+0000 7f9980c15740 1 -- 172.21.15.103:0/3433599713 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5646fe516820 con 0x5646fe5072f0 2024-09-11T01:10:17.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.833+0000 7f9977e00640 1 --2- 172.21.15.103:0/3433599713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe513ba0 0x5646fe5110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.833+0000 7f9976a00640 1 --2- 172.21.15.103:0/3433599713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe507c10 0x5646fe5109c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.833+0000 7f9980c15740 10 client.0 _ll_register_callbacks cb 0x5646fe421be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:17.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.834+0000 7f9976a00640 1 -- 172.21.15.103:0/3433599713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe5072f0 msgr2=0x5646fe513570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:17.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.834+0000 7f9976a00640 1 --2- 172.21.15.103:0/3433599713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe5072f0 0x5646fe513570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.834+0000 7f9976a00640 1 -- 172.21.15.103:0/3433599713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe513ba0 msgr2=0x5646fe5110b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:17.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.834+0000 7f9976a00640 1 --2- 172.21.15.103:0/3433599713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe513ba0 0x5646fe5110b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.837 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.834+0000 7f9976a00640 1 -- 172.21.15.103:0/3433599713 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646fe1d9b90 con 0x5646fe507c10 2024-09-11T01:10:17.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.834+0000 7f9976a00640 1 --2- 172.21.15.103:0/3433599713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe507c10 0x5646fe5109c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f99640cc840 tx=0x7f99640308b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52ef4fb0eef5f7d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:17.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.834+0000 7f9960c00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:10:17.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.834+0000 7f9960c00640 1 -- 172.21.15.103:0/3433599713 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99640cc200 con 0x5646fe507c10 2024-09-11T01:10:17.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.835+0000 7f9960c00640 1 -- 172.21.15.103:0/3433599713 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f99640cdde0 con 0x5646fe507c10 2024-09-11T01:10:17.838 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.835+0000 7f9980c15740 1 -- 172.21.15.103:0/3433599713 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f997000cb50 con 0x5646fe507c10 2024-09-11T01:10:17.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.835+0000 7f9960c00640 1 -- 172.21.15.103:0/3433599713 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f99640cc020 con 0x5646fe507c10 2024-09-11T01:10:17.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.835+0000 7f9980c15740 10 client.25574 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:17.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.835+0000 7f9980c15740 1 -- 172.21.15.103:0/3433599713 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5646fe522220 con 0x5646fe507c10 2024-09-11T01:10:17.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.835+0000 7f9960c00640 1 -- 172.21.15.103:0/3433599713 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f997000cb50 con 0x5646fe507c10 2024-09-11T01:10:17.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.835+0000 7f9960c00640 1 -- 172.21.15.103:0/3433599713 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f99640d59b0 con 0x5646fe507c10 2024-09-11T01:10:17.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.836+0000 7f9980c15740 10 client.25574 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:17.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.836+0000 7f9980c15740 10 client.25574 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:10:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.836+0000 7f9980c15740 20 client.25574 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.836+0000 7f9980c15740 1 --2- 172.21.15.103:0/3433599713 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5646fe523570 0x5646fe525960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.836+0000 7f9980c15740 4 client.25574 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:10:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.836+0000 7f9980c15740 1 -- 172.21.15.103:0/3433599713 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646fe47ebf0 con 0x5646fe523570 2024-09-11T01:10:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.836+0000 7f9977400640 1 --2- 172.21.15.103:0/3433599713 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5646fe523570 0x5646fe525960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.837+0000 7f9977400640 1 --2- 172.21.15.103:0/3433599713 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5646fe523570 0x5646fe525960 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28a1e4e216ec7c4e server_cookie=22c9daa7593d5041 in_seq=0 out_seq=0 2024-09-11T01:10:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.837+0000 7f9960c00640 10 client.25574 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.837+0000 7f9960c00640 1 -- 172.21.15.103:0/3433599713 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5646fe47ebf0 con 0x5646fe523570 2024-09-11T01:10:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.837+0000 7f9960c00640 10 client.25574 handle_command_reply: tid=0 2024-09-11T01:10:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.837+0000 7f9980c15740 1 client.25574 shutdown 2024-09-11T01:10:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.838+0000 7f9980c15740 1 -- 172.21.15.103:0/3433599713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe507c10 msgr2=0x5646fe5109c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.838+0000 7f9980c15740 1 --2- 172.21.15.103:0/3433599713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe507c10 0x5646fe5109c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f99640cc840 tx=0x7f99640308b0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.838+0000 7f9980c15740 1 -- 172.21.15.103:0/3433599713 shutdown_connections 2024-09-11T01:10:17.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.838+0000 7f9980c15740 1 --2- 172.21.15.103:0/3433599713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe513ba0 0x5646fe5110b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.838+0000 7f9980c15740 1 --2- 172.21.15.103:0/3433599713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe507c10 0x5646fe5109c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.838+0000 7f9980c15740 1 --2- 172.21.15.103:0/3433599713 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5646fe523570 0x5646fe525960 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.838+0000 7f9980c15740 1 --2- 172.21.15.103:0/3433599713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe5072f0 0x5646fe513570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.838+0000 7f9960c00640 0 client.25574 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.838+0000 7f9980c15740 1 -- 172.21.15.103:0/3433599713 >> 172.21.15.103:0/3433599713 conn(0x5646fe505120 msgr2=0x5646fe50ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.838+0000 7f9980c15740 1 -- 172.21.15.103:0/3433599713 shutdown_connections 2024-09-11T01:10:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.838+0000 7f9980c15740 1 -- 172.21.15.103:0/3433599713 wait complete. 2024-09-11T01:10:17.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.838+0000 7f9980c15740 20 client.25574 trim_cache size 0 max 16384 2024-09-11T01:10:17.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.857+0000 7f9980c15740 1 Processor -- start 2024-09-11T01:10:17.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.857+0000 7f9980c15740 1 -- start start 2024-09-11T01:10:17.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.857+0000 7f9980c15740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe5072f0 0x5646fe51fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.857+0000 7f9980c15740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe507c10 0x5646fe50f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.857+0000 7f9980c15740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe513ba0 0x5646fe50f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.857+0000 7f9980c15740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f99781c9820 con 0x5646fe507c10 2024-09-11T01:10:17.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.857+0000 7f9980c15740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99781c70c0 con 0x5646fe513ba0 2024-09-11T01:10:17.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.857+0000 7f9980c15740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f997810fe90 con 0x5646fe5072f0 2024-09-11T01:10:17.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.858+0000 7f9977e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe513ba0 0x5646fe50f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.858+0000 7f9977e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe513ba0 0x5646fe50f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:37918/0 (socket says 172.21.15.103:37918) 2024-09-11T01:10:17.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.858+0000 7f9977e00640 1 -- 172.21.15.103:0/350732732 learned_addr learned my addr 172.21.15.103:0/350732732 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:17.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.858+0000 7f9976a00640 1 --2- 172.21.15.103:0/350732732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe507c10 0x5646fe50f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.858+0000 7f9977400640 1 --2- 172.21.15.103:0/350732732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe5072f0 0x5646fe51fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.858+0000 7f9977e00640 1 -- 172.21.15.103:0/350732732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe5072f0 msgr2=0x5646fe51fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:17.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.858+0000 7f9977e00640 1 --2- 172.21.15.103:0/350732732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe5072f0 0x5646fe51fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.858+0000 7f9977e00640 1 -- 172.21.15.103:0/350732732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe507c10 msgr2=0x5646fe50f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:17.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.858+0000 7f9977e00640 1 --2- 172.21.15.103:0/350732732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe507c10 0x5646fe50f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.858+0000 7f9977e00640 1 -- 172.21.15.103:0/350732732 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646fe506a20 con 0x5646fe513ba0 2024-09-11T01:10:17.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.859+0000 7f9977e00640 1 --2- 172.21.15.103:0/350732732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe513ba0 0x5646fe50f780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9970018850 tx=0x7f9970023000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deb3153503a1b53e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:17.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.859+0000 7f9963400640 1 -- 172.21.15.103:0/350732732 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997002b050 con 0x5646fe513ba0 2024-09-11T01:10:17.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.859+0000 7f9963400640 1 -- 172.21.15.103:0/350732732 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f997002c040 con 0x5646fe513ba0 2024-09-11T01:10:17.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.859+0000 7f9963400640 1 -- 172.21.15.103:0/350732732 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997001d040 con 0x5646fe513ba0 2024-09-11T01:10:17.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.860+0000 7f9980c15740 1 -- 172.21.15.103:0/350732732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe513ba0 msgr2=0x5646fe50f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:17.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.860+0000 7f9980c15740 1 --2- 172.21.15.103:0/350732732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe513ba0 0x5646fe50f780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9970018850 tx=0x7f9970023000 comp rx=0 tx=0).stop 2024-09-11T01:10:17.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.860+0000 7f9980c15740 1 -- 172.21.15.103:0/350732732 shutdown_connections 2024-09-11T01:10:17.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.860+0000 7f9980c15740 1 --2- 172.21.15.103:0/350732732 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe513ba0 0x5646fe50f780 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.860+0000 7f9980c15740 1 --2- 172.21.15.103:0/350732732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe507c10 0x5646fe50f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.860+0000 7f9980c15740 1 --2- 172.21.15.103:0/350732732 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe5072f0 0x5646fe51fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.860+0000 7f9980c15740 1 -- 172.21.15.103:0/350732732 >> 172.21.15.103:0/350732732 conn(0x5646fe505120 msgr2=0x5646fe50bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:17.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.860+0000 7f9980c15740 1 -- 172.21.15.103:0/350732732 shutdown_connections 2024-09-11T01:10:17.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.860+0000 7f9980c15740 1 -- 172.21.15.103:0/350732732 wait complete. 2024-09-11T01:10:17.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.860+0000 7f9980c15740 1 -- start start 2024-09-11T01:10:17.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.861+0000 7f9980c15740 1 Processor -- start 2024-09-11T01:10:17.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.861+0000 7f9980c15740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe5072f0 0x5646fe51bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.861+0000 7f9980c15740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe507c10 0x5646fe51c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.861+0000 7f9980c15740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe513ba0 0x5646fe516c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.861+0000 7f9980c15740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9978110500 con 0x5646fe507c10 2024-09-11T01:10:17.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.861+0000 7f9980c15740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f99781c69f0 con 0x5646fe5072f0 2024-09-11T01:10:17.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.861+0000 7f9980c15740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9978110bd0 con 0x5646fe513ba0 2024-09-11T01:10:17.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.861+0000 7f9980c15740 10 client.0 _ll_register_callbacks cb 0x7f99640c8f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:17.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.861+0000 7f9977400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe5072f0 0x5646fe51bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.861+0000 7f9977400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe5072f0 0x5646fe51bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:37924/0 (socket says 172.21.15.103:37924) 2024-09-11T01:10:17.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.861+0000 7f9977400640 1 -- 172.21.15.103:0/1455923017 learned_addr learned my addr 172.21.15.103:0/1455923017 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:17.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.862+0000 7f9977e00640 1 --2- 172.21.15.103:0/1455923017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe513ba0 0x5646fe516c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.862+0000 7f9976a00640 1 --2- 172.21.15.103:0/1455923017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe507c10 0x5646fe51c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.862+0000 7f9977400640 1 -- 172.21.15.103:0/1455923017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe513ba0 msgr2=0x5646fe516c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:17.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.862+0000 7f9977400640 1 --2- 172.21.15.103:0/1455923017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe513ba0 0x5646fe516c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.862+0000 7f9977400640 1 -- 172.21.15.103:0/1455923017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe507c10 msgr2=0x5646fe51c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:17.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.862+0000 7f9977400640 1 --2- 172.21.15.103:0/1455923017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe507c10 0x5646fe51c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:17.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.862+0000 7f9977400640 1 -- 172.21.15.103:0/1455923017 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646fe5174a0 con 0x5646fe5072f0 2024-09-11T01:10:17.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.862+0000 7f9977400640 1 --2- 172.21.15.103:0/1455923017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe5072f0 0x5646fe51bf00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9968005fd0 tx=0x7f99680108c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e518ecd7fa8ddd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:17.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.862+0000 7f9960c00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:10:17.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.862+0000 7f9960c00640 1 -- 172.21.15.103:0/1455923017 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9968004220 con 0x5646fe5072f0 2024-09-11T01:10:17.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.863+0000 7f9980c15740 1 -- 172.21.15.103:0/1455923017 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f997002c040 con 0x5646fe5072f0 2024-09-11T01:10:17.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.863+0000 7f9960c00640 1 -- 172.21.15.103:0/1455923017 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f99680043c0 con 0x5646fe5072f0 2024-09-11T01:10:17.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.863+0000 7f9960c00640 1 -- 172.21.15.103:0/1455923017 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f996802c050 con 0x5646fe5072f0 2024-09-11T01:10:17.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.863+0000 7f9980c15740 10 client.25580 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:17.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.863+0000 7f9980c15740 1 -- 172.21.15.103:0/1455923017 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5646fe591170 con 0x5646fe5072f0 2024-09-11T01:10:17.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.863+0000 7f9960c00640 1 -- 172.21.15.103:0/1455923017 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f997002c040 con 0x5646fe5072f0 2024-09-11T01:10:17.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.863+0000 7f9960c00640 1 -- 172.21.15.103:0/1455923017 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f996800f5a0 con 0x5646fe5072f0 2024-09-11T01:10:17.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.863+0000 7f9980c15740 10 client.25580 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:17.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.863+0000 7f9980c15740 10 client.25580 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:10:17.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.863+0000 7f9980c15740 20 client.25580 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:17.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.863+0000 7f9980c15740 1 --2- 172.21.15.103:0/1455923017 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5646fe591a20 0x5646fe593e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:17.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.863+0000 7f9980c15740 4 client.25580 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}] 2024-09-11T01:10:17.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.863+0000 7f9980c15740 1 -- 172.21.15.103:0/1455923017 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}) -- 0x5646fe47a6a0 con 0x5646fe591a20 2024-09-11T01:10:17.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.864+0000 7f9976a00640 1 --2- 172.21.15.103:0/1455923017 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5646fe591a20 0x5646fe593e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:17.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.864+0000 7f9976a00640 1 --2- 172.21.15.103:0/1455923017 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5646fe591a20 0x5646fe593e40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae06509e89172903 server_cookie=46487f6b6a2b6e9 in_seq=0 out_seq=0 2024-09-11T01:10:17.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:17.864+0000 7f9960c00640 10 client.25580 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:18.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:17 smithi117 ceph-mon[35358]: pgmap v458: 129 pgs: 129 active+clean; 4.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 242 MiB/s wr, 94 op/s 2024-09-11T01:10:18.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:17 smithi183 ceph-mon[34992]: pgmap v458: 129 pgs: 129 active+clean; 4.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 242 MiB/s wr, 94 op/s 2024-09-11T01:10:18.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.175+0000 7f9960c00640 1 -- 172.21.15.103:0/1455923017 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5646fe47a6a0 con 0x5646fe591a20 2024-09-11T01:10:18.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.175+0000 7f9960c00640 10 client.25580 handle_command_reply: tid=0 2024-09-11T01:10:18.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.178+0000 7f9980c15740 1 client.25580 shutdown 2024-09-11T01:10:18.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.178+0000 7f9980c15740 1 -- 172.21.15.103:0/1455923017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe5072f0 msgr2=0x5646fe51bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:18.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.178+0000 7f9980c15740 1 --2- 172.21.15.103:0/1455923017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe5072f0 0x5646fe51bf00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9968005fd0 tx=0x7f99680108c0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.178+0000 7f9980c15740 1 -- 172.21.15.103:0/1455923017 shutdown_connections 2024-09-11T01:10:18.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.178+0000 7f9980c15740 1 --2- 172.21.15.103:0/1455923017 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5646fe591a20 0x5646fe593e40 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.179+0000 7f9980c15740 1 --2- 172.21.15.103:0/1455923017 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5646fe513ba0 0x5646fe516c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.179+0000 7f9980c15740 1 --2- 172.21.15.103:0/1455923017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5646fe507c10 0x5646fe51c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.179+0000 7f9980c15740 1 --2- 172.21.15.103:0/1455923017 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5646fe5072f0 0x5646fe51bf00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.179+0000 7f9980c15740 1 -- 172.21.15.103:0/1455923017 >> 172.21.15.103:0/1455923017 conn(0x5646fe505120 msgr2=0x5646fe50f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:18.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.179+0000 7f9960c00640 0 client.25580 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:18.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.179+0000 7f9980c15740 1 -- 172.21.15.103:0/1455923017 shutdown_connections 2024-09-11T01:10:18.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.180+0000 7f9980c15740 1 -- 172.21.15.103:0/1455923017 wait complete. 2024-09-11T01:10:18.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.181+0000 7f9980c15740 20 client.25580 trim_cache size 0 max 16384 2024-09-11T01:10:18.185 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:10:18.185 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 28, 2024-09-11T01:10:18.185 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24665, 2024-09-11T01:10:18.185 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 6, 2024-09-11T01:10:18.185 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-09-11T01:10:18.185 INFO:teuthology.orchestra.run.smithi103.stdout: "39731ca6": { 2024-09-11T01:10:18.185 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 6, 2024-09-11T01:10:18.185 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-09-11T01:10:18.185 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:10:18.185 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCED", 2024-09-11T01:10:18.185 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:10:18.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:10:18.185 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-09-11T01:10:18.186 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 140.5, 2024-09-11T01:10:18.186 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-09-11T01:10:18.186 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-09-11T01:10:18.186 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-09-11T01:10:18.186 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:10:18.186 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCED", 2024-09-11T01:10:18.186 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:10:18.186 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:18.186 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:18.186 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:18.186 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:18.186 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:18.186 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:10:18.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.183+0000 7f997ca00640 1 -- 172.21.15.103:0/2498832394 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f995c0b5560 msgr2=0x7f995c0b7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:18.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.183+0000 7f997ca00640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f995c0b5560 0x7f995c0b7a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f9970009e70 tx=0x7f9970018880 comp rx=0 tx=0).stop 2024-09-11T01:10:18.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.183+0000 7f997ca00640 1 -- 172.21.15.103:0/2498832394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9978102220 msgr2=0x7f9978074c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:18.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.183+0000 7f997ca00640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9978102220 0x7f9978074c40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9964000c00 tx=0x7f9964005780 comp rx=0 tx=0).stop 2024-09-11T01:10:18.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.189+0000 7f997ca00640 1 -- 172.21.15.103:0/2498832394 shutdown_connections 2024-09-11T01:10:18.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.189+0000 7f997ca00640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f995c0b5560 0x7f995c0b7a20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.189+0000 7f997ca00640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9978106d40 0x7f997806d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.189+0000 7f997ca00640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9978102220 0x7f9978074c40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.189+0000 7f997ca00640 1 --2- 172.21.15.103:0/2498832394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9978101900 0x7f9978074700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.189+0000 7f997ca00640 1 -- 172.21.15.103:0/2498832394 >> 172.21.15.103:0/2498832394 conn(0x7f99780fd5b0 msgr2=0x7f99781046c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:18.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.191+0000 7f997ca00640 1 -- 172.21.15.103:0/2498832394 shutdown_connections 2024-09-11T01:10:18.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:18.194+0000 7f997ca00640 1 -- 172.21.15.103:0/2498832394 wait complete. 2024-09-11T01:10:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.474+0000 7f5188a00640 1 -- 172.21.15.103:0/1727614853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184076f90 msgr2=0x7f51840755e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.474+0000 7f5188a00640 1 --2- 172.21.15.103:0/1727614853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184076f90 0x7f51840755e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5174009900 tx=0x7f517402a420 comp rx=0 tx=0).stop 2024-09-11T01:10:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.475+0000 7f5188a00640 1 -- 172.21.15.103:0/1727614853 shutdown_connections 2024-09-11T01:10:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.475+0000 7f5188a00640 1 --2- 172.21.15.103:0/1727614853 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5184106490 0x7f5184111170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.475+0000 7f5188a00640 1 --2- 172.21.15.103:0/1727614853 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184075b20 0x7f5184075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.475+0000 7f5188a00640 1 --2- 172.21.15.103:0/1727614853 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184076f90 0x7f51840755e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.475+0000 7f5188a00640 1 -- 172.21.15.103:0/1727614853 >> 172.21.15.103:0/1727614853 conn(0x7f51840fe240 msgr2=0x7f5184100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.475+0000 7f5188a00640 1 -- 172.21.15.103:0/1727614853 shutdown_connections 2024-09-11T01:10:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.475+0000 7f5188a00640 1 -- 172.21.15.103:0/1727614853 wait complete. 2024-09-11T01:10:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.478+0000 7f5188a00640 1 Processor -- start 2024-09-11T01:10:18.483 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.481+0000 7f5188a00640 1 -- start start 2024-09-11T01:10:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.483+0000 7f5188a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5184075b20 0x7f5184071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.485+0000 7f5188a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184076f90 0x7f5184072290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.485+0000 7f5188a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184072ec0 0x7f5184073370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.485+0000 7f5181e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5184075b20 0x7f5184071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.486+0000 7f5188a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5184114c60 con 0x7f5184072ec0 2024-09-11T01:10:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.486+0000 7f5188a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5184114ae0 con 0x7f5184076f90 2024-09-11T01:10:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.486+0000 7f5188a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5184114de0 con 0x7f5184075b20 2024-09-11T01:10:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.486+0000 7f5181400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184076f90 0x7f5184072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.486+0000 7f5181e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5184075b20 0x7f5184071c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:33672/0 (socket says 172.21.15.103:33672) 2024-09-11T01:10:18.491 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.486+0000 7f5181e00640 1 -- 172.21.15.103:0/1733278685 learned_addr learned my addr 172.21.15.103:0/1733278685 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.490+0000 7f5182800640 1 --2- 172.21.15.103:0/1733278685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184072ec0 0x7f5184073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.490+0000 7f5181400640 1 -- 172.21.15.103:0/1733278685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5184075b20 msgr2=0x7f5184071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:18.492 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.490+0000 7f5181400640 1 --2- 172.21.15.103:0/1733278685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5184075b20 0x7f5184071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.492+0000 7f5181400640 1 -- 172.21.15.103:0/1733278685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184072ec0 msgr2=0x7f5184073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:18.494 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.493+0000 7f5181400640 1 --2- 172.21.15.103:0/1733278685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184072ec0 0x7f5184073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.494+0000 7f5181400640 1 -- 172.21.15.103:0/1733278685 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5184073b70 con 0x7f5184076f90 2024-09-11T01:10:18.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.495+0000 7f5181400640 1 --2- 172.21.15.103:0/1733278685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184076f90 0x7f5184072290 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f517000b3f0 tx=0x7f517000b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:18.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.496+0000 7f517aa00640 1 -- 172.21.15.103:0/1733278685 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170015020 con 0x7f5184076f90 2024-09-11T01:10:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.496+0000 7f517aa00640 1 -- 172.21.15.103:0/1733278685 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5170011ce0 con 0x7f5184076f90 2024-09-11T01:10:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.496+0000 7f517aa00640 1 -- 172.21.15.103:0/1733278685 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170010d80 con 0x7f5184076f90 2024-09-11T01:10:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.497+0000 7f5188a00640 1 -- 172.21.15.103:0/1733278685 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5184073f30 con 0x7f5184076f90 2024-09-11T01:10:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.497+0000 7f5188a00640 1 -- 172.21.15.103:0/1733278685 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51840744b0 con 0x7f5184076f90 2024-09-11T01:10:18.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.509+0000 7f518b7e1740 1 Processor -- start 2024-09-11T01:10:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.510+0000 7f518b7e1740 1 -- start start 2024-09-11T01:10:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.511+0000 7f518b7e1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f60790 0x5641e2f62b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.511+0000 7f518b7e1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f630c0 0x5641e2f654b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.511+0000 7f518b7e1740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f65b00 0x5641e2f67fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.511+0000 7f518b7e1740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5641e2ed36b0 con 0x5641e2f65b00 2024-09-11T01:10:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.511+0000 7f518b7e1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5641e2ec2ae0 con 0x5641e2f60790 2024-09-11T01:10:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.511+0000 7f518b7e1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5641e2ec68f0 con 0x5641e2f630c0 2024-09-11T01:10:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.520+0000 7f5182800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f60790 0x5641e2f62b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.520+0000 7f5182800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f60790 0x5641e2f62b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:37962/0 (socket says 172.21.15.103:37962) 2024-09-11T01:10:18.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.520+0000 7f5182800640 1 -- 172.21.15.103:0/3592247902 learned_addr learned my addr 172.21.15.103:0/3592247902 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:18.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.521+0000 7f5181e00640 1 --2- 172.21.15.103:0/3592247902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f630c0 0x5641e2f654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:18.532 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.526+0000 7f5182800640 1 -- 172.21.15.103:0/3592247902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f630c0 msgr2=0x5641e2f654b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.526+0000 7f5182800640 1 --2- 172.21.15.103:0/3592247902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f630c0 0x5641e2f654b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.526+0000 7f5182800640 1 -- 172.21.15.103:0/3592247902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f65b00 msgr2=0x5641e2f67fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:10:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.526+0000 7f5182800640 1 --2- 172.21.15.103:0/3592247902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f65b00 0x5641e2f67fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.526+0000 7f5182800640 1 -- 172.21.15.103:0/3592247902 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e2e8f780 con 0x5641e2f60790 2024-09-11T01:10:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.532+0000 7f517aa00640 1 -- 172.21.15.103:0/1733278685 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f517001a400 con 0x7f5184076f90 2024-09-11T01:10:18.535 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.534+0000 7f5182800640 1 --2- 172.21.15.103:0/3592247902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f60790 0x5641e2f62b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f517c009eb0 tx=0x7f517c00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3c4e09bb5dc8d47 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.534+0000 7f516f000640 1 -- 172.21.15.103:0/3592247902 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c011640 con 0x5641e2f60790 2024-09-11T01:10:18.536 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.535+0000 7f516f000640 1 -- 172.21.15.103:0/3592247902 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f517c011c90 con 0x5641e2f60790 2024-09-11T01:10:18.537 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.535+0000 7f516f000640 1 -- 172.21.15.103:0/3592247902 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c01bd20 con 0x5641e2f60790 2024-09-11T01:10:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.541+0000 7f518b7e1740 1 -- 172.21.15.103:0/3592247902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f60790 msgr2=0x5641e2f62b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:18.546 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.541+0000 7f518b7e1740 1 --2- 172.21.15.103:0/3592247902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f60790 0x5641e2f62b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f517c009eb0 tx=0x7f517c00f730 comp rx=0 tx=0).stop 2024-09-11T01:10:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.545+0000 7f517aa00640 1 --2- 172.21.15.103:0/1733278685 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f51680b5430 0x7f51680b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.549 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.546+0000 7f517aa00640 1 -- 172.21.15.103:0/1733278685 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f51700e58c0 con 0x7f5184076f90 2024-09-11T01:10:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.551+0000 7f518b7e1740 1 -- 172.21.15.103:0/3592247902 shutdown_connections 2024-09-11T01:10:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.551+0000 7f518b7e1740 1 --2- 172.21.15.103:0/3592247902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f65b00 0x5641e2f67fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.553 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.552+0000 7f518b7e1740 1 --2- 172.21.15.103:0/3592247902 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f630c0 0x5641e2f654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.552+0000 7f518b7e1740 1 --2- 172.21.15.103:0/3592247902 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f60790 0x5641e2f62b80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.552+0000 7f518b7e1740 1 -- 172.21.15.103:0/3592247902 >> 172.21.15.103:0/3592247902 conn(0x5641e2f5b8e0 msgr2=0x5641e2f5c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:18.554 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.553+0000 7f518b7e1740 1 -- 172.21.15.103:0/3592247902 shutdown_connections 2024-09-11T01:10:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.553+0000 7f518b7e1740 1 -- 172.21.15.103:0/3592247902 wait complete. 2024-09-11T01:10:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.555+0000 7f518b7e1740 1 -- start start 2024-09-11T01:10:18.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.555+0000 7f518b7e1740 1 Processor -- start 2024-09-11T01:10:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.560+0000 7f5181e00640 1 --2- 172.21.15.103:0/1733278685 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f51680b5430 0x7f51680b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.556+0000 7f518b7e1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f60790 0x5641e2f69fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.560+0000 7f518b7e1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f630c0 0x5641e2f6a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.560+0000 7f518b7e1740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f65b00 0x5641e2f6b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.560+0000 7f518b7e1740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5641e2dfaab0 con 0x5641e2f65b00 2024-09-11T01:10:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.560+0000 7f518b7e1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5641e2e69570 con 0x5641e2f630c0 2024-09-11T01:10:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.560+0000 7f518b7e1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5641e2f68ae0 con 0x5641e2f60790 2024-09-11T01:10:18.563 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.560+0000 7f518b7e1740 10 client.0 _ll_register_callbacks cb 0x5641e2e78100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.562+0000 7f5181400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f630c0 0x5641e2f6a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.565+0000 7f5181400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f630c0 0x5641e2f6a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:37978/0 (socket says 172.21.15.103:37978) 2024-09-11T01:10:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.565+0000 7f5181400640 1 -- 172.21.15.103:0/2278613972 learned_addr learned my addr 172.21.15.103:0/2278613972 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.565+0000 7f5182800640 1 --2- 172.21.15.103:0/2278613972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f65b00 0x5641e2f6b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.568+0000 7f5181400640 1 -- 172.21.15.103:0/2278613972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f60790 msgr2=0x5641e2f69fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T01:10:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.568+0000 7f5181400640 1 --2- 172.21.15.103:0/2278613972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f60790 0x5641e2f69fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.568+0000 7f5181400640 1 -- 172.21.15.103:0/2278613972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f65b00 msgr2=0x5641e2f6b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.568+0000 7f5181400640 1 --2- 172.21.15.103:0/2278613972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f65b00 0x5641e2f6b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.568+0000 7f5181400640 1 -- 172.21.15.103:0/2278613972 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e2c24790 con 0x5641e2f630c0 2024-09-11T01:10:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.569+0000 7f5181400640 1 --2- 172.21.15.103:0/2278613972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f630c0 0x5641e2f6a620 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f517000b3c0 tx=0x7f51700abb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9937c9f7d6b6655 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:18.570 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.569+0000 7f5163400640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:10:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.569+0000 7f5181e00640 1 --2- 172.21.15.103:0/1733278685 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f51680b5430 0x7f51680b78f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5174004650 tx=0x7f5174004b70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.569+0000 7f5163400640 1 -- 172.21.15.103:0/2278613972 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51700ab7e0 con 0x5641e2f630c0 2024-09-11T01:10:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.570+0000 7f5163400640 1 -- 172.21.15.103:0/2278613972 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5170011830 con 0x5641e2f630c0 2024-09-11T01:10:18.572 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.571+0000 7f518b7e1740 1 -- 172.21.15.103:0/2278613972 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f517c011c90 con 0x5641e2f630c0 2024-09-11T01:10:18.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.572+0000 7f5163400640 1 -- 172.21.15.103:0/2278613972 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f51700ac3d0 con 0x5641e2f630c0 2024-09-11T01:10:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.572+0000 7f518b7e1740 10 client.25592 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:18.574 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.572+0000 7f518b7e1740 1 -- 172.21.15.103:0/2278613972 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5641e2c9d620 con 0x5641e2f630c0 2024-09-11T01:10:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.575+0000 7f5163400640 1 -- 172.21.15.103:0/2278613972 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51700abcd0 con 0x5641e2f630c0 2024-09-11T01:10:18.576 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.575+0000 7f5163400640 1 -- 172.21.15.103:0/2278613972 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f51700a7620 con 0x5641e2f630c0 2024-09-11T01:10:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.575+0000 7f518b7e1740 10 client.25592 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.575+0000 7f518b7e1740 10 client.25592 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:10:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.575+0000 7f518b7e1740 20 client.25592 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:18.577 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.575+0000 7f518b7e1740 1 --2- 172.21.15.103:0/2278613972 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641e2f75c90 0x5641e2f780b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.576+0000 7f5181e00640 1 --2- 172.21.15.103:0/2278613972 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641e2f75c90 0x5641e2f780b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:18.579 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.577+0000 7f518b7e1740 4 client.25592 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:10:18.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.580+0000 7f518b7e1740 1 -- 172.21.15.103:0/2278613972 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f517c011c90 con 0x5641e2f75c90 2024-09-11T01:10:18.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.580+0000 7f5181e00640 1 --2- 172.21.15.103:0/2278613972 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641e2f75c90 0x5641e2f780b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5adc3d80f7242e16 server_cookie=1973e8002b39ad68 in_seq=0 out_seq=0 2024-09-11T01:10:18.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.580+0000 7f5163400640 10 client.25592 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.581+0000 7f5163400640 1 -- 172.21.15.103:0/2278613972 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f517c011c90 con 0x5641e2f75c90 2024-09-11T01:10:18.582 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.581+0000 7f5163400640 10 client.25592 handle_command_reply: tid=0 2024-09-11T01:10:18.584 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.581+0000 7f518b7e1740 1 client.25592 shutdown 2024-09-11T01:10:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.585+0000 7f518b7e1740 1 -- 172.21.15.103:0/2278613972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f630c0 msgr2=0x5641e2f6a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:18.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.585+0000 7f518b7e1740 1 --2- 172.21.15.103:0/2278613972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f630c0 0x5641e2f6a620 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f517000b3c0 tx=0x7f51700abb60 comp rx=0 tx=0).stop 2024-09-11T01:10:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.585+0000 7f518b7e1740 1 -- 172.21.15.103:0/2278613972 shutdown_connections 2024-09-11T01:10:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.585+0000 7f518b7e1740 1 --2- 172.21.15.103:0/2278613972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f65b00 0x5641e2f6b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.585+0000 7f518b7e1740 1 --2- 172.21.15.103:0/2278613972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f630c0 0x5641e2f6a620 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.585+0000 7f518b7e1740 1 --2- 172.21.15.103:0/2278613972 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641e2f75c90 0x5641e2f780b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.585+0000 7f518b7e1740 1 --2- 172.21.15.103:0/2278613972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f60790 0x5641e2f69fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.585+0000 7f518b7e1740 1 -- 172.21.15.103:0/2278613972 >> 172.21.15.103:0/2278613972 conn(0x5641e2f5b8e0 msgr2=0x5641e2f634a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:18.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.585+0000 7f5163400640 0 client.25592 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.587+0000 7f518b7e1740 1 -- 172.21.15.103:0/2278613972 shutdown_connections 2024-09-11T01:10:18.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.587+0000 7f518b7e1740 1 -- 172.21.15.103:0/2278613972 wait complete. 2024-09-11T01:10:18.590 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.588+0000 7f518b7e1740 20 client.25592 trim_cache size 0 max 16384 2024-09-11T01:10:18.634 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.633+0000 7f518b7e1740 1 Processor -- start 2024-09-11T01:10:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.633+0000 7f518b7e1740 1 -- start start 2024-09-11T01:10:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.633+0000 7f518b7e1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f60790 0x5641e2f56960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.633+0000 7f518b7e1740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f630c0 0x5641e2f646c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.636 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.633+0000 7f518b7e1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f65b00 0x5641e2f64c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.633+0000 7f518b7e1740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f51841bd000 con 0x5641e2f630c0 2024-09-11T01:10:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.633+0000 7f518b7e1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f51841ba8a0 con 0x5641e2f65b00 2024-09-11T01:10:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.633+0000 7f518b7e1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51841b86b0 con 0x5641e2f60790 2024-09-11T01:10:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.634+0000 7f5182800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f65b00 0x5641e2f64c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.634+0000 7f5182800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f65b00 0x5641e2f64c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:37988/0 (socket says 172.21.15.103:37988) 2024-09-11T01:10:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.634+0000 7f5182800640 1 -- 172.21.15.103:0/3063002840 learned_addr learned my addr 172.21.15.103:0/3063002840 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.634+0000 7f5182800640 1 -- 172.21.15.103:0/3063002840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f60790 msgr2=0x5641e2f56960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:10:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.634+0000 7f5182800640 1 --2- 172.21.15.103:0/3063002840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f60790 0x5641e2f56960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.634+0000 7f5182800640 1 -- 172.21.15.103:0/3063002840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f630c0 msgr2=0x5641e2f646c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.634+0000 7f5182800640 1 --2- 172.21.15.103:0/3063002840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f630c0 0x5641e2f646c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.634+0000 7f5182800640 1 -- 172.21.15.103:0/3063002840 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641e2f62ef0 con 0x5641e2f65b00 2024-09-11T01:10:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.635+0000 7f5182800640 1 --2- 172.21.15.103:0/3063002840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f65b00 0x5641e2f64c00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f517c009b10 tx=0x7f517c0098e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc42242ac3a44a52 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.635+0000 7f516e600640 1 -- 172.21.15.103:0/3063002840 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c029070 con 0x5641e2f65b00 2024-09-11T01:10:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.635+0000 7f516e600640 1 -- 172.21.15.103:0/3063002840 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f517c01b620 con 0x5641e2f65b00 2024-09-11T01:10:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.635+0000 7f516e600640 1 -- 172.21.15.103:0/3063002840 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517c005340 con 0x5641e2f65b00 2024-09-11T01:10:18.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.636+0000 7f518b7e1740 1 -- 172.21.15.103:0/3063002840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f65b00 msgr2=0x5641e2f64c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.636+0000 7f518b7e1740 1 --2- 172.21.15.103:0/3063002840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f65b00 0x5641e2f64c00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f517c009b10 tx=0x7f517c0098e0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.637+0000 7f518b7e1740 1 -- 172.21.15.103:0/3063002840 shutdown_connections 2024-09-11T01:10:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.637+0000 7f518b7e1740 1 --2- 172.21.15.103:0/3063002840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f65b00 0x5641e2f64c00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.637+0000 7f518b7e1740 1 --2- 172.21.15.103:0/3063002840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f630c0 0x5641e2f646c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.637+0000 7f518b7e1740 1 --2- 172.21.15.103:0/3063002840 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f60790 0x5641e2f56960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.637+0000 7f518b7e1740 1 -- 172.21.15.103:0/3063002840 >> 172.21.15.103:0/3063002840 conn(0x5641e2f5b8e0 msgr2=0x5641e2f69180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.639+0000 7f518b7e1740 1 -- 172.21.15.103:0/3063002840 shutdown_connections 2024-09-11T01:10:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.639+0000 7f518b7e1740 1 -- 172.21.15.103:0/3063002840 wait complete. 2024-09-11T01:10:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.639+0000 7f518b7e1740 1 -- start start 2024-09-11T01:10:18.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.640+0000 7f518b7e1740 1 Processor -- start 2024-09-11T01:10:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.640+0000 7f518b7e1740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f60790 0x5641e2f7e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.640+0000 7f518b7e1740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f630c0 0x5641e2fdea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.640+0000 7f518b7e1740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f65b00 0x5641e2fe1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.640+0000 7f518b7e1740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f51841b8d60 con 0x5641e2f65b00 2024-09-11T01:10:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.640+0000 7f518b7e1740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f51841ba1d0 con 0x5641e2f60790 2024-09-11T01:10:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.640+0000 7f518b7e1740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f51841b9430 con 0x5641e2f630c0 2024-09-11T01:10:18.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.640+0000 7f518b7e1740 10 client.0 _ll_register_callbacks cb 0x7f5170010f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.641+0000 7f5181e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f60790 0x5641e2f7e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.641+0000 7f5181400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f630c0 0x5641e2fdea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.641+0000 7f5181e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f60790 0x5641e2f7e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:37998/0 (socket says 172.21.15.103:37998) 2024-09-11T01:10:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.641+0000 7f5181e00640 1 -- 172.21.15.103:0/3249710889 learned_addr learned my addr 172.21.15.103:0/3249710889 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.641+0000 7f5181400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f630c0 0x5641e2fdea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:33706/0 (socket says 172.21.15.103:33706) 2024-09-11T01:10:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.642+0000 7f5181400640 1 -- 172.21.15.103:0/3249710889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f60790 msgr2=0x5641e2f7e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.642+0000 7f5181400640 1 --2- 172.21.15.103:0/3249710889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f60790 0x5641e2f7e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.642+0000 7f5181400640 1 -- 172.21.15.103:0/3249710889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f65b00 msgr2=0x5641e2fe1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.642+0000 7f5181400640 1 --2- 172.21.15.103:0/3249710889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f65b00 0x5641e2fe1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.642+0000 7f5181400640 1 -- 172.21.15.103:0/3249710889 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641e2f78420 con 0x5641e2f630c0 2024-09-11T01:10:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.644+0000 7f5181400640 1 --2- 172.21.15.103:0/3249710889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f630c0 0x5641e2fdea80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f517000bdb0 tx=0x7f51700a8170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76557c51735565af server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.644+0000 7f5163400640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:10:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.644+0000 7f5163400640 1 -- 172.21.15.103:0/3249710889 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51700ac3d0 con 0x5641e2f630c0 2024-09-11T01:10:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.645+0000 7f5163400640 1 -- 172.21.15.103:0/3249710889 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5170011a30 con 0x5641e2f630c0 2024-09-11T01:10:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.645+0000 7f518b7e1740 1 -- 172.21.15.103:0/3249710889 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5641e2ed5600 con 0x5641e2f630c0 2024-09-11T01:10:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.646+0000 7f5163400640 1 -- 172.21.15.103:0/3249710889 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f51700abcd0 con 0x5641e2f630c0 2024-09-11T01:10:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.646+0000 7f518b7e1740 10 client.25564 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.647+0000 7f518b7e1740 1 -- 172.21.15.103:0/3249710889 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5641e2fe2af0 con 0x5641e2f630c0 2024-09-11T01:10:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.647+0000 7f5163400640 1 -- 172.21.15.103:0/3249710889 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5641e2ed5600 con 0x5641e2f630c0 2024-09-11T01:10:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.650+0000 7f5163400640 1 -- 172.21.15.103:0/3249710889 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f51700aaf30 con 0x5641e2f630c0 2024-09-11T01:10:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.651+0000 7f518b7e1740 10 client.25564 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:18.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.651+0000 7f518b7e1740 10 client.25564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:10:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.651+0000 7f518b7e1740 20 client.25564 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.651+0000 7f518b7e1740 1 --2- 172.21.15.103:0/3249710889 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641e2fe3290 0x5641e2fe56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.651+0000 7f518b7e1740 4 client.25564 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:10:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.651+0000 7f518b7e1740 1 -- 172.21.15.103:0/3249710889 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5641e2ed10b0 con 0x5641e2fe3290 2024-09-11T01:10:18.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.652+0000 7f5181e00640 1 --2- 172.21.15.103:0/3249710889 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641e2fe3290 0x5641e2fe56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.653+0000 7f5181e00640 1 --2- 172.21.15.103:0/3249710889 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641e2fe3290 0x5641e2fe56b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6168a769b5ed0d28 server_cookie=c174fd98c999ae82 in_seq=0 out_seq=0 2024-09-11T01:10:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:18.653+0000 7f5163400640 10 client.25564 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:19.385 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '39731ca6', quiesce took 5.7 seconds. Will release after: 14.8 2024-09-11T01:10:19.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.618+0000 7f5163400640 1 -- 172.21.15.103:0/3249710889 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5641e2ed10b0 con 0x5641e2fe3290 2024-09-11T01:10:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.618+0000 7f5163400640 10 client.25564 handle_command_reply: tid=0 2024-09-11T01:10:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.618+0000 7f518b7e1740 1 client.25564 shutdown 2024-09-11T01:10:19.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.618+0000 7f518b7e1740 1 -- 172.21.15.103:0/3249710889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f630c0 msgr2=0x5641e2fdea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.618+0000 7f518b7e1740 1 --2- 172.21.15.103:0/3249710889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f630c0 0x5641e2fdea80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f517000bdb0 tx=0x7f51700a8170 comp rx=0 tx=0).stop 2024-09-11T01:10:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.619+0000 7f518b7e1740 1 -- 172.21.15.103:0/3249710889 shutdown_connections 2024-09-11T01:10:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.619+0000 7f518b7e1740 1 --2- 172.21.15.103:0/3249710889 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5641e2f65b00 0x5641e2fe1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.619+0000 7f518b7e1740 1 --2- 172.21.15.103:0/3249710889 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5641e2fe3290 0x5641e2fe56b0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.619+0000 7f518b7e1740 1 --2- 172.21.15.103:0/3249710889 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5641e2f630c0 0x5641e2fdea80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.619+0000 7f5163400640 0 client.25564 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.619+0000 7f518b7e1740 1 --2- 172.21.15.103:0/3249710889 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5641e2f60790 0x5641e2f7e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:19.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.619+0000 7f518b7e1740 1 -- 172.21.15.103:0/3249710889 >> 172.21.15.103:0/3249710889 conn(0x5641e2f5b8e0 msgr2=0x5641e2f646c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.620+0000 7f518b7e1740 1 -- 172.21.15.103:0/3249710889 shutdown_connections 2024-09-11T01:10:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.620+0000 7f518b7e1740 1 -- 172.21.15.103:0/3249710889 wait complete. 2024-09-11T01:10:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.620+0000 7f518b7e1740 20 client.25564 trim_cache size 0 max 16384 2024-09-11T01:10:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:10:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:10:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:10:19.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:10:19.629 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.628+0000 7f5188a00640 1 -- 172.21.15.103:0/1733278685 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f51680b5430 msgr2=0x7f51680b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:19.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.628+0000 7f5188a00640 1 --2- 172.21.15.103:0/1733278685 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f51680b5430 0x7f51680b78f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5174004650 tx=0x7f5174004b70 comp rx=0 tx=0).stop 2024-09-11T01:10:19.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.628+0000 7f5188a00640 1 -- 172.21.15.103:0/1733278685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184076f90 msgr2=0x7f5184072290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:19.630 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.628+0000 7f5188a00640 1 --2- 172.21.15.103:0/1733278685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184076f90 0x7f5184072290 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f517000b3f0 tx=0x7f517000b8b0 comp rx=0 tx=0).stop 2024-09-11T01:10:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.636+0000 7f5188a00640 1 -- 172.21.15.103:0/1733278685 shutdown_connections 2024-09-11T01:10:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.636+0000 7f5188a00640 1 --2- 172.21.15.103:0/1733278685 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f51680b5430 0x7f51680b78f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.636+0000 7f5188a00640 1 --2- 172.21.15.103:0/1733278685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5184072ec0 0x7f5184073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.636+0000 7f5188a00640 1 --2- 172.21.15.103:0/1733278685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5184076f90 0x7f5184072290 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.636+0000 7f5188a00640 1 --2- 172.21.15.103:0/1733278685 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5184075b20 0x7f5184071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:19.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.636+0000 7f5188a00640 1 -- 172.21.15.103:0/1733278685 >> 172.21.15.103:0/1733278685 conn(0x7f51840fe240 msgr2=0x7f5184100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.636+0000 7f5188a00640 1 -- 172.21.15.103:0/1733278685 shutdown_connections 2024-09-11T01:10:19.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:19.636+0000 7f5188a00640 1 -- 172.21.15.103:0/1733278685 wait complete. 2024-09-11T01:10:21.089 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:20 smithi103 ceph-mon[30562]: pgmap v459: 129 pgs: 129 active+clean; 4.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 303 MiB/s wr, 121 op/s 2024-09-11T01:10:21.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:20 smithi117 ceph-mon[35358]: pgmap v459: 129 pgs: 129 active+clean; 4.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 303 MiB/s wr, 121 op/s 2024-09-11T01:10:21.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:20 smithi183 ceph-mon[34992]: pgmap v459: 129 pgs: 129 active+clean; 4.9 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 303 MiB/s wr, 121 op/s 2024-09-11T01:10:22.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:21 smithi103 ceph-mon[30562]: pgmap v460: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 256 MiB/s wr, 97 op/s 2024-09-11T01:10:22.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:21 smithi117 ceph-mon[35358]: pgmap v460: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 256 MiB/s wr, 97 op/s 2024-09-11T01:10:22.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:21 smithi183 ceph-mon[34992]: pgmap v460: 129 pgs: 129 active+clean; 5.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 256 MiB/s wr, 97 op/s 2024-09-11T01:10:24.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:24 smithi183 ceph-mon[34992]: pgmap v461: 129 pgs: 129 active+clean; 6.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 309 MiB/s wr, 130 op/s 2024-09-11T01:10:25.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:24 smithi103 ceph-mon[30562]: pgmap v461: 129 pgs: 129 active+clean; 6.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 309 MiB/s wr, 130 op/s 2024-09-11T01:10:25.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:24 smithi117 ceph-mon[35358]: pgmap v461: 129 pgs: 129 active+clean; 6.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 309 MiB/s wr, 130 op/s 2024-09-11T01:10:26.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:26 smithi183 ceph-mon[34992]: pgmap v462: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 268 MiB/s wr, 109 op/s 2024-09-11T01:10:26.925 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:26 smithi117 ceph-mon[35358]: pgmap v462: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 268 MiB/s wr, 109 op/s 2024-09-11T01:10:27.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:26 smithi103 ceph-mon[30562]: pgmap v462: 129 pgs: 129 active+clean; 6.5 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 268 MiB/s wr, 109 op/s 2024-09-11T01:10:28.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:28 smithi183 ceph-mon[34992]: pgmap v463: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 226 MiB/s wr, 98 op/s 2024-09-11T01:10:29.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:28 smithi103 ceph-mon[30562]: pgmap v463: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 226 MiB/s wr, 98 op/s 2024-09-11T01:10:29.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:28 smithi117 ceph-mon[35358]: pgmap v463: 129 pgs: 129 active+clean; 6.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 226 MiB/s wr, 98 op/s 2024-09-11T01:10:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:30 smithi183 ceph-mon[34992]: pgmap v464: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 241 MiB/s wr, 104 op/s 2024-09-11T01:10:31.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:30 smithi103 ceph-mon[30562]: pgmap v464: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 241 MiB/s wr, 104 op/s 2024-09-11T01:10:31.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:30 smithi117 ceph-mon[35358]: pgmap v464: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 241 MiB/s wr, 104 op/s 2024-09-11T01:10:31.947 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:31 smithi183 ceph-mon[34992]: pgmap v465: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 174 MiB/s wr, 74 op/s 2024-09-11T01:10:32.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:31 smithi103 ceph-mon[30562]: pgmap v465: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 174 MiB/s wr, 74 op/s 2024-09-11T01:10:32.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:31 smithi117 ceph-mon[35358]: pgmap v465: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 174 MiB/s wr, 74 op/s 2024-09-11T01:10:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.777+0000 7fc72d800640 1 -- 172.21.15.103:0/3110510281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc728105ce0 msgr2=0x7fc728106160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.777+0000 7fc72d800640 1 --2- 172.21.15.103:0/3110510281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc728105ce0 0x7fc728106160 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc714009930 tx=0x7fc71402a420 comp rx=0 tx=0).stop 2024-09-11T01:10:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.777+0000 7fc72d800640 1 -- 172.21.15.103:0/3110510281 shutdown_connections 2024-09-11T01:10:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.777+0000 7fc72d800640 1 --2- 172.21.15.103:0/3110510281 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7281066a0 0x7fc72810d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.777+0000 7fc72d800640 1 --2- 172.21.15.103:0/3110510281 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc728105ce0 0x7fc728106160 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.777+0000 7fc72d800640 1 --2- 172.21.15.103:0/3110510281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc728104b90 0x7fc728104f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.780 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.777+0000 7fc72d800640 1 -- 172.21.15.103:0/3110510281 >> 172.21.15.103:0/3110510281 conn(0x7fc728100470 msgr2=0x7fc728102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:32.781 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.777+0000 7fc72d800640 1 -- 172.21.15.103:0/3110510281 shutdown_connections 2024-09-11T01:10:32.781 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.777+0000 7fc72d800640 1 -- 172.21.15.103:0/3110510281 wait complete. 2024-09-11T01:10:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.778+0000 7fc72d800640 1 Processor -- start 2024-09-11T01:10:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.778+0000 7fc72d800640 1 -- start start 2024-09-11T01:10:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.778+0000 7fc72d800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc728104b90 0x7fc72819af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.778+0000 7fc72d800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc728105ce0 0x7fc72819b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.778+0000 7fc72d800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7281066a0 0x7fc72819c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.778+0000 7fc72d800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc728110800 con 0x7fc728105ce0 2024-09-11T01:10:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.778+0000 7fc72d800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc728110680 con 0x7fc7281066a0 2024-09-11T01:10:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.778+0000 7fc72d800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc728110980 con 0x7fc728104b90 2024-09-11T01:10:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.778+0000 7fc726000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc728105ce0 0x7fc72819b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.779+0000 7fc726000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc728105ce0 0x7fc72819b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51222/0 (socket says 172.21.15.103:51222) 2024-09-11T01:10:32.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.779+0000 7fc726000640 1 -- 172.21.15.103:0/1619867963 learned_addr learned my addr 172.21.15.103:0/1619867963 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.779+0000 7fc726a00640 1 --2- 172.21.15.103:0/1619867963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc728104b90 0x7fc72819af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.779+0000 7fc727400640 1 --2- 172.21.15.103:0/1619867963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7281066a0 0x7fc72819c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.779+0000 7fc726000640 1 -- 172.21.15.103:0/1619867963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc728104b90 msgr2=0x7fc72819af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.779+0000 7fc726000640 1 --2- 172.21.15.103:0/1619867963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc728104b90 0x7fc72819af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.779+0000 7fc726000640 1 -- 172.21.15.103:0/1619867963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7281066a0 msgr2=0x7fc72819c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.779+0000 7fc726000640 1 --2- 172.21.15.103:0/1619867963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7281066a0 0x7fc72819c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.779+0000 7fc726000640 1 -- 172.21.15.103:0/1619867963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc72819cad0 con 0x7fc728105ce0 2024-09-11T01:10:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.779+0000 7fc726000640 1 --2- 172.21.15.103:0/1619867963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc728105ce0 0x7fc72819b5e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc714009a50 tx=0x7fc7140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.780+0000 7fc71f400640 1 -- 172.21.15.103:0/1619867963 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc71403f030 con 0x7fc728105ce0 2024-09-11T01:10:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.780+0000 7fc71f400640 1 -- 172.21.15.103:0/1619867963 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc714003cb0 con 0x7fc728105ce0 2024-09-11T01:10:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.780+0000 7fc72d800640 1 -- 172.21.15.103:0/1619867963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc72819cd60 con 0x7fc728105ce0 2024-09-11T01:10:32.784 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.780+0000 7fc71f400640 1 -- 172.21.15.103:0/1619867963 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714035070 con 0x7fc728105ce0 2024-09-11T01:10:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.780+0000 7fc72d800640 1 -- 172.21.15.103:0/1619867963 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7281a3490 con 0x7fc728105ce0 2024-09-11T01:10:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.783+0000 7fc730858740 1 Processor -- start 2024-09-11T01:10:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.783+0000 7fc730858740 1 -- start start 2024-09-11T01:10:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.783+0000 7fc71f400640 1 -- 172.21.15.103:0/1619867963 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7fc71403bb90 con 0x7fc728105ce0 2024-09-11T01:10:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.783+0000 7fc730858740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.783+0000 7fc730858740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 0x5569ea9a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.783+0000 7fc730858740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a8b00 0x5569ea9aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.783+0000 7fc730858740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5569ea9166b0 con 0x5569ea9a8b00 2024-09-11T01:10:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.783+0000 7fc730858740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5569ea905ae0 con 0x5569ea9a60c0 2024-09-11T01:10:32.786 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.783+0000 7fc730858740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5569ea9098f0 con 0x5569ea9a3790 2024-09-11T01:10:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.784+0000 7fc727400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.784+0000 7fc727400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9a5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:35852/0 (socket says 172.21.15.103:35852) 2024-09-11T01:10:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.784+0000 7fc726000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a8b00 0x5569ea9aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.784+0000 7fc727400640 1 -- 172.21.15.103:0/2673119485 learned_addr learned my addr 172.21.15.103:0/2673119485 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.784+0000 7fc726a00640 1 --2- 172.21.15.103:0/2673119485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 0x5569ea9a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.784+0000 7fc727400640 1 -- 172.21.15.103:0/2673119485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 msgr2=0x5569ea9a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.784+0000 7fc727400640 1 --2- 172.21.15.103:0/2673119485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 0x5569ea9a84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.784+0000 7fc727400640 1 -- 172.21.15.103:0/2673119485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a8b00 msgr2=0x5569ea9aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.784+0000 7fc727400640 1 --2- 172.21.15.103:0/2673119485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a8b00 0x5569ea9aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.784+0000 7fc727400640 1 -- 172.21.15.103:0/2673119485 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ea8d2780 con 0x5569ea9a3790 2024-09-11T01:10:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.784+0000 7fc727400640 1 --2- 172.21.15.103:0/2673119485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9a5b80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc720009f30 tx=0x7fc7200118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f67f46b361fc195e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:32.789 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.784+0000 7fc71f400640 1 --2- 172.21.15.103:0/1619867963 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc70c0b5360 0x7fc70c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.785+0000 7fc713e00640 1 -- 172.21.15.103:0/2673119485 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720004d20 con 0x5569ea9a3790 2024-09-11T01:10:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.785+0000 7fc713e00640 1 -- 172.21.15.103:0/2673119485 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc720004050 con 0x5569ea9a3790 2024-09-11T01:10:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.785+0000 7fc713e00640 1 -- 172.21.15.103:0/2673119485 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720005260 con 0x5569ea9a3790 2024-09-11T01:10:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.785+0000 7fc71f400640 1 -- 172.21.15.103:0/1619867963 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fc714106c00 con 0x7fc728105ce0 2024-09-11T01:10:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.785+0000 7fc726a00640 1 --2- 172.21.15.103:0/1619867963 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc70c0b5360 0x7fc70c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.785+0000 7fc730858740 1 -- 172.21.15.103:0/2673119485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 msgr2=0x5569ea9a5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.785+0000 7fc730858740 1 --2- 172.21.15.103:0/2673119485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9a5b80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc720009f30 tx=0x7fc7200118d0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.785+0000 7fc730858740 1 -- 172.21.15.103:0/2673119485 shutdown_connections 2024-09-11T01:10:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.785+0000 7fc730858740 1 --2- 172.21.15.103:0/2673119485 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a8b00 0x5569ea9aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.790 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.785+0000 7fc730858740 1 --2- 172.21.15.103:0/2673119485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 0x5569ea9a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.785+0000 7fc730858740 1 --2- 172.21.15.103:0/2673119485 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9a5b80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.785+0000 7fc730858740 1 -- 172.21.15.103:0/2673119485 >> 172.21.15.103:0/2673119485 conn(0x5569ea99e8e0 msgr2=0x5569ea99f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:32.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.786+0000 7fc726a00640 1 --2- 172.21.15.103:0/1619867963 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc70c0b5360 0x7fc70c0b7820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc718005d00 tx=0x7fc71800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:32.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.786+0000 7fc730858740 1 -- 172.21.15.103:0/2673119485 shutdown_connections 2024-09-11T01:10:32.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.786+0000 7fc730858740 1 -- 172.21.15.103:0/2673119485 wait complete. 2024-09-11T01:10:32.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.786+0000 7fc730858740 1 -- start start 2024-09-11T01:10:32.791 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.786+0000 7fc730858740 1 Processor -- start 2024-09-11T01:10:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc730858740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9acf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc730858740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a60c0 0x5569ea9ad600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc730858740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a8b00 0x5569ea9ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc730858740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5569ea83dab0 con 0x5569ea9a60c0 2024-09-11T01:10:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc730858740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5569ea8ac570 con 0x5569ea9a8b00 2024-09-11T01:10:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc730858740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5569ea9abae0 con 0x5569ea9a3790 2024-09-11T01:10:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc730858740 10 client.0 _ll_register_callbacks cb 0x5569ea8bb100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc726a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc726000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a60c0 0x5569ea9ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc727400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a8b00 0x5569ea9ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc727400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a8b00 0x5569ea9ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:37302/0 (socket says 172.21.15.103:37302) 2024-09-11T01:10:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc727400640 1 -- 172.21.15.103:0/896762856 learned_addr learned my addr 172.21.15.103:0/896762856 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc726a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9acf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:35866/0 (socket says 172.21.15.103:35866) 2024-09-11T01:10:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc727400640 1 -- 172.21.15.103:0/896762856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 msgr2=0x5569ea9acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc727400640 1 --2- 172.21.15.103:0/896762856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc727400640 1 -- 172.21.15.103:0/896762856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a60c0 msgr2=0x5569ea9ad600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc727400640 1 --2- 172.21.15.103:0/896762856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a60c0 0x5569ea9ad600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc727400640 1 -- 172.21.15.103:0/896762856 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569ea667790 con 0x5569ea9a8b00 2024-09-11T01:10:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.787+0000 7fc726000640 1 --2- 172.21.15.103:0/896762856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a60c0 0x5569ea9ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:10:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.788+0000 7fc727400640 1 --2- 172.21.15.103:0/896762856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a8b00 0x5569ea9ae1d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc720009f00 tx=0x7fc720004c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ff7d5476fc895cb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.788+0000 7fc710c00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:10:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.788+0000 7fc710c00640 1 -- 172.21.15.103:0/896762856 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720029020 con 0x5569ea9a8b00 2024-09-11T01:10:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.788+0000 7fc730858740 1 -- 172.21.15.103:0/896762856 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc720004050 con 0x5569ea9a8b00 2024-09-11T01:10:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.788+0000 7fc710c00640 1 -- 172.21.15.103:0/896762856 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fc720005040 con 0x5569ea9a8b00 2024-09-11T01:10:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.788+0000 7fc710c00640 1 -- 172.21.15.103:0/896762856 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc720034050 con 0x5569ea9a8b00 2024-09-11T01:10:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.788+0000 7fc730858740 10 client.25610 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.788+0000 7fc730858740 1 -- 172.21.15.103:0/896762856 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5569ea6e0620 con 0x5569ea9a8b00 2024-09-11T01:10:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.789+0000 7fc710c00640 1 -- 172.21.15.103:0/896762856 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc720004050 con 0x5569ea9a8b00 2024-09-11T01:10:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.789+0000 7fc710c00640 1 -- 172.21.15.103:0/896762856 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7fc720025470 con 0x5569ea9a8b00 2024-09-11T01:10:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.789+0000 7fc730858740 10 client.25610 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.789+0000 7fc730858740 10 client.25610 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:10:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.789+0000 7fc730858740 20 client.25610 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.789+0000 7fc730858740 1 --2- 172.21.15.103:0/896762856 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5569ea9b86f0 0x5569ea9bab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.789+0000 7fc730858740 4 client.25610 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:10:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.789+0000 7fc730858740 1 -- 172.21.15.103:0/896762856 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569ea918600 con 0x5569ea9b86f0 2024-09-11T01:10:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.789+0000 7fc726a00640 1 --2- 172.21.15.103:0/896762856 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5569ea9b86f0 0x5569ea9bab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.790+0000 7fc726a00640 1 --2- 172.21.15.103:0/896762856 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5569ea9b86f0 0x5569ea9bab10 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9756f306bd813bce server_cookie=4454a5361103b04c in_seq=0 out_seq=0 2024-09-11T01:10:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.790+0000 7fc710c00640 10 client.25610 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc710c00640 1 -- 172.21.15.103:0/896762856 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5569ea918600 con 0x5569ea9b86f0 2024-09-11T01:10:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc710c00640 10 client.25610 handle_command_reply: tid=0 2024-09-11T01:10:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc730858740 1 client.25610 shutdown 2024-09-11T01:10:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc730858740 1 -- 172.21.15.103:0/896762856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a8b00 msgr2=0x5569ea9ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc730858740 1 --2- 172.21.15.103:0/896762856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a8b00 0x5569ea9ae1d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc720009f00 tx=0x7fc720004c70 comp rx=0 tx=0).stop 2024-09-11T01:10:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc730858740 1 -- 172.21.15.103:0/896762856 shutdown_connections 2024-09-11T01:10:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc730858740 1 --2- 172.21.15.103:0/896762856 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a8b00 0x5569ea9ae1d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc730858740 1 --2- 172.21.15.103:0/896762856 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a60c0 0x5569ea9ad600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc730858740 1 --2- 172.21.15.103:0/896762856 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5569ea9b86f0 0x5569ea9bab10 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc730858740 1 --2- 172.21.15.103:0/896762856 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc730858740 1 -- 172.21.15.103:0/896762856 >> 172.21.15.103:0/896762856 conn(0x5569ea99e8e0 msgr2=0x5569ea99da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc710c00640 0 client.25610 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc730858740 1 -- 172.21.15.103:0/896762856 shutdown_connections 2024-09-11T01:10:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc730858740 1 -- 172.21.15.103:0/896762856 wait complete. 2024-09-11T01:10:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.791+0000 7fc730858740 20 client.25610 trim_cache size 0 max 16384 2024-09-11T01:10:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.806+0000 7fc730858740 1 Processor -- start 2024-09-11T01:10:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.806+0000 7fc730858740 1 -- start start 2024-09-11T01:10:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc730858740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a3790 0x5569ea9a0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc730858740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 0x5569ea9b4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc730858740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a8b00 0x5569ea9a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc730858740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc7281b01f0 con 0x5569ea9a3790 2024-09-11T01:10:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc730858740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc7281ada90 con 0x5569ea9a60c0 2024-09-11T01:10:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc730858740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc7281ab8e0 con 0x5569ea9a8b00 2024-09-11T01:10:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc726a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a3790 0x5569ea9a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc726a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a3790 0x5569ea9a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51252/0 (socket says 172.21.15.103:51252) 2024-09-11T01:10:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc726a00640 1 -- 172.21.15.103:0/4262353183 learned_addr learned my addr 172.21.15.103:0/4262353183 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc727400640 1 --2- 172.21.15.103:0/4262353183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a8b00 0x5569ea9a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc726000640 1 --2- 172.21.15.103:0/4262353183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 0x5569ea9b4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc727400640 1 -- 172.21.15.103:0/4262353183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 msgr2=0x5569ea9b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc727400640 1 --2- 172.21.15.103:0/4262353183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 0x5569ea9b4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc727400640 1 -- 172.21.15.103:0/4262353183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a3790 msgr2=0x5569ea9a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc727400640 1 --2- 172.21.15.103:0/4262353183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a3790 0x5569ea9a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc727400640 1 -- 172.21.15.103:0/4262353183 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ea9a8820 con 0x5569ea9a8b00 2024-09-11T01:10:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc726a00640 1 --2- 172.21.15.103:0/4262353183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a3790 0x5569ea9a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:10:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.807+0000 7fc727400640 1 --2- 172.21.15.103:0/4262353183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a8b00 0x5569ea9a0c50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc720011910 tx=0x7fc720011e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=207ab7602f4fc65d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.808+0000 7fc713400640 1 -- 172.21.15.103:0/4262353183 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720029040 con 0x5569ea9a8b00 2024-09-11T01:10:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.808+0000 7fc713400640 1 -- 172.21.15.103:0/4262353183 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc720025470 con 0x5569ea9a8b00 2024-09-11T01:10:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.808+0000 7fc713400640 1 -- 172.21.15.103:0/4262353183 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720005040 con 0x5569ea9a8b00 2024-09-11T01:10:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.808+0000 7fc730858740 1 -- 172.21.15.103:0/4262353183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a8b00 msgr2=0x5569ea9a0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.808+0000 7fc730858740 1 --2- 172.21.15.103:0/4262353183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a8b00 0x5569ea9a0c50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc720011910 tx=0x7fc720011e80 comp rx=0 tx=0).stop 2024-09-11T01:10:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.808+0000 7fc730858740 1 -- 172.21.15.103:0/4262353183 shutdown_connections 2024-09-11T01:10:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.808+0000 7fc730858740 1 --2- 172.21.15.103:0/4262353183 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a8b00 0x5569ea9a0c50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.808+0000 7fc730858740 1 --2- 172.21.15.103:0/4262353183 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 0x5569ea9b4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.808+0000 7fc730858740 1 --2- 172.21.15.103:0/4262353183 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a3790 0x5569ea9a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.808+0000 7fc730858740 1 -- 172.21.15.103:0/4262353183 >> 172.21.15.103:0/4262353183 conn(0x5569ea99e8e0 msgr2=0x5569ea9a8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:32.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.808+0000 7fc730858740 1 -- 172.21.15.103:0/4262353183 shutdown_connections 2024-09-11T01:10:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.809+0000 7fc730858740 1 -- 172.21.15.103:0/4262353183 wait complete. 2024-09-11T01:10:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.809+0000 7fc730858740 1 -- start start 2024-09-11T01:10:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.809+0000 7fc730858740 1 Processor -- start 2024-09-11T01:10:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.809+0000 7fc730858740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.809+0000 7fc730858740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 0x5569ea9b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.809+0000 7fc730858740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a8b00 0x5569ea9b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.809+0000 7fc730858740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc7281abf50 con 0x5569ea9a8b00 2024-09-11T01:10:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.809+0000 7fc730858740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc7281ad3c0 con 0x5569ea9a60c0 2024-09-11T01:10:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.809+0000 7fc730858740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc7281ac620 con 0x5569ea9a3790 2024-09-11T01:10:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.809+0000 7fc730858740 10 client.0 _ll_register_callbacks cb 0x7fc71410a510 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.810+0000 7fc727400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a8b00 0x5569ea9b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.810+0000 7fc726a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.810+0000 7fc727400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a8b00 0x5569ea9b3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51260/0 (socket says 172.21.15.103:51260) 2024-09-11T01:10:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.810+0000 7fc727400640 1 -- 172.21.15.103:0/2276451359 learned_addr learned my addr 172.21.15.103:0/2276451359 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.810+0000 7fc726000640 1 --2- 172.21.15.103:0/2276451359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 0x5569ea9b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.810+0000 7fc727400640 1 -- 172.21.15.103:0/2276451359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 msgr2=0x5569ea9b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.810+0000 7fc727400640 1 --2- 172.21.15.103:0/2276451359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.810+0000 7fc727400640 1 -- 172.21.15.103:0/2276451359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 msgr2=0x5569ea9b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.810+0000 7fc727400640 1 --2- 172.21.15.103:0/2276451359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 0x5569ea9b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.810+0000 7fc727400640 1 -- 172.21.15.103:0/2276451359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569ea9b4610 con 0x5569ea9a8b00 2024-09-11T01:10:32.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.810+0000 7fc726a00640 1 --2- 172.21.15.103:0/2276451359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:10:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.810+0000 7fc727400640 1 --2- 172.21.15.103:0/2276451359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a8b00 0x5569ea9b3de0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc720025980 tx=0x7fc720025690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6a7324edb39659 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.810+0000 7fc710c00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:10:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.811+0000 7fc710c00640 1 -- 172.21.15.103:0/2276451359 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc720029040 con 0x5569ea9a8b00 2024-09-11T01:10:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.811+0000 7fc710c00640 1 -- 172.21.15.103:0/2276451359 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fc720003c40 con 0x5569ea9a8b00 2024-09-11T01:10:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.811+0000 7fc730858740 1 -- 172.21.15.103:0/2276451359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc720025470 con 0x5569ea9a8b00 2024-09-11T01:10:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.811+0000 7fc710c00640 1 -- 172.21.15.103:0/2276451359 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc720004850 con 0x5569ea9a8b00 2024-09-11T01:10:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.811+0000 7fc730858740 10 client.15582 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.811+0000 7fc730858740 1 -- 172.21.15.103:0/2276451359 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5569eaa256e0 con 0x5569ea9a8b00 2024-09-11T01:10:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.811+0000 7fc710c00640 1 -- 172.21.15.103:0/2276451359 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc720025470 con 0x5569ea9a8b00 2024-09-11T01:10:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.811+0000 7fc710c00640 1 -- 172.21.15.103:0/2276451359 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7fc72000f480 con 0x5569ea9a8b00 2024-09-11T01:10:32.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.811+0000 7fc730858740 10 client.15582 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.811+0000 7fc730858740 10 client.15582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:10:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.811+0000 7fc730858740 20 client.15582 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.811+0000 7fc730858740 1 --2- 172.21.15.103:0/2276451359 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5569eaa260f0 0x5569eaa28510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.811+0000 7fc730858740 4 client.15582 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:10:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.811+0000 7fc730858740 1 -- 172.21.15.103:0/2276451359 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5569ea9140b0 con 0x5569eaa260f0 2024-09-11T01:10:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.812+0000 7fc726a00640 1 --2- 172.21.15.103:0/2276451359 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5569eaa260f0 0x5569eaa28510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.812+0000 7fc726a00640 1 --2- 172.21.15.103:0/2276451359 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5569eaa260f0 0x5569eaa28510 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7325fb7a38ac1f45 server_cookie=d96b35a53574a1d9 in_seq=0 out_seq=0 2024-09-11T01:10:32.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.812+0000 7fc710c00640 10 client.15582 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.830+0000 7fc710c00640 1 -- 172.21.15.103:0/2276451359 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5569ea9140b0 con 0x5569eaa260f0 2024-09-11T01:10:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.830+0000 7fc710c00640 10 client.15582 handle_command_reply: tid=0 2024-09-11T01:10:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.830+0000 7fc730858740 1 client.15582 shutdown 2024-09-11T01:10:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.830+0000 7fc730858740 1 -- 172.21.15.103:0/2276451359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a8b00 msgr2=0x5569ea9b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.830+0000 7fc730858740 1 --2- 172.21.15.103:0/2276451359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a8b00 0x5569ea9b3de0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fc720025980 tx=0x7fc720025690 comp rx=0 tx=0).stop 2024-09-11T01:10:32.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.830+0000 7fc730858740 1 -- 172.21.15.103:0/2276451359 shutdown_connections 2024-09-11T01:10:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.830+0000 7fc730858740 1 --2- 172.21.15.103:0/2276451359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5569ea9a8b00 0x5569ea9b3de0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.830+0000 7fc730858740 1 --2- 172.21.15.103:0/2276451359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5569ea9a60c0 0x5569ea9b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.830+0000 7fc730858740 1 --2- 172.21.15.103:0/2276451359 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5569eaa260f0 0x5569eaa28510 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.830+0000 7fc730858740 1 --2- 172.21.15.103:0/2276451359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5569ea9a3790 0x5569ea9b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.830+0000 7fc710c00640 0 client.15582 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.830+0000 7fc730858740 1 -- 172.21.15.103:0/2276451359 >> 172.21.15.103:0/2276451359 conn(0x5569ea99e8e0 msgr2=0x5569ea99d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.830+0000 7fc730858740 1 -- 172.21.15.103:0/2276451359 shutdown_connections 2024-09-11T01:10:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.830+0000 7fc730858740 1 -- 172.21.15.103:0/2276451359 wait complete. 2024-09-11T01:10:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.831+0000 7fc730858740 20 client.15582 trim_cache size 0 max 16384 2024-09-11T01:10:32.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:10:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:10:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:10:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:10:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.831+0000 7fc72d800640 1 -- 172.21.15.103:0/1619867963 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc70c0b5360 msgr2=0x7fc70c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.831+0000 7fc72d800640 1 --2- 172.21.15.103:0/1619867963 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc70c0b5360 0x7fc70c0b7820 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc718005d00 tx=0x7fc71800b410 comp rx=0 tx=0).stop 2024-09-11T01:10:32.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.831+0000 7fc72d800640 1 -- 172.21.15.103:0/1619867963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc728105ce0 msgr2=0x7fc72819b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.831+0000 7fc72d800640 1 --2- 172.21.15.103:0/1619867963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc728105ce0 0x7fc72819b5e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc714009a50 tx=0x7fc7140042f0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.831+0000 7fc72d800640 1 -- 172.21.15.103:0/1619867963 shutdown_connections 2024-09-11T01:10:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.831+0000 7fc72d800640 1 --2- 172.21.15.103:0/1619867963 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc70c0b5360 0x7fc70c0b7820 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.831+0000 7fc72d800640 1 --2- 172.21.15.103:0/1619867963 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc7281066a0 0x7fc72819c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.831+0000 7fc72d800640 1 --2- 172.21.15.103:0/1619867963 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc728105ce0 0x7fc72819b5e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.831+0000 7fc72d800640 1 --2- 172.21.15.103:0/1619867963 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc728104b90 0x7fc72819af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.831+0000 7fc72d800640 1 -- 172.21.15.103:0/1619867963 >> 172.21.15.103:0/1619867963 conn(0x7fc728100470 msgr2=0x7fc7281090d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.831+0000 7fc72d800640 1 -- 172.21.15.103:0/1619867963 shutdown_connections 2024-09-11T01:10:32.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:32.831+0000 7fc72d800640 1 -- 172.21.15.103:0/1619867963 wait complete. 2024-09-11T01:10:34.186 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:10:34.569 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:10:34.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:34 smithi103 ceph-mon[30562]: pgmap v466: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 141 MiB/s wr, 65 op/s 2024-09-11T01:10:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:34 smithi183 ceph-mon[34992]: pgmap v466: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 141 MiB/s wr, 65 op/s 2024-09-11T01:10:35.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:34 smithi117 ceph-mon[35358]: pgmap v466: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 141 MiB/s wr, 65 op/s 2024-09-11T01:10:35.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.142+0000 7f730ee00640 1 -- 172.21.15.103:0/718125367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7308077ff0 msgr2=0x7f7308113450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:35.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.142+0000 7f730ee00640 1 --2- 172.21.15.103:0/718125367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7308077ff0 0x7f7308113450 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009900 tx=0x7f72f402a3f0 comp rx=0 tx=0).stop 2024-09-11T01:10:35.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.142+0000 7f730ee00640 1 -- 172.21.15.103:0/718125367 shutdown_connections 2024-09-11T01:10:35.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.142+0000 7f730ee00640 1 --2- 172.21.15.103:0/718125367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7308113990 0x7f7308115d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:35.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.142+0000 7f730ee00640 1 --2- 172.21.15.103:0/718125367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7308077ff0 0x7f7308113450 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:35.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.142+0000 7f730ee00640 1 --2- 172.21.15.103:0/718125367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73080776d0 0x7f7308077ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:35.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.142+0000 7f730ee00640 1 -- 172.21.15.103:0/718125367 >> 172.21.15.103:0/718125367 conn(0x7f7308100a50 msgr2=0x7f7308102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:35.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.142+0000 7f730ee00640 1 -- 172.21.15.103:0/718125367 shutdown_connections 2024-09-11T01:10:35.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.142+0000 7f730ee00640 1 -- 172.21.15.103:0/718125367 wait complete. 2024-09-11T01:10:35.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.144+0000 7f730ee00640 1 Processor -- start 2024-09-11T01:10:35.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.144+0000 7f730ee00640 1 -- start start 2024-09-11T01:10:35.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.144+0000 7f730ee00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73080776d0 0x7f730819f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:35.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.144+0000 7f730ee00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7308077ff0 0x7f730819fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:35.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.144+0000 7f730ee00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7308113990 0x7f73081a51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:35.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.144+0000 7f730ee00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f73081193c0 con 0x7f7308113990 2024-09-11T01:10:35.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.144+0000 7f730ee00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7308119240 con 0x7f7308077ff0 2024-09-11T01:10:35.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.144+0000 7f730ee00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7308119540 con 0x7f73080776d0 2024-09-11T01:10:35.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.145+0000 7f7307e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73080776d0 0x7f730819f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:35.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.145+0000 7f730ce00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7308113990 0x7f73081a51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:35.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.145+0000 7f7307e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73080776d0 0x7f730819f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:35894/0 (socket says 172.21.15.103:35894) 2024-09-11T01:10:35.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.145+0000 7f7307e00640 1 -- 172.21.15.103:0/89433069 learned_addr learned my addr 172.21.15.103:0/89433069 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:35.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.145+0000 7f7307400640 1 --2- 172.21.15.103:0/89433069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7308077ff0 0x7f730819fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:35.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.145+0000 7f7307e00640 1 -- 172.21.15.103:0/89433069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7308077ff0 msgr2=0x7f730819fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:35.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.145+0000 7f7307e00640 1 --2- 172.21.15.103:0/89433069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7308077ff0 0x7f730819fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:35.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.145+0000 7f7307e00640 1 -- 172.21.15.103:0/89433069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7308113990 msgr2=0x7f73081a51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:35.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.145+0000 7f7307e00640 1 --2- 172.21.15.103:0/89433069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7308113990 0x7f73081a51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:35.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.145+0000 7f7307e00640 1 -- 172.21.15.103:0/89433069 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73081a59a0 con 0x7f73080776d0 2024-09-11T01:10:35.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.145+0000 7f730ce00640 1 --2- 172.21.15.103:0/89433069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7308113990 0x7f73081a51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:10:35.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.145+0000 7f7307e00640 1 --2- 172.21.15.103:0/89433069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73080776d0 0x7f730819f8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009d50 tx=0x7f72f800c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:35.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.146+0000 7f7304c00640 1 -- 172.21.15.103:0/89433069 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8003b70 con 0x7f73080776d0 2024-09-11T01:10:35.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.146+0000 7f7304c00640 1 -- 172.21.15.103:0/89433069 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72f8003d10 con 0x7f73080776d0 2024-09-11T01:10:35.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.146+0000 7f7304c00640 1 -- 172.21.15.103:0/89433069 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f80108a0 con 0x7f73080776d0 2024-09-11T01:10:35.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.146+0000 7f730ee00640 1 -- 172.21.15.103:0/89433069 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73081a5c90 con 0x7f73080776d0 2024-09-11T01:10:35.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.146+0000 7f730ee00640 1 -- 172.21.15.103:0/89433069 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73081ac520 con 0x7f73080776d0 2024-09-11T01:10:35.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.147+0000 7f730ee00640 1 -- 172.21.15.103:0/89433069 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7308077ab0 con 0x7f73080776d0 2024-09-11T01:10:35.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.149+0000 7f7304c00640 1 -- 172.21.15.103:0/89433069 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f72f8004000 con 0x7f73080776d0 2024-09-11T01:10:35.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.150+0000 7f7304c00640 1 --2- 172.21.15.103:0/89433069 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f72ec0b5360 0x7f72ec0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:35.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.151+0000 7f7304c00640 1 -- 172.21.15.103:0/89433069 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f72f80e66e0 con 0x7f73080776d0 2024-09-11T01:10:35.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.151+0000 7f7307400640 1 --2- 172.21.15.103:0/89433069 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f72ec0b5360 0x7f72ec0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:35.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.151+0000 7f7307400640 1 --2- 172.21.15.103:0/89433069 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f72ec0b5360 0x7f72ec0b7820 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f72f4005ab0 tx=0x7f72f4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:35.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.152+0000 7f7304c00640 1 -- 172.21.15.103:0/89433069 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f72f80ad220 con 0x7f73080776d0 2024-09-11T01:10:35.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.372+0000 7f730ee00640 1 -- 172.21.15.103:0/89433069 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f73081a0a20 con 0x7f73080776d0 2024-09-11T01:10:35.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.374+0000 7f7304c00640 1 -- 172.21.15.103:0/89433069 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11934 (secure 0 0 0) 0x7f73081a0a20 con 0x7f73080776d0 2024-09-11T01:10:35.377 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:10:35.377 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"btime":"2024-09-11T01:09:42:655122+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:09:42.508953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24629,24619]},"id":1}]} 2024-09-11T01:10:35.377 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2024-09-11T01:10:35.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.376+0000 7f730ee00640 1 -- 172.21.15.103:0/89433069 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f72ec0b5360 msgr2=0x7f72ec0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:35.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.376+0000 7f730ee00640 1 --2- 172.21.15.103:0/89433069 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f72ec0b5360 0x7f72ec0b7820 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f72f4005ab0 tx=0x7f72f4005a20 comp rx=0 tx=0).stop 2024-09-11T01:10:35.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.376+0000 7f730ee00640 1 -- 172.21.15.103:0/89433069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73080776d0 msgr2=0x7f730819f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:35.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.376+0000 7f730ee00640 1 --2- 172.21.15.103:0/89433069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73080776d0 0x7f730819f8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009d50 tx=0x7f72f800c6a0 comp rx=0 tx=0).stop 2024-09-11T01:10:35.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.376+0000 7f730ee00640 1 -- 172.21.15.103:0/89433069 shutdown_connections 2024-09-11T01:10:35.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.376+0000 7f730ee00640 1 --2- 172.21.15.103:0/89433069 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f72ec0b5360 0x7f72ec0b7820 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:35.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.376+0000 7f730ee00640 1 --2- 172.21.15.103:0/89433069 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7308113990 0x7f73081a51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:35.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.376+0000 7f730ee00640 1 --2- 172.21.15.103:0/89433069 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7308077ff0 0x7f730819fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:35.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.376+0000 7f730ee00640 1 --2- 172.21.15.103:0/89433069 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f73080776d0 0x7f730819f8f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:35.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.376+0000 7f730ee00640 1 -- 172.21.15.103:0/89433069 >> 172.21.15.103:0/89433069 conn(0x7f7308100a50 msgr2=0x7f7308102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:35.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.376+0000 7f730ee00640 1 -- 172.21.15.103:0/89433069 shutdown_connections 2024-09-11T01:10:35.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:35.376+0000 7f730ee00640 1 -- 172.21.15.103:0/89433069 wait complete. 2024-09-11T01:10:35.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:35 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/89433069' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:10:36.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:35 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/89433069' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:10:36.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:35 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/89433069' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:10:36.295 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24665 quiesce db --set-id 39731ca6 --release --await' 2024-09-11T01:10:36.295 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24665 quiesce db --set-id 39731ca6 --release --await 2024-09-11T01:10:36.670 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:10:36.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:36 smithi183 ceph-mon[34992]: pgmap v467: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 66 MiB/s wr, 27 op/s 2024-09-11T01:10:36.994 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:36 smithi103 ceph-mon[30562]: pgmap v467: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 66 MiB/s wr, 27 op/s 2024-09-11T01:10:37.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:36 smithi117 ceph-mon[35358]: pgmap v467: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 66 MiB/s wr, 27 op/s 2024-09-11T01:10:37.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.301+0000 7fb87e400640 1 -- 172.21.15.103:0/3374799513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8780754c0 msgr2=0x7fb8780758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:37.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.301+0000 7fb87e400640 1 --2- 172.21.15.103:0/3374799513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8780754c0 0x7fb8780758a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb86c009900 tx=0x7fb86c02a3f0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.301+0000 7fb87e400640 1 -- 172.21.15.103:0/3374799513 shutdown_connections 2024-09-11T01:10:37.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.301+0000 7fb87e400640 1 --2- 172.21.15.103:0/3374799513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb87810f220 0x7fb878111610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.301+0000 7fb87e400640 1 --2- 172.21.15.103:0/3374799513 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb878075de0 0x7fb87810ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.301+0000 7fb87e400640 1 --2- 172.21.15.103:0/3374799513 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8780754c0 0x7fb8780758a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.301+0000 7fb87e400640 1 -- 172.21.15.103:0/3374799513 >> 172.21.15.103:0/3374799513 conn(0x7fb8780fe660 msgr2=0x7fb878100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:37.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.301+0000 7fb87e400640 1 -- 172.21.15.103:0/3374799513 shutdown_connections 2024-09-11T01:10:37.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.301+0000 7fb87e400640 1 -- 172.21.15.103:0/3374799513 wait complete. 2024-09-11T01:10:37.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.302+0000 7fb87e400640 1 Processor -- start 2024-09-11T01:10:37.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.302+0000 7fb87e400640 1 -- start start 2024-09-11T01:10:37.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb87e400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8780754c0 0x7fb87819b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb87e400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb878075de0 0x7fb87819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb87e400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb87810f220 0x7fb8781a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb87e400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb878114e00 con 0x7fb878075de0 2024-09-11T01:10:37.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb87e400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb878114c80 con 0x7fb87810f220 2024-09-11T01:10:37.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb87e400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb878114f80 con 0x7fb8780754c0 2024-09-11T01:10:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb877e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb878075de0 0x7fb87819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb877e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb878075de0 0x7fb87819b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51304/0 (socket says 172.21.15.103:51304) 2024-09-11T01:10:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb877e00640 1 -- 172.21.15.103:0/2940840359 learned_addr learned my addr 172.21.15.103:0/2940840359 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb87d000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8780754c0 0x7fb87819b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb87da00640 1 --2- 172.21.15.103:0/2940840359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb87810f220 0x7fb8781a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb87d000640 1 -- 172.21.15.103:0/2940840359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb87810f220 msgr2=0x7fb8781a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb87d000640 1 --2- 172.21.15.103:0/2940840359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb87810f220 0x7fb8781a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb87d000640 1 -- 172.21.15.103:0/2940840359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb878075de0 msgr2=0x7fb87819b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb87d000640 1 --2- 172.21.15.103:0/2940840359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb878075de0 0x7fb87819b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.303+0000 7fb87d000640 1 -- 172.21.15.103:0/2940840359 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8781a1360 con 0x7fb8780754c0 2024-09-11T01:10:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.304+0000 7fb877e00640 1 --2- 172.21.15.103:0/2940840359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb878075de0 0x7fb87819b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:10:37.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.304+0000 7fb87d000640 1 --2- 172.21.15.103:0/2940840359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8780754c0 0x7fb87819b2b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb86c02a910 tx=0x7fb86c031a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:37.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.304+0000 7fb875600640 1 -- 172.21.15.103:0/2940840359 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c03f030 con 0x7fb8780754c0 2024-09-11T01:10:37.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.304+0000 7fb875600640 1 -- 172.21.15.103:0/2940840359 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb86c004490 con 0x7fb8780754c0 2024-09-11T01:10:37.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.304+0000 7fb875600640 1 -- 172.21.15.103:0/2940840359 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86c035070 con 0x7fb8780754c0 2024-09-11T01:10:37.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.304+0000 7fb87e400640 1 -- 172.21.15.103:0/2940840359 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8781a15f0 con 0x7fb8780754c0 2024-09-11T01:10:37.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.304+0000 7fb87e400640 1 -- 172.21.15.103:0/2940840359 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8781a7d10 con 0x7fb8780754c0 2024-09-11T01:10:37.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.307+0000 7fb882122740 1 Processor -- start 2024-09-11T01:10:37.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.307+0000 7fb882122740 1 -- start start 2024-09-11T01:10:37.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb882122740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecb1d0 0x557b61ecb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb882122740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecbaf0 0x557b61ed7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb882122740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ed9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb882122740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557b61e42290 con 0x557b61ed7a80 2024-09-11T01:10:37.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb882122740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557b61e316c0 con 0x557b61ecb1d0 2024-09-11T01:10:37.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb882122740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557b61e354d0 con 0x557b61ecbaf0 2024-09-11T01:10:37.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb877e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ed9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb875600640 1 -- 172.21.15.103:0/2940840359 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7fb86c03ba30 con 0x7fb8780754c0 2024-09-11T01:10:37.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb87da00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecb1d0 0x557b61ecb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb877e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ed9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51310/0 (socket says 172.21.15.103:51310) 2024-09-11T01:10:37.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb877e00640 1 -- 172.21.15.103:0/2142248028 learned_addr learned my addr 172.21.15.103:0/2142248028 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:37.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb87da00640 1 -- 172.21.15.103:0/2142248028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecbaf0 msgr2=0x557b61ed7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:37.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb87da00640 1 --2- 172.21.15.103:0/2142248028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecbaf0 0x557b61ed7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb87da00640 1 -- 172.21.15.103:0/2142248028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 msgr2=0x557b61ed9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:37.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.308+0000 7fb87da00640 1 --2- 172.21.15.103:0/2142248028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ed9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.309+0000 7fb87da00640 1 -- 172.21.15.103:0/2142248028 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b61dbe460 con 0x557b61ecb1d0 2024-09-11T01:10:37.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.309+0000 7fb877e00640 1 --2- 172.21.15.103:0/2142248028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ed9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:10:37.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.309+0000 7fb87da00640 1 --2- 172.21.15.103:0/2142248028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecb1d0 0x557b61ecb5b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb87806bf90 tx=0x7fb870011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d57ea6e1860bf9b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:37.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.309+0000 7fb86a000640 1 -- 172.21.15.103:0/2142248028 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870004d20 con 0x557b61ecb1d0 2024-09-11T01:10:37.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.309+0000 7fb86a000640 1 -- 172.21.15.103:0/2142248028 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb870004050 con 0x557b61ecb1d0 2024-09-11T01:10:37.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.309+0000 7fb86a000640 1 -- 172.21.15.103:0/2142248028 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870005280 con 0x557b61ecb1d0 2024-09-11T01:10:37.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.310+0000 7fb875600640 1 --2- 172.21.15.103:0/2940840359 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8600b5410 0x7fb8600b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.310+0000 7fb882122740 1 -- 172.21.15.103:0/2142248028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecb1d0 msgr2=0x557b61ecb5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:37.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.310+0000 7fb882122740 1 --2- 172.21.15.103:0/2142248028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecb1d0 0x557b61ecb5b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb87806bf90 tx=0x7fb870011810 comp rx=0 tx=0).stop 2024-09-11T01:10:37.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.310+0000 7fb882122740 1 -- 172.21.15.103:0/2142248028 shutdown_connections 2024-09-11T01:10:37.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.310+0000 7fb882122740 1 --2- 172.21.15.103:0/2142248028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ed9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.310+0000 7fb882122740 1 --2- 172.21.15.103:0/2142248028 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecbaf0 0x557b61ed7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.310+0000 7fb882122740 1 --2- 172.21.15.103:0/2142248028 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecb1d0 0x557b61ecb5b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.310+0000 7fb882122740 1 -- 172.21.15.103:0/2142248028 >> 172.21.15.103:0/2142248028 conn(0x557b61ec9000 msgr2=0x557b61eca1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:37.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.310+0000 7fb875600640 1 -- 172.21.15.103:0/2940840359 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fb86c1064c0 con 0x7fb8780754c0 2024-09-11T01:10:37.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.310+0000 7fb87d000640 1 --2- 172.21.15.103:0/2940840359 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8600b5410 0x7fb8600b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.310+0000 7fb882122740 1 -- 172.21.15.103:0/2142248028 shutdown_connections 2024-09-11T01:10:37.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.310+0000 7fb882122740 1 -- 172.21.15.103:0/2142248028 wait complete. 2024-09-11T01:10:37.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.311+0000 7fb87d000640 1 --2- 172.21.15.103:0/2940840359 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8600b5410 0x7fb8600b78d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0c8ef0 tx=0x7fb86c005b70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:37.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.311+0000 7fb882122740 1 -- start start 2024-09-11T01:10:37.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.311+0000 7fb882122740 1 Processor -- start 2024-09-11T01:10:37.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.311+0000 7fb882122740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecb1d0 0x557b61ed7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.311+0000 7fb882122740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecbaf0 0x557b61ed4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.311+0000 7fb882122740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ed5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.311+0000 7fb882122740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557b61c92bb0 con 0x557b61ed7a80 2024-09-11T01:10:37.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.311+0000 7fb882122740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x557b61dcc6c0 con 0x557b61ecb1d0 2024-09-11T01:10:37.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.311+0000 7fb882122740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x557b61eda730 con 0x557b61ecbaf0 2024-09-11T01:10:37.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.311+0000 7fb882122740 10 client.0 _ll_register_callbacks cb 0x557b61de7490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:37.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.312+0000 7fb87da00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecb1d0 0x557b61ed7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.312+0000 7fb877e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecbaf0 0x557b61ed4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.312+0000 7fb877e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecbaf0 0x557b61ed4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:35926/0 (socket says 172.21.15.103:35926) 2024-09-11T01:10:37.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.312+0000 7fb877e00640 1 -- 172.21.15.103:0/1804187032 learned_addr learned my addr 172.21.15.103:0/1804187032 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:37.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.312+0000 7fb87da00640 1 --2- 172.21.15.103:0/1804187032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ed5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.312+0000 7fb877e00640 1 -- 172.21.15.103:0/1804187032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecb1d0 msgr2=0x557b61ed7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.312+0000 7fb877e00640 1 --2- 172.21.15.103:0/1804187032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecb1d0 0x557b61ed7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.312+0000 7fb877e00640 1 -- 172.21.15.103:0/1804187032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 msgr2=0x557b61ed5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.312+0000 7fb877e00640 1 --2- 172.21.15.103:0/1804187032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ed5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.312+0000 7fb877e00640 1 -- 172.21.15.103:0/1804187032 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b61b8fb00 con 0x557b61ecbaf0 2024-09-11T01:10:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.312+0000 7fb877e00640 1 --2- 172.21.15.103:0/1804187032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecbaf0 0x557b61ed4980 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb864012d20 tx=0x7fb86400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2c74abd28de1ccc server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.312+0000 7fb85ea00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:10:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.313+0000 7fb85ea00640 1 -- 172.21.15.103:0/1804187032 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb864010430 con 0x557b61ecbaf0 2024-09-11T01:10:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.313+0000 7fb882122740 1 -- 172.21.15.103:0/1804187032 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb870004050 con 0x557b61ecbaf0 2024-09-11T01:10:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.313+0000 7fb85ea00640 1 -- 172.21.15.103:0/1804187032 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fb8640105d0 con 0x557b61ecbaf0 2024-09-11T01:10:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.313+0000 7fb85ea00640 1 -- 172.21.15.103:0/1804187032 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb8640107d0 con 0x557b61ecbaf0 2024-09-11T01:10:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.313+0000 7fb882122740 10 client.25597 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.313+0000 7fb882122740 1 -- 172.21.15.103:0/1804187032 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557b61c06960 con 0x557b61ecbaf0 2024-09-11T01:10:37.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.313+0000 7fb85ea00640 1 -- 172.21.15.103:0/1804187032 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb870004050 con 0x557b61ecbaf0 2024-09-11T01:10:37.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.314+0000 7fb85ea00640 1 -- 172.21.15.103:0/1804187032 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7fb86401c800 con 0x557b61ecbaf0 2024-09-11T01:10:37.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.314+0000 7fb882122740 10 client.25597 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:37.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.314+0000 7fb882122740 10 client.25597 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:10:37.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.314+0000 7fb882122740 20 client.25597 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:37.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.314+0000 7fb882122740 1 --2- 172.21.15.103:0/1804187032 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x557b61eefe30 0x557b61ef2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.314+0000 7fb882122740 4 client.25597 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:10:37.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.314+0000 7fb882122740 1 -- 172.21.15.103:0/1804187032 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b61e441e0 con 0x557b61eefe30 2024-09-11T01:10:37.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.314+0000 7fb87da00640 1 --2- 172.21.15.103:0/1804187032 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x557b61eefe30 0x557b61ef2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.315+0000 7fb87da00640 1 --2- 172.21.15.103:0/1804187032 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x557b61eefe30 0x557b61ef2220 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f236f32da2565e3d server_cookie=4518f0a4bc5b0a86 in_seq=0 out_seq=0 2024-09-11T01:10:37.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.315+0000 7fb85ea00640 10 client.25597 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:37.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.316+0000 7fb85ea00640 1 -- 172.21.15.103:0/1804187032 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557b61e441e0 con 0x557b61eefe30 2024-09-11T01:10:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.316+0000 7fb85ea00640 10 client.25597 handle_command_reply: tid=0 2024-09-11T01:10:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.316+0000 7fb882122740 1 client.25597 shutdown 2024-09-11T01:10:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.316+0000 7fb882122740 1 -- 172.21.15.103:0/1804187032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecbaf0 msgr2=0x557b61ed4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.316+0000 7fb882122740 1 --2- 172.21.15.103:0/1804187032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecbaf0 0x557b61ed4980 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb864012d20 tx=0x7fb86400f790 comp rx=0 tx=0).stop 2024-09-11T01:10:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.316+0000 7fb882122740 1 -- 172.21.15.103:0/1804187032 shutdown_connections 2024-09-11T01:10:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.316+0000 7fb882122740 1 --2- 172.21.15.103:0/1804187032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ed5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.316+0000 7fb882122740 1 --2- 172.21.15.103:0/1804187032 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x557b61eefe30 0x557b61ef2220 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.316+0000 7fb882122740 1 --2- 172.21.15.103:0/1804187032 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecbaf0 0x557b61ed4980 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.316+0000 7fb882122740 1 --2- 172.21.15.103:0/1804187032 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecb1d0 0x557b61ed7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.316+0000 7fb85ea00640 0 client.25597 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.316+0000 7fb882122740 1 -- 172.21.15.103:0/1804187032 >> 172.21.15.103:0/1804187032 conn(0x557b61ec9000 msgr2=0x557b61eceba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.316+0000 7fb882122740 1 -- 172.21.15.103:0/1804187032 shutdown_connections 2024-09-11T01:10:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.316+0000 7fb882122740 1 -- 172.21.15.103:0/1804187032 wait complete. 2024-09-11T01:10:37.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.317+0000 7fb882122740 20 client.25597 trim_cache size 0 max 16384 2024-09-11T01:10:37.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.334+0000 7fb882122740 1 Processor -- start 2024-09-11T01:10:37.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.334+0000 7fb882122740 1 -- start start 2024-09-11T01:10:37.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb882122740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecb1d0 0x557b61ed24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb882122740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecbaf0 0x557b61ec3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb882122740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ef7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb882122740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb8781b0070 con 0x557b61ed7a80 2024-09-11T01:10:37.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb882122740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb8781ad910 con 0x557b61ecbaf0 2024-09-11T01:10:37.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb882122740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb8781ab7a0 con 0x557b61ecb1d0 2024-09-11T01:10:37.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb877e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecbaf0 0x557b61ec3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb877e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecbaf0 0x557b61ec3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:37376/0 (socket says 172.21.15.103:37376) 2024-09-11T01:10:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb87da00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecb1d0 0x557b61ed24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb877e00640 1 -- 172.21.15.103:0/2272912816 learned_addr learned my addr 172.21.15.103:0/2272912816 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb87da00640 1 --2- 172.21.15.103:0/2272912816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ef7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb877e00640 1 -- 172.21.15.103:0/2272912816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecb1d0 msgr2=0x557b61ed24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb877e00640 1 --2- 172.21.15.103:0/2272912816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecb1d0 0x557b61ed24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb877e00640 1 -- 172.21.15.103:0/2272912816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 msgr2=0x557b61ef7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb877e00640 1 --2- 172.21.15.103:0/2272912816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ef7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.335+0000 7fb877e00640 1 -- 172.21.15.103:0/2272912816 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b61ecb920 con 0x557b61ecbaf0 2024-09-11T01:10:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.336+0000 7fb877e00640 1 --2- 172.21.15.103:0/2272912816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecbaf0 0x557b61ec3d30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb864000c00 tx=0x7fb86400fee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5422e580ad88758b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.336+0000 7fb869600640 1 -- 172.21.15.103:0/2272912816 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb864010430 con 0x557b61ecbaf0 2024-09-11T01:10:37.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.336+0000 7fb869600640 1 -- 172.21.15.103:0/2272912816 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb864010e20 con 0x557b61ecbaf0 2024-09-11T01:10:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.336+0000 7fb869600640 1 -- 172.21.15.103:0/2272912816 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8640054e0 con 0x557b61ecbaf0 2024-09-11T01:10:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.336+0000 7fb882122740 1 -- 172.21.15.103:0/2272912816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecbaf0 msgr2=0x557b61ec3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.336+0000 7fb882122740 1 --2- 172.21.15.103:0/2272912816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecbaf0 0x557b61ec3d30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb864000c00 tx=0x7fb86400fee0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.337+0000 7fb882122740 1 -- 172.21.15.103:0/2272912816 shutdown_connections 2024-09-11T01:10:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.337+0000 7fb882122740 1 --2- 172.21.15.103:0/2272912816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ef7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.337+0000 7fb882122740 1 --2- 172.21.15.103:0/2272912816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecbaf0 0x557b61ec3d30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.337+0000 7fb882122740 1 --2- 172.21.15.103:0/2272912816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecb1d0 0x557b61ed24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.337+0000 7fb882122740 1 -- 172.21.15.103:0/2272912816 >> 172.21.15.103:0/2272912816 conn(0x557b61ec9000 msgr2=0x557b61ed1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.337+0000 7fb882122740 1 -- 172.21.15.103:0/2272912816 shutdown_connections 2024-09-11T01:10:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.337+0000 7fb882122740 1 -- 172.21.15.103:0/2272912816 wait complete. 2024-09-11T01:10:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.337+0000 7fb882122740 1 -- start start 2024-09-11T01:10:37.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.337+0000 7fb882122740 1 Processor -- start 2024-09-11T01:10:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.338+0000 7fb882122740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecb1d0 0x557b61ee82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.338+0000 7fb882122740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecbaf0 0x557b61ee8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.338+0000 7fb882122740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ee3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.338+0000 7fb882122740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb8781abdf0 con 0x557b61ed7a80 2024-09-11T01:10:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.338+0000 7fb882122740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb8781ad240 con 0x557b61ecbaf0 2024-09-11T01:10:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.338+0000 7fb882122740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb8781ac4a0 con 0x557b61ecb1d0 2024-09-11T01:10:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.338+0000 7fb882122740 10 client.0 _ll_register_callbacks cb 0x7fb864009de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.338+0000 7fb87da00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecb1d0 0x557b61ee82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.338+0000 7fb877e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecbaf0 0x557b61ee8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.338+0000 7fb877e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecbaf0 0x557b61ee8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:37388/0 (socket says 172.21.15.103:37388) 2024-09-11T01:10:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.338+0000 7fb877e00640 1 -- 172.21.15.103:0/1862996901 learned_addr learned my addr 172.21.15.103:0/1862996901 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.338+0000 7fb87da00640 1 --2- 172.21.15.103:0/1862996901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ee3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.339+0000 7fb877e00640 1 -- 172.21.15.103:0/1862996901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecb1d0 msgr2=0x557b61ee82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.339+0000 7fb877e00640 1 --2- 172.21.15.103:0/1862996901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecb1d0 0x557b61ee82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.339+0000 7fb877e00640 1 -- 172.21.15.103:0/1862996901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 msgr2=0x557b61ee3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.339+0000 7fb877e00640 1 --2- 172.21.15.103:0/1862996901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ee3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.339+0000 7fb877e00640 1 -- 172.21.15.103:0/1862996901 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b61ee3860 con 0x557b61ecbaf0 2024-09-11T01:10:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.339+0000 7fb87da00640 1 --2- 172.21.15.103:0/1862996901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecb1d0 0x557b61ee82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:10:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.339+0000 7fb877e00640 1 --2- 172.21.15.103:0/1862996901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecbaf0 0x557b61ee8840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb86401ce80 tx=0x7fb86400ffd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec2f92931dc55be5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.339+0000 7fb85ea00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:10:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.339+0000 7fb85ea00640 1 -- 172.21.15.103:0/1862996901 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86401c630 con 0x557b61ecbaf0 2024-09-11T01:10:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.339+0000 7fb85ea00640 1 -- 172.21.15.103:0/1862996901 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fb86401c7d0 con 0x557b61ecbaf0 2024-09-11T01:10:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.339+0000 7fb882122740 1 -- 172.21.15.103:0/1862996901 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb864010e20 con 0x557b61ecbaf0 2024-09-11T01:10:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.339+0000 7fb85ea00640 1 -- 172.21.15.103:0/1862996901 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb86401c9d0 con 0x557b61ecbaf0 2024-09-11T01:10:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.339+0000 7fb882122740 10 client.25640 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.340+0000 7fb882122740 1 -- 172.21.15.103:0/1862996901 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557b61f5d610 con 0x557b61ecbaf0 2024-09-11T01:10:37.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.340+0000 7fb85ea00640 1 -- 172.21.15.103:0/1862996901 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb864010e20 con 0x557b61ecbaf0 2024-09-11T01:10:37.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.340+0000 7fb85ea00640 1 -- 172.21.15.103:0/1862996901 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7fb864003680 con 0x557b61ecbaf0 2024-09-11T01:10:37.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.340+0000 7fb882122740 10 client.25640 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:37.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.340+0000 7fb882122740 10 client.25640 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:10:37.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.340+0000 7fb882122740 20 client.25640 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:37.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.340+0000 7fb882122740 1 --2- 172.21.15.103:0/1862996901 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x557b61f5dcc0 0x557b61f600e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:37.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.340+0000 7fb882122740 4 client.25640 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "39731ca6", "release": true, "await": true}] 2024-09-11T01:10:37.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.340+0000 7fb882122740 1 -- 172.21.15.103:0/1862996901 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "quiesce db", "set_id": "39731ca6", "release": true, "await": true}) -- 0x557b61e3fc90 con 0x557b61f5dcc0 2024-09-11T01:10:37.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.340+0000 7fb87da00640 1 --2- 172.21.15.103:0/1862996901 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x557b61f5dcc0 0x557b61f600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:37.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.341+0000 7fb87da00640 1 --2- 172.21.15.103:0/1862996901 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x557b61f5dcc0 0x557b61f600e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44730a102768656f server_cookie=7f0f36930354ca11 in_seq=0 out_seq=0 2024-09-11T01:10:37.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.341+0000 7fb85ea00640 10 client.25640 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:37.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.355+0000 7fb85ea00640 1 -- 172.21.15.103:0/1862996901 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x557b61e3fc90 con 0x557b61f5dcc0 2024-09-11T01:10:37.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.355+0000 7fb85ea00640 10 client.25640 handle_command_reply: tid=0 2024-09-11T01:10:37.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.355+0000 7fb882122740 1 client.25640 shutdown 2024-09-11T01:10:37.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.355+0000 7fb882122740 1 -- 172.21.15.103:0/1862996901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecbaf0 msgr2=0x557b61ee8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:37.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.355+0000 7fb882122740 1 --2- 172.21.15.103:0/1862996901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecbaf0 0x557b61ee8840 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb86401ce80 tx=0x7fb86400ffd0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.355+0000 7fb882122740 1 -- 172.21.15.103:0/1862996901 shutdown_connections 2024-09-11T01:10:37.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.355+0000 7fb882122740 1 --2- 172.21.15.103:0/1862996901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b61ed7a80 0x557b61ee3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.355+0000 7fb882122740 1 --2- 172.21.15.103:0/1862996901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x557b61ecbaf0 0x557b61ee8840 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.355+0000 7fb882122740 1 --2- 172.21.15.103:0/1862996901 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x557b61f5dcc0 0x557b61f600e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.355+0000 7fb882122740 1 --2- 172.21.15.103:0/1862996901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x557b61ecb1d0 0x557b61ee82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.355+0000 7fb85ea00640 0 client.25640 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:37.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.355+0000 7fb882122740 1 -- 172.21.15.103:0/1862996901 >> 172.21.15.103:0/1862996901 conn(0x557b61ec9000 msgr2=0x557b61eeb240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:37.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.355+0000 7fb882122740 1 -- 172.21.15.103:0/1862996901 shutdown_connections 2024-09-11T01:10:37.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.356+0000 7fb882122740 1 -- 172.21.15.103:0/1862996901 wait complete. 2024-09-11T01:10:37.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.356+0000 7fb882122740 20 client.25640 trim_cache size 0 max 16384 2024-09-11T01:10:37.359 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:10:37.360 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 28, 2024-09-11T01:10:37.360 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24665, 2024-09-11T01:10:37.360 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 8, 2024-09-11T01:10:37.360 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-09-11T01:10:37.360 INFO:teuthology.orchestra.run.smithi103.stdout: "39731ca6": { 2024-09-11T01:10:37.360 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 8, 2024-09-11T01:10:37.360 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-09-11T01:10:37.360 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:10:37.360 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RELEASED", 2024-09-11T01:10:37.360 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:10:37.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:10:37.360 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-09-11T01:10:37.360 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 140.5, 2024-09-11T01:10:37.361 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-09-11T01:10:37.361 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-09-11T01:10:37.361 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-09-11T01:10:37.361 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:10:37.361 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RELEASED", 2024-09-11T01:10:37.361 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:10:37.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:37.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:37.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:37.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:37.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:37.361 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:10:37.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.356+0000 7fb87e400640 1 -- 172.21.15.103:0/2940840359 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8600b5410 msgr2=0x7fb8600b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:37.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.356+0000 7fb87e400640 1 --2- 172.21.15.103:0/2940840359 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8600b5410 0x7fb8600b78d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0c8ef0 tx=0x7fb86c005b70 comp rx=0 tx=0).stop 2024-09-11T01:10:37.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.356+0000 7fb87e400640 1 -- 172.21.15.103:0/2940840359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8780754c0 msgr2=0x7fb87819b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:37.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.356+0000 7fb87e400640 1 --2- 172.21.15.103:0/2940840359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8780754c0 0x7fb87819b2b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb86c02a910 tx=0x7fb86c031a20 comp rx=0 tx=0).stop 2024-09-11T01:10:37.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.356+0000 7fb87e400640 1 -- 172.21.15.103:0/2940840359 shutdown_connections 2024-09-11T01:10:37.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.357+0000 7fb87e400640 1 --2- 172.21.15.103:0/2940840359 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8600b5410 0x7fb8600b78d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.357+0000 7fb87e400640 1 --2- 172.21.15.103:0/2940840359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb87810f220 0x7fb8781a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.357+0000 7fb87e400640 1 --2- 172.21.15.103:0/2940840359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb878075de0 0x7fb87819b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.357+0000 7fb87e400640 1 --2- 172.21.15.103:0/2940840359 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8780754c0 0x7fb87819b2b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:37.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.357+0000 7fb87e400640 1 -- 172.21.15.103:0/2940840359 >> 172.21.15.103:0/2940840359 conn(0x7fb8780fe660 msgr2=0x7fb8781113f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:37.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.357+0000 7fb87e400640 1 -- 172.21.15.103:0/2940840359 shutdown_connections 2024-09-11T01:10:37.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:37.357+0000 7fb87e400640 1 -- 172.21.15.103:0/2940840359 wait complete. 2024-09-11T01:10:37.940 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:37 smithi103 ceph-mon[30562]: pgmap v468: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 34 MiB/s wr, 19 op/s 2024-09-11T01:10:38.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:37 smithi117 ceph-mon[35358]: pgmap v468: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 34 MiB/s wr, 19 op/s 2024-09-11T01:10:38.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:37 smithi183 ceph-mon[34992]: pgmap v468: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 34 MiB/s wr, 19 op/s 2024-09-11T01:10:38.394 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '39731ca6', total seconds elapsed: 24.7 2024-09-11T01:10:38.394 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.5 2024-09-11T01:10:38.394 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:10:38.771 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:10:39.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.415+0000 7f7252200640 1 -- 172.21.15.103:0/3532836303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f724c108620 msgr2=0x7f724c108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:39.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.415+0000 7f7252200640 1 --2- 172.21.15.103:0/3532836303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f724c108620 0x7f724c108a60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7238009860 tx=0x7f723802a340 comp rx=0 tx=0).stop 2024-09-11T01:10:39.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.415+0000 7f7252200640 1 -- 172.21.15.103:0/3532836303 shutdown_connections 2024-09-11T01:10:39.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.415+0000 7f7252200640 1 --2- 172.21.15.103:0/3532836303 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724c108fa0 0x7f724c10f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:39.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.415+0000 7f7252200640 1 --2- 172.21.15.103:0/3532836303 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f724c108620 0x7f724c108a60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:39.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.415+0000 7f7252200640 1 --2- 172.21.15.103:0/3532836303 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f724c102c10 0x7f724c102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:39.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.415+0000 7f7252200640 1 -- 172.21.15.103:0/3532836303 >> 172.21.15.103:0/3532836303 conn(0x7f724c0fe660 msgr2=0x7f724c100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:39.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.415+0000 7f7252200640 1 -- 172.21.15.103:0/3532836303 shutdown_connections 2024-09-11T01:10:39.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.416+0000 7f7252200640 1 -- 172.21.15.103:0/3532836303 wait complete. 2024-09-11T01:10:39.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.417+0000 7f7252200640 1 Processor -- start 2024-09-11T01:10:39.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.417+0000 7f7252200640 1 -- start start 2024-09-11T01:10:39.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.418+0000 7f7252200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724c102c10 0x7f724c199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.418+0000 7f7252200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f724c108620 0x7f724c199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.418+0000 7f7252200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f724c108fa0 0x7f724c19e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.418+0000 7f7252200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f724c112c60 con 0x7f724c102c10 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.418+0000 7f7252200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f724c112ae0 con 0x7f724c108fa0 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.418+0000 7f7252200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f724c112de0 con 0x7f724c108620 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.418+0000 7f7250e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724c102c10 0x7f724c199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.418+0000 7f724be00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f724c108620 0x7f724c199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.418+0000 7f7250e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724c102c10 0x7f724c199030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51354/0 (socket says 172.21.15.103:51354) 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.418+0000 7f7250e00640 1 -- 172.21.15.103:0/4130386656 learned_addr learned my addr 172.21.15.103:0/4130386656 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.418+0000 7f7251800640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f724c108fa0 0x7f724c19e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.418+0000 7f724be00640 1 -- 172.21.15.103:0/4130386656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f724c108fa0 msgr2=0x7f724c19e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.418+0000 7f724be00640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f724c108fa0 0x7f724c19e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.419+0000 7f724be00640 1 -- 172.21.15.103:0/4130386656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724c102c10 msgr2=0x7f724c199030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.419+0000 7f724be00640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724c102c10 0x7f724c199030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:39.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.419+0000 7f724be00640 1 -- 172.21.15.103:0/4130386656 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f724c19f0e0 con 0x7f724c108620 2024-09-11T01:10:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.419+0000 7f7251800640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f724c108fa0 0x7f724c19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:10:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.419+0000 7f7250e00640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724c102c10 0x7f724c199030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:10:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.419+0000 7f724be00640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f724c108620 0x7f724c199570 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7238035040 tx=0x7f7238032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.419+0000 7f7249600640 1 -- 172.21.15.103:0/4130386656 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238040020 con 0x7f724c108620 2024-09-11T01:10:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.419+0000 7f7252200640 1 -- 172.21.15.103:0/4130386656 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f724c19f370 con 0x7f724c108620 2024-09-11T01:10:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.419+0000 7f7249600640 1 -- 172.21.15.103:0/4130386656 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7238030e10 con 0x7f724c108620 2024-09-11T01:10:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.419+0000 7f7249600640 1 -- 172.21.15.103:0/4130386656 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238037040 con 0x7f724c108620 2024-09-11T01:10:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.419+0000 7f7252200640 1 -- 172.21.15.103:0/4130386656 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f724c1a5a90 con 0x7f724c108620 2024-09-11T01:10:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.421+0000 7f7252200640 1 -- 172.21.15.103:0/4130386656 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f724c102ff0 con 0x7f724c108620 2024-09-11T01:10:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.425+0000 7f7249600640 1 -- 172.21.15.103:0/4130386656 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f7238030450 con 0x7f724c108620 2024-09-11T01:10:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.426+0000 7f7249600640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f72340b5390 0x7f72340b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.426+0000 7f7249600640 1 -- 172.21.15.103:0/4130386656 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f7238106590 con 0x7f724c108620 2024-09-11T01:10:39.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.426+0000 7f7250e00640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f72340b5390 0x7f72340b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:39.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.427+0000 7f7249600640 1 -- 172.21.15.103:0/4130386656 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f723804a020 con 0x7f724c108620 2024-09-11T01:10:39.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.427+0000 7f7250e00640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f72340b5390 0x7f72340b7850 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7240011550 tx=0x7f7240005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:39.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.655+0000 7f7252200640 1 -- 172.21.15.103:0/4130386656 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f724c1a5d30 con 0x7f724c108620 2024-09-11T01:10:39.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.656+0000 7f7249600640 1 -- 172.21.15.103:0/4130386656 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11934 (secure 0 0 0) 0x7f72380cd0c0 con 0x7f724c108620 2024-09-11T01:10:39.659 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:10:39.659 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2024-09-11T01:10:39.659 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"btime":"2024-09-11T01:09:42:655122+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:09:42.508953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24629,24619]},"id":1}]} 2024-09-11T01:10:39.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.658+0000 7f7252200640 1 -- 172.21.15.103:0/4130386656 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f72340b5390 msgr2=0x7f72340b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:39.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.658+0000 7f7252200640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f72340b5390 0x7f72340b7850 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7240011550 tx=0x7f7240005f90 comp rx=0 tx=0).stop 2024-09-11T01:10:39.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.659+0000 7f7252200640 1 -- 172.21.15.103:0/4130386656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f724c108620 msgr2=0x7f724c199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:39.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.659+0000 7f7252200640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f724c108620 0x7f724c199570 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7238035040 tx=0x7f7238032d50 comp rx=0 tx=0).stop 2024-09-11T01:10:39.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.659+0000 7f7252200640 1 -- 172.21.15.103:0/4130386656 shutdown_connections 2024-09-11T01:10:39.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.659+0000 7f7252200640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f72340b5390 0x7f72340b7850 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:39.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.659+0000 7f7252200640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f724c108fa0 0x7f724c19e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:39.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.659+0000 7f7252200640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f724c108620 0x7f724c199570 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:39.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.659+0000 7f7252200640 1 --2- 172.21.15.103:0/4130386656 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f724c102c10 0x7f724c199030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:39.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.659+0000 7f7252200640 1 -- 172.21.15.103:0/4130386656 >> 172.21.15.103:0/4130386656 conn(0x7f724c0fe660 msgr2=0x7f724c101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:39.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.659+0000 7f7252200640 1 -- 172.21.15.103:0/4130386656 shutdown_connections 2024-09-11T01:10:39.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:39.659+0000 7f7252200640 1 -- 172.21.15.103:0/4130386656 wait complete. 2024-09-11T01:10:40.570 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24665 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0' 2024-09-11T01:10:40.571 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24665 quiesce db / --timeout 90 --expiration 140.5 --await-for 45.0 2024-09-11T01:10:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:40 smithi103 ceph-mon[30562]: pgmap v469: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-09-11T01:10:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:40 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/4130386656' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:10:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:40 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:10:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:40 smithi183 ceph-mon[34992]: pgmap v469: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-09-11T01:10:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:40 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/4130386656' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:10:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:40 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:10:40.971 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:10:41.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:40 smithi117 ceph-mon[35358]: pgmap v469: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 31 MiB/s wr, 23 op/s 2024-09-11T01:10:41.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:40 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/4130386656' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:10:41.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:40 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:10:41.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.626+0000 7f11ff000640 1 -- 172.21.15.103:0/1436326134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8108610 msgr2=0x7f11f8108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:41.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.626+0000 7f11ff000640 1 --2- 172.21.15.103:0/1436326134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8108610 0x7f11f8108a50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009900 tx=0x7f11e402a3f0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.626+0000 7f11ff000640 1 -- 172.21.15.103:0/1436326134 shutdown_connections 2024-09-11T01:10:41.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.626+0000 7f11ff000640 1 --2- 172.21.15.103:0/1436326134 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f8108f90 0x7f11f810f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.626+0000 7f11ff000640 1 --2- 172.21.15.103:0/1436326134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8108610 0x7f11f8108a50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.626+0000 7f11ff000640 1 --2- 172.21.15.103:0/1436326134 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f8102c00 0x7f11f8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.626+0000 7f11ff000640 1 -- 172.21.15.103:0/1436326134 >> 172.21.15.103:0/1436326134 conn(0x7f11f80fe6d0 msgr2=0x7f11f8100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:41.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.626+0000 7f11ff000640 1 -- 172.21.15.103:0/1436326134 shutdown_connections 2024-09-11T01:10:41.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.626+0000 7f11ff000640 1 -- 172.21.15.103:0/1436326134 wait complete. 2024-09-11T01:10:41.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.627+0000 7f11ff000640 1 Processor -- start 2024-09-11T01:10:41.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.627+0000 7f11ff000640 1 -- start start 2024-09-11T01:10:41.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11ff000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f8102c00 0x7f11f80754a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11ff000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8108610 0x7f11f80759e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11ff000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f8108f90 0x7f11f8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11ff000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8112c50 con 0x7f11f8108f90 2024-09-11T01:10:41.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11ff000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8112ad0 con 0x7f11f8108610 2024-09-11T01:10:41.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11ff000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f11f8112dd0 con 0x7f11f8102c00 2024-09-11T01:10:41.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11fdc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f8102c00 0x7f11f80754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11fdc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f8102c00 0x7f11f80754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:43020/0 (socket says 172.21.15.103:43020) 2024-09-11T01:10:41.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11fdc00640 1 -- 172.21.15.103:0/2080867030 learned_addr learned my addr 172.21.15.103:0/2080867030 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:41.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11fd200640 1 --2- 172.21.15.103:0/2080867030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8108610 0x7f11f80759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11fe600640 1 --2- 172.21.15.103:0/2080867030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f8108f90 0x7f11f8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11fdc00640 1 -- 172.21.15.103:0/2080867030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8108610 msgr2=0x7f11f80759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:41.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11fdc00640 1 --2- 172.21.15.103:0/2080867030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8108610 0x7f11f80759e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11fdc00640 1 -- 172.21.15.103:0/2080867030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f8108f90 msgr2=0x7f11f8075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:41.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11fdc00640 1 --2- 172.21.15.103:0/2080867030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f8108f90 0x7f11f8075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.628+0000 7f11fdc00640 1 -- 172.21.15.103:0/2080867030 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f81a74a0 con 0x7f11f8102c00 2024-09-11T01:10:41.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.629+0000 7f11fdc00640 1 --2- 172.21.15.103:0/2080867030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f8102c00 0x7f11f80754a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00e9f0 tx=0x7f11ec00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:41.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.629+0000 7f11f6000640 1 -- 172.21.15.103:0/2080867030 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec00cd80 con 0x7f11f8102c00 2024-09-11T01:10:41.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.629+0000 7f11ff000640 1 -- 172.21.15.103:0/2080867030 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f81a7790 con 0x7f11f8102c00 2024-09-11T01:10:41.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.629+0000 7f11f6000640 1 -- 172.21.15.103:0/2080867030 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11ec0054d0 con 0x7f11f8102c00 2024-09-11T01:10:41.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.629+0000 7f11f6000640 1 -- 172.21.15.103:0/2080867030 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec010690 con 0x7f11f8102c00 2024-09-11T01:10:41.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.629+0000 7f11ff000640 1 -- 172.21.15.103:0/2080867030 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f81a7ca0 con 0x7f11f8102c00 2024-09-11T01:10:41.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.632+0000 7f120308b740 1 Processor -- start 2024-09-11T01:10:41.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.633+0000 7f120308b740 1 -- start start 2024-09-11T01:10:41.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.633+0000 7f120308b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef122f0 0x55709ef126d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.633+0000 7f120308b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 0x55709ef1e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.633+0000 7f120308b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef1eba0 0x55709ef20f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.633+0000 7f120308b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55709ee87ca0 con 0x55709ef12c10 2024-09-11T01:10:41.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.633+0000 7f120308b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55709ee770d0 con 0x55709ef122f0 2024-09-11T01:10:41.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.633+0000 7f120308b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55709ee7aee0 con 0x55709ef1eba0 2024-09-11T01:10:41.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.633+0000 7f11fe600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef122f0 0x55709ef126d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.633+0000 7f11fe600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef122f0 0x55709ef126d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:41590/0 (socket says 172.21.15.103:41590) 2024-09-11T01:10:41.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.633+0000 7f11fe600640 1 -- 172.21.15.103:0/2519370920 learned_addr learned my addr 172.21.15.103:0/2519370920 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:41.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.633+0000 7f11fd200640 1 --2- 172.21.15.103:0/2519370920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef1eba0 0x55709ef20f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.634+0000 7f11fe600640 1 -- 172.21.15.103:0/2519370920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef1eba0 msgr2=0x55709ef20f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:41.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.634+0000 7f11fe600640 1 --2- 172.21.15.103:0/2519370920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef1eba0 0x55709ef20f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.634+0000 7f11fe600640 1 -- 172.21.15.103:0/2519370920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 msgr2=0x55709ef1e660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:10:41.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.634+0000 7f11fe600640 1 --2- 172.21.15.103:0/2519370920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 0x55709ef1e660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.634+0000 7f11fe600640 1 -- 172.21.15.103:0/2519370920 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709ee29400 con 0x55709ef122f0 2024-09-11T01:10:41.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.634+0000 7f11fe600640 1 --2- 172.21.15.103:0/2519370920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef122f0 0x55709ef126d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f11f0009f00 tx=0x7f11f00107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=561a0600349c2ec server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:41.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.634+0000 7f11eaa00640 1 -- 172.21.15.103:0/2519370920 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f0003b70 con 0x55709ef122f0 2024-09-11T01:10:41.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.634+0000 7f11eaa00640 1 -- 172.21.15.103:0/2519370920 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11f0003d10 con 0x55709ef122f0 2024-09-11T01:10:41.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.634+0000 7f11eaa00640 1 -- 172.21.15.103:0/2519370920 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f00118f0 con 0x55709ef122f0 2024-09-11T01:10:41.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.635+0000 7f11f6000640 1 -- 172.21.15.103:0/2080867030 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f11ec004e90 con 0x7f11f8102c00 2024-09-11T01:10:41.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.635+0000 7f120308b740 1 -- 172.21.15.103:0/2519370920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef122f0 msgr2=0x55709ef126d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:41.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.635+0000 7f120308b740 1 --2- 172.21.15.103:0/2519370920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef122f0 0x55709ef126d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f11f0009f00 tx=0x7f11f00107a0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.635+0000 7f120308b740 1 -- 172.21.15.103:0/2519370920 shutdown_connections 2024-09-11T01:10:41.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.635+0000 7f120308b740 1 --2- 172.21.15.103:0/2519370920 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef1eba0 0x55709ef20f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.635+0000 7f120308b740 1 --2- 172.21.15.103:0/2519370920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 0x55709ef1e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.635+0000 7f120308b740 1 --2- 172.21.15.103:0/2519370920 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef122f0 0x55709ef126d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.635+0000 7f120308b740 1 -- 172.21.15.103:0/2519370920 >> 172.21.15.103:0/2519370920 conn(0x55709ef10120 msgr2=0x55709ef112c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:41.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.635+0000 7f120308b740 1 -- 172.21.15.103:0/2519370920 shutdown_connections 2024-09-11T01:10:41.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.635+0000 7f120308b740 1 -- 172.21.15.103:0/2519370920 wait complete. 2024-09-11T01:10:41.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.636+0000 7f120308b740 1 -- start start 2024-09-11T01:10:41.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.636+0000 7f120308b740 1 Processor -- start 2024-09-11T01:10:41.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.636+0000 7f11f6000640 1 --2- 172.21.15.103:0/2080867030 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f11e00b52a0 0x7f11e00b7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.637+0000 7f120308b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef122f0 0x55709ef1e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.637+0000 7f120308b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 0x55709ef1b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.637+0000 7f120308b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef1eba0 0x55709ef1bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.637+0000 7f120308b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55709ecd87a0 con 0x55709ef12c10 2024-09-11T01:10:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.637+0000 7f120308b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55709ee1ca10 con 0x55709ef1eba0 2024-09-11T01:10:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.637+0000 7f120308b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55709ef21820 con 0x55709ef122f0 2024-09-11T01:10:41.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.637+0000 7f11f6000640 1 -- 172.21.15.103:0/2080867030 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f11ec0e6440 con 0x7f11f8102c00 2024-09-11T01:10:41.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.637+0000 7f120308b740 10 client.0 _ll_register_callbacks cb 0x55709ee2cbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:41.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.637+0000 7f11fe600640 1 --2- 172.21.15.103:0/2080867030 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f11e00b52a0 0x7f11e00b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.637+0000 7f11fd200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 0x55709ef1b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.637+0000 7f11fdc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef122f0 0x55709ef1e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.637+0000 7f11fd200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 0x55709ef1b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54984/0 (socket says 172.21.15.103:54984) 2024-09-11T01:10:41.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.637+0000 7f11fd200640 1 -- 172.21.15.103:0/909972014 learned_addr learned my addr 172.21.15.103:0/909972014 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:41.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f11fdc00640 1 -- 172.21.15.103:0/909972014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef1eba0 msgr2=0x55709ef1bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:41.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f11fdc00640 1 --2- 172.21.15.103:0/909972014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef1eba0 0x55709ef1bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f11fdc00640 1 -- 172.21.15.103:0/909972014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 msgr2=0x55709ef1b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:41.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f11fdc00640 1 --2- 172.21.15.103:0/909972014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 0x55709ef1b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f11fdc00640 1 -- 172.21.15.103:0/909972014 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55709ebe4b90 con 0x55709ef122f0 2024-09-11T01:10:41.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f11fd200640 1 --2- 172.21.15.103:0/909972014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 0x55709ef1b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:10:41.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f11fdc00640 1 --2- 172.21.15.103:0/909972014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef122f0 0x55709ef1e500 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55709ef11000 tx=0x7f11ec0a86f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2eb36ae44f9086c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:41.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f11df400640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:10:41.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f11fe600640 1 --2- 172.21.15.103:0/2080867030 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f11e00b52a0 0x7f11e00b7760 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f11f0006010 tx=0x7f11f00047c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:41.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f11df400640 1 -- 172.21.15.103:0/909972014 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0abfc0 con 0x55709ef122f0 2024-09-11T01:10:41.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f11df400640 1 -- 172.21.15.103:0/909972014 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f11ec0a8ac0 con 0x55709ef122f0 2024-09-11T01:10:41.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f120308b740 1 -- 172.21.15.103:0/909972014 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11f0003d10 con 0x55709ef122f0 2024-09-11T01:10:41.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f11df400640 1 -- 172.21.15.103:0/909972014 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f11ec0ac360 con 0x55709ef122f0 2024-09-11T01:10:41.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f120308b740 10 client.25621 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:41.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.638+0000 7f120308b740 1 -- 172.21.15.103:0/909972014 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55709ef35a40 con 0x55709ef122f0 2024-09-11T01:10:41.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.639+0000 7f11df400640 1 -- 172.21.15.103:0/909972014 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11f0003d10 con 0x55709ef122f0 2024-09-11T01:10:41.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.639+0000 7f11df400640 1 -- 172.21.15.103:0/909972014 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f11ec0e60b0 con 0x55709ef122f0 2024-09-11T01:10:41.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.639+0000 7f120308b740 10 client.25621 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:41.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.639+0000 7f120308b740 10 client.25621 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:10:41.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.639+0000 7f120308b740 20 client.25621 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:41.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.639+0000 7f120308b740 1 --2- 172.21.15.103:0/909972014 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55709ef36fa0 0x55709ef393c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.639+0000 7f120308b740 4 client.25621 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:10:41.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.639+0000 7f120308b740 1 -- 172.21.15.103:0/909972014 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55709ee89bf0 con 0x55709ef36fa0 2024-09-11T01:10:41.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.639+0000 7f11fd200640 1 --2- 172.21.15.103:0/909972014 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55709ef36fa0 0x55709ef393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.640+0000 7f11fd200640 1 --2- 172.21.15.103:0/909972014 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55709ef36fa0 0x55709ef393c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c13365b025e7cb8a server_cookie=6171f2fafa4859c1 in_seq=0 out_seq=0 2024-09-11T01:10:41.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.640+0000 7f11df400640 10 client.25621 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:41.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.640+0000 7f11df400640 1 -- 172.21.15.103:0/909972014 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55709ee89bf0 con 0x55709ef36fa0 2024-09-11T01:10:41.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.640+0000 7f11df400640 10 client.25621 handle_command_reply: tid=0 2024-09-11T01:10:41.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.641+0000 7f120308b740 1 client.25621 shutdown 2024-09-11T01:10:41.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.641+0000 7f120308b740 1 -- 172.21.15.103:0/909972014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef122f0 msgr2=0x55709ef1e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:41.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.641+0000 7f120308b740 1 --2- 172.21.15.103:0/909972014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef122f0 0x55709ef1e500 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x55709ef11000 tx=0x7f11ec0a86f0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.641+0000 7f120308b740 1 -- 172.21.15.103:0/909972014 shutdown_connections 2024-09-11T01:10:41.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.641+0000 7f120308b740 1 --2- 172.21.15.103:0/909972014 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef1eba0 0x55709ef1bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.641+0000 7f120308b740 1 --2- 172.21.15.103:0/909972014 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 0x55709ef1b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.641+0000 7f120308b740 1 --2- 172.21.15.103:0/909972014 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55709ef36fa0 0x55709ef393c0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.641+0000 7f120308b740 1 --2- 172.21.15.103:0/909972014 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef122f0 0x55709ef1e500 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.641+0000 7f120308b740 1 -- 172.21.15.103:0/909972014 >> 172.21.15.103:0/909972014 conn(0x55709ef10120 msgr2=0x55709ef15cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:41.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.641+0000 7f11df400640 0 client.25621 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:41.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.641+0000 7f120308b740 1 -- 172.21.15.103:0/909972014 shutdown_connections 2024-09-11T01:10:41.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.641+0000 7f120308b740 1 -- 172.21.15.103:0/909972014 wait complete. 2024-09-11T01:10:41.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.641+0000 7f120308b740 20 client.25621 trim_cache size 0 max 16384 2024-09-11T01:10:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.660+0000 7f120308b740 1 Processor -- start 2024-09-11T01:10:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.660+0000 7f120308b740 1 -- start start 2024-09-11T01:10:41.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f120308b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef122f0 0x55709ef332e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f120308b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef12c10 0x55709ef1ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f120308b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef1eba0 0x55709ef204d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f120308b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f11f81aff30 con 0x55709ef1eba0 2024-09-11T01:10:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f120308b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f11f81ad7d0 con 0x55709ef12c10 2024-09-11T01:10:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f120308b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f11f81ab660 con 0x55709ef122f0 2024-09-11T01:10:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f11fdc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef122f0 0x55709ef332e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f11fd200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef12c10 0x55709ef1ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f11fe600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef1eba0 0x55709ef204d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f11fdc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef122f0 0x55709ef332e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:43056/0 (socket says 172.21.15.103:43056) 2024-09-11T01:10:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f11fd200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef12c10 0x55709ef1ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:41610/0 (socket says 172.21.15.103:41610) 2024-09-11T01:10:41.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f11fdc00640 1 -- 172.21.15.103:0/2777343514 learned_addr learned my addr 172.21.15.103:0/2777343514 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:41.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f11fdc00640 1 -- 172.21.15.103:0/2777343514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef12c10 msgr2=0x55709ef1ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f11fdc00640 1 --2- 172.21.15.103:0/2777343514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef12c10 0x55709ef1ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f11fdc00640 1 -- 172.21.15.103:0/2777343514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef1eba0 msgr2=0x55709ef204d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f11fdc00640 1 --2- 172.21.15.103:0/2777343514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef1eba0 0x55709ef204d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.661+0000 7f11fdc00640 1 -- 172.21.15.103:0/2777343514 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55709ef1c340 con 0x55709ef122f0 2024-09-11T01:10:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.662+0000 7f11fdc00640 1 --2- 172.21.15.103:0/2777343514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef122f0 0x55709ef332e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009380 tx=0x7f11ec0b5d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcc5bda44136cde0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.662+0000 7f11ea000640 1 -- 172.21.15.103:0/2777343514 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0abfc0 con 0x55709ef122f0 2024-09-11T01:10:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.662+0000 7f11ea000640 1 -- 172.21.15.103:0/2777343514 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11ec005680 con 0x55709ef122f0 2024-09-11T01:10:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.662+0000 7f11ea000640 1 -- 172.21.15.103:0/2777343514 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0e6230 con 0x55709ef122f0 2024-09-11T01:10:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.663+0000 7f120308b740 1 -- 172.21.15.103:0/2777343514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef122f0 msgr2=0x55709ef332e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.663+0000 7f120308b740 1 --2- 172.21.15.103:0/2777343514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef122f0 0x55709ef332e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f11ec009380 tx=0x7f11ec0b5d10 comp rx=0 tx=0).stop 2024-09-11T01:10:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.663+0000 7f120308b740 1 -- 172.21.15.103:0/2777343514 shutdown_connections 2024-09-11T01:10:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.663+0000 7f120308b740 1 --2- 172.21.15.103:0/2777343514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef1eba0 0x55709ef204d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.663+0000 7f120308b740 1 --2- 172.21.15.103:0/2777343514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef12c10 0x55709ef1ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.663+0000 7f120308b740 1 --2- 172.21.15.103:0/2777343514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef122f0 0x55709ef332e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.663+0000 7f120308b740 1 -- 172.21.15.103:0/2777343514 >> 172.21.15.103:0/2777343514 conn(0x55709ef10120 msgr2=0x55709ef1d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:41.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.663+0000 7f120308b740 1 -- 172.21.15.103:0/2777343514 shutdown_connections 2024-09-11T01:10:41.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.663+0000 7f120308b740 1 -- 172.21.15.103:0/2777343514 wait complete. 2024-09-11T01:10:41.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.663+0000 7f120308b740 1 -- start start 2024-09-11T01:10:41.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.664+0000 7f120308b740 1 Processor -- start 2024-09-11T01:10:41.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.664+0000 7f120308b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef122f0 0x55709ef2fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.664+0000 7f120308b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 0x55709ef2a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.664+0000 7f120308b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef1eba0 0x55709ef2a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.664+0000 7f120308b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f11f81abcb0 con 0x55709ef12c10 2024-09-11T01:10:41.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.664+0000 7f120308b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f11f81ad100 con 0x55709ef122f0 2024-09-11T01:10:41.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.664+0000 7f120308b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f11f81ac360 con 0x55709ef1eba0 2024-09-11T01:10:41.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.664+0000 7f120308b740 10 client.0 _ll_register_callbacks cb 0x7f11ec0a6f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:41.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.664+0000 7f11fdc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef122f0 0x55709ef2fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.664+0000 7f11fd200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 0x55709ef2a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.664+0000 7f11fe600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef1eba0 0x55709ef2a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.664+0000 7f11fdc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef122f0 0x55709ef2fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:41612/0 (socket says 172.21.15.103:41612) 2024-09-11T01:10:41.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.664+0000 7f11fdc00640 1 -- 172.21.15.103:0/972849867 learned_addr learned my addr 172.21.15.103:0/972849867 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:41.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.664+0000 7f11fe600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef1eba0 0x55709ef2a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:43068/0 (socket says 172.21.15.103:43068) 2024-09-11T01:10:41.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.665+0000 7f11fdc00640 1 -- 172.21.15.103:0/972849867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef1eba0 msgr2=0x55709ef2a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:41.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.665+0000 7f11fdc00640 1 --2- 172.21.15.103:0/972849867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef1eba0 0x55709ef2a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.665+0000 7f11fdc00640 1 -- 172.21.15.103:0/972849867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 msgr2=0x55709ef2a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:41.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.665+0000 7f11fdc00640 1 --2- 172.21.15.103:0/972849867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 0x55709ef2a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:41.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.665+0000 7f11fdc00640 1 -- 172.21.15.103:0/972849867 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55709ef2b0f0 con 0x55709ef122f0 2024-09-11T01:10:41.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.665+0000 7f11fe600640 1 --2- 172.21.15.103:0/972849867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef1eba0 0x55709ef2a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:10:41.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.665+0000 7f11fdc00640 1 --2- 172.21.15.103:0/972849867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef122f0 0x55709ef2fb50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0b5ea0 tx=0x7f11ec009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7460606af56d0be server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:41.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.665+0000 7f11df400640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:10:41.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.665+0000 7f11df400640 1 -- 172.21.15.103:0/972849867 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ec0abfc0 con 0x55709ef122f0 2024-09-11T01:10:41.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.665+0000 7f120308b740 1 -- 172.21.15.103:0/972849867 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11ec005680 con 0x55709ef122f0 2024-09-11T01:10:41.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.665+0000 7f11df400640 1 -- 172.21.15.103:0/972849867 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f11ec0cfba0 con 0x55709ef122f0 2024-09-11T01:10:41.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.666+0000 7f11df400640 1 -- 172.21.15.103:0/972849867 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f11ec0b5b60 con 0x55709ef122f0 2024-09-11T01:10:41.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.666+0000 7f120308b740 10 client.25661 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:41.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.666+0000 7f120308b740 1 -- 172.21.15.103:0/972849867 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55709efa4f10 con 0x55709ef122f0 2024-09-11T01:10:41.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.666+0000 7f11df400640 1 -- 172.21.15.103:0/972849867 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f11ec005680 con 0x55709ef122f0 2024-09-11T01:10:41.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.666+0000 7f11df400640 1 -- 172.21.15.103:0/972849867 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f11ec0a81a0 con 0x55709ef122f0 2024-09-11T01:10:41.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.666+0000 7f120308b740 10 client.25661 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:41.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.666+0000 7f120308b740 10 client.25661 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:10:41.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.666+0000 7f120308b740 20 client.25661 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:41.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.666+0000 7f120308b740 1 --2- 172.21.15.103:0/972849867 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55709efa5540 0x55709efa7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:41.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.666+0000 7f120308b740 4 client.25661 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}] 2024-09-11T01:10:41.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.666+0000 7f120308b740 1 -- 172.21.15.103:0/972849867 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.5, "await_for": 45.0}) -- 0x55709ee856a0 con 0x55709efa5540 2024-09-11T01:10:41.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.666+0000 7f11fd200640 1 --2- 172.21.15.103:0/972849867 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55709efa5540 0x55709efa7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:41.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.667+0000 7f11fd200640 1 --2- 172.21.15.103:0/972849867 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55709efa5540 0x55709efa7960 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e78da38869a3de9c server_cookie=75b1159ca34115b4 in_seq=0 out_seq=0 2024-09-11T01:10:41.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:41.667+0000 7f11df400640 10 client.25661 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:41.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:10:41.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:10:41.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:10:42.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:10:42.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:10:42.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:10:42.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:10:42.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:10:42.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:10:42.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:42 smithi183 ceph-mon[34992]: pgmap v470: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 695 KiB/s wr, 13 op/s 2024-09-11T01:10:43.088 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:42 smithi103 ceph-mon[30562]: pgmap v470: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 695 KiB/s wr, 13 op/s 2024-09-11T01:10:43.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:42 smithi117 ceph-mon[35358]: pgmap v470: 129 pgs: 129 active+clean; 6.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 695 KiB/s wr, 13 op/s 2024-09-11T01:10:43.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.459+0000 7f11df400640 1 -- 172.21.15.103:0/972849867 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55709ee856a0 con 0x55709efa5540 2024-09-11T01:10:43.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.459+0000 7f11df400640 10 client.25661 handle_command_reply: tid=0 2024-09-11T01:10:43.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.459+0000 7f120308b740 1 client.25661 shutdown 2024-09-11T01:10:43.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.459+0000 7f120308b740 1 -- 172.21.15.103:0/972849867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef122f0 msgr2=0x55709ef2fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:43.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.459+0000 7f120308b740 1 --2- 172.21.15.103:0/972849867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef122f0 0x55709ef2fb50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0b5ea0 tx=0x7f11ec009310 comp rx=0 tx=0).stop 2024-09-11T01:10:43.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.460+0000 7f120308b740 1 -- 172.21.15.103:0/972849867 shutdown_connections 2024-09-11T01:10:43.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.460+0000 7f120308b740 1 --2- 172.21.15.103:0/972849867 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55709efa5540 0x55709efa7960 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:43.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.460+0000 7f120308b740 1 --2- 172.21.15.103:0/972849867 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55709ef1eba0 0x55709ef2a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:43.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.460+0000 7f120308b740 1 --2- 172.21.15.103:0/972849867 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55709ef12c10 0x55709ef2a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:43.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.460+0000 7f120308b740 1 --2- 172.21.15.103:0/972849867 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55709ef122f0 0x55709ef2fb50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:43.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.460+0000 7f120308b740 1 -- 172.21.15.103:0/972849867 >> 172.21.15.103:0/972849867 conn(0x55709ef10120 msgr2=0x55709ef1ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:43.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.460+0000 7f11df400640 0 client.25661 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:43.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.460+0000 7f120308b740 1 -- 172.21.15.103:0/972849867 shutdown_connections 2024-09-11T01:10:43.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.460+0000 7f120308b740 1 -- 172.21.15.103:0/972849867 wait complete. 2024-09-11T01:10:43.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.460+0000 7f120308b740 20 client.25661 trim_cache size 0 max 16384 2024-09-11T01:10:43.465 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:10:43.465 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 28, 2024-09-11T01:10:43.466 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24665, 2024-09-11T01:10:43.466 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 10, 2024-09-11T01:10:43.466 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-09-11T01:10:43.466 INFO:teuthology.orchestra.run.smithi103.stdout: "d6e0e76c": { 2024-09-11T01:10:43.466 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 10, 2024-09-11T01:10:43.466 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-09-11T01:10:43.466 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:10:43.466 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCED", 2024-09-11T01:10:43.466 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:10:43.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:10:43.466 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-09-11T01:10:43.467 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 140.5, 2024-09-11T01:10:43.467 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-09-11T01:10:43.467 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-09-11T01:10:43.467 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-09-11T01:10:43.467 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:10:43.467 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCED", 2024-09-11T01:10:43.467 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:10:43.467 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:43.467 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:43.467 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:43.467 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:43.467 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:10:43.467 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:10:43.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.461+0000 7f11ff000640 1 -- 172.21.15.103:0/2080867030 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f11e00b52a0 msgr2=0x7f11e00b7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:43.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.461+0000 7f11ff000640 1 --2- 172.21.15.103:0/2080867030 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f11e00b52a0 0x7f11e00b7760 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f11f0006010 tx=0x7f11f00047c0 comp rx=0 tx=0).stop 2024-09-11T01:10:43.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.461+0000 7f11ff000640 1 -- 172.21.15.103:0/2080867030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f8102c00 msgr2=0x7f11f80754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:43.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.461+0000 7f11ff000640 1 --2- 172.21.15.103:0/2080867030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f8102c00 0x7f11f80754a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f11ec00e9f0 tx=0x7f11ec00edf0 comp rx=0 tx=0).stop 2024-09-11T01:10:43.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.461+0000 7f11ff000640 1 -- 172.21.15.103:0/2080867030 shutdown_connections 2024-09-11T01:10:43.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.461+0000 7f11ff000640 1 --2- 172.21.15.103:0/2080867030 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f11e00b52a0 0x7f11e00b7760 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:43.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.461+0000 7f11ff000640 1 --2- 172.21.15.103:0/2080867030 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f11f8108f90 0x7f11f8075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:43.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.461+0000 7f11ff000640 1 --2- 172.21.15.103:0/2080867030 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11f8108610 0x7f11f80759e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:43.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.461+0000 7f11ff000640 1 --2- 172.21.15.103:0/2080867030 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f11f8102c00 0x7f11f80754a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:43.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.461+0000 7f11ff000640 1 -- 172.21.15.103:0/2080867030 >> 172.21.15.103:0/2080867030 conn(0x7f11f80fe6d0 msgr2=0x7f11f8100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:43.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.461+0000 7f11ff000640 1 -- 172.21.15.103:0/2080867030 shutdown_connections 2024-09-11T01:10:43.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:10:43.461+0000 7f11ff000640 1 -- 172.21.15.103:0/2080867030 wait complete. 2024-09-11T01:10:44.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:43 smithi103 ceph-mon[30562]: pgmap v471: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 33 op/s 2024-09-11T01:10:44.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:43 smithi117 ceph-mon[35358]: pgmap v471: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 33 op/s 2024-09-11T01:10:44.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:43 smithi183 ceph-mon[34992]: pgmap v471: 129 pgs: 129 active+clean; 7.3 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 33 op/s 2024-09-11T01:10:44.312 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd6e0e76c', quiesce took 5.9 seconds. Will release after: 14.6 2024-09-11T01:10:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.955+0000 7f6f21200640 1 -- 172.21.15.103:0/583526720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f1c105ce0 msgr2=0x7f6f1c106160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.955+0000 7f6f21200640 1 --2- 172.21.15.103:0/583526720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f1c105ce0 0x7f6f1c106160 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009930 tx=0x7f6f0802a420 comp rx=0 tx=0).stop 2024-09-11T01:10:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.955+0000 7f6f21200640 1 -- 172.21.15.103:0/583526720 shutdown_connections 2024-09-11T01:10:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.955+0000 7f6f21200640 1 --2- 172.21.15.103:0/583526720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f1c1066a0 0x7f6f1c10d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.955+0000 7f6f21200640 1 --2- 172.21.15.103:0/583526720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f1c105ce0 0x7f6f1c106160 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.955+0000 7f6f21200640 1 --2- 172.21.15.103:0/583526720 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f1c104b90 0x7f6f1c104f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.955+0000 7f6f21200640 1 -- 172.21.15.103:0/583526720 >> 172.21.15.103:0/583526720 conn(0x7f6f1c100470 msgr2=0x7f6f1c102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.955+0000 7f6f21200640 1 -- 172.21.15.103:0/583526720 shutdown_connections 2024-09-11T01:10:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.955+0000 7f6f21200640 1 -- 172.21.15.103:0/583526720 wait complete. 2024-09-11T01:10:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.956+0000 7f6f21200640 1 Processor -- start 2024-09-11T01:10:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.956+0000 7f6f21200640 1 -- start start 2024-09-11T01:10:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f21200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f1c104b90 0x7f6f1c19afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f21200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f1c105ce0 0x7f6f1c19b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f21200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f1c1066a0 0x7f6f1c19c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f21200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c110800 con 0x7f6f1c104b90 2024-09-11T01:10:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f21200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c110680 con 0x7f6f1c105ce0 2024-09-11T01:10:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f21200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c110980 con 0x7f6f1c1066a0 2024-09-11T01:10:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f19e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f1c104b90 0x7f6f1c19afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f19e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f1c104b90 0x7f6f1c19afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55010/0 (socket says 172.21.15.103:55010) 2024-09-11T01:10:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f19e00640 1 -- 172.21.15.103:0/1495800592 learned_addr learned my addr 172.21.15.103:0/1495800592 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f1a800640 1 --2- 172.21.15.103:0/1495800592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f1c1066a0 0x7f6f1c19c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f19400640 1 --2- 172.21.15.103:0/1495800592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f1c105ce0 0x7f6f1c19b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f19e00640 1 -- 172.21.15.103:0/1495800592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f1c1066a0 msgr2=0x7f6f1c19c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f19e00640 1 --2- 172.21.15.103:0/1495800592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f1c1066a0 0x7f6f1c19c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f19e00640 1 -- 172.21.15.103:0/1495800592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f1c105ce0 msgr2=0x7f6f1c19b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f19e00640 1 --2- 172.21.15.103:0/1495800592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f1c105ce0 0x7f6f1c19b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.957+0000 7f6f19e00640 1 -- 172.21.15.103:0/1495800592 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1c19caf0 con 0x7f6f1c104b90 2024-09-11T01:10:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.958+0000 7f6f19e00640 1 --2- 172.21.15.103:0/1495800592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f1c104b90 0x7f6f1c19afb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00eb90 tx=0x7f6f0c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.958+0000 7f6f12a00640 1 -- 172.21.15.103:0/1495800592 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c004d20 con 0x7f6f1c104b90 2024-09-11T01:10:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.958+0000 7f6f21200640 1 -- 172.21.15.103:0/1495800592 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1c19cde0 con 0x7f6f1c104b90 2024-09-11T01:10:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.958+0000 7f6f12a00640 1 -- 172.21.15.103:0/1495800592 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f0c00ee90 con 0x7f6f1c104b90 2024-09-11T01:10:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.958+0000 7f6f12a00640 1 -- 172.21.15.103:0/1495800592 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c010670 con 0x7f6f1c104b90 2024-09-11T01:10:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.958+0000 7f6f21200640 1 -- 172.21.15.103:0/1495800592 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1c1a34b0 con 0x7f6f1c104b90 2024-09-11T01:10:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.961+0000 7f6f2422b740 1 Processor -- start 2024-09-11T01:10:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.961+0000 7f6f2422b740 1 -- start start 2024-09-11T01:10:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.961+0000 7f6f2422b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a08ff790 0x5584a0901b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.961+0000 7f6f12a00640 1 -- 172.21.15.103:0/1495800592 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f6f0c005020 con 0x7f6f1c104b90 2024-09-11T01:10:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.961+0000 7f6f2422b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a09020c0 0x5584a09044b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.961+0000 7f6f2422b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 0x5584a0906fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.965 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.961+0000 7f6f2422b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5584a08726b0 con 0x5584a09020c0 2024-09-11T01:10:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.961+0000 7f6f2422b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5584a0861ae0 con 0x5584a08ff790 2024-09-11T01:10:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.961+0000 7f6f2422b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5584a08658f0 con 0x5584a0904b00 2024-09-11T01:10:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.962+0000 7f6f19e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a09020c0 0x5584a09044b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.962+0000 7f6f1a800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a08ff790 0x5584a0901b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.962+0000 7f6f19e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a09020c0 0x5584a09044b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55018/0 (socket says 172.21.15.103:55018) 2024-09-11T01:10:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.962+0000 7f6f19e00640 1 -- 172.21.15.103:0/815248278 learned_addr learned my addr 172.21.15.103:0/815248278 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.962+0000 7f6f19400640 1 --2- 172.21.15.103:0/815248278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 0x5584a0906fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.962+0000 7f6f1a800640 1 -- 172.21.15.103:0/815248278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 msgr2=0x5584a0906fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.962+0000 7f6f1a800640 1 --2- 172.21.15.103:0/815248278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 0x5584a0906fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.962+0000 7f6f1a800640 1 -- 172.21.15.103:0/815248278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a09020c0 msgr2=0x5584a09044b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.962+0000 7f6f1a800640 1 --2- 172.21.15.103:0/815248278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a09020c0 0x5584a09044b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.962+0000 7f6f1a800640 1 -- 172.21.15.103:0/815248278 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584a082e780 con 0x5584a08ff790 2024-09-11T01:10:45.966 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.963+0000 7f6f1a800640 1 --2- 172.21.15.103:0/815248278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a08ff790 0x5584a0901b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009b50 tx=0x7f6f14011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0d7a7885914be14 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:45.968 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.963+0000 7f6f07400640 1 -- 172.21.15.103:0/815248278 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14004030 con 0x5584a08ff790 2024-09-11T01:10:45.969 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.963+0000 7f6f07400640 1 -- 172.21.15.103:0/815248278 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f14005020 con 0x5584a08ff790 2024-09-11T01:10:45.969 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.963+0000 7f6f07400640 1 -- 172.21.15.103:0/815248278 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14004c20 con 0x5584a08ff790 2024-09-11T01:10:45.969 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.963+0000 7f6f12a00640 1 --2- 172.21.15.103:0/1495800592 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6f000b52e0 0x7f6f000b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.969 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.964+0000 7f6f12a00640 1 -- 172.21.15.103:0/1495800592 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f6f0c0e6600 con 0x7f6f1c104b90 2024-09-11T01:10:45.969 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.964+0000 7f6f19e00640 1 --2- 172.21.15.103:0/1495800592 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6f000b52e0 0x7f6f000b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.969 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.964+0000 7f6f2422b740 1 -- 172.21.15.103:0/815248278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a08ff790 msgr2=0x5584a0901b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:45.969 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.964+0000 7f6f2422b740 1 --2- 172.21.15.103:0/815248278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a08ff790 0x5584a0901b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009b50 tx=0x7f6f14011810 comp rx=0 tx=0).stop 2024-09-11T01:10:45.969 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.964+0000 7f6f2422b740 1 -- 172.21.15.103:0/815248278 shutdown_connections 2024-09-11T01:10:45.969 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.964+0000 7f6f2422b740 1 --2- 172.21.15.103:0/815248278 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 0x5584a0906fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.969 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.964+0000 7f6f2422b740 1 --2- 172.21.15.103:0/815248278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a09020c0 0x5584a09044b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.964+0000 7f6f2422b740 1 --2- 172.21.15.103:0/815248278 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a08ff790 0x5584a0901b80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.964+0000 7f6f2422b740 1 -- 172.21.15.103:0/815248278 >> 172.21.15.103:0/815248278 conn(0x5584a08fa8e0 msgr2=0x5584a08fb670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.964+0000 7f6f2422b740 1 -- 172.21.15.103:0/815248278 shutdown_connections 2024-09-11T01:10:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.964+0000 7f6f2422b740 1 -- 172.21.15.103:0/815248278 wait complete. 2024-09-11T01:10:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.964+0000 7f6f19e00640 1 --2- 172.21.15.103:0/1495800592 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6f000b52e0 0x7f6f000b77a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0058b0 tx=0x7f6f0c0ec0e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.965+0000 7f6f2422b740 1 -- start start 2024-09-11T01:10:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.965+0000 7f6f2422b740 1 Processor -- start 2024-09-11T01:10:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.965+0000 7f6f2422b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a08ff790 0x5584a0908e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.965+0000 7f6f2422b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a09020c0 0x5584a0909500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.965+0000 7f6f2422b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 0x5584a090a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.965+0000 7f6f2422b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5584a0799ab0 con 0x5584a08ff790 2024-09-11T01:10:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.965+0000 7f6f2422b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5584a0808570 con 0x5584a09020c0 2024-09-11T01:10:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.965+0000 7f6f2422b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5584a0907ae0 con 0x5584a0904b00 2024-09-11T01:10:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.965+0000 7f6f2422b740 10 client.0 _ll_register_callbacks cb 0x5584a0817100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.966+0000 7f6f1a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a08ff790 0x5584a0908e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.966+0000 7f6f1a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a08ff790 0x5584a0908e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55030/0 (socket says 172.21.15.103:55030) 2024-09-11T01:10:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.966+0000 7f6f1a800640 1 -- 172.21.15.103:0/4053556928 learned_addr learned my addr 172.21.15.103:0/4053556928 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:45.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.966+0000 7f6f19400640 1 --2- 172.21.15.103:0/4053556928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a09020c0 0x5584a0909500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.974 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.966+0000 7f6f1a800640 1 --2- 172.21.15.103:0/4053556928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 0x5584a090a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.974 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.966+0000 7f6f19400640 1 -- 172.21.15.103:0/4053556928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 msgr2=0x5584a090a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.966+0000 7f6f19400640 1 --2- 172.21.15.103:0/4053556928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 0x5584a090a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.966+0000 7f6f19400640 1 -- 172.21.15.103:0/4053556928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a08ff790 msgr2=0x5584a0908e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.966+0000 7f6f19400640 1 --2- 172.21.15.103:0/4053556928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a08ff790 0x5584a0908e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.966+0000 7f6f19400640 1 -- 172.21.15.103:0/4053556928 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584a05c3790 con 0x5584a09020c0 2024-09-11T01:10:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.966+0000 7f6f1a800640 1 --2- 172.21.15.103:0/4053556928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a08ff790 0x5584a0908e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:10:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.966+0000 7f6f19400640 1 --2- 172.21.15.103:0/4053556928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a09020c0 0x5584a0909500 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6f08005ab0 tx=0x7f6f08031db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ae5049f3792bae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.966+0000 7f6efbe00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:10:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.967+0000 7f6efbe00640 1 -- 172.21.15.103:0/4053556928 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f08035040 con 0x5584a09020c0 2024-09-11T01:10:45.975 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.967+0000 7f6efbe00640 1 -- 172.21.15.103:0/4053556928 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f6f08004040 con 0x5584a09020c0 2024-09-11T01:10:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.967+0000 7f6f2422b740 1 -- 172.21.15.103:0/4053556928 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f14005020 con 0x5584a09020c0 2024-09-11T01:10:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.967+0000 7f6efbe00640 1 -- 172.21.15.103:0/4053556928 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6f0804e050 con 0x5584a09020c0 2024-09-11T01:10:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.967+0000 7f6f2422b740 10 client.25673 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.967+0000 7f6f2422b740 1 -- 172.21.15.103:0/4053556928 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5584a063c620 con 0x5584a09020c0 2024-09-11T01:10:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.967+0000 7f6efbe00640 1 -- 172.21.15.103:0/4053556928 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f14005020 con 0x5584a09020c0 2024-09-11T01:10:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.967+0000 7f6efbe00640 1 -- 172.21.15.103:0/4053556928 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f6f0803c440 con 0x5584a09020c0 2024-09-11T01:10:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.968+0000 7f6f2422b740 10 client.25673 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.968+0000 7f6f2422b740 10 client.25673 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:10:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.968+0000 7f6f2422b740 20 client.25673 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.968+0000 7f6f2422b740 1 --2- 172.21.15.103:0/4053556928 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5584a09147b0 0x5584a0916bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.968+0000 7f6f2422b740 4 client.25673 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:10:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.968+0000 7f6f2422b740 1 -- 172.21.15.103:0/4053556928 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584a0874600 con 0x5584a09147b0 2024-09-11T01:10:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.968+0000 7f6f1a800640 1 --2- 172.21.15.103:0/4053556928 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5584a09147b0 0x5584a0916bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.968+0000 7f6f1a800640 1 --2- 172.21.15.103:0/4053556928 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5584a09147b0 0x5584a0916bf0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeca352dffaca9c7 server_cookie=b8846dba9a70f1de in_seq=0 out_seq=0 2024-09-11T01:10:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.968+0000 7f6efbe00640 10 client.25673 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.969+0000 7f6efbe00640 1 -- 172.21.15.103:0/4053556928 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5584a0874600 con 0x5584a09147b0 2024-09-11T01:10:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.969+0000 7f6efbe00640 10 client.25673 handle_command_reply: tid=0 2024-09-11T01:10:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.969+0000 7f6f2422b740 1 client.25673 shutdown 2024-09-11T01:10:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.969+0000 7f6f2422b740 1 -- 172.21.15.103:0/4053556928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a09020c0 msgr2=0x5584a0909500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.969+0000 7f6f2422b740 1 --2- 172.21.15.103:0/4053556928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a09020c0 0x5584a0909500 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6f08005ab0 tx=0x7f6f08031db0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.969+0000 7f6f2422b740 1 -- 172.21.15.103:0/4053556928 shutdown_connections 2024-09-11T01:10:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.969+0000 7f6f2422b740 1 --2- 172.21.15.103:0/4053556928 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5584a09147b0 0x5584a0916bf0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.969+0000 7f6f2422b740 1 --2- 172.21.15.103:0/4053556928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 0x5584a090a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.969+0000 7f6f2422b740 1 --2- 172.21.15.103:0/4053556928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a09020c0 0x5584a0909500 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.969+0000 7f6f2422b740 1 --2- 172.21.15.103:0/4053556928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a08ff790 0x5584a0908e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.969+0000 7f6efbe00640 0 client.25673 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.969+0000 7f6f2422b740 1 -- 172.21.15.103:0/4053556928 >> 172.21.15.103:0/4053556928 conn(0x5584a08fa8e0 msgr2=0x5584a08f9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.969+0000 7f6f2422b740 1 -- 172.21.15.103:0/4053556928 shutdown_connections 2024-09-11T01:10:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.969+0000 7f6f2422b740 1 -- 172.21.15.103:0/4053556928 wait complete. 2024-09-11T01:10:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.970+0000 7f6f2422b740 20 client.25673 trim_cache size 0 max 16384 2024-09-11T01:10:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.985+0000 7f6f2422b740 1 Processor -- start 2024-09-11T01:10:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.985+0000 7f6f2422b740 1 -- start start 2024-09-11T01:10:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.985+0000 7f6f2422b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a08ff790 0x5584a08f5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.985+0000 7f6f2422b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a09020c0 0x5584a0904ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.985+0000 7f6f2422b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 0x5584a0905420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.985+0000 7f6f2422b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c1b0170 con 0x5584a08ff790 2024-09-11T01:10:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.985+0000 7f6f2422b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c1ada10 con 0x5584a09020c0 2024-09-11T01:10:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.985+0000 7f6f2422b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c1ab860 con 0x5584a0904b00 2024-09-11T01:10:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.985+0000 7f6f1a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a08ff790 0x5584a08f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.985+0000 7f6f1a800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a08ff790 0x5584a08f5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55038/0 (socket says 172.21.15.103:55038) 2024-09-11T01:10:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.985+0000 7f6f1a800640 1 -- 172.21.15.103:0/1133149713 learned_addr learned my addr 172.21.15.103:0/1133149713 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.985+0000 7f6f19400640 1 --2- 172.21.15.103:0/1133149713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a09020c0 0x5584a0904ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.985+0000 7f6f1a800640 1 --2- 172.21.15.103:0/1133149713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 0x5584a0905420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.986+0000 7f6f1a800640 1 -- 172.21.15.103:0/1133149713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 msgr2=0x5584a0905420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.986+0000 7f6f1a800640 1 --2- 172.21.15.103:0/1133149713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 0x5584a0905420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.986+0000 7f6f1a800640 1 -- 172.21.15.103:0/1133149713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a09020c0 msgr2=0x5584a0904ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.986+0000 7f6f1a800640 1 --2- 172.21.15.103:0/1133149713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a09020c0 0x5584a0904ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.986+0000 7f6f1a800640 1 -- 172.21.15.103:0/1133149713 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584a0901ef0 con 0x5584a08ff790 2024-09-11T01:10:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.986+0000 7f6f1a800640 1 --2- 172.21.15.103:0/1133149713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a08ff790 0x5584a08f5960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009960 tx=0x7f6f14005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb7baea51c47395 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.986+0000 7f6f06a00640 1 -- 172.21.15.103:0/1133149713 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1401e040 con 0x5584a08ff790 2024-09-11T01:10:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.986+0000 7f6f06a00640 1 -- 172.21.15.103:0/1133149713 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f140042c0 con 0x5584a08ff790 2024-09-11T01:10:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.986+0000 7f6f06a00640 1 -- 172.21.15.103:0/1133149713 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f140049c0 con 0x5584a08ff790 2024-09-11T01:10:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.987+0000 7f6f2422b740 1 -- 172.21.15.103:0/1133149713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a08ff790 msgr2=0x5584a08f5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.987+0000 7f6f2422b740 1 --2- 172.21.15.103:0/1133149713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a08ff790 0x5584a08f5960 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009960 tx=0x7f6f14005f90 comp rx=0 tx=0).stop 2024-09-11T01:10:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.987+0000 7f6f2422b740 1 -- 172.21.15.103:0/1133149713 shutdown_connections 2024-09-11T01:10:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.987+0000 7f6f2422b740 1 --2- 172.21.15.103:0/1133149713 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a0904b00 0x5584a0905420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.987+0000 7f6f2422b740 1 --2- 172.21.15.103:0/1133149713 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a09020c0 0x5584a0904ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.987+0000 7f6f2422b740 1 --2- 172.21.15.103:0/1133149713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a08ff790 0x5584a08f5960 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.987+0000 7f6f2422b740 1 -- 172.21.15.103:0/1133149713 >> 172.21.15.103:0/1133149713 conn(0x5584a08fa8e0 msgr2=0x5584a08febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.987+0000 7f6f2422b740 1 -- 172.21.15.103:0/1133149713 shutdown_connections 2024-09-11T01:10:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.987+0000 7f6f2422b740 1 -- 172.21.15.103:0/1133149713 wait complete. 2024-09-11T01:10:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.987+0000 7f6f2422b740 1 -- start start 2024-09-11T01:10:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.987+0000 7f6f2422b740 1 Processor -- start 2024-09-11T01:10:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f2422b740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a08ff790 0x5584a09109b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f2422b740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a09020c0 0x5584a090f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f2422b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a0904b00 0x5584a090fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f2422b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c1abed0 con 0x5584a0904b00 2024-09-11T01:10:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f2422b740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c1ad340 con 0x5584a08ff790 2024-09-11T01:10:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f2422b740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c1ac5a0 con 0x5584a09020c0 2024-09-11T01:10:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f2422b740 10 client.0 _ll_register_callbacks cb 0x7f6f08009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f19400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a09020c0 0x5584a090f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f19400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a09020c0 0x5584a090f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:43120/0 (socket says 172.21.15.103:43120) 2024-09-11T01:10:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f19400640 1 -- 172.21.15.103:0/2547187336 learned_addr learned my addr 172.21.15.103:0/2547187336 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f1a800640 1 --2- 172.21.15.103:0/2547187336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a08ff790 0x5584a09109b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f1a800640 1 --2- 172.21.15.103:0/2547187336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a0904b00 0x5584a090fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f19400640 1 -- 172.21.15.103:0/2547187336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a08ff790 msgr2=0x5584a09109b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f19400640 1 --2- 172.21.15.103:0/2547187336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a08ff790 0x5584a09109b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f19400640 1 -- 172.21.15.103:0/2547187336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a0904b00 msgr2=0x5584a090fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f19400640 1 --2- 172.21.15.103:0/2547187336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a0904b00 0x5584a090fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.988+0000 7f6f19400640 1 -- 172.21.15.103:0/2547187336 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584a0910480 con 0x5584a09020c0 2024-09-11T01:10:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.989+0000 7f6f19400640 1 --2- 172.21.15.103:0/2547187336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a09020c0 0x5584a090f6b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6f0803c670 tx=0x7f6f0803c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b0b4fa59b096291 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.989+0000 7f6efbe00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:10:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.989+0000 7f6efbe00640 1 -- 172.21.15.103:0/2547187336 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f08057060 con 0x5584a09020c0 2024-09-11T01:10:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.989+0000 7f6f2422b740 1 -- 172.21.15.103:0/2547187336 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f140042c0 con 0x5584a09020c0 2024-09-11T01:10:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.989+0000 7f6efbe00640 1 -- 172.21.15.103:0/2547187336 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f6f0803cbf0 con 0x5584a09020c0 2024-09-11T01:10:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.989+0000 7f6efbe00640 1 -- 172.21.15.103:0/2547187336 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6f0805e050 con 0x5584a09020c0 2024-09-11T01:10:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.989+0000 7f6f2422b740 10 client.25645 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.989+0000 7f6f2422b740 1 -- 172.21.15.103:0/2547187336 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5584a098a0a0 con 0x5584a09020c0 2024-09-11T01:10:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.989+0000 7f6efbe00640 1 -- 172.21.15.103:0/2547187336 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6f140042c0 con 0x5584a09020c0 2024-09-11T01:10:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.990+0000 7f6efbe00640 1 -- 172.21.15.103:0/2547187336 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f6f08046430 con 0x5584a09020c0 2024-09-11T01:10:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.990+0000 7f6f2422b740 10 client.25645 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.990+0000 7f6f2422b740 10 client.25645 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:10:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.990+0000 7f6f2422b740 20 client.25645 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.990+0000 7f6f2422b740 1 --2- 172.21.15.103:0/2547187336 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5584a098aae0 0x5584a098cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.990+0000 7f6f2422b740 4 client.25645 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:10:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.990+0000 7f6f2422b740 1 -- 172.21.15.103:0/2547187336 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5584a08700b0 con 0x5584a098aae0 2024-09-11T01:10:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.990+0000 7f6f1a800640 1 --2- 172.21.15.103:0/2547187336 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5584a098aae0 0x5584a098cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.991+0000 7f6f1a800640 1 --2- 172.21.15.103:0/2547187336 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5584a098aae0 0x5584a098cf00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fe20a3a629553f4 server_cookie=d0969d435e066676 in_seq=0 out_seq=0 2024-09-11T01:10:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:45.991+0000 7f6efbe00640 10 client.25645 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6efbe00640 1 -- 172.21.15.103:0/2547187336 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5584a08700b0 con 0x5584a098aae0 2024-09-11T01:10:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6efbe00640 10 client.25645 handle_command_reply: tid=0 2024-09-11T01:10:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f2422b740 1 client.25645 shutdown 2024-09-11T01:10:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f2422b740 1 -- 172.21.15.103:0/2547187336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a09020c0 msgr2=0x5584a090f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f2422b740 1 --2- 172.21.15.103:0/2547187336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a09020c0 0x5584a090f6b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6f0803c670 tx=0x7f6f0803c6a0 comp rx=0 tx=0).stop 2024-09-11T01:10:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f2422b740 1 -- 172.21.15.103:0/2547187336 shutdown_connections 2024-09-11T01:10:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f2422b740 1 --2- 172.21.15.103:0/2547187336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5584a0904b00 0x5584a090fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f2422b740 1 --2- 172.21.15.103:0/2547187336 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5584a098aae0 0x5584a098cf00 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f2422b740 1 --2- 172.21.15.103:0/2547187336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5584a09020c0 0x5584a090f6b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f2422b740 1 --2- 172.21.15.103:0/2547187336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5584a08ff790 0x5584a09109b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6efbe00640 0 client.25645 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f2422b740 1 -- 172.21.15.103:0/2547187336 >> 172.21.15.103:0/2547187336 conn(0x5584a08fa8e0 msgr2=0x5584a0908e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f2422b740 1 -- 172.21.15.103:0/2547187336 shutdown_connections 2024-09-11T01:10:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f2422b740 1 -- 172.21.15.103:0/2547187336 wait complete. 2024-09-11T01:10:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f2422b740 20 client.25645 trim_cache size 0 max 16384 2024-09-11T01:10:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:10:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:10:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:10:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:10:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f21200640 1 -- 172.21.15.103:0/1495800592 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6f000b52e0 msgr2=0x7f6f000b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f21200640 1 --2- 172.21.15.103:0/1495800592 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6f000b52e0 0x7f6f000b77a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c0058b0 tx=0x7f6f0c0ec0e0 comp rx=0 tx=0).stop 2024-09-11T01:10:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f21200640 1 -- 172.21.15.103:0/1495800592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f1c104b90 msgr2=0x7f6f1c19afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.006+0000 7f6f21200640 1 --2- 172.21.15.103:0/1495800592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f1c104b90 0x7f6f1c19afb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00eb90 tx=0x7f6f0c00c6a0 comp rx=0 tx=0).stop 2024-09-11T01:10:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.007+0000 7f6f21200640 1 -- 172.21.15.103:0/1495800592 shutdown_connections 2024-09-11T01:10:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.007+0000 7f6f21200640 1 --2- 172.21.15.103:0/1495800592 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f6f000b52e0 0x7f6f000b77a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.007+0000 7f6f21200640 1 --2- 172.21.15.103:0/1495800592 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f6f1c1066a0 0x7f6f1c19c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.007+0000 7f6f21200640 1 --2- 172.21.15.103:0/1495800592 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f1c105ce0 0x7f6f1c19b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.007+0000 7f6f21200640 1 --2- 172.21.15.103:0/1495800592 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f1c104b90 0x7f6f1c19afb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.007+0000 7f6f21200640 1 -- 172.21.15.103:0/1495800592 >> 172.21.15.103:0/1495800592 conn(0x7f6f1c100470 msgr2=0x7f6f1c109130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.007+0000 7f6f21200640 1 -- 172.21.15.103:0/1495800592 shutdown_connections 2024-09-11T01:10:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:46.007+0000 7f6f21200640 1 -- 172.21.15.103:0/1495800592 wait complete. 2024-09-11T01:10:46.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:46 smithi183 ceph-mon[34992]: pgmap v472: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 MiB/s wr, 37 op/s 2024-09-11T01:10:47.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:46 smithi103 ceph-mon[30562]: pgmap v472: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 MiB/s wr, 37 op/s 2024-09-11T01:10:47.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:46 smithi117 ceph-mon[35358]: pgmap v472: 129 pgs: 129 active+clean; 7.5 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 50 MiB/s wr, 37 op/s 2024-09-11T01:10:48.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:48 smithi183 ceph-mon[34992]: pgmap v473: 129 pgs: 129 active+clean; 7.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 56 MiB/s wr, 37 op/s 2024-09-11T01:10:49.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:48 smithi103 ceph-mon[30562]: pgmap v473: 129 pgs: 129 active+clean; 7.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 56 MiB/s wr, 37 op/s 2024-09-11T01:10:49.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:48 smithi117 ceph-mon[35358]: pgmap v473: 129 pgs: 129 active+clean; 7.6 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 56 MiB/s wr, 37 op/s 2024-09-11T01:10:50.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:49 smithi103 ceph-mon[30562]: pgmap v474: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 67 MiB/s wr, 41 op/s 2024-09-11T01:10:50.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:49 smithi117 ceph-mon[35358]: pgmap v474: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 67 MiB/s wr, 41 op/s 2024-09-11T01:10:50.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:49 smithi183 ceph-mon[34992]: pgmap v474: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 67 MiB/s wr, 41 op/s 2024-09-11T01:10:52.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:52 smithi183 ceph-mon[34992]: pgmap v475: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 67 MiB/s wr, 39 op/s 2024-09-11T01:10:53.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:52 smithi103 ceph-mon[30562]: pgmap v475: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 67 MiB/s wr, 39 op/s 2024-09-11T01:10:53.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:52 smithi117 ceph-mon[35358]: pgmap v475: 129 pgs: 129 active+clean; 7.7 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 67 MiB/s wr, 39 op/s 2024-09-11T01:10:54.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:54 smithi183 ceph-mon[34992]: pgmap v476: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 MiB/s wr, 42 op/s 2024-09-11T01:10:55.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:54 smithi103 ceph-mon[30562]: pgmap v476: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 MiB/s wr, 42 op/s 2024-09-11T01:10:55.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:54 smithi117 ceph-mon[35358]: pgmap v476: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 72 MiB/s wr, 42 op/s 2024-09-11T01:10:56.024 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:55 smithi117 ceph-mon[35358]: pgmap v477: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 47 MiB/s wr, 22 op/s 2024-09-11T01:10:56.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:55 smithi103 ceph-mon[30562]: pgmap v477: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 47 MiB/s wr, 22 op/s 2024-09-11T01:10:56.895 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:55 smithi183 ceph-mon[34992]: pgmap v477: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 47 MiB/s wr, 22 op/s 2024-09-11T01:10:58.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:10:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:10:58 smithi183 ceph-mon[34992]: pgmap v478: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 25 MiB/s wr, 15 op/s 2024-09-11T01:10:58.966 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:10:58 smithi103 ceph-mon[30562]: pgmap v478: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 25 MiB/s wr, 15 op/s 2024-09-11T01:10:59.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:10:58 smithi117 ceph-mon[35358]: pgmap v478: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 25 MiB/s wr, 15 op/s 2024-09-11T01:10:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.125+0000 7faa4aa00640 1 -- 172.21.15.103:0/1408834246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa441044a0 msgr2=0x7faa4410ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.125+0000 7faa4aa00640 1 --2- 172.21.15.103:0/1408834246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa441044a0 0x7faa4410ae20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faa3c009be0 tx=0x7faa3c02a6c0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.125+0000 7faa4aa00640 1 -- 172.21.15.103:0/1408834246 shutdown_connections 2024-09-11T01:10:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.125+0000 7faa4aa00640 1 --2- 172.21.15.103:0/1408834246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa441044a0 0x7faa4410ae20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.125+0000 7faa4aa00640 1 --2- 172.21.15.103:0/1408834246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa44103ae0 0x7faa44103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.125+0000 7faa4aa00640 1 --2- 172.21.15.103:0/1408834246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa44102990 0x7faa44102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.125+0000 7faa4aa00640 1 -- 172.21.15.103:0/1408834246 >> 172.21.15.103:0/1408834246 conn(0x7faa440fe250 msgr2=0x7faa44100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.125+0000 7faa4aa00640 1 -- 172.21.15.103:0/1408834246 shutdown_connections 2024-09-11T01:10:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.125+0000 7faa4aa00640 1 -- 172.21.15.103:0/1408834246 wait complete. 2024-09-11T01:10:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.127+0000 7faa4aa00640 1 Processor -- start 2024-09-11T01:10:59.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.127+0000 7faa4aa00640 1 -- start start 2024-09-11T01:10:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.127+0000 7faa4aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa44102990 0x7faa44076ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.127+0000 7faa4aa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa44103ae0 0x7faa44075540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.127+0000 7faa4aa00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa441044a0 0x7faa44075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.127+0000 7faa4aa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faa4410e600 con 0x7faa44102990 2024-09-11T01:10:59.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.127+0000 7faa4aa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faa4410e480 con 0x7faa44103ae0 2024-09-11T01:10:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.127+0000 7faa4aa00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faa4410e780 con 0x7faa441044a0 2024-09-11T01:10:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.128+0000 7faa43400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa44103ae0 0x7faa44075540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.128+0000 7faa43e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa44102990 0x7faa44076ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.128+0000 7faa43400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa44103ae0 0x7faa44075540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:36424/0 (socket says 172.21.15.103:36424) 2024-09-11T01:10:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.128+0000 7faa43400640 1 -- 172.21.15.103:0/3666239263 learned_addr learned my addr 172.21.15.103:0/3666239263 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:59.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.128+0000 7faa48a00640 1 --2- 172.21.15.103:0/3666239263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa441044a0 0x7faa44075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.128+0000 7faa43400640 1 -- 172.21.15.103:0/3666239263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa441044a0 msgr2=0x7faa44075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.128+0000 7faa43400640 1 --2- 172.21.15.103:0/3666239263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa441044a0 0x7faa44075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.128+0000 7faa43400640 1 -- 172.21.15.103:0/3666239263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa44102990 msgr2=0x7faa44076ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.128+0000 7faa43400640 1 --2- 172.21.15.103:0/3666239263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa44102990 0x7faa44076ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.128+0000 7faa43400640 1 -- 172.21.15.103:0/3666239263 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa440762f0 con 0x7faa44103ae0 2024-09-11T01:10:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.129+0000 7faa43400640 1 --2- 172.21.15.103:0/3666239263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa44103ae0 0x7faa44075540 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faa3000e9c0 tx=0x7faa3000ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.129+0000 7faa40c00640 1 -- 172.21.15.103:0/3666239263 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3000cde0 con 0x7faa44103ae0 2024-09-11T01:10:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.129+0000 7faa40c00640 1 -- 172.21.15.103:0/3666239263 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa300035f0 con 0x7faa44103ae0 2024-09-11T01:10:59.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.129+0000 7faa40c00640 1 -- 172.21.15.103:0/3666239263 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30010690 con 0x7faa44103ae0 2024-09-11T01:10:59.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.129+0000 7faa4aa00640 1 -- 172.21.15.103:0/3666239263 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa441a2dd0 con 0x7faa44103ae0 2024-09-11T01:10:59.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.129+0000 7faa4aa00640 1 -- 172.21.15.103:0/3666239263 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa441a3240 con 0x7faa44103ae0 2024-09-11T01:10:59.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.133+0000 7faa4d8c7740 1 Processor -- start 2024-09-11T01:10:59.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.133+0000 7faa4d8c7740 1 -- start start 2024-09-11T01:10:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.133+0000 7faa4d8c7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f6f790 0x558683f71b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.133+0000 7faa4d8c7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f720c0 0x558683f744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.133+0000 7faa4d8c7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f74b00 0x558683f76fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.134+0000 7faa4d8c7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558683ee26b0 con 0x558683f74b00 2024-09-11T01:10:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.134+0000 7faa4d8c7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558683ed1ae0 con 0x558683f6f790 2024-09-11T01:10:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.134+0000 7faa4d8c7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558683ed58f0 con 0x558683f720c0 2024-09-11T01:10:59.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.134+0000 7faa48a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f6f790 0x558683f71b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.134+0000 7faa43e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f720c0 0x558683f744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.134+0000 7faa48a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f6f790 0x558683f71b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:36430/0 (socket says 172.21.15.103:36430) 2024-09-11T01:10:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.134+0000 7faa43e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f720c0 0x558683f744b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:35874/0 (socket says 172.21.15.103:35874) 2024-09-11T01:10:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.134+0000 7faa48a00640 1 -- 172.21.15.103:0/2940904820 learned_addr learned my addr 172.21.15.103:0/2940904820 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.134+0000 7faa40c00640 1 -- 172.21.15.103:0/3666239263 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7faa30004000 con 0x7faa44103ae0 2024-09-11T01:10:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.134+0000 7faa48a00640 1 -- 172.21.15.103:0/2940904820 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f720c0 msgr2=0x558683f744b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.134+0000 7faa48a00640 1 --2- 172.21.15.103:0/2940904820 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f720c0 0x558683f744b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.134+0000 7faa48a00640 1 -- 172.21.15.103:0/2940904820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f74b00 msgr2=0x558683f76fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T01:10:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.134+0000 7faa43400640 1 --2- 172.21.15.103:0/2940904820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f74b00 0x558683f76fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.135+0000 7faa48a00640 1 --2- 172.21.15.103:0/2940904820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f74b00 0x558683f76fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.135+0000 7faa48a00640 1 -- 172.21.15.103:0/2940904820 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558683e9e780 con 0x558683f6f790 2024-09-11T01:10:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.135+0000 7faa48a00640 1 --2- 172.21.15.103:0/2940904820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f6f790 0x558683f71b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faa3c02acb0 tx=0x7faa3c005ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9efeb29acb076070 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.135+0000 7faa39200640 1 -- 172.21.15.103:0/2940904820 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c041030 con 0x558683f6f790 2024-09-11T01:10:59.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.135+0000 7faa39200640 1 -- 172.21.15.103:0/2940904820 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa3c030660 con 0x558683f6f790 2024-09-11T01:10:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.135+0000 7faa39200640 1 -- 172.21.15.103:0/2940904820 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3c036040 con 0x558683f6f790 2024-09-11T01:10:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.136+0000 7faa40c00640 1 --2- 172.21.15.103:0/3666239263 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faa280b5360 0x7faa280b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.136+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2940904820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f6f790 msgr2=0x558683f71b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.136+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/2940904820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f6f790 0x558683f71b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faa3c02acb0 tx=0x7faa3c005ec0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.136+0000 7faa40c00640 1 -- 172.21.15.103:0/3666239263 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7faa300e61f0 con 0x7faa44103ae0 2024-09-11T01:10:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.136+0000 7faa43e00640 1 --2- 172.21.15.103:0/3666239263 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faa280b5360 0x7faa280b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.136+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2940904820 shutdown_connections 2024-09-11T01:10:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.136+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/2940904820 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f74b00 0x558683f76fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.136+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/2940904820 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f720c0 0x558683f744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.136+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/2940904820 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f6f790 0x558683f71b80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.136+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2940904820 >> 172.21.15.103:0/2940904820 conn(0x558683f6a8e0 msgr2=0x558683f6b670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.137+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2940904820 shutdown_connections 2024-09-11T01:10:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.137+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2940904820 wait complete. 2024-09-11T01:10:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.137+0000 7faa43e00640 1 --2- 172.21.15.103:0/3666239263 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faa280b5360 0x7faa280b7820 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faa34009d00 tx=0x7faa34005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.137+0000 7faa4d8c7740 1 -- start start 2024-09-11T01:10:59.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.137+0000 7faa4d8c7740 1 Processor -- start 2024-09-11T01:10:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.138+0000 7faa4d8c7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f6f790 0x558683f78e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.138+0000 7faa4d8c7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f720c0 0x558683f794a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.138+0000 7faa4d8c7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f74b00 0x558683f7a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.138+0000 7faa4d8c7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558683e09ab0 con 0x558683f720c0 2024-09-11T01:10:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.138+0000 7faa4d8c7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x558683e78570 con 0x558683f74b00 2024-09-11T01:10:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.138+0000 7faa4d8c7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x558683f77a80 con 0x558683f6f790 2024-09-11T01:10:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.138+0000 7faa4d8c7740 10 client.0 _ll_register_callbacks cb 0x558683e87100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.138+0000 7faa43e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f6f790 0x558683f78e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.138+0000 7faa43e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f6f790 0x558683f78e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:35882/0 (socket says 172.21.15.103:35882) 2024-09-11T01:10:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.138+0000 7faa43e00640 1 -- 172.21.15.103:0/3708589089 learned_addr learned my addr 172.21.15.103:0/3708589089 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.138+0000 7faa48a00640 1 --2- 172.21.15.103:0/3708589089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f74b00 0x558683f7a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.138+0000 7faa43400640 1 --2- 172.21.15.103:0/3708589089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f720c0 0x558683f794a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.138+0000 7faa43e00640 1 -- 172.21.15.103:0/3708589089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f74b00 msgr2=0x558683f7a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.138+0000 7faa43e00640 1 --2- 172.21.15.103:0/3708589089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f74b00 0x558683f7a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.139+0000 7faa43e00640 1 -- 172.21.15.103:0/3708589089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f720c0 msgr2=0x558683f794a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.139+0000 7faa43e00640 1 --2- 172.21.15.103:0/3708589089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f720c0 0x558683f794a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.139+0000 7faa43e00640 1 -- 172.21.15.103:0/3708589089 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558683c33790 con 0x558683f6f790 2024-09-11T01:10:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.139+0000 7faa43e00640 1 --2- 172.21.15.103:0/3708589089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f6f790 0x558683f78e00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faa34009650 tx=0x7faa34004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2cf6cf614bac9d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.139+0000 7faa2d600640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:10:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.139+0000 7faa2d600640 1 -- 172.21.15.103:0/3708589089 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3401e470 con 0x558683f6f790 2024-09-11T01:10:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.139+0000 7faa4d8c7740 1 -- 172.21.15.103:0/3708589089 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558683ee4600 con 0x558683f6f790 2024-09-11T01:10:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.139+0000 7faa2d600640 1 -- 172.21.15.103:0/3708589089 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7faa3401e610 con 0x558683f6f790 2024-09-11T01:10:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.139+0000 7faa2d600640 1 -- 172.21.15.103:0/3708589089 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa3401e810 con 0x558683f6f790 2024-09-11T01:10:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.139+0000 7faa4d8c7740 10 client.25657 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.139+0000 7faa4d8c7740 1 -- 172.21.15.103:0/3708589089 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558683cac620 con 0x558683f6f790 2024-09-11T01:10:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.140+0000 7faa2d600640 1 -- 172.21.15.103:0/3708589089 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558683ee4600 con 0x558683f6f790 2024-09-11T01:10:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.140+0000 7faa2d600640 1 -- 172.21.15.103:0/3708589089 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7faa34027070 con 0x558683f6f790 2024-09-11T01:10:59.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.140+0000 7faa4d8c7740 10 client.25657 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.140+0000 7faa4d8c7740 10 client.25657 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:10:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.140+0000 7faa4d8c7740 20 client.25657 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.140+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/3708589089 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558683f847d0 0x558683f86c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.140+0000 7faa4d8c7740 4 client.25657 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:10:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.140+0000 7faa4d8c7740 1 -- 172.21.15.103:0/3708589089 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558683ee00b0 con 0x558683f847d0 2024-09-11T01:10:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.140+0000 7faa43400640 1 --2- 172.21.15.103:0/3708589089 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558683f847d0 0x558683f86c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.141+0000 7faa43400640 1 --2- 172.21.15.103:0/3708589089 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558683f847d0 0x558683f86c20 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d024d6aa04827122 server_cookie=bdc7cf671ae6ba47 in_seq=0 out_seq=0 2024-09-11T01:10:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.141+0000 7faa2d600640 10 client.25657 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa2d600640 1 -- 172.21.15.103:0/3708589089 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558683ee00b0 con 0x558683f847d0 2024-09-11T01:10:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa2d600640 10 client.25657 handle_command_reply: tid=0 2024-09-11T01:10:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa4d8c7740 1 client.25657 shutdown 2024-09-11T01:10:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa4d8c7740 1 -- 172.21.15.103:0/3708589089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f6f790 msgr2=0x558683f78e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:59.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/3708589089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f6f790 0x558683f78e00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7faa34009650 tx=0x7faa34004730 comp rx=0 tx=0).stop 2024-09-11T01:10:59.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa4d8c7740 1 -- 172.21.15.103:0/3708589089 shutdown_connections 2024-09-11T01:10:59.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/3708589089 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f74b00 0x558683f7a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/3708589089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f720c0 0x558683f794a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/3708589089 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558683f847d0 0x558683f86c20 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/3708589089 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f6f790 0x558683f78e00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa2d600640 0 client.25657 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:59.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa4d8c7740 1 -- 172.21.15.103:0/3708589089 >> 172.21.15.103:0/3708589089 conn(0x558683f6a8e0 msgr2=0x558683f69a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:59.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa4d8c7740 1 -- 172.21.15.103:0/3708589089 shutdown_connections 2024-09-11T01:10:59.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa4d8c7740 1 -- 172.21.15.103:0/3708589089 wait complete. 2024-09-11T01:10:59.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.142+0000 7faa4d8c7740 20 client.25657 trim_cache size 0 max 16384 2024-09-11T01:10:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.157+0000 7faa4d8c7740 1 Processor -- start 2024-09-11T01:10:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.158+0000 7faa4d8c7740 1 -- start start 2024-09-11T01:10:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.158+0000 7faa4d8c7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f6f790 0x558683f78b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.159 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.158+0000 7faa4d8c7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f720c0 0x558683f6d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.158+0000 7faa4d8c7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f74b00 0x558683f6de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.158+0000 7faa4d8c7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faa441b0110 con 0x558683f6f790 2024-09-11T01:10:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.158+0000 7faa4d8c7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faa441ad9b0 con 0x558683f720c0 2024-09-11T01:10:59.160 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.158+0000 7faa4d8c7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faa441ab800 con 0x558683f74b00 2024-09-11T01:10:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.158+0000 7faa43e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f6f790 0x558683f78b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.158+0000 7faa43400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f720c0 0x558683f6d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.158+0000 7faa43e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f6f790 0x558683f78b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50046/0 (socket says 172.21.15.103:50046) 2024-09-11T01:10:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.158+0000 7faa43e00640 1 -- 172.21.15.103:0/2515071040 learned_addr learned my addr 172.21.15.103:0/2515071040 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.158+0000 7faa48a00640 1 --2- 172.21.15.103:0/2515071040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f74b00 0x558683f6de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.159+0000 7faa43400640 1 -- 172.21.15.103:0/2515071040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f74b00 msgr2=0x558683f6de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.159+0000 7faa43400640 1 --2- 172.21.15.103:0/2515071040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f74b00 0x558683f6de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.159+0000 7faa43400640 1 -- 172.21.15.103:0/2515071040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f6f790 msgr2=0x558683f78b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.159+0000 7faa43400640 1 --2- 172.21.15.103:0/2515071040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f6f790 0x558683f78b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.161 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.159+0000 7faa43400640 1 -- 172.21.15.103:0/2515071040 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558683f74820 con 0x558683f720c0 2024-09-11T01:10:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.159+0000 7faa43400640 1 --2- 172.21.15.103:0/2515071040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f720c0 0x558683f6d930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faa300e3990 tx=0x7faa300e3810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1545f32bf1a82631 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.159+0000 7faa2fe00640 1 -- 172.21.15.103:0/2515071040 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa300acd00 con 0x558683f720c0 2024-09-11T01:10:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.159+0000 7faa2fe00640 1 -- 172.21.15.103:0/2515071040 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa300ac600 con 0x558683f720c0 2024-09-11T01:10:59.162 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.159+0000 7faa2fe00640 1 -- 172.21.15.103:0/2515071040 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30004320 con 0x558683f720c0 2024-09-11T01:10:59.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.160+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2515071040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f720c0 msgr2=0x558683f6d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:59.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.160+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/2515071040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f720c0 0x558683f6d930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faa300e3990 tx=0x7faa300e3810 comp rx=0 tx=0).stop 2024-09-11T01:10:59.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.160+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2515071040 shutdown_connections 2024-09-11T01:10:59.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.160+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/2515071040 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f74b00 0x558683f6de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.160+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/2515071040 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f720c0 0x558683f6d930 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.160+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/2515071040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f6f790 0x558683f78b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.160+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2515071040 >> 172.21.15.103:0/2515071040 conn(0x558683f6a8e0 msgr2=0x558683f6ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:59.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.160+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2515071040 shutdown_connections 2024-09-11T01:10:59.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.160+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2515071040 wait complete. 2024-09-11T01:10:59.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.160+0000 7faa4d8c7740 1 -- start start 2024-09-11T01:10:59.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.161+0000 7faa4d8c7740 1 Processor -- start 2024-09-11T01:10:59.165 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.161+0000 7faa4d8c7740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f6f790 0x558683f7ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.161+0000 7faa4d8c7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f720c0 0x558683f805b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.161+0000 7faa4d8c7740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f74b00 0x558683f7ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.161+0000 7faa4d8c7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faa441abe70 con 0x558683f720c0 2024-09-11T01:10:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.161+0000 7faa4d8c7740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7faa441ad2e0 con 0x558683f6f790 2024-09-11T01:10:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.161+0000 7faa4d8c7740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7faa441ac540 con 0x558683f74b00 2024-09-11T01:10:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.161+0000 7faa4d8c7740 10 client.0 _ll_register_callbacks cb 0x7faa34005a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:10:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.161+0000 7faa43400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f720c0 0x558683f805b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.161+0000 7faa43400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f720c0 0x558683f805b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50048/0 (socket says 172.21.15.103:50048) 2024-09-11T01:10:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.161+0000 7faa43400640 1 -- 172.21.15.103:0/2027488260 learned_addr learned my addr 172.21.15.103:0/2027488260 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:10:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.161+0000 7faa43e00640 1 --2- 172.21.15.103:0/2027488260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f6f790 0x558683f7ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.162+0000 7faa48a00640 1 --2- 172.21.15.103:0/2027488260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f74b00 0x558683f7ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.162+0000 7faa43400640 1 -- 172.21.15.103:0/2027488260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f74b00 msgr2=0x558683f7ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:59.166 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.162+0000 7faa43400640 1 --2- 172.21.15.103:0/2027488260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f74b00 0x558683f7ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.162+0000 7faa43400640 1 -- 172.21.15.103:0/2027488260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f6f790 msgr2=0x558683f7ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:10:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.162+0000 7faa43400640 1 --2- 172.21.15.103:0/2027488260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f6f790 0x558683f7ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.162+0000 7faa43400640 1 -- 172.21.15.103:0/2027488260 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558683f7f050 con 0x558683f720c0 2024-09-11T01:10:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.162+0000 7faa43e00640 1 --2- 172.21.15.103:0/2027488260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f6f790 0x558683f7ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:10:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.162+0000 7faa43400640 1 --2- 172.21.15.103:0/2027488260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f720c0 0x558683f805b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faa300e3910 tx=0x7faa300e3ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193366d6967bd901 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:10:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.162+0000 7faa2d600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:10:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.162+0000 7faa2d600640 1 -- 172.21.15.103:0/2027488260 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa300acd00 con 0x558683f720c0 2024-09-11T01:10:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.162+0000 7faa2d600640 1 -- 172.21.15.103:0/2027488260 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7faa30004320 con 0x558683f720c0 2024-09-11T01:10:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.162+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2027488260 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa300ac600 con 0x558683f720c0 2024-09-11T01:10:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.162+0000 7faa2d600640 1 -- 172.21.15.103:0/2027488260 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7faa300b10e0 con 0x558683f720c0 2024-09-11T01:10:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.162+0000 7faa4d8c7740 10 client.15660 fetch_fsmap learned FSMap version 28 2024-09-11T01:10:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.163+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2027488260 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558683ff2030 con 0x558683f720c0 2024-09-11T01:10:59.167 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.163+0000 7faa2d600640 1 -- 172.21.15.103:0/2027488260 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa300c3030 con 0x558683f720c0 2024-09-11T01:10:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.163+0000 7faa2d600640 1 -- 172.21.15.103:0/2027488260 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7faa300a7f50 con 0x558683f720c0 2024-09-11T01:10:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.163+0000 7faa4d8c7740 10 client.15660 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:10:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.163+0000 7faa4d8c7740 10 client.15660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:10:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.163+0000 7faa4d8c7740 20 client.15660 populate_metadata read hostname 'smithi103' 2024-09-11T01:10:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.163+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/2027488260 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558683ff2a90 0x558683ff4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:10:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.163+0000 7faa4d8c7740 4 client.15660 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:10:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.163+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2027488260 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558683edd4e0 con 0x558683ff2a90 2024-09-11T01:10:59.168 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.164+0000 7faa43e00640 1 --2- 172.21.15.103:0/2027488260 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558683ff2a90 0x558683ff4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:10:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.164+0000 7faa43e00640 1 --2- 172.21.15.103:0/2027488260 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558683ff2a90 0x558683ff4eb0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54c07b877edb6933 server_cookie=82f9bb9da73425eb in_seq=0 out_seq=0 2024-09-11T01:10:59.169 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.164+0000 7faa2d600640 10 client.15660 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.176+0000 7faa2d600640 1 -- 172.21.15.103:0/2027488260 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558683edd4e0 con 0x558683ff2a90 2024-09-11T01:10:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.176+0000 7faa2d600640 10 client.15660 handle_command_reply: tid=0 2024-09-11T01:10:59.177 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.176+0000 7faa4d8c7740 1 client.15660 shutdown 2024-09-11T01:10:59.178 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.176+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2027488260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f720c0 msgr2=0x558683f805b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.176+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/2027488260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f720c0 0x558683f805b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faa300e3910 tx=0x7faa300e3ae0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.177+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2027488260 shutdown_connections 2024-09-11T01:10:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.177+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/2027488260 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x558683ff2a90 0x558683ff4eb0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.177+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/2027488260 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x558683f74b00 0x558683f7ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.177+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/2027488260 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558683f720c0 0x558683f805b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.177+0000 7faa4d8c7740 1 --2- 172.21.15.103:0/2027488260 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x558683f6f790 0x558683f7ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.177+0000 7faa2d600640 0 client.15660 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:10:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.177+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2027488260 >> 172.21.15.103:0/2027488260 conn(0x558683f6a8e0 msgr2=0x558683f69240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:59.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.177+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2027488260 shutdown_connections 2024-09-11T01:10:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.177+0000 7faa4d8c7740 1 -- 172.21.15.103:0/2027488260 wait complete. 2024-09-11T01:10:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.177+0000 7faa4d8c7740 20 client.15660 trim_cache size 0 max 16384 2024-09-11T01:10:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:10:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:10:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:10:59.180 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:10:59.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.177+0000 7faa4aa00640 1 -- 172.21.15.103:0/3666239263 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faa280b5360 msgr2=0x7faa280b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:59.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.177+0000 7faa4aa00640 1 --2- 172.21.15.103:0/3666239263 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faa280b5360 0x7faa280b7820 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faa34009d00 tx=0x7faa34005f90 comp rx=0 tx=0).stop 2024-09-11T01:10:59.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.178+0000 7faa4aa00640 1 -- 172.21.15.103:0/3666239263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa44103ae0 msgr2=0x7faa44075540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:10:59.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.178+0000 7faa4aa00640 1 --2- 172.21.15.103:0/3666239263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa44103ae0 0x7faa44075540 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faa3000e9c0 tx=0x7faa3000ee80 comp rx=0 tx=0).stop 2024-09-11T01:10:59.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.178+0000 7faa4aa00640 1 -- 172.21.15.103:0/3666239263 shutdown_connections 2024-09-11T01:10:59.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.178+0000 7faa4aa00640 1 --2- 172.21.15.103:0/3666239263 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7faa280b5360 0x7faa280b7820 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.178+0000 7faa4aa00640 1 --2- 172.21.15.103:0/3666239263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7faa441044a0 0x7faa44075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.181 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.178+0000 7faa4aa00640 1 --2- 172.21.15.103:0/3666239263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa44103ae0 0x7faa44075540 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.178+0000 7faa4aa00640 1 --2- 172.21.15.103:0/3666239263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faa44102990 0x7faa44076ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:10:59.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.178+0000 7faa4aa00640 1 -- 172.21.15.103:0/3666239263 >> 172.21.15.103:0/3666239263 conn(0x7faa440fe250 msgr2=0x7faa44106eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:10:59.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.178+0000 7faa4aa00640 1 -- 172.21.15.103:0/3666239263 shutdown_connections 2024-09-11T01:10:59.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:10:59.178+0000 7faa4aa00640 1 -- 172.21.15.103:0/3666239263 wait complete. 2024-09-11T01:10:59.308 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:11:00.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.069+0000 7f00d9e00640 1 -- 172.21.15.103:0/3542585131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d410f220 msgr2=0x7f00d4111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:00.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.069+0000 7f00d9e00640 1 --2- 172.21.15.103:0/3542585131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d410f220 0x7f00d4111610 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f00cc009ca0 tx=0x7f00cc02a8c0 comp rx=0 tx=0).stop 2024-09-11T01:11:00.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.069+0000 7f00d9e00640 1 -- 172.21.15.103:0/3542585131 shutdown_connections 2024-09-11T01:11:00.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.069+0000 7f00d9e00640 1 --2- 172.21.15.103:0/3542585131 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d410f220 0x7f00d4111610 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:00.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.069+0000 7f00d9e00640 1 --2- 172.21.15.103:0/3542585131 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d4075f40 0x7f00d410ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:00.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.069+0000 7f00d9e00640 1 --2- 172.21.15.103:0/3542585131 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00d4075540 0x7f00d4075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:00.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.069+0000 7f00d9e00640 1 -- 172.21.15.103:0/3542585131 >> 172.21.15.103:0/3542585131 conn(0x7f00d40fe6d0 msgr2=0x7f00d4100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:00.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.069+0000 7f00d9e00640 1 -- 172.21.15.103:0/3542585131 shutdown_connections 2024-09-11T01:11:00.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.069+0000 7f00d9e00640 1 -- 172.21.15.103:0/3542585131 wait complete. 2024-09-11T01:11:00.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.070+0000 7f00d9e00640 1 Processor -- start 2024-09-11T01:11:00.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.070+0000 7f00d9e00640 1 -- start start 2024-09-11T01:11:00.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00d9e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00d4075540 0x7f00d419b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:00.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00d9e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d4075f40 0x7f00d419b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:00.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00d9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d410f220 0x7f00d41a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:00.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00d9e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00d4114e20 con 0x7f00d410f220 2024-09-11T01:11:00.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00d9e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f00d4114ca0 con 0x7f00d4075f40 2024-09-11T01:11:00.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00d9e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f00d4114fa0 con 0x7f00d4075540 2024-09-11T01:11:00.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00cbe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d4075f40 0x7f00d419b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:00.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00cbe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d4075f40 0x7f00d419b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:41534/0 (socket says 172.21.15.103:41534) 2024-09-11T01:11:00.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00cbe00640 1 -- 172.21.15.103:0/2197631124 learned_addr learned my addr 172.21.15.103:0/2197631124 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:00.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00d8a00640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00d4075540 0x7f00d419b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:00.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00cbe00640 1 -- 172.21.15.103:0/2197631124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00d4075540 msgr2=0x7f00d419b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:00.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00cbe00640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00d4075540 0x7f00d419b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:00.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00d9400640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d410f220 0x7f00d41a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:00.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00cbe00640 1 -- 172.21.15.103:0/2197631124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d410f220 msgr2=0x7f00d41a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:00.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00cbe00640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d410f220 0x7f00d41a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:00.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.071+0000 7f00cbe00640 1 -- 172.21.15.103:0/2197631124 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d41a12a0 con 0x7f00d4075f40 2024-09-11T01:11:00.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.072+0000 7f00d9400640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d410f220 0x7f00d41a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:11:00.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.072+0000 7f00cbe00640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d4075f40 0x7f00d419b730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00d950 tx=0x7f00bc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:00.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.072+0000 7f00d2000640 1 -- 172.21.15.103:0/2197631124 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc017030 con 0x7f00d4075f40 2024-09-11T01:11:00.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.072+0000 7f00d2000640 1 -- 172.21.15.103:0/2197631124 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00bc004020 con 0x7f00d4075f40 2024-09-11T01:11:00.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.072+0000 7f00d9e00640 1 -- 172.21.15.103:0/2197631124 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d41a1590 con 0x7f00d4075f40 2024-09-11T01:11:00.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.072+0000 7f00d2000640 1 -- 172.21.15.103:0/2197631124 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc0047a0 con 0x7f00d4075f40 2024-09-11T01:11:00.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.072+0000 7f00d9e00640 1 -- 172.21.15.103:0/2197631124 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d41a7e20 con 0x7f00d4075f40 2024-09-11T01:11:00.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.073+0000 7f00d9e00640 1 -- 172.21.15.103:0/2197631124 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d4075920 con 0x7f00d4075f40 2024-09-11T01:11:00.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.075+0000 7f00d2000640 1 -- 172.21.15.103:0/2197631124 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f00bc009a30 con 0x7f00d4075f40 2024-09-11T01:11:00.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.077+0000 7f00d2000640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f00b80b5410 0x7f00b80b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:00.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.077+0000 7f00d2000640 1 -- 172.21.15.103:0/2197631124 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f00bc0e5ff0 con 0x7f00d4075f40 2024-09-11T01:11:00.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.077+0000 7f00d8a00640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f00b80b5410 0x7f00b80b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:00.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.078+0000 7f00d8a00640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f00b80b5410 0x7f00b80b78d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f00c4009bd0 tx=0x7f00c4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:00.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.079+0000 7f00d2000640 1 -- 172.21.15.103:0/2197631124 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f00bc0acb20 con 0x7f00d4075f40 2024-09-11T01:11:00.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.306+0000 7f00d9e00640 1 -- 172.21.15.103:0/2197631124 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00d41a8050 con 0x7f00d4075f40 2024-09-11T01:11:00.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.307+0000 7f00d2000640 1 -- 172.21.15.103:0/2197631124 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11934 (secure 0 0 0) 0x7f00bc0ac420 con 0x7f00d4075f40 2024-09-11T01:11:00.309 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:11:00.309 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":28,"btime":"2024-09-11T01:09:42:655122+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:09:42.508953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[1,2],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24629,24619]},"id":1}]} 2024-09-11T01:11:00.310 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 28 2024-09-11T01:11:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.310+0000 7f00d9e00640 1 -- 172.21.15.103:0/2197631124 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f00b80b5410 msgr2=0x7f00b80b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.310+0000 7f00d9e00640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f00b80b5410 0x7f00b80b78d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f00c4009bd0 tx=0x7f00c4005f90 comp rx=0 tx=0).stop 2024-09-11T01:11:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.310+0000 7f00d9e00640 1 -- 172.21.15.103:0/2197631124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d4075f40 msgr2=0x7f00d419b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.310+0000 7f00d9e00640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d4075f40 0x7f00d419b730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00d950 tx=0x7f00bc00de10 comp rx=0 tx=0).stop 2024-09-11T01:11:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.310+0000 7f00d9e00640 1 -- 172.21.15.103:0/2197631124 shutdown_connections 2024-09-11T01:11:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.310+0000 7f00d9e00640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f00b80b5410 0x7f00b80b78d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.310+0000 7f00d9e00640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00d410f220 0x7f00d41a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.310+0000 7f00d9e00640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00d4075f40 0x7f00d419b730 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.310+0000 7f00d9e00640 1 --2- 172.21.15.103:0/2197631124 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f00d4075540 0x7f00d419b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.310+0000 7f00d9e00640 1 -- 172.21.15.103:0/2197631124 >> 172.21.15.103:0/2197631124 conn(0x7f00d40fe6d0 msgr2=0x7f00d40feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:00.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.310+0000 7f00d9e00640 1 -- 172.21.15.103:0/2197631124 shutdown_connections 2024-09-11T01:11:00.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:00.310+0000 7f00d9e00640 1 -- 172.21.15.103:0/2197631124 wait complete. 2024-09-11T01:11:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:00 smithi183 ceph-mon[34992]: pgmap v479: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 19 MiB/s wr, 15 op/s 2024-09-11T01:11:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:00 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2197631124' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:11:01.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:00 smithi103 ceph-mon[30562]: pgmap v479: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 19 MiB/s wr, 15 op/s 2024-09-11T01:11:01.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:00 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2197631124' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:11:01.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:00 smithi117 ceph-mon[35358]: pgmap v479: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 19 MiB/s wr, 15 op/s 2024-09-11T01:11:01.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:00 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2197631124' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:11:01.197 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24665 quiesce db --set-id d6e0e76c --release --await' 2024-09-11T01:11:01.197 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24665 quiesce db --set-id d6e0e76c --release --await 2024-09-11T01:11:01.573 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:11:01.922 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:01 smithi103 ceph-mon[30562]: pgmap v480: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8.3 MiB/s wr, 11 op/s 2024-09-11T01:11:02.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:01 smithi117 ceph-mon[35358]: pgmap v480: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8.3 MiB/s wr, 11 op/s 2024-09-11T01:11:02.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:01 smithi183 ceph-mon[34992]: pgmap v480: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8.3 MiB/s wr, 11 op/s 2024-09-11T01:11:02.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.249+0000 7f5a86800640 1 -- 172.21.15.103:0/981847918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a80102c10 msgr2=0x7f5a80102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:02.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.249+0000 7f5a86800640 1 --2- 172.21.15.103:0/981847918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a80102c10 0x7f5a80102ff0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5a74009ca0 tx=0x7f5a7402a8c0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.249+0000 7f5a86800640 1 -- 172.21.15.103:0/981847918 shutdown_connections 2024-09-11T01:11:02.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.249+0000 7f5a86800640 1 --2- 172.21.15.103:0/981847918 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a80108fa0 0x7f5a8010f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.249+0000 7f5a86800640 1 --2- 172.21.15.103:0/981847918 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a80108620 0x7f5a80108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.249+0000 7f5a86800640 1 --2- 172.21.15.103:0/981847918 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a80102c10 0x7f5a80102ff0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.249+0000 7f5a86800640 1 -- 172.21.15.103:0/981847918 >> 172.21.15.103:0/981847918 conn(0x7f5a800fe660 msgr2=0x7f5a80100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:02.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.249+0000 7f5a86800640 1 -- 172.21.15.103:0/981847918 shutdown_connections 2024-09-11T01:11:02.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.249+0000 7f5a86800640 1 -- 172.21.15.103:0/981847918 wait complete. 2024-09-11T01:11:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.250+0000 7f5a86800640 1 Processor -- start 2024-09-11T01:11:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.250+0000 7f5a86800640 1 -- start start 2024-09-11T01:11:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a86800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a80102c10 0x7f5a8019b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a86800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a80108620 0x7f5a8019b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a86800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a80108fa0 0x7f5a801a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a86800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5a80112c60 con 0x7f5a80102c10 2024-09-11T01:11:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a86800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5a80112ae0 con 0x7f5a80108fa0 2024-09-11T01:11:02.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a86800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5a80112de0 con 0x7f5a80108620 2024-09-11T01:11:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a85400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a80102c10 0x7f5a8019b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a85400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a80102c10 0x7f5a8019b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52282/0 (socket says 172.21.15.103:52282) 2024-09-11T01:11:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a84a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a80108620 0x7f5a8019b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a85400640 1 -- 172.21.15.103:0/3444656925 learned_addr learned my addr 172.21.15.103:0/3444656925 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a85e00640 1 --2- 172.21.15.103:0/3444656925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a80108fa0 0x7f5a801a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a84a00640 1 -- 172.21.15.103:0/3444656925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a80108fa0 msgr2=0x7f5a801a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a84a00640 1 --2- 172.21.15.103:0/3444656925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a80108fa0 0x7f5a801a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a84a00640 1 -- 172.21.15.103:0/3444656925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a80102c10 msgr2=0x7f5a8019b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a84a00640 1 --2- 172.21.15.103:0/3444656925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a80102c10 0x7f5a8019b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.251+0000 7f5a84a00640 1 -- 172.21.15.103:0/3444656925 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a801a1360 con 0x7f5a80108620 2024-09-11T01:11:02.254 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.252+0000 7f5a84a00640 1 --2- 172.21.15.103:0/3444656925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a80108620 0x7f5a8019b7f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00e9f0 tx=0x7f5a6c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:02.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.252+0000 7f5a7e000640 1 -- 172.21.15.103:0/3444656925 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c00ccc0 con 0x7f5a80108620 2024-09-11T01:11:02.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.252+0000 7f5a86800640 1 -- 172.21.15.103:0/3444656925 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a801a1650 con 0x7f5a80108620 2024-09-11T01:11:02.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.252+0000 7f5a7e000640 1 -- 172.21.15.103:0/3444656925 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a6c0108e0 con 0x7f5a80108620 2024-09-11T01:11:02.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.252+0000 7f5a7e000640 1 -- 172.21.15.103:0/3444656925 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c018880 con 0x7f5a80108620 2024-09-11T01:11:02.255 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.252+0000 7f5a86800640 1 -- 172.21.15.103:0/3444656925 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a801a7ee0 con 0x7f5a80108620 2024-09-11T01:11:02.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.256+0000 7f5a8a8bc740 1 Processor -- start 2024-09-11T01:11:02.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.256+0000 7f5a8a8bc740 1 -- start start 2024-09-11T01:11:02.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.256+0000 7f5a8a8bc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d601d0 0x55e1f7d605b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.256+0000 7f5a8a8bc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d60af0 0x55e1f7d6c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a8a8bc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d6ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a8a8bc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e1f7cd7290 con 0x55e1f7d601d0 2024-09-11T01:11:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a8a8bc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e1f7cc66c0 con 0x55e1f7d6ca80 2024-09-11T01:11:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a8a8bc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e1f7cca4d0 con 0x55e1f7d60af0 2024-09-11T01:11:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d601d0 0x55e1f7d605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d601d0 0x55e1f7d605b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52290/0 (socket says 172.21.15.103:52290) 2024-09-11T01:11:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a85e00640 1 -- 172.21.15.103:0/841562399 learned_addr learned my addr 172.21.15.103:0/841562399 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a85400640 1 --2- 172.21.15.103:0/841562399 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d60af0 0x55e1f7d6c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a7e000640 1 -- 172.21.15.103:0/3444656925 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f5a6c010430 con 0x7f5a80108620 2024-09-11T01:11:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a85e00640 1 -- 172.21.15.103:0/841562399 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d60af0 msgr2=0x55e1f7d6c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a85e00640 1 --2- 172.21.15.103:0/841562399 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d60af0 0x55e1f7d6c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a85e00640 1 -- 172.21.15.103:0/841562399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d6ca80 msgr2=0x55e1f7d6ee70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T01:11:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a85e00640 1 --2- 172.21.15.103:0/841562399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d6ee70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a85e00640 1 -- 172.21.15.103:0/841562399 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1f7c53460 con 0x55e1f7d601d0 2024-09-11T01:11:02.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.257+0000 7f5a85400640 1 --2- 172.21.15.103:0/841562399 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d60af0 0x55e1f7d6c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:11:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.258+0000 7f5a85e00640 1 --2- 172.21.15.103:0/841562399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d601d0 0x55e1f7d605b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009c50 tx=0x7f5a78011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=451f33f1729ae5cf server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.258+0000 7f5a72600640 1 -- 172.21.15.103:0/841562399 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7801e070 con 0x55e1f7d601d0 2024-09-11T01:11:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.258+0000 7f5a72600640 1 -- 172.21.15.103:0/841562399 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a78019ae0 con 0x55e1f7d601d0 2024-09-11T01:11:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.258+0000 7f5a72600640 1 -- 172.21.15.103:0/841562399 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7800e9f0 con 0x55e1f7d601d0 2024-09-11T01:11:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.259+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/841562399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d601d0 msgr2=0x55e1f7d605b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.259+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/841562399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d601d0 0x55e1f7d605b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5a78009c50 tx=0x7f5a78011810 comp rx=0 tx=0).stop 2024-09-11T01:11:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.259+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/841562399 shutdown_connections 2024-09-11T01:11:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.259+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/841562399 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d6ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.259+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/841562399 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d60af0 0x55e1f7d6c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.259+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/841562399 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d601d0 0x55e1f7d605b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.259+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/841562399 >> 172.21.15.103:0/841562399 conn(0x55e1f7d5e000 msgr2=0x55e1f7d5f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.259+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/841562399 shutdown_connections 2024-09-11T01:11:02.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.259+0000 7f5a7e000640 1 --2- 172.21.15.103:0/3444656925 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5a680b5320 0x7f5a680b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.259+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/841562399 wait complete. 2024-09-11T01:11:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.259+0000 7f5a7e000640 1 -- 172.21.15.103:0/3444656925 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5a6c0e6230 con 0x7f5a80108620 2024-09-11T01:11:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.259+0000 7f5a85400640 1 --2- 172.21.15.103:0/3444656925 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5a680b5320 0x7f5a680b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.260+0000 7f5a8a8bc740 1 -- start start 2024-09-11T01:11:02.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.260+0000 7f5a8a8bc740 1 Processor -- start 2024-09-11T01:11:02.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.260+0000 7f5a85400640 1 --2- 172.21.15.103:0/3444656925 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5a680b5320 0x7f5a680b77e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55e1f7d63350 tx=0x7f5a74005f30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:02.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.260+0000 7f5a8a8bc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d601d0 0x55e1f7d69aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.260+0000 7f5a8a8bc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d60af0 0x55e1f7d69fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.260+0000 7f5a8a8bc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d6a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.260+0000 7f5a8a8bc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55e1f7b27bb0 con 0x55e1f7d601d0 2024-09-11T01:11:02.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.260+0000 7f5a8a8bc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55e1f7c616c0 con 0x55e1f7d60af0 2024-09-11T01:11:02.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.260+0000 7f5a8a8bc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55e1f7d6f730 con 0x55e1f7d6ca80 2024-09-11T01:11:02.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.260+0000 7f5a8a8bc740 10 client.0 _ll_register_callbacks cb 0x55e1f7c7c490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:11:02.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.261+0000 7f5a85400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d601d0 0x55e1f7d69aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.261+0000 7f5a84a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d60af0 0x55e1f7d69fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.261+0000 7f5a85400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d601d0 0x55e1f7d69aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52304/0 (socket says 172.21.15.103:52304) 2024-09-11T01:11:02.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.261+0000 7f5a85400640 1 -- 172.21.15.103:0/3910032833 learned_addr learned my addr 172.21.15.103:0/3910032833 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:02.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.261+0000 7f5a85e00640 1 --2- 172.21.15.103:0/3910032833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d6a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.261+0000 7f5a85400640 1 -- 172.21.15.103:0/3910032833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 msgr2=0x55e1f7d6a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:02.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.261+0000 7f5a85400640 1 --2- 172.21.15.103:0/3910032833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d6a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.261+0000 7f5a85400640 1 -- 172.21.15.103:0/3910032833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d60af0 msgr2=0x55e1f7d69fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:02.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.261+0000 7f5a85400640 1 --2- 172.21.15.103:0/3910032833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d60af0 0x55e1f7d69fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.261+0000 7f5a85400640 1 -- 172.21.15.103:0/3910032833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1f7a24b00 con 0x55e1f7d601d0 2024-09-11T01:11:02.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.261+0000 7f5a85400640 1 --2- 172.21.15.103:0/3910032833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d601d0 0x55e1f7d69aa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5a74006010 tx=0x7f5a7402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba9cbefe274352f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:02.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.261+0000 7f5a66a00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:11:02.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.262+0000 7f5a66a00640 1 -- 172.21.15.103:0/3910032833 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74003b80 con 0x55e1f7d601d0 2024-09-11T01:11:02.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.262+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/3910032833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a78019ae0 con 0x55e1f7d601d0 2024-09-11T01:11:02.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.262+0000 7f5a66a00640 1 -- 172.21.15.103:0/3910032833 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5a74003d20 con 0x55e1f7d601d0 2024-09-11T01:11:02.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.262+0000 7f5a66a00640 1 -- 172.21.15.103:0/3910032833 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5a74004040 con 0x55e1f7d601d0 2024-09-11T01:11:02.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.262+0000 7f5a8a8bc740 10 client.15675 fetch_fsmap learned FSMap version 28 2024-09-11T01:11:02.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.262+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/3910032833 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e1f7a9b960 con 0x55e1f7d601d0 2024-09-11T01:11:02.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.263+0000 7f5a66a00640 1 -- 172.21.15.103:0/3910032833 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a78019ae0 con 0x55e1f7d601d0 2024-09-11T01:11:02.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.263+0000 7f5a66a00640 1 -- 172.21.15.103:0/3910032833 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f5a74051070 con 0x55e1f7d601d0 2024-09-11T01:11:02.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.263+0000 7f5a8a8bc740 10 client.15675 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:11:02.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.263+0000 7f5a8a8bc740 10 client.15675 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:11:02.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.263+0000 7f5a8a8bc740 20 client.15675 populate_metadata read hostname 'smithi103' 2024-09-11T01:11:02.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.263+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/3910032833 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1f7d7c5b0 0x55e1f7d7ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.263+0000 7f5a8a8bc740 4 client.15675 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:11:02.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.263+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/3910032833 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e1f7cd91e0 con 0x55e1f7d7c5b0 2024-09-11T01:11:02.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.263+0000 7f5a84a00640 1 --2- 172.21.15.103:0/3910032833 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1f7d7c5b0 0x55e1f7d7ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.264+0000 7f5a84a00640 1 --2- 172.21.15.103:0/3910032833 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1f7d7c5b0 0x55e1f7d7ea30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0316a9837d86073 server_cookie=b2ce7614d61da5ac in_seq=0 out_seq=0 2024-09-11T01:11:02.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.264+0000 7f5a66a00640 10 client.15675 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.265+0000 7f5a66a00640 1 -- 172.21.15.103:0/3910032833 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e1f7cd91e0 con 0x55e1f7d7c5b0 2024-09-11T01:11:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.265+0000 7f5a66a00640 10 client.15675 handle_command_reply: tid=0 2024-09-11T01:11:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.265+0000 7f5a8a8bc740 1 client.15675 shutdown 2024-09-11T01:11:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.265+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/3910032833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d601d0 msgr2=0x55e1f7d69aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.265+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/3910032833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d601d0 0x55e1f7d69aa0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5a74006010 tx=0x7f5a7402a8c0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.265+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/3910032833 shutdown_connections 2024-09-11T01:11:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.265+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/3910032833 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1f7d7c5b0 0x55e1f7d7ea30 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.265+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/3910032833 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d6a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.265+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/3910032833 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d60af0 0x55e1f7d69fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.265+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/3910032833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d601d0 0x55e1f7d69aa0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.265+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/3910032833 >> 172.21.15.103:0/3910032833 conn(0x55e1f7d5e000 msgr2=0x55e1f7d63ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.265+0000 7f5a66a00640 0 client.15675 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.265+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/3910032833 shutdown_connections 2024-09-11T01:11:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.265+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/3910032833 wait complete. 2024-09-11T01:11:02.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.266+0000 7f5a8a8bc740 20 client.15675 trim_cache size 0 max 16384 2024-09-11T01:11:02.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.283+0000 7f5a8a8bc740 1 Processor -- start 2024-09-11T01:11:02.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.283+0000 7f5a8a8bc740 1 -- start start 2024-09-11T01:11:02.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a8a8bc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d601d0 0x55e1f7d6b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a8a8bc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d60af0 0x55e1f7d66cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a8a8bc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d671f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a8a8bc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801b4440 con 0x55e1f7d60af0 2024-09-11T01:11:02.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a8a8bc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801b1ce0 con 0x55e1f7d601d0 2024-09-11T01:11:02.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a8a8bc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801afb30 con 0x55e1f7d6ca80 2024-09-11T01:11:02.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a84a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d60af0 0x55e1f7d66cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a84a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d60af0 0x55e1f7d66cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52310/0 (socket says 172.21.15.103:52310) 2024-09-11T01:11:02.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a84a00640 1 -- 172.21.15.103:0/607493694 learned_addr learned my addr 172.21.15.103:0/607493694 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:02.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a85e00640 1 --2- 172.21.15.103:0/607493694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d671f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a85400640 1 --2- 172.21.15.103:0/607493694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d601d0 0x55e1f7d6b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a84a00640 1 -- 172.21.15.103:0/607493694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 msgr2=0x55e1f7d671f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:02.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a84a00640 1 --2- 172.21.15.103:0/607493694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d671f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a84a00640 1 -- 172.21.15.103:0/607493694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d601d0 msgr2=0x55e1f7d6b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:02.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a84a00640 1 --2- 172.21.15.103:0/607493694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d601d0 0x55e1f7d6b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.284+0000 7f5a84a00640 1 -- 172.21.15.103:0/607493694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1f7d68a00 con 0x55e1f7d60af0 2024-09-11T01:11:02.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.285+0000 7f5a84a00640 1 --2- 172.21.15.103:0/607493694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d60af0 0x55e1f7d66cb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c000c00 tx=0x7f5a6c00cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29ae163a21b2c8d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:02.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.285+0000 7f5a71c00640 1 -- 172.21.15.103:0/607493694 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0ac6f0 con 0x55e1f7d60af0 2024-09-11T01:11:02.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.285+0000 7f5a71c00640 1 -- 172.21.15.103:0/607493694 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a6c0b1120 con 0x55e1f7d60af0 2024-09-11T01:11:02.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.285+0000 7f5a71c00640 1 -- 172.21.15.103:0/607493694 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0a8040 con 0x55e1f7d60af0 2024-09-11T01:11:02.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.285+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/607493694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d60af0 msgr2=0x55e1f7d66cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:02.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.285+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/607493694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d60af0 0x55e1f7d66cb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c000c00 tx=0x7f5a6c00cef0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.286+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/607493694 shutdown_connections 2024-09-11T01:11:02.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.286+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/607493694 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d671f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.286+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/607493694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d60af0 0x55e1f7d66cb0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.286+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/607493694 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d601d0 0x55e1f7d6b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.286+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/607493694 >> 172.21.15.103:0/607493694 conn(0x55e1f7d5e000 msgr2=0x55e1f7d6b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:02.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.286+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/607493694 shutdown_connections 2024-09-11T01:11:02.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.286+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/607493694 wait complete. 2024-09-11T01:11:02.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.286+0000 7f5a8a8bc740 1 -- start start 2024-09-11T01:11:02.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.286+0000 7f5a8a8bc740 1 Processor -- start 2024-09-11T01:11:02.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a8a8bc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d601d0 0x55e1f7d751e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a8a8bc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d60af0 0x55e1f7d716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a8a8bc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d71c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a8a8bc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801b01a0 con 0x55e1f7d60af0 2024-09-11T01:11:02.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a8a8bc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801b1610 con 0x55e1f7d601d0 2024-09-11T01:11:02.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a8a8bc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5a801b0870 con 0x55e1f7d6ca80 2024-09-11T01:11:02.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a8a8bc740 10 client.0 _ll_register_callbacks cb 0x7f5a74009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:11:02.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a84a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d60af0 0x55e1f7d716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a85400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d601d0 0x55e1f7d751e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a84a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d60af0 0x55e1f7d716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52320/0 (socket says 172.21.15.103:52320) 2024-09-11T01:11:02.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a84a00640 1 -- 172.21.15.103:0/2355969251 learned_addr learned my addr 172.21.15.103:0/2355969251 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:02.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a85e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d71c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a85400640 1 -- 172.21.15.103:0/2355969251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 msgr2=0x55e1f7d71c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:02.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a85400640 1 --2- 172.21.15.103:0/2355969251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d71c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a85400640 1 -- 172.21.15.103:0/2355969251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d60af0 msgr2=0x55e1f7d716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a85400640 1 --2- 172.21.15.103:0/2355969251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d60af0 0x55e1f7d716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a85400640 1 -- 172.21.15.103:0/2355969251 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1f7d72470 con 0x55e1f7d601d0 2024-09-11T01:11:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.287+0000 7f5a84a00640 1 --2- 172.21.15.103:0/2355969251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d60af0 0x55e1f7d716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:11:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.288+0000 7f5a85400640 1 --2- 172.21.15.103:0/2355969251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d601d0 0x55e1f7d751e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5a74004af0 tx=0x7f5a74031fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e3658964b0c68b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.288+0000 7f5a66a00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:11:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.288+0000 7f5a66a00640 1 -- 172.21.15.103:0/2355969251 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7402f860 con 0x55e1f7d601d0 2024-09-11T01:11:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.288+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/2355969251 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a6c0b1120 con 0x55e1f7d601d0 2024-09-11T01:11:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.288+0000 7f5a66a00640 1 -- 172.21.15.103:0/2355969251 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5a740041e0 con 0x55e1f7d601d0 2024-09-11T01:11:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.288+0000 7f5a66a00640 1 -- 172.21.15.103:0/2355969251 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5a74005c70 con 0x55e1f7d601d0 2024-09-11T01:11:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.288+0000 7f5a8a8bc740 10 client.25718 fetch_fsmap learned FSMap version 28 2024-09-11T01:11:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.288+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/2355969251 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e1f7df2e40 con 0x55e1f7d601d0 2024-09-11T01:11:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.289+0000 7f5a66a00640 1 -- 172.21.15.103:0/2355969251 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a6c0b1120 con 0x55e1f7d601d0 2024-09-11T01:11:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.289+0000 7f5a66a00640 1 -- 172.21.15.103:0/2355969251 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f5a74051040 con 0x55e1f7d601d0 2024-09-11T01:11:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.289+0000 7f5a8a8bc740 10 client.25718 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:11:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.289+0000 7f5a8a8bc740 10 client.25718 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:11:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.289+0000 7f5a8a8bc740 20 client.25718 populate_metadata read hostname 'smithi103' 2024-09-11T01:11:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.289+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/2355969251 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1f7df3670 0x55e1f7df5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.289+0000 7f5a8a8bc740 4 client.25718 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d6e0e76c", "release": true, "await": true}] 2024-09-11T01:11:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.289+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/2355969251 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d6e0e76c", "release": true, "await": true}) -- 0x55e1f7cd4c90 con 0x55e1f7df3670 2024-09-11T01:11:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.289+0000 7f5a84a00640 1 --2- 172.21.15.103:0/2355969251 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1f7df3670 0x55e1f7df5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:02.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.290+0000 7f5a84a00640 1 --2- 172.21.15.103:0/2355969251 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1f7df3670 0x55e1f7df5a90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a94ad2c2398e5d1 server_cookie=d09bf4361b0fa014 in_seq=0 out_seq=0 2024-09-11T01:11:02.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.290+0000 7f5a66a00640 10 client.25718 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:02.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.300+0000 7f5a66a00640 1 -- 172.21.15.103:0/2355969251 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e1f7cd4c90 con 0x55e1f7df3670 2024-09-11T01:11:02.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.300+0000 7f5a66a00640 10 client.25718 handle_command_reply: tid=0 2024-09-11T01:11:02.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.300+0000 7f5a8a8bc740 1 client.25718 shutdown 2024-09-11T01:11:02.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.301+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/2355969251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d601d0 msgr2=0x55e1f7d751e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:02.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.301+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/2355969251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d601d0 0x55e1f7d751e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5a74004af0 tx=0x7f5a74031fd0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.301+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/2355969251 shutdown_connections 2024-09-11T01:11:02.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.301+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/2355969251 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55e1f7df3670 0x55e1f7df5a90 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.301+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/2355969251 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55e1f7d6ca80 0x55e1f7d71c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.301+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/2355969251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55e1f7d60af0 0x55e1f7d716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.301+0000 7f5a8a8bc740 1 --2- 172.21.15.103:0/2355969251 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55e1f7d601d0 0x55e1f7d751e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.301+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/2355969251 >> 172.21.15.103:0/2355969251 conn(0x55e1f7d5e000 msgr2=0x55e1f7d5d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:02.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.301+0000 7f5a66a00640 0 client.25718 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:02.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.301+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/2355969251 shutdown_connections 2024-09-11T01:11:02.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.301+0000 7f5a8a8bc740 1 -- 172.21.15.103:0/2355969251 wait complete. 2024-09-11T01:11:02.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.301+0000 7f5a8a8bc740 20 client.25718 trim_cache size 0 max 16384 2024-09-11T01:11:02.304 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:11:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 28, 2024-09-11T01:11:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24665, 2024-09-11T01:11:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 12, 2024-09-11T01:11:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-09-11T01:11:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "d6e0e76c": { 2024-09-11T01:11:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 12, 2024-09-11T01:11:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-09-11T01:11:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:11:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RELEASED", 2024-09-11T01:11:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:11:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:11:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-09-11T01:11:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 140.5, 2024-09-11T01:11:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-09-11T01:11:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-09-11T01:11:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-09-11T01:11:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:11:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RELEASED", 2024-09-11T01:11:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:11:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:11:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:11:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:11:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:11:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:11:02.306 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:11:02.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.302+0000 7f5a86800640 1 -- 172.21.15.103:0/3444656925 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5a680b5320 msgr2=0x7f5a680b77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:02.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.302+0000 7f5a86800640 1 --2- 172.21.15.103:0/3444656925 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5a680b5320 0x7f5a680b77e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55e1f7d63350 tx=0x7f5a74005f30 comp rx=0 tx=0).stop 2024-09-11T01:11:02.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.302+0000 7f5a86800640 1 -- 172.21.15.103:0/3444656925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a80108620 msgr2=0x7f5a8019b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:02.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.302+0000 7f5a86800640 1 --2- 172.21.15.103:0/3444656925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a80108620 0x7f5a8019b7f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00e9f0 tx=0x7f5a6c00eeb0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.302+0000 7f5a86800640 1 -- 172.21.15.103:0/3444656925 shutdown_connections 2024-09-11T01:11:02.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.302+0000 7f5a86800640 1 --2- 172.21.15.103:0/3444656925 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5a680b5320 0x7f5a680b77e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.302+0000 7f5a86800640 1 --2- 172.21.15.103:0/3444656925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5a80108fa0 0x7f5a801a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.302+0000 7f5a86800640 1 --2- 172.21.15.103:0/3444656925 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5a80108620 0x7f5a8019b7f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.302+0000 7f5a86800640 1 --2- 172.21.15.103:0/3444656925 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5a80102c10 0x7f5a8019b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:02.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.302+0000 7f5a86800640 1 -- 172.21.15.103:0/3444656925 >> 172.21.15.103:0/3444656925 conn(0x7f5a800fe660 msgr2=0x7f5a801043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:02.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.302+0000 7f5a86800640 1 -- 172.21.15.103:0/3444656925 shutdown_connections 2024-09-11T01:11:02.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:11:02.302+0000 7f5a86800640 1 -- 172.21.15.103:0/3444656925 wait complete. 2024-09-11T01:11:03.233 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd6e0e76c', total seconds elapsed: 24.8 2024-09-11T01:11:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:04 smithi183 ceph-mon[34992]: pgmap v481: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.3 MiB/s wr, 14 op/s 2024-09-11T01:11:05.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:04 smithi103 ceph-mon[30562]: pgmap v481: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.3 MiB/s wr, 14 op/s 2024-09-11T01:11:05.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:04 smithi117 ceph-mon[35358]: pgmap v481: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 8.3 MiB/s wr, 14 op/s 2024-09-11T01:11:06.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:05 smithi103 ceph-mon[30562]: pgmap v482: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-09-11T01:11:06.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:05 smithi117 ceph-mon[35358]: pgmap v482: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-09-11T01:11:06.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:05 smithi183 ceph-mon[34992]: pgmap v482: 129 pgs: 129 active+clean; 7.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.3 MiB/s wr, 11 op/s 2024-09-11T01:11:08.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:07 smithi103 ceph-mon[30562]: pgmap v483: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-09-11T01:11:08.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:07 smithi117 ceph-mon[35358]: pgmap v483: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-09-11T01:11:08.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:07 smithi183 ceph-mon[34992]: pgmap v483: 129 pgs: 129 active+clean; 7.9 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 3.3 MiB/s wr, 12 op/s 2024-09-11T01:11:10.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:10 smithi103 ceph-mon[30562]: pgmap v484: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 59 MiB/s wr, 38 op/s 2024-09-11T01:11:11.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:10 smithi117 ceph-mon[35358]: pgmap v484: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 59 MiB/s wr, 38 op/s 2024-09-11T01:11:11.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:10 smithi183 ceph-mon[34992]: pgmap v484: 129 pgs: 129 active+clean; 8.5 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 59 MiB/s wr, 38 op/s 2024-09-11T01:11:12.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:11 smithi103 ceph-mon[30562]: pgmap v485: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 85 MiB/s wr, 44 op/s 2024-09-11T01:11:12.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:11 smithi117 ceph-mon[35358]: pgmap v485: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 85 MiB/s wr, 44 op/s 2024-09-11T01:11:12.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:11 smithi183 ceph-mon[34992]: pgmap v485: 129 pgs: 129 active+clean; 8.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 85 MiB/s wr, 44 op/s 2024-09-11T01:11:12.257 INFO:tasks.workunit.client.0.smithi103.stdout:fs setup took 79 secs 2024-09-11T01:11:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.387+0000 7ffbc3e00640 1 -- 172.21.15.103:0/2651877299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbc41084b0 msgr2=0x7ffbc410a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.387+0000 7ffbc3e00640 1 --2- 172.21.15.103:0/2651877299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbc41084b0 0x7ffbc410a970 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc009ca0 tx=0x7ffbbc02a8c0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.387+0000 7ffbc3e00640 1 -- 172.21.15.103:0/2651877299 shutdown_connections 2024-09-11T01:11:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.387+0000 7ffbc3e00640 1 --2- 172.21.15.103:0/2651877299 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbc41084b0 0x7ffbc410a970 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.387+0000 7ffbc3e00640 1 --2- 172.21.15.103:0/2651877299 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbc4105920 0x7ffbc4107d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.387+0000 7ffbc3e00640 1 --2- 172.21.15.103:0/2651877299 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc406b3f0 0x7ffbc41053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.387+0000 7ffbc3e00640 1 -- 172.21.15.103:0/2651877299 >> 172.21.15.103:0/2651877299 conn(0x7ffbc40fcf30 msgr2=0x7ffbc40ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.387+0000 7ffbc3e00640 1 -- 172.21.15.103:0/2651877299 shutdown_connections 2024-09-11T01:11:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.387+0000 7ffbc3e00640 1 -- 172.21.15.103:0/2651877299 wait complete. 2024-09-11T01:11:12.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.389+0000 7ffbc3e00640 1 Processor -- start 2024-09-11T01:11:12.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.389+0000 7ffbc3e00640 1 -- start start 2024-09-11T01:11:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.390+0000 7ffbc3e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbc406b3f0 0x7ffbc4198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.390+0000 7ffbc3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc4105920 0x7ffbc4199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.390+0000 7ffbc3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbc41084b0 0x7ffbc4199d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.390+0000 7ffbc3e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc410e460 con 0x7ffbc41084b0 2024-09-11T01:11:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.390+0000 7ffbc3e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc410e2e0 con 0x7ffbc4105920 2024-09-11T01:11:12.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.390+0000 7ffbc3e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc410e5e0 con 0x7ffbc406b3f0 2024-09-11T01:11:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.391+0000 7ffbc2a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbc406b3f0 0x7ffbc4198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.391+0000 7ffbc2a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbc406b3f0 0x7ffbc4198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:55112/0 (socket says 172.21.15.103:55112) 2024-09-11T01:11:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.391+0000 7ffbc2a00640 1 -- 172.21.15.103:0/3480922654 learned_addr learned my addr 172.21.15.103:0/3480922654 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.391+0000 7ffbc2000640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc4105920 0x7ffbc4199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.391+0000 7ffbc3400640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbc41084b0 0x7ffbc4199d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.391+0000 7ffbc2000640 1 -- 172.21.15.103:0/3480922654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbc406b3f0 msgr2=0x7ffbc4198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.391+0000 7ffbc2000640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbc406b3f0 0x7ffbc4198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.391+0000 7ffbc2000640 1 -- 172.21.15.103:0/3480922654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbc41084b0 msgr2=0x7ffbc4199d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:12.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.391+0000 7ffbc2000640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbc41084b0 0x7ffbc4199d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.391+0000 7ffbc2000640 1 -- 172.21.15.103:0/3480922654 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc419a600 con 0x7ffbc4105920 2024-09-11T01:11:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.391+0000 7ffbc2a00640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbc406b3f0 0x7ffbc4198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:11:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.392+0000 7ffbc2000640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc4105920 0x7ffbc4199110 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000c940 tx=0x7ffbb000ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:12.394 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.392+0000 7ffbbb400640 1 -- 172.21.15.103:0/3480922654 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0007bb0 con 0x7ffbc4105920 2024-09-11T01:11:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.392+0000 7ffbbb400640 1 -- 172.21.15.103:0/3480922654 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb0007d50 con 0x7ffbc4105920 2024-09-11T01:11:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.392+0000 7ffbbb400640 1 -- 172.21.15.103:0/3480922654 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb00187c0 con 0x7ffbc4105920 2024-09-11T01:11:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.393+0000 7ffbc3e00640 1 -- 172.21.15.103:0/3480922654 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc419a8f0 con 0x7ffbc4105920 2024-09-11T01:11:12.395 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.393+0000 7ffbc3e00640 1 -- 172.21.15.103:0/3480922654 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc41a0fc0 con 0x7ffbc4105920 2024-09-11T01:11:12.398 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.396+0000 7ffbcc9f6740 1 Processor -- start 2024-09-11T01:11:12.398 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.397+0000 7ffbcc9f6740 1 -- start start 2024-09-11T01:11:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.397+0000 7ffbcc9f6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff9863f970 0x55ff98641d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.397+0000 7ffbcc9f6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff986422c0 0x55ff98642740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.397+0000 7ffbcc9f6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff98642cd0 0x55ff98643180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.397+0000 7ffbcc9f6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ff985b26b0 con 0x55ff9863f970 2024-09-11T01:11:12.399 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.397+0000 7ffbcc9f6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ff985a1ae0 con 0x55ff98642cd0 2024-09-11T01:11:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.397+0000 7ffbcc9f6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ff985a58f0 con 0x55ff986422c0 2024-09-11T01:11:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.398+0000 7ffbc2a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff986422c0 0x55ff98642740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.398+0000 7ffbc3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff9863f970 0x55ff98641d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.398+0000 7ffbc3400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff9863f970 0x55ff98641d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43060/0 (socket says 172.21.15.103:43060) 2024-09-11T01:11:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.398+0000 7ffbc3400640 1 -- 172.21.15.103:0/2349622466 learned_addr learned my addr 172.21.15.103:0/2349622466 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.398+0000 7ffbc3400640 1 -- 172.21.15.103:0/2349622466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff986422c0 msgr2=0x55ff98642740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.398+0000 7ffbc3400640 1 --2- 172.21.15.103:0/2349622466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff986422c0 0x55ff98642740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.398+0000 7ffbc3400640 1 -- 172.21.15.103:0/2349622466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff98642cd0 msgr2=0x55ff98643180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:11:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.398+0000 7ffbc3400640 1 --2- 172.21.15.103:0/2349622466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff98642cd0 0x55ff98643180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.400 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.398+0000 7ffbc3400640 1 -- 172.21.15.103:0/2349622466 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff9856e780 con 0x55ff9863f970 2024-09-11T01:11:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.399+0000 7ffbc3400640 1 --2- 172.21.15.103:0/2349622466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff9863f970 0x55ff98641d80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc02f530 tx=0x7ffbbc009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ed271e53944c92 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.399+0000 7ffbbb400640 1 -- 172.21.15.103:0/3480922654 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7ffbb0020020 con 0x7ffbc4105920 2024-09-11T01:11:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.399+0000 7ffbafe00640 1 -- 172.21.15.103:0/2349622466 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc031450 con 0x55ff9863f970 2024-09-11T01:11:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.399+0000 7ffbafe00640 1 -- 172.21.15.103:0/2349622466 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbbc036070 con 0x55ff9863f970 2024-09-11T01:11:12.401 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.399+0000 7ffbafe00640 1 -- 172.21.15.103:0/2349622466 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc004600 con 0x55ff9863f970 2024-09-11T01:11:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.401+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/2349622466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff9863f970 msgr2=0x55ff98641d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:12.402 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.401+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/2349622466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff9863f970 0x55ff98641d80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc02f530 tx=0x7ffbbc009360 comp rx=0 tx=0).stop 2024-09-11T01:11:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.401+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/2349622466 shutdown_connections 2024-09-11T01:11:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.401+0000 7ffbbb400640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffba80b53e0 0x7ffba80b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.403 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.401+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/2349622466 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff98642cd0 0x55ff98643180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.401+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/2349622466 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff986422c0 0x55ff98642740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.401+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/2349622466 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff9863f970 0x55ff98641d80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.401+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/2349622466 >> 172.21.15.103:0/2349622466 conn(0x55ff9863aac0 msgr2=0x55ff9863b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.402+0000 7ffbbb400640 1 -- 172.21.15.103:0/3480922654 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7ffbb00e5bf0 con 0x7ffbc4105920 2024-09-11T01:11:12.404 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.402+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/2349622466 shutdown_connections 2024-09-11T01:11:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.402+0000 7ffbc3400640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffba80b53e0 0x7ffba80b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.403+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/2349622466 wait complete. 2024-09-11T01:11:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.403+0000 7ffbcc9f6740 1 -- start start 2024-09-11T01:11:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.403+0000 7ffbcc9f6740 1 Processor -- start 2024-09-11T01:11:12.405 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.404+0000 7ffbc3400640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffba80b53e0 0x7ffba80b78a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc02f470 tx=0x7ffbbc02a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.404+0000 7ffbcc9f6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff9863f970 0x55ff986518c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.406 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.404+0000 7ffbcc9f6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff986422c0 0x55ff98651f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.404+0000 7ffbcc9f6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff98642cd0 0x55ff98652b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.404+0000 7ffbcc9f6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ff984d9ab0 con 0x55ff98642cd0 2024-09-11T01:11:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.404+0000 7ffbcc9f6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ff98548570 con 0x55ff9863f970 2024-09-11T01:11:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.404+0000 7ffbcc9f6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ff986505b0 con 0x55ff986422c0 2024-09-11T01:11:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.404+0000 7ffbcc9f6740 10 client.0 _ll_register_callbacks cb 0x55ff98557100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:11:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.405+0000 7ffbc2a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff9863f970 0x55ff986518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.405+0000 7ffbc2a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff9863f970 0x55ff986518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:49252/0 (socket says 172.21.15.103:49252) 2024-09-11T01:11:12.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.405+0000 7ffbc2a00640 1 -- 172.21.15.103:0/1890094848 learned_addr learned my addr 172.21.15.103:0/1890094848 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.405+0000 7ffbc2000640 1 --2- 172.21.15.103:0/1890094848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff986422c0 0x55ff98651f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.405+0000 7ffbc2000640 1 -- 172.21.15.103:0/1890094848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff9863f970 msgr2=0x55ff986518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.405+0000 7ffbc2000640 1 --2- 172.21.15.103:0/1890094848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff9863f970 0x55ff986518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.405+0000 7ffbc2000640 1 -- 172.21.15.103:0/1890094848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff98642cd0 msgr2=0x55ff98652b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:11:12.408 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.406+0000 7ffbc3400640 1 --2- 172.21.15.103:0/1890094848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff98642cd0 0x55ff98652b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.406+0000 7ffbc2000640 1 --2- 172.21.15.103:0/1890094848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff98642cd0 0x55ff98652b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.406+0000 7ffbc2000640 1 -- 172.21.15.103:0/1890094848 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff98303790 con 0x55ff986422c0 2024-09-11T01:11:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.407+0000 7ffbc3400640 1 --2- 172.21.15.103:0/1890094848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff98642cd0 0x55ff98652b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:11:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.407+0000 7ffbc2000640 1 --2- 172.21.15.103:0/1890094848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff986422c0 0x55ff98651f60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000ffd0 tx=0x7ffbb000fc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baa545ff869ac6ff server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:12.409 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.408+0000 7ffbacc00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:11:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.408+0000 7ffbacc00640 1 -- 172.21.15.103:0/1890094848 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb00abfa0 con 0x55ff986422c0 2024-09-11T01:11:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.409+0000 7ffbacc00640 1 -- 172.21.15.103:0/1890094848 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7ffbb00ab410 con 0x55ff986422c0 2024-09-11T01:11:12.410 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.409+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/1890094848 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbbc036070 con 0x55ff986422c0 2024-09-11T01:11:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.410+0000 7ffbacc00640 1 -- 172.21.15.103:0/1890094848 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffbb00b0a80 con 0x55ff986422c0 2024-09-11T01:11:12.411 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.410+0000 7ffbcc9f6740 10 client.25699 fetch_fsmap learned FSMap version 28 2024-09-11T01:11:12.412 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.410+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/1890094848 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ff9837c620 con 0x55ff986422c0 2024-09-11T01:11:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.411+0000 7ffbacc00640 1 -- 172.21.15.103:0/1890094848 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbbc036070 con 0x55ff986422c0 2024-09-11T01:11:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.411+0000 7ffbacc00640 1 -- 172.21.15.103:0/1890094848 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7ffbb00d0070 con 0x55ff986422c0 2024-09-11T01:11:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.411+0000 7ffbcc9f6740 10 client.25699 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:11:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.411+0000 7ffbcc9f6740 10 client.25699 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:11:12.413 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.411+0000 7ffbcc9f6740 20 client.25699 populate_metadata read hostname 'smithi103' 2024-09-11T01:11:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.412+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/1890094848 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ff9865d110 0x55ff9865f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.412+0000 7ffbcc9f6740 4 client.25699 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:11:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.412+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/1890094848 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff985b4600 con 0x55ff9865d110 2024-09-11T01:11:12.414 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.412+0000 7ffbc2a00640 1 --2- 172.21.15.103:0/1890094848 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ff9865d110 0x55ff9865f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:12.416 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.415+0000 7ffbacc00640 10 client.25699 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:12.417 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.415+0000 7ffbc2a00640 1 --2- 172.21.15.103:0/1890094848 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ff9865d110 0x55ff9865f530 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e56d0e211fc4b602 server_cookie=f016f9d3a87f3a0b in_seq=0 out_seq=0 2024-09-11T01:11:12.418 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.417+0000 7ffbacc00640 1 -- 172.21.15.103:0/1890094848 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ff985b4600 con 0x55ff9865d110 2024-09-11T01:11:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.417+0000 7ffbacc00640 10 client.25699 handle_command_reply: tid=0 2024-09-11T01:11:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.417+0000 7ffbcc9f6740 1 client.25699 shutdown 2024-09-11T01:11:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.417+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/1890094848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff986422c0 msgr2=0x55ff98651f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.417+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/1890094848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff986422c0 0x55ff98651f60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000ffd0 tx=0x7ffbb000fc50 comp rx=0 tx=0).stop 2024-09-11T01:11:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.418+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/1890094848 shutdown_connections 2024-09-11T01:11:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.418+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/1890094848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff98642cd0 0x55ff98652b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.419 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.418+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/1890094848 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ff9865d110 0x55ff9865f530 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.418+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/1890094848 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff986422c0 0x55ff98651f60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.418+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/1890094848 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff9863f970 0x55ff986518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.418+0000 7ffbacc00640 0 client.25699 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.418+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/1890094848 >> 172.21.15.103:0/1890094848 conn(0x55ff9863aac0 msgr2=0x55ff98639bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.418+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/1890094848 shutdown_connections 2024-09-11T01:11:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.418+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/1890094848 wait complete. 2024-09-11T01:11:12.420 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.418+0000 7ffbcc9f6740 20 client.25699 trim_cache size 0 max 16384 2024-09-11T01:11:12.438 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.436+0000 7ffbcc9f6740 1 Processor -- start 2024-09-11T01:11:12.438 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.436+0000 7ffbcc9f6740 1 -- start start 2024-09-11T01:11:12.438 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.436+0000 7ffbcc9f6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff9863f970 0x55ff98650a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.438 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.436+0000 7ffbcc9f6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff986422c0 0x55ff98650fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.438 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.436+0000 7ffbcc9f6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff98642cd0 0x55ff9864e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.436+0000 7ffbcc9f6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41abb30 con 0x55ff986422c0 2024-09-11T01:11:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.436+0000 7ffbcc9f6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41a93d0 con 0x55ff98642cd0 2024-09-11T01:11:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.436+0000 7ffbcc9f6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41a7220 con 0x55ff9863f970 2024-09-11T01:11:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.437+0000 7ffbc2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff986422c0 0x55ff98650fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.437+0000 7ffbc2000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff986422c0 0x55ff98650fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43082/0 (socket says 172.21.15.103:43082) 2024-09-11T01:11:12.439 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.437+0000 7ffbc2000640 1 -- 172.21.15.103:0/3488426854 learned_addr learned my addr 172.21.15.103:0/3488426854 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.437+0000 7ffbc2000640 1 -- 172.21.15.103:0/3488426854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff9863f970 msgr2=0x55ff98650a80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T01:11:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.437+0000 7ffbc2000640 1 --2- 172.21.15.103:0/3488426854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff9863f970 0x55ff98650a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.437+0000 7ffbc2000640 1 -- 172.21.15.103:0/3488426854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff98642cd0 msgr2=0x55ff9864e650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:11:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.437+0000 7ffbc2000640 1 --2- 172.21.15.103:0/3488426854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff98642cd0 0x55ff9864e650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.437+0000 7ffbc2000640 1 -- 172.21.15.103:0/3488426854 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff9865fb90 con 0x55ff986422c0 2024-09-11T01:11:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.438+0000 7ffbc2000640 1 --2- 172.21.15.103:0/3488426854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff986422c0 0x55ff98650fc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ffbb00cf1a0 tx=0x7ffbb000fd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ed715241a376b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.438+0000 7ffbaf400640 1 -- 172.21.15.103:0/3488426854 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb00aac70 con 0x55ff986422c0 2024-09-11T01:11:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.438+0000 7ffbaf400640 1 -- 172.21.15.103:0/3488426854 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb00b5530 con 0x55ff986422c0 2024-09-11T01:11:12.440 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.438+0000 7ffbaf400640 1 -- 172.21.15.103:0/3488426854 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb00b0470 con 0x55ff986422c0 2024-09-11T01:11:12.441 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.439+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/3488426854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff986422c0 msgr2=0x55ff98650fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:12.441 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.439+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/3488426854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff986422c0 0x55ff98650fc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ffbb00cf1a0 tx=0x7ffbb000fd60 comp rx=0 tx=0).stop 2024-09-11T01:11:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.439+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/3488426854 shutdown_connections 2024-09-11T01:11:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.439+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/3488426854 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff98642cd0 0x55ff9864e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.439+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/3488426854 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff986422c0 0x55ff98650fc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.439+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/3488426854 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff9863f970 0x55ff98650a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.439+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/3488426854 >> 172.21.15.103:0/3488426854 conn(0x55ff9863aac0 msgr2=0x55ff9864fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.439+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/3488426854 shutdown_connections 2024-09-11T01:11:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.439+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/3488426854 wait complete. 2024-09-11T01:11:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.440+0000 7ffbcc9f6740 1 -- start start 2024-09-11T01:11:12.442 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.440+0000 7ffbcc9f6740 1 Processor -- start 2024-09-11T01:11:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.441+0000 7ffbcc9f6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff9863f970 0x55ff98655750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.441+0000 7ffbcc9f6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff98642cd0 0x55ff98655c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.441+0000 7ffbcc9f6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff986569a0 0x55ff98656e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.441+0000 7ffbcc9f6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41a7890 con 0x55ff9863f970 2024-09-11T01:11:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.441+0000 7ffbcc9f6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41a8d00 con 0x55ff986569a0 2024-09-11T01:11:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.441+0000 7ffbcc9f6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc41a7f60 con 0x55ff98642cd0 2024-09-11T01:11:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.441+0000 7ffbcc9f6740 10 client.0 _ll_register_callbacks cb 0x7ffbb00abd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:11:12.443 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.441+0000 7ffbc2000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff98642cd0 0x55ff98655c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.441+0000 7ffbc2000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff98642cd0 0x55ff98655c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:55160/0 (socket says 172.21.15.103:55160) 2024-09-11T01:11:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.441+0000 7ffbc2000640 1 -- 172.21.15.103:0/3562283661 learned_addr learned my addr 172.21.15.103:0/3562283661 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.441+0000 7ffbc2000640 1 -- 172.21.15.103:0/3562283661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff986569a0 msgr2=0x55ff98656e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:11:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.441+0000 7ffbc2000640 1 --2- 172.21.15.103:0/3562283661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff986569a0 0x55ff98656e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.444 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.441+0000 7ffbc2000640 1 -- 172.21.15.103:0/3562283661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff9863f970 msgr2=0x55ff98655750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:11:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.442+0000 7ffbc2a00640 1 --2- 172.21.15.103:0/3562283661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff9863f970 0x55ff98655750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.442+0000 7ffbc2000640 1 --2- 172.21.15.103:0/3562283661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff9863f970 0x55ff98655750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.445 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.442+0000 7ffbc2000640 1 -- 172.21.15.103:0/3562283661 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff986573f0 con 0x55ff98642cd0 2024-09-11T01:11:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.442+0000 7ffbc2a00640 1 --2- 172.21.15.103:0/3562283661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff9863f970 0x55ff98655750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:11:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.443+0000 7ffbc2000640 1 --2- 172.21.15.103:0/3562283661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff98642cd0 0x55ff98655c90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffbb00b1c30 tx=0x7ffbb00ab620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8a25df795082e55 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.443+0000 7ffbacc00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:11:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.443+0000 7ffbacc00640 1 -- 172.21.15.103:0/3562283661 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb00abfa0 con 0x55ff98642cd0 2024-09-11T01:11:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.443+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/3562283661 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffbb00b5530 con 0x55ff98642cd0 2024-09-11T01:11:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.443+0000 7ffbacc00640 1 -- 172.21.15.103:0/3562283661 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7ffbb00a7b00 con 0x55ff98642cd0 2024-09-11T01:11:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.443+0000 7ffbacc00640 1 -- 172.21.15.103:0/3562283661 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ffbb00aac70 con 0x55ff98642cd0 2024-09-11T01:11:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.444+0000 7ffbcc9f6740 10 client.25702 fetch_fsmap learned FSMap version 28 2024-09-11T01:11:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.444+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/3562283661 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ff986573f0 con 0x55ff98642cd0 2024-09-11T01:11:12.446 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.444+0000 7ffbacc00640 1 -- 172.21.15.103:0/3562283661 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffbb00b5530 con 0x55ff98642cd0 2024-09-11T01:11:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.445+0000 7ffbacc00640 1 -- 172.21.15.103:0/3562283661 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7ffbb00d0040 con 0x55ff98642cd0 2024-09-11T01:11:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.445+0000 7ffbcc9f6740 10 client.25702 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:11:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.445+0000 7ffbcc9f6740 10 client.25702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:11:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.445+0000 7ffbcc9f6740 20 client.25702 populate_metadata read hostname 'smithi103' 2024-09-11T01:11:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.445+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/3562283661 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ff98645070 0x55ff98647490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:12.447 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.445+0000 7ffbcc9f6740 4 client.25702 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:11:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.445+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/3562283661 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ff985b00b0 con 0x55ff98645070 2024-09-11T01:11:12.448 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.446+0000 7ffbc2a00640 1 --2- 172.21.15.103:0/3562283661 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ff98645070 0x55ff98647490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:12.449 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.448+0000 7ffbc2a00640 1 --2- 172.21.15.103:0/3562283661 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ff98645070 0x55ff98647490 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39d35ef8e0b39d97 server_cookie=22e05563608afeb0 in_seq=0 out_seq=0 2024-09-11T01:11:12.449 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.448+0000 7ffbacc00640 10 client.25702 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:12.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.458+0000 7ffbacc00640 1 -- 172.21.15.103:0/3562283661 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ff985b00b0 con 0x55ff98645070 2024-09-11T01:11:12.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.458+0000 7ffbacc00640 10 client.25702 handle_command_reply: tid=0 2024-09-11T01:11:12.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.458+0000 7ffbcc9f6740 1 client.25702 shutdown 2024-09-11T01:11:12.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.458+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/3562283661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff98642cd0 msgr2=0x55ff98655c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:12.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.458+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/3562283661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff98642cd0 0x55ff98655c90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffbb00b1c30 tx=0x7ffbb00ab620 comp rx=0 tx=0).stop 2024-09-11T01:11:12.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.459+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/3562283661 shutdown_connections 2024-09-11T01:11:12.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.459+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/3562283661 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ff986569a0 0x55ff98656e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.459+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/3562283661 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ff98645070 0x55ff98647490 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.460 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.459+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/3562283661 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ff98642cd0 0x55ff98655c90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.459+0000 7ffbcc9f6740 1 --2- 172.21.15.103:0/3562283661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ff9863f970 0x55ff98655750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.459+0000 7ffbacc00640 0 client.25702 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:12.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.459+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/3562283661 >> 172.21.15.103:0/3562283661 conn(0x55ff9863aac0 msgr2=0x55ff9864e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:12.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.459+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/3562283661 shutdown_connections 2024-09-11T01:11:12.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.459+0000 7ffbcc9f6740 1 -- 172.21.15.103:0/3562283661 wait complete. 2024-09-11T01:11:12.461 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.459+0000 7ffbcc9f6740 20 client.25702 trim_cache size 0 max 16384 2024-09-11T01:11:12.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:11:12.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:11:12.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:11:12.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:11:12.462 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.460+0000 7ffbc3e00640 1 -- 172.21.15.103:0/3480922654 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffba80b53e0 msgr2=0x7ffba80b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.460+0000 7ffbc3e00640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffba80b53e0 0x7ffba80b78a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc02f470 tx=0x7ffbbc02a8c0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.460+0000 7ffbc3e00640 1 -- 172.21.15.103:0/3480922654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc4105920 msgr2=0x7ffbc4199110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.460+0000 7ffbc3e00640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc4105920 0x7ffbc4199110 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000c940 tx=0x7ffbb000ce00 comp rx=0 tx=0).stop 2024-09-11T01:11:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.460+0000 7ffbc3e00640 1 -- 172.21.15.103:0/3480922654 shutdown_connections 2024-09-11T01:11:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.460+0000 7ffbc3e00640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ffba80b53e0 0x7ffba80b78a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.460+0000 7ffbc3e00640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffbc41084b0 0x7ffbc4199d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.460+0000 7ffbc3e00640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffbc4105920 0x7ffbc4199110 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.460+0000 7ffbc3e00640 1 --2- 172.21.15.103:0/3480922654 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ffbc406b3f0 0x7ffbc4198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.460+0000 7ffbc3e00640 1 -- 172.21.15.103:0/3480922654 >> 172.21.15.103:0/3480922654 conn(0x7ffbc40fcf30 msgr2=0x7ffbc4103bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.460+0000 7ffbc3e00640 1 -- 172.21.15.103:0/3480922654 shutdown_connections 2024-09-11T01:11:12.463 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:12.460+0000 7ffbc3e00640 1 -- 172.21.15.103:0/3480922654 wait complete. 2024-09-11T01:11:15.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:14 smithi103 ceph-mon[30562]: pgmap v486: 129 pgs: 129 active+clean; 9.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 160 MiB/s wr, 72 op/s 2024-09-11T01:11:15.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:14 smithi117 ceph-mon[35358]: pgmap v486: 129 pgs: 129 active+clean; 9.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 160 MiB/s wr, 72 op/s 2024-09-11T01:11:15.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:14 smithi183 ceph-mon[34992]: pgmap v486: 129 pgs: 129 active+clean; 9.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 160 MiB/s wr, 72 op/s 2024-09-11T01:11:16.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:15 smithi103 ceph-mon[30562]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 206 MiB/s wr, 81 op/s 2024-09-11T01:11:16.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:15 smithi117 ceph-mon[35358]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 206 MiB/s wr, 81 op/s 2024-09-11T01:11:16.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:15 smithi183 ceph-mon[34992]: pgmap v487: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 206 MiB/s wr, 81 op/s 2024-09-11T01:11:19.091 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:18 smithi103 ceph-mon[30562]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 219 MiB/s wr, 85 op/s 2024-09-11T01:11:19.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:18 smithi117 ceph-mon[35358]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 219 MiB/s wr, 85 op/s 2024-09-11T01:11:19.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:18 smithi183 ceph-mon[34992]: pgmap v488: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 219 MiB/s wr, 85 op/s 2024-09-11T01:11:20.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:19 smithi103 ceph-mon[30562]: pgmap v489: 129 pgs: 129 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 312 MiB/s wr, 108 op/s 2024-09-11T01:11:20.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:19 smithi117 ceph-mon[35358]: pgmap v489: 129 pgs: 129 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 312 MiB/s wr, 108 op/s 2024-09-11T01:11:20.124 INFO:tasks.workunit.client.0.smithi103.stdout:Syncing()...7 sec 2024-09-11T01:11:20.126 INFO:tasks.workunit.client.0.smithi103.stdout:Starting Actual Benchmark At: Wed Sep 11 01:11:20 2024 2024-09-11T01:11:20.127 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:11:20.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:19 smithi183 ceph-mon[34992]: pgmap v489: 129 pgs: 129 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 312 MiB/s wr, 108 op/s 2024-09-11T01:11:23.087 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:22 smithi103 ceph-mon[30562]: pgmap v490: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 290 MiB/s wr, 91 op/s 2024-09-11T01:11:23.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:22 smithi117 ceph-mon[35358]: pgmap v490: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 290 MiB/s wr, 91 op/s 2024-09-11T01:11:23.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:22 smithi183 ceph-mon[34992]: pgmap v490: 129 pgs: 129 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 290 MiB/s wr, 91 op/s 2024-09-11T01:11:24.086 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:23 smithi103 ceph-mon[30562]: pgmap v491: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 305 MiB/s wr, 595 op/s 2024-09-11T01:11:24.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:23 smithi117 ceph-mon[35358]: pgmap v491: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 305 MiB/s wr, 595 op/s 2024-09-11T01:11:24.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:23 smithi183 ceph-mon[34992]: pgmap v491: 129 pgs: 129 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 305 MiB/s wr, 595 op/s 2024-09-11T01:11:25.688 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.685+0000 7f4ae6800640 1 -- 172.21.15.103:0/186039757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae0105cf0 msgr2=0x7f4ae0106170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.685+0000 7f4ae6800640 1 --2- 172.21.15.103:0/186039757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae0105cf0 0x7f4ae0106170 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009890 tx=0x7f4acc02a360 comp rx=0 tx=0).stop 2024-09-11T01:11:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.686+0000 7f4ae6800640 1 -- 172.21.15.103:0/186039757 shutdown_connections 2024-09-11T01:11:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.686+0000 7f4ae6800640 1 --2- 172.21.15.103:0/186039757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ae01066b0 0x7f4ae010d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.686+0000 7f4ae6800640 1 --2- 172.21.15.103:0/186039757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae0105cf0 0x7f4ae0106170 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.686+0000 7f4ae6800640 1 --2- 172.21.15.103:0/186039757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae0104ba0 0x7f4ae0104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.686+0000 7f4ae6800640 1 -- 172.21.15.103:0/186039757 >> 172.21.15.103:0/186039757 conn(0x7f4ae0100460 msgr2=0x7f4ae0102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.686+0000 7f4ae6800640 1 -- 172.21.15.103:0/186039757 shutdown_connections 2024-09-11T01:11:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.686+0000 7f4ae6800640 1 -- 172.21.15.103:0/186039757 wait complete. 2024-09-11T01:11:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.687+0000 7f4ae6800640 1 Processor -- start 2024-09-11T01:11:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.688+0000 7f4ae6800640 1 -- start start 2024-09-11T01:11:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.688+0000 7f4ae6800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae0104ba0 0x7f4ae019af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.688+0000 7f4ae6800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ae0105cf0 0x7f4ae019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.688+0000 7f4ae6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae01066b0 0x7f4ae019c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.688+0000 7f4ae6800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae0110810 con 0x7f4ae01066b0 2024-09-11T01:11:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.688+0000 7f4ae6800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae0110690 con 0x7f4ae0104ba0 2024-09-11T01:11:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.688+0000 7f4ae6800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae0110990 con 0x7f4ae0105cf0 2024-09-11T01:11:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.688+0000 7f4adea00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ae0105cf0 0x7f4ae019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.688+0000 7f4adea00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ae0105cf0 0x7f4ae019b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:42938/0 (socket says 172.21.15.103:42938) 2024-09-11T01:11:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.689+0000 7f4adea00640 1 -- 172.21.15.103:0/2185837813 learned_addr learned my addr 172.21.15.103:0/2185837813 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.689+0000 7f4adf400640 1 --2- 172.21.15.103:0/2185837813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae0104ba0 0x7f4ae019af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.689+0000 7f4adfe00640 1 --2- 172.21.15.103:0/2185837813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae01066b0 0x7f4ae019c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.689+0000 7f4adea00640 1 -- 172.21.15.103:0/2185837813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae0104ba0 msgr2=0x7f4ae019af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.689+0000 7f4adea00640 1 --2- 172.21.15.103:0/2185837813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae0104ba0 0x7f4ae019af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.689+0000 7f4adea00640 1 -- 172.21.15.103:0/2185837813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae01066b0 msgr2=0x7f4ae019c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.689+0000 7f4adea00640 1 --2- 172.21.15.103:0/2185837813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae01066b0 0x7f4ae019c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.689+0000 7f4adea00640 1 -- 172.21.15.103:0/2185837813 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ae019cab0 con 0x7f4ae0105cf0 2024-09-11T01:11:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.689+0000 7f4adea00640 1 --2- 172.21.15.103:0/2185837813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ae0105cf0 0x7f4ae019b5c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4acc032d80 tx=0x7f4acc032db0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.690+0000 7f4ad7e00640 1 -- 172.21.15.103:0/2185837813 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc037040 con 0x7f4ae0105cf0 2024-09-11T01:11:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.690+0000 7f4ad7e00640 1 -- 172.21.15.103:0/2185837813 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4acc041070 con 0x7f4ae0105cf0 2024-09-11T01:11:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.690+0000 7f4ad7e00640 1 -- 172.21.15.103:0/2185837813 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc003850 con 0x7f4ae0105cf0 2024-09-11T01:11:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.690+0000 7f4ae6800640 1 -- 172.21.15.103:0/2185837813 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ae019cd40 con 0x7f4ae0105cf0 2024-09-11T01:11:25.694 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.690+0000 7f4ae6800640 1 -- 172.21.15.103:0/2185837813 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ae01a3290 con 0x7f4ae0105cf0 2024-09-11T01:11:25.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.695+0000 7f4ad7e00640 1 -- 172.21.15.103:0/2185837813 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f4acc030520 con 0x7f4ae0105cf0 2024-09-11T01:11:25.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.696+0000 7f4ae9606740 1 Processor -- start 2024-09-11T01:11:25.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.696+0000 7f4ae9606740 1 -- start start 2024-09-11T01:11:25.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.697+0000 7f4ae9606740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001a1f0 0x56434001c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.697+0000 7f4ae9606740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001cb40 0x56434001efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.697+0000 7f4ae9606740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001f560 0x564340021a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.697+0000 7f4ad7e00640 1 --2- 172.21.15.103:0/2185837813 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4ac40b5360 0x7f4ac40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.697+0000 7f4ae9606740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56433ff926b0 con 0x56434001cb40 2024-09-11T01:11:25.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.697+0000 7f4ae9606740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56433ff81ae0 con 0x56434001f560 2024-09-11T01:11:25.704 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.697+0000 7f4ae9606740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56433ff858f0 con 0x56434001a1f0 2024-09-11T01:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.698+0000 7f4adfe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001a1f0 0x56434001c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.698+0000 7f4adfe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001a1f0 0x56434001c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:42948/0 (socket says 172.21.15.103:42948) 2024-09-11T01:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.698+0000 7f4adfe00640 1 -- 172.21.15.103:0/2354304819 learned_addr learned my addr 172.21.15.103:0/2354304819 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.698+0000 7f4ad7e00640 1 -- 172.21.15.103:0/2185837813 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f4acc105c60 con 0x7f4ae0105cf0 2024-09-11T01:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.698+0000 7f4adea00640 1 --2- 172.21.15.103:0/2354304819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001f560 0x564340021a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.698+0000 7f4adf400640 1 --2- 172.21.15.103:0/2354304819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001cb40 0x56434001efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.699+0000 7f4adea00640 1 -- 172.21.15.103:0/2354304819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001a1f0 msgr2=0x56434001c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.699+0000 7f4adea00640 1 --2- 172.21.15.103:0/2354304819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001a1f0 0x56434001c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.699+0000 7f4adea00640 1 -- 172.21.15.103:0/2354304819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001cb40 msgr2=0x56434001efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.699+0000 7f4adea00640 1 --2- 172.21.15.103:0/2354304819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001cb40 0x56434001efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.699+0000 7f4adfe00640 1 --2- 172.21.15.103:0/2185837813 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4ac40b5360 0x7f4ac40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.699+0000 7f4adea00640 1 -- 172.21.15.103:0/2354304819 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56433ff4e780 con 0x56434001f560 2024-09-11T01:11:25.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.699+0000 7f4adf400640 1 --2- 172.21.15.103:0/2354304819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001cb40 0x56434001efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.699+0000 7f4adea00640 1 --2- 172.21.15.103:0/2354304819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001f560 0x564340021a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4acc032f50 tx=0x7f4acc02a360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8e1507dbd548941 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.699+0000 7f4ad4c00640 1 -- 172.21.15.103:0/2354304819 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc0cb960 con 0x56434001f560 2024-09-11T01:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.699+0000 7f4ad4c00640 1 -- 172.21.15.103:0/2354304819 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4acc0328f0 con 0x56434001f560 2024-09-11T01:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.699+0000 7f4ad4c00640 1 -- 172.21.15.103:0/2354304819 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc0b4960 con 0x56434001f560 2024-09-11T01:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.701+0000 7f4ae9606740 1 -- 172.21.15.103:0/2354304819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001f560 msgr2=0x564340021a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.701+0000 7f4adfe00640 1 --2- 172.21.15.103:0/2185837813 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4ac40b5360 0x7f4ac40b7820 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009fd0 tx=0x7f4ad8004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:25.706 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.701+0000 7f4ae9606740 1 --2- 172.21.15.103:0/2354304819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001f560 0x564340021a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4acc032f50 tx=0x7f4acc02a360 comp rx=0 tx=0).stop 2024-09-11T01:11:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.701+0000 7f4ae9606740 1 -- 172.21.15.103:0/2354304819 shutdown_connections 2024-09-11T01:11:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.702+0000 7f4ae9606740 1 --2- 172.21.15.103:0/2354304819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001f560 0x564340021a20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.702+0000 7f4ae9606740 1 --2- 172.21.15.103:0/2354304819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001cb40 0x56434001efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.702+0000 7f4ae9606740 1 --2- 172.21.15.103:0/2354304819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001a1f0 0x56434001c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.702+0000 7f4ae9606740 1 -- 172.21.15.103:0/2354304819 >> 172.21.15.103:0/2354304819 conn(0x5643400230f0 msgr2=0x564340023e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.704+0000 7f4ae9606740 1 -- 172.21.15.103:0/2354304819 shutdown_connections 2024-09-11T01:11:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.704+0000 7f4ae9606740 1 -- 172.21.15.103:0/2354304819 wait complete. 2024-09-11T01:11:25.707 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.705+0000 7f4ae9606740 1 -- start start 2024-09-11T01:11:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.705+0000 7f4ae9606740 1 Processor -- start 2024-09-11T01:11:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.706+0000 7f4ae9606740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001a1f0 0x564340028c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.706+0000 7f4ae9606740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001cb40 0x5643400292a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.708 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.706+0000 7f4ae9606740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001f560 0x564340029e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.706+0000 7f4adea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001cb40 0x5643400292a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.706+0000 7f4adea00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001cb40 0x5643400292a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:58598/0 (socket says 172.21.15.103:58598) 2024-09-11T01:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.706+0000 7f4adea00640 1 -- 172.21.15.103:0/1610099838 learned_addr learned my addr 172.21.15.103:0/1610099838 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.706+0000 7f4adfe00640 1 --2- 172.21.15.103:0/1610099838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001f560 0x564340029e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.707+0000 7f4ae9606740 1 -- 172.21.15.103:0/1610099838 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56433feb9ab0 con 0x56434001a1f0 2024-09-11T01:11:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.707+0000 7f4ae9606740 1 -- 172.21.15.103:0/1610099838 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56433ff28570 con 0x56434001cb40 2024-09-11T01:11:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.707+0000 7f4ae9606740 1 -- 172.21.15.103:0/1610099838 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564340022300 con 0x56434001f560 2024-09-11T01:11:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.707+0000 7f4adf400640 1 --2- 172.21.15.103:0/1610099838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001a1f0 0x564340028c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.707+0000 7f4ae9606740 10 client.0 _ll_register_callbacks cb 0x56433ff37100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:11:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.707+0000 7f4adea00640 1 -- 172.21.15.103:0/1610099838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001f560 msgr2=0x564340029e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.707+0000 7f4adea00640 1 --2- 172.21.15.103:0/1610099838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001f560 0x564340029e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.707+0000 7f4adea00640 1 -- 172.21.15.103:0/1610099838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001a1f0 msgr2=0x564340028c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:25.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.707+0000 7f4adea00640 1 --2- 172.21.15.103:0/1610099838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001a1f0 0x564340028c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.707+0000 7f4adea00640 1 -- 172.21.15.103:0/1610099838 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56433fce3790 con 0x56434001cb40 2024-09-11T01:11:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.708+0000 7f4adf400640 1 --2- 172.21.15.103:0/1610099838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001a1f0 0x564340028c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:11:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.709+0000 7f4adea00640 1 --2- 172.21.15.103:0/1610099838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001cb40 0x5643400292a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0c85e0 tx=0x7f4acc004280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=121cc9bc778e1a38 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.709+0000 7f4ac9600640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:11:25.711 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.709+0000 7f4ac9600640 1 -- 172.21.15.103:0/1610099838 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4acc0cb780 con 0x56434001cb40 2024-09-11T01:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.709+0000 7f4ac9600640 1 -- 172.21.15.103:0/1610099838 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f4acc0b2090 con 0x56434001cb40 2024-09-11T01:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.710+0000 7f4ae9606740 1 -- 172.21.15.103:0/1610099838 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4acc0328f0 con 0x56434001cb40 2024-09-11T01:11:25.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.710+0000 7f4ac9600640 1 -- 172.21.15.103:0/1610099838 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4acc0cbb20 con 0x56434001cb40 2024-09-11T01:11:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.712+0000 7f4ae9606740 10 client.25739 fetch_fsmap learned FSMap version 28 2024-09-11T01:11:25.714 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.712+0000 7f4ae9606740 1 -- 172.21.15.103:0/1610099838 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56433fd5c620 con 0x56434001cb40 2024-09-11T01:11:25.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.712+0000 7f4ac9600640 1 -- 172.21.15.103:0/1610099838 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4acc0328f0 con 0x56434001cb40 2024-09-11T01:11:25.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.712+0000 7f4ac9600640 1 -- 172.21.15.103:0/1610099838 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f4acc0e1b90 con 0x56434001cb40 2024-09-11T01:11:25.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.713+0000 7f4ae9606740 10 client.25739 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:11:25.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.713+0000 7f4ae9606740 10 client.25739 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:11:25.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.713+0000 7f4ae9606740 20 client.25739 populate_metadata read hostname 'smithi103' 2024-09-11T01:11:25.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.713+0000 7f4ae9606740 1 --2- 172.21.15.103:0/1610099838 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5643400343a0 0x5643400367e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.713+0000 7f4ae9606740 4 client.25739 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:11:25.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.713+0000 7f4ae9606740 1 -- 172.21.15.103:0/1610099838 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56433ff94600 con 0x5643400343a0 2024-09-11T01:11:25.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.713+0000 7f4adf400640 1 --2- 172.21.15.103:0/1610099838 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5643400343a0 0x5643400367e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.720 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.718+0000 7f4ac9600640 10 client.25739 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:25.721 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.718+0000 7f4adf400640 1 --2- 172.21.15.103:0/1610099838 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5643400343a0 0x5643400367e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91e6f2535ac527d7 server_cookie=6e5ddd9e6f8be4c5 in_seq=0 out_seq=0 2024-09-11T01:11:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.719+0000 7f4ac9600640 1 -- 172.21.15.103:0/1610099838 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56433ff94600 con 0x5643400343a0 2024-09-11T01:11:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.719+0000 7f4ac9600640 10 client.25739 handle_command_reply: tid=0 2024-09-11T01:11:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.719+0000 7f4ae9606740 1 client.25739 shutdown 2024-09-11T01:11:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.722+0000 7f4ae9606740 1 -- 172.21.15.103:0/1610099838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001cb40 msgr2=0x5643400292a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.722+0000 7f4ae9606740 1 --2- 172.21.15.103:0/1610099838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001cb40 0x5643400292a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0c85e0 tx=0x7f4acc004280 comp rx=0 tx=0).stop 2024-09-11T01:11:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.723+0000 7f4ae9606740 1 -- 172.21.15.103:0/1610099838 shutdown_connections 2024-09-11T01:11:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.723+0000 7f4ae9606740 1 --2- 172.21.15.103:0/1610099838 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5643400343a0 0x5643400367e0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.723+0000 7f4ae9606740 1 --2- 172.21.15.103:0/1610099838 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001f560 0x564340029e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.723+0000 7f4ac9600640 0 client.25739 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:25.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.723+0000 7f4ae9606740 1 --2- 172.21.15.103:0/1610099838 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001cb40 0x5643400292a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.723+0000 7f4ae9606740 1 --2- 172.21.15.103:0/1610099838 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001a1f0 0x564340028c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.723+0000 7f4ae9606740 1 -- 172.21.15.103:0/1610099838 >> 172.21.15.103:0/1610099838 conn(0x5643400230f0 msgr2=0x564340019a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.726+0000 7f4ae9606740 1 -- 172.21.15.103:0/1610099838 shutdown_connections 2024-09-11T01:11:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.726+0000 7f4ae9606740 1 -- 172.21.15.103:0/1610099838 wait complete. 2024-09-11T01:11:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.726+0000 7f4ae9606740 20 client.25739 trim_cache size 0 max 16384 2024-09-11T01:11:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.758+0000 7f4ae9606740 1 Processor -- start 2024-09-11T01:11:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.759+0000 7f4ae9606740 1 -- start start 2024-09-11T01:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.759+0000 7f4ae9606740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001a1f0 0x564340025f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.759+0000 7f4ae9606740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001cb40 0x564340026470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.759+0000 7f4ae9606740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001f560 0x564340030eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.759+0000 7f4ae9606740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01abde0 con 0x56434001f560 2024-09-11T01:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.759+0000 7f4ae9606740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01a9680 con 0x56434001a1f0 2024-09-11T01:11:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.759+0000 7f4ae9606740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01a74f0 con 0x56434001cb40 2024-09-11T01:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.760+0000 7f4adf400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001a1f0 0x564340025f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.760+0000 7f4adf400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001a1f0 0x564340025f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:58602/0 (socket says 172.21.15.103:58602) 2024-09-11T01:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.760+0000 7f4adf400640 1 -- 172.21.15.103:0/745069807 learned_addr learned my addr 172.21.15.103:0/745069807 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.760+0000 7f4adfe00640 1 --2- 172.21.15.103:0/745069807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001f560 0x564340030eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.760+0000 7f4adea00640 1 --2- 172.21.15.103:0/745069807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001cb40 0x564340026470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.761+0000 7f4adf400640 1 -- 172.21.15.103:0/745069807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001cb40 msgr2=0x564340026470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.761+0000 7f4adf400640 1 --2- 172.21.15.103:0/745069807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001cb40 0x564340026470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.761+0000 7f4adf400640 1 -- 172.21.15.103:0/745069807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001f560 msgr2=0x564340030eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.762+0000 7f4adf400640 1 --2- 172.21.15.103:0/745069807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001f560 0x564340030eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.762+0000 7f4adf400640 1 -- 172.21.15.103:0/745069807 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56434002a740 con 0x56434001a1f0 2024-09-11T01:11:25.765 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.762+0000 7f4adfe00640 1 --2- 172.21.15.103:0/745069807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001f560 0x564340030eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:11:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.764+0000 7f4adf400640 1 --2- 172.21.15.103:0/745069807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001a1f0 0x564340025f30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0000c00 tx=0x7f4ad0004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=688beb65d1e8af6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.765+0000 7f4acbe00640 1 -- 172.21.15.103:0/745069807 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0003ad0 con 0x56434001a1f0 2024-09-11T01:11:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.765+0000 7f4acbe00640 1 -- 172.21.15.103:0/745069807 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ad0003c70 con 0x56434001a1f0 2024-09-11T01:11:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.765+0000 7f4acbe00640 1 -- 172.21.15.103:0/745069807 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0003ad0 con 0x56434001a1f0 2024-09-11T01:11:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.766+0000 7f4ae9606740 1 -- 172.21.15.103:0/745069807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001a1f0 msgr2=0x564340025f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.766+0000 7f4ae9606740 1 --2- 172.21.15.103:0/745069807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001a1f0 0x564340025f30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0000c00 tx=0x7f4ad0004410 comp rx=0 tx=0).stop 2024-09-11T01:11:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.766+0000 7f4ae9606740 1 -- 172.21.15.103:0/745069807 shutdown_connections 2024-09-11T01:11:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.766+0000 7f4ae9606740 1 --2- 172.21.15.103:0/745069807 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001f560 0x564340030eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.767+0000 7f4ae9606740 1 --2- 172.21.15.103:0/745069807 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001cb40 0x564340026470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.767+0000 7f4ae9606740 1 --2- 172.21.15.103:0/745069807 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001a1f0 0x564340025f30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.767+0000 7f4ae9606740 1 -- 172.21.15.103:0/745069807 >> 172.21.15.103:0/745069807 conn(0x5643400230f0 msgr2=0x564340023950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.767+0000 7f4ae9606740 1 -- 172.21.15.103:0/745069807 shutdown_connections 2024-09-11T01:11:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.767+0000 7f4ae9606740 1 -- 172.21.15.103:0/745069807 wait complete. 2024-09-11T01:11:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.768+0000 7f4ae9606740 1 -- start start 2024-09-11T01:11:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.769+0000 7f4ae9606740 1 Processor -- start 2024-09-11T01:11:25.773 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.771+0000 7f4ae9606740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001a1f0 0x56434002fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.774 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.771+0000 7f4ae9606740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001cb40 0x5643400301e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.772+0000 7f4ae9606740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001f560 0x564340030720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.772+0000 7f4ae9606740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01a7b40 con 0x56434001a1f0 2024-09-11T01:11:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.772+0000 7f4ae9606740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01a8fb0 con 0x56434001f560 2024-09-11T01:11:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.772+0000 7f4ae9606740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4ae01a8210 con 0x56434001cb40 2024-09-11T01:11:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.772+0000 7f4ae9606740 10 client.0 _ll_register_callbacks cb 0x7f4ad8009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:11:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.772+0000 7f4adf400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001a1f0 0x56434002fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.772+0000 7f4adf400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001a1f0 0x56434002fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41394/0 (socket says 172.21.15.103:41394) 2024-09-11T01:11:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.772+0000 7f4adf400640 1 -- 172.21.15.103:0/4289709651 learned_addr learned my addr 172.21.15.103:0/4289709651 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:25.775 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.772+0000 7f4adea00640 1 --2- 172.21.15.103:0/4289709651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001cb40 0x5643400301e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.773+0000 7f4adfe00640 1 --2- 172.21.15.103:0/4289709651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001f560 0x564340030720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.773+0000 7f4adf400640 1 -- 172.21.15.103:0/4289709651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001cb40 msgr2=0x5643400301e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.773+0000 7f4adf400640 1 --2- 172.21.15.103:0/4289709651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001cb40 0x5643400301e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.773+0000 7f4adf400640 1 -- 172.21.15.103:0/4289709651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001f560 msgr2=0x564340030720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.773+0000 7f4adf400640 1 --2- 172.21.15.103:0/4289709651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001f560 0x564340030720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.773+0000 7f4adf400640 1 -- 172.21.15.103:0/4289709651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56434002e920 con 0x56434001a1f0 2024-09-11T01:11:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.773+0000 7f4adea00640 1 --2- 172.21.15.103:0/4289709651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001cb40 0x5643400301e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:11:25.776 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.773+0000 7f4adf400640 1 --2- 172.21.15.103:0/4289709651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001a1f0 0x56434002fca0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0005e40 tx=0x7f4ad001ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b711b4d7faab9769 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.773+0000 7f4ac9600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:11:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.774+0000 7f4ac9600640 1 -- 172.21.15.103:0/4289709651 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0036060 con 0x56434001a1f0 2024-09-11T01:11:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.774+0000 7f4ac9600640 1 -- 172.21.15.103:0/4289709651 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f4ad0005240 con 0x56434001a1f0 2024-09-11T01:11:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.774+0000 7f4ae9606740 1 -- 172.21.15.103:0/4289709651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ad0003c70 con 0x56434001a1f0 2024-09-11T01:11:25.777 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.775+0000 7f4ac9600640 1 -- 172.21.15.103:0/4289709651 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4ad003d050 con 0x56434001a1f0 2024-09-11T01:11:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.775+0000 7f4ae9606740 10 client.15702 fetch_fsmap learned FSMap version 28 2024-09-11T01:11:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.775+0000 7f4ae9606740 1 -- 172.21.15.103:0/4289709651 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5643400a17d0 con 0x56434001a1f0 2024-09-11T01:11:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.775+0000 7f4ac9600640 1 -- 172.21.15.103:0/4289709651 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ad0003c70 con 0x56434001a1f0 2024-09-11T01:11:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.776+0000 7f4ac9600640 1 -- 172.21.15.103:0/4289709651 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f4ad0004ae0 con 0x56434001a1f0 2024-09-11T01:11:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.776+0000 7f4ae9606740 10 client.15702 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:11:25.778 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.776+0000 7f4ae9606740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:11:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.776+0000 7f4ae9606740 20 client.15702 populate_metadata read hostname 'smithi103' 2024-09-11T01:11:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.776+0000 7f4ae9606740 1 --2- 172.21.15.103:0/4289709651 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5643400343a0 0x5643400a41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.776+0000 7f4ae9606740 4 client.15702 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:11:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.776+0000 7f4ae9606740 1 -- 172.21.15.103:0/4289709651 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56433ff900b0 con 0x5643400343a0 2024-09-11T01:11:25.779 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.776+0000 7f4adea00640 1 --2- 172.21.15.103:0/4289709651 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5643400343a0 0x5643400a41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:25.782 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.780+0000 7f4adea00640 1 --2- 172.21.15.103:0/4289709651 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5643400343a0 0x5643400a41a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94add2136cc11830 server_cookie=7ff4ceeac2a7dc6d in_seq=0 out_seq=0 2024-09-11T01:11:25.783 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:25.780+0000 7f4ac9600640 10 client.15702 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:27.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:26 smithi103 ceph-mon[30562]: pgmap v492: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 248 MiB/s wr, 1.45k op/s 2024-09-11T01:11:27.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:26 smithi117 ceph-mon[35358]: pgmap v492: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 248 MiB/s wr, 1.45k op/s 2024-09-11T01:11:27.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:26 smithi183 ceph-mon[34992]: pgmap v492: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 248 MiB/s wr, 1.45k op/s 2024-09-11T01:11:28.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:27 smithi103 ceph-mon[30562]: pgmap v493: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 205 MiB/s wr, 1.84k op/s 2024-09-11T01:11:28.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:27 smithi117 ceph-mon[35358]: pgmap v493: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 205 MiB/s wr, 1.84k op/s 2024-09-11T01:11:28.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:27 smithi183 ceph-mon[34992]: pgmap v493: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 376 KiB/s rd, 205 MiB/s wr, 1.84k op/s 2024-09-11T01:11:29.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.176+0000 7f4ac9600640 1 -- 172.21.15.103:0/4289709651 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56433ff900b0 con 0x5643400343a0 2024-09-11T01:11:29.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.176+0000 7f4ac9600640 10 client.15702 handle_command_reply: tid=0 2024-09-11T01:11:29.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.181+0000 7f4ae9606740 1 client.15702 shutdown 2024-09-11T01:11:29.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.181+0000 7f4ae9606740 1 -- 172.21.15.103:0/4289709651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001a1f0 msgr2=0x56434002fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.181+0000 7f4ae9606740 1 --2- 172.21.15.103:0/4289709651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001a1f0 0x56434002fca0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4ad0005e40 tx=0x7f4ad001ee70 comp rx=0 tx=0).stop 2024-09-11T01:11:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.181+0000 7f4ae9606740 1 -- 172.21.15.103:0/4289709651 shutdown_connections 2024-09-11T01:11:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.181+0000 7f4ae9606740 1 --2- 172.21.15.103:0/4289709651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56434001f560 0x564340030720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:29.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.181+0000 7f4ae9606740 1 --2- 172.21.15.103:0/4289709651 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5643400343a0 0x5643400a41a0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:29.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.181+0000 7f4ae9606740 1 --2- 172.21.15.103:0/4289709651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56434001cb40 0x5643400301e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:29.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.181+0000 7f4ae9606740 1 --2- 172.21.15.103:0/4289709651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56434001a1f0 0x56434002fca0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:29.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.181+0000 7f4ae9606740 1 -- 172.21.15.103:0/4289709651 >> 172.21.15.103:0/4289709651 conn(0x5643400230f0 msgr2=0x564340019240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:29.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.182+0000 7f4ac9600640 0 client.15702 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:29.185 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.182+0000 7f4ae9606740 1 -- 172.21.15.103:0/4289709651 shutdown_connections 2024-09-11T01:11:29.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.182+0000 7f4ae9606740 1 -- 172.21.15.103:0/4289709651 wait complete. 2024-09-11T01:11:29.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.183+0000 7f4ae9606740 20 client.15702 trim_cache size 0 max 16384 2024-09-11T01:11:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:11:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:11:29.189 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:11:29.190 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:11:29.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.188+0000 7f4ae6800640 1 -- 172.21.15.103:0/2185837813 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4ac40b5360 msgr2=0x7f4ac40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:29.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.188+0000 7f4ae6800640 1 --2- 172.21.15.103:0/2185837813 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4ac40b5360 0x7f4ac40b7820 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009fd0 tx=0x7f4ad8004ab0 comp rx=0 tx=0).stop 2024-09-11T01:11:29.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.189+0000 7f4ae6800640 1 -- 172.21.15.103:0/2185837813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ae0105cf0 msgr2=0x7f4ae019b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:29.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.189+0000 7f4ae6800640 1 --2- 172.21.15.103:0/2185837813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ae0105cf0 0x7f4ae019b5c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4acc032d80 tx=0x7f4acc032db0 comp rx=0 tx=0).stop 2024-09-11T01:11:29.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.189+0000 7f4ae6800640 1 -- 172.21.15.103:0/2185837813 shutdown_connections 2024-09-11T01:11:29.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.189+0000 7f4ae6800640 1 --2- 172.21.15.103:0/2185837813 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4ac40b5360 0x7f4ac40b7820 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:29.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.189+0000 7f4ae6800640 1 --2- 172.21.15.103:0/2185837813 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ae01066b0 0x7f4ae019c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:29.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.189+0000 7f4ae6800640 1 --2- 172.21.15.103:0/2185837813 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4ae0105cf0 0x7f4ae019b5c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:29.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.189+0000 7f4ae6800640 1 --2- 172.21.15.103:0/2185837813 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae0104ba0 0x7f4ae019af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:29.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.189+0000 7f4ae6800640 1 -- 172.21.15.103:0/2185837813 >> 172.21.15.103:0/2185837813 conn(0x7f4ae0100460 msgr2=0x7f4ae0109080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:29.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.190+0000 7f4ae6800640 1 -- 172.21.15.103:0/2185837813 shutdown_connections 2024-09-11T01:11:29.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:29.190+0000 7f4ae6800640 1 -- 172.21.15.103:0/2185837813 wait complete. 2024-09-11T01:11:31.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:30 smithi103 ceph-mon[30562]: pgmap v494: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 209 MiB/s wr, 4.52k op/s 2024-09-11T01:11:31.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:30 smithi117 ceph-mon[35358]: pgmap v494: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 209 MiB/s wr, 4.52k op/s 2024-09-11T01:11:31.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:30 smithi183 ceph-mon[34992]: pgmap v494: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 209 MiB/s wr, 4.52k op/s 2024-09-11T01:11:32.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:31 smithi103 ceph-mon[30562]: pgmap v495: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 121 MiB/s wr, 5.61k op/s 2024-09-11T01:11:32.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:31 smithi117 ceph-mon[35358]: pgmap v495: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 121 MiB/s wr, 5.61k op/s 2024-09-11T01:11:32.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:31 smithi183 ceph-mon[34992]: pgmap v495: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 121 MiB/s wr, 5.61k op/s 2024-09-11T01:11:34.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:33 smithi103 ceph-mon[30562]: pgmap v496: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 100 MiB/s wr, 7.48k op/s 2024-09-11T01:11:34.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:33 smithi117 ceph-mon[35358]: pgmap v496: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 100 MiB/s wr, 7.48k op/s 2024-09-11T01:11:34.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:33 smithi183 ceph-mon[34992]: pgmap v496: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 556 KiB/s rd, 100 MiB/s wr, 7.48k op/s 2024-09-11T01:11:37.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:36 smithi103 ceph-mon[30562]: pgmap v497: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 71 MiB/s wr, 8.53k op/s 2024-09-11T01:11:37.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:36 smithi117 ceph-mon[35358]: pgmap v497: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 71 MiB/s wr, 8.53k op/s 2024-09-11T01:11:37.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:36 smithi183 ceph-mon[34992]: pgmap v497: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 71 MiB/s wr, 8.53k op/s 2024-09-11T01:11:38.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:37 smithi103 ceph-mon[30562]: pgmap v498: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 57 MiB/s wr, 8.38k op/s 2024-09-11T01:11:38.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:37 smithi117 ceph-mon[35358]: pgmap v498: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 57 MiB/s wr, 8.38k op/s 2024-09-11T01:11:38.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:37 smithi183 ceph-mon[34992]: pgmap v498: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 57 MiB/s wr, 8.38k op/s 2024-09-11T01:11:40.088 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:39 smithi103 ceph-mon[30562]: pgmap v499: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 74 MiB/s wr, 10.36k op/s 2024-09-11T01:11:40.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:39 smithi117 ceph-mon[35358]: pgmap v499: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 74 MiB/s wr, 10.36k op/s 2024-09-11T01:11:40.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:39 smithi183 ceph-mon[34992]: pgmap v499: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 74 MiB/s wr, 10.36k op/s 2024-09-11T01:11:41.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:41 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:11:41.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:41 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:11:41.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:41 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:11:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.614+0000 7f3616a00640 1 -- 172.21.15.103:0/982936451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3610079530 msgr2=0x7f3610079e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.614+0000 7f3616a00640 1 --2- 172.21.15.103:0/982936451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3610079530 0x7f3610079e80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3608009ca0 tx=0x7f360802a8c0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.614+0000 7f3616a00640 1 -- 172.21.15.103:0/982936451 shutdown_connections 2024-09-11T01:11:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.614+0000 7f3616a00640 1 --2- 172.21.15.103:0/982936451 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3610079530 0x7f3610079e80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.614+0000 7f3616a00640 1 --2- 172.21.15.103:0/982936451 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3610078b70 0x7f3610078ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.614+0000 7f3616a00640 1 --2- 172.21.15.103:0/982936451 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3610077a20 0x7f3610077e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.617 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.614+0000 7f3616a00640 1 -- 172.21.15.103:0/982936451 >> 172.21.15.103:0/982936451 conn(0x7f3610100410 msgr2=0x7f3610102870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.617+0000 7f3616a00640 1 -- 172.21.15.103:0/982936451 shutdown_connections 2024-09-11T01:11:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.617+0000 7f3616a00640 1 -- 172.21.15.103:0/982936451 wait complete. 2024-09-11T01:11:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.618+0000 7f3616a00640 1 Processor -- start 2024-09-11T01:11:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.618+0000 7f3616a00640 1 -- start start 2024-09-11T01:11:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.619+0000 7f3616a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3610077a20 0x7f361019f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.619+0000 7f3616a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3610078b70 0x7f361019f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.620+0000 7f360fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3610077a20 0x7f361019f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.621+0000 7f3616a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3610079530 0x7f36101a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.621+0000 7f360fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3610077a20 0x7f361019f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:39200/0 (socket says 172.21.15.103:39200) 2024-09-11T01:11:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.621+0000 7f360fe00640 1 -- 172.21.15.103:0/475593676 learned_addr learned my addr 172.21.15.103:0/475593676 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.621+0000 7f360f400640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3610078b70 0x7f361019f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.621+0000 7f3616a00640 1 -- 172.21.15.103:0/475593676 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3610114c10 con 0x7f3610078b70 2024-09-11T01:11:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.621+0000 7f3616a00640 1 -- 172.21.15.103:0/475593676 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3610114a90 con 0x7f3610077a20 2024-09-11T01:11:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.621+0000 7f3616a00640 1 -- 172.21.15.103:0/475593676 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3610114d90 con 0x7f3610079530 2024-09-11T01:11:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.622+0000 7f3614a00640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3610079530 0x7f36101a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.623+0000 7f360fe00640 1 -- 172.21.15.103:0/475593676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3610079530 msgr2=0x7f36101a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.623+0000 7f360fe00640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3610079530 0x7f36101a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.623+0000 7f360fe00640 1 -- 172.21.15.103:0/475593676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3610078b70 msgr2=0x7f361019f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.623+0000 7f360fe00640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3610078b70 0x7f361019f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.623+0000 7f360fe00640 1 -- 172.21.15.103:0/475593676 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36101a0eb0 con 0x7f3610077a20 2024-09-11T01:11:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.623+0000 7f3614a00640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3610079530 0x7f36101a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:11:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.623+0000 7f360f400640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3610078b70 0x7f361019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:11:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.624+0000 7f360fe00640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3610077a20 0x7f361019f370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f360000e9f0 tx=0x7f360000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:42.627 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.626+0000 7f360cc00640 1 -- 172.21.15.103:0/475593676 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360000cd80 con 0x7f3610077a20 2024-09-11T01:11:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.626+0000 7f360cc00640 1 -- 172.21.15.103:0/475593676 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36000054d0 con 0x7f3610077a20 2024-09-11T01:11:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.626+0000 7f360cc00640 1 -- 172.21.15.103:0/475593676 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3600010690 con 0x7f3610077a20 2024-09-11T01:11:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.626+0000 7f3616a00640 1 -- 172.21.15.103:0/475593676 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36101a11a0 con 0x7f3610077a20 2024-09-11T01:11:42.628 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.627+0000 7f3616a00640 1 -- 172.21.15.103:0/475593676 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36101a7870 con 0x7f3610077a20 2024-09-11T01:11:42.640 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.639+0000 7f36198c3740 1 Processor -- start 2024-09-11T01:11:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.639+0000 7f36198c3740 1 -- start start 2024-09-11T01:11:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.639+0000 7f36198c3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74570790 0x555c74572b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.639+0000 7f36198c3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c745730c0 0x555c745754b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.639+0000 7f36198c3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74575b00 0x555c74577fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.640+0000 7f36198c3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555c744e36b0 con 0x555c745730c0 2024-09-11T01:11:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.640+0000 7f36198c3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555c744d2ae0 con 0x555c74575b00 2024-09-11T01:11:42.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.640+0000 7f36198c3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555c744d68f0 con 0x555c74570790 2024-09-11T01:11:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.640+0000 7f360f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74575b00 0x555c74577fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.640+0000 7f360f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74575b00 0x555c74577fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:39206/0 (socket says 172.21.15.103:39206) 2024-09-11T01:11:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.640+0000 7f360f400640 1 -- 172.21.15.103:0/2550331620 learned_addr learned my addr 172.21.15.103:0/2550331620 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:42.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.640+0000 7f360f400640 1 -- 172.21.15.103:0/2550331620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74570790 msgr2=0x555c74572b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:11:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.640+0000 7f360f400640 1 --2- 172.21.15.103:0/2550331620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74570790 0x555c74572b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.640+0000 7f360f400640 1 -- 172.21.15.103:0/2550331620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c745730c0 msgr2=0x555c745754b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:11:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.640+0000 7f360f400640 1 --2- 172.21.15.103:0/2550331620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c745730c0 0x555c745754b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.641+0000 7f360f400640 1 -- 172.21.15.103:0/2550331620 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c7449f780 con 0x555c74575b00 2024-09-11T01:11:42.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.641+0000 7f360cc00640 1 -- 172.21.15.103:0/475593676 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f3600004e90 con 0x7f3610077a20 2024-09-11T01:11:42.644 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.642+0000 7f360f400640 1 --2- 172.21.15.103:0/2550331620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74575b00 0x555c74577fc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0104d0 tx=0x7f35fc010990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=111044b141db02f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.644+0000 7f3605200640 1 -- 172.21.15.103:0/2550331620 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc011760 con 0x555c74575b00 2024-09-11T01:11:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.645+0000 7f3605200640 1 -- 172.21.15.103:0/2550331620 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35fc011db0 con 0x555c74575b00 2024-09-11T01:11:42.647 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.645+0000 7f3605200640 1 -- 172.21.15.103:0/2550331620 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc00e430 con 0x555c74575b00 2024-09-11T01:11:42.649 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.647+0000 7f360cc00640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f35f40b54b0 0x7f35f40b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.647+0000 7f36198c3740 1 -- 172.21.15.103:0/2550331620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74575b00 msgr2=0x555c74577fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.649+0000 7f36198c3740 1 --2- 172.21.15.103:0/2550331620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74575b00 0x555c74577fc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0104d0 tx=0x7f35fc010990 comp rx=0 tx=0).stop 2024-09-11T01:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.648+0000 7f360cc00640 1 -- 172.21.15.103:0/475593676 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f36000e63f0 con 0x7f3610077a20 2024-09-11T01:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.648+0000 7f3614a00640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f35f40b54b0 0x7f35f40b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.650+0000 7f36198c3740 1 -- 172.21.15.103:0/2550331620 shutdown_connections 2024-09-11T01:11:42.652 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.650+0000 7f36198c3740 1 --2- 172.21.15.103:0/2550331620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74575b00 0x555c74577fc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.650+0000 7f36198c3740 1 --2- 172.21.15.103:0/2550331620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c745730c0 0x555c745754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.650+0000 7f36198c3740 1 --2- 172.21.15.103:0/2550331620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74570790 0x555c74572b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.653 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.650+0000 7f36198c3740 1 -- 172.21.15.103:0/2550331620 >> 172.21.15.103:0/2550331620 conn(0x555c7456b8e0 msgr2=0x555c7456c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:42.655 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.653+0000 7f36198c3740 1 -- 172.21.15.103:0/2550331620 shutdown_connections 2024-09-11T01:11:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.654+0000 7f36198c3740 1 -- 172.21.15.103:0/2550331620 wait complete. 2024-09-11T01:11:42.656 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.654+0000 7f36198c3740 1 -- start start 2024-09-11T01:11:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.655+0000 7f36198c3740 1 Processor -- start 2024-09-11T01:11:42.657 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.656+0000 7f36198c3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 0x555c74579fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.657+0000 7f36198c3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c745730c0 0x555c7457a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.658 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.657+0000 7f36198c3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c74575b00 0x555c7457b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.657+0000 7f36198c3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555c7440aab0 con 0x555c74575b00 2024-09-11T01:11:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.657+0000 7f36198c3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555c74479570 con 0x555c74570790 2024-09-11T01:11:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.657+0000 7f36198c3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555c74578ae0 con 0x555c745730c0 2024-09-11T01:11:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.657+0000 7f360fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 0x555c74579fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.657+0000 7f360f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c745730c0 0x555c7457a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.657+0000 7f360f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c745730c0 0x555c7457a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:35252/0 (socket says 172.21.15.103:35252) 2024-09-11T01:11:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.657+0000 7f360f400640 1 -- 172.21.15.103:0/3890945152 learned_addr learned my addr 172.21.15.103:0/3890945152 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:42.659 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.657+0000 7f36198c3740 10 client.0 _ll_register_callbacks cb 0x555c74488100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:11:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.658+0000 7f360f400640 1 -- 172.21.15.103:0/3890945152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 msgr2=0x555c74579fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:42.661 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.658+0000 7f360f400640 1 --2- 172.21.15.103:0/3890945152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 0x555c74579fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.658+0000 7f360f400640 1 -- 172.21.15.103:0/3890945152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c74575b00 msgr2=0x555c7457b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.658+0000 7f360f400640 1 --2- 172.21.15.103:0/3890945152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c74575b00 0x555c7457b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.660+0000 7f360f400640 1 -- 172.21.15.103:0/3890945152 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c74234790 con 0x555c745730c0 2024-09-11T01:11:42.662 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.660+0000 7f3614a00640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f35f40b54b0 0x7f35f40b7970 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3608006010 tx=0x7f36080093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.661+0000 7f360f400640 1 --2- 172.21.15.103:0/3890945152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c745730c0 0x555c7457a680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00bcd0 tx=0x7f35fc01ddd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71db80443c1861b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:42.663 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.661+0000 7f35f9600640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:11:42.664 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.662+0000 7f35f9600640 1 -- 172.21.15.103:0/3890945152 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35fc005450 con 0x555c745730c0 2024-09-11T01:11:42.665 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.663+0000 7f35f9600640 1 -- 172.21.15.103:0/3890945152 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f35fc0055f0 con 0x555c745730c0 2024-09-11T01:11:42.665 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.663+0000 7f36198c3740 1 -- 172.21.15.103:0/3890945152 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35fc011db0 con 0x555c745730c0 2024-09-11T01:11:42.665 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.664+0000 7f35f9600640 1 -- 172.21.15.103:0/3890945152 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f35fc01c740 con 0x555c745730c0 2024-09-11T01:11:42.666 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.664+0000 7f36198c3740 10 client.25723 fetch_fsmap learned FSMap version 28 2024-09-11T01:11:42.666 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.664+0000 7f36198c3740 1 -- 172.21.15.103:0/3890945152 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555c742ad620 con 0x555c745730c0 2024-09-11T01:11:42.667 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.666+0000 7f35f9600640 1 -- 172.21.15.103:0/3890945152 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35fc011db0 con 0x555c745730c0 2024-09-11T01:11:42.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.667+0000 7f35f9600640 1 -- 172.21.15.103:0/3890945152 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f35fc025070 con 0x555c745730c0 2024-09-11T01:11:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.667+0000 7f36198c3740 10 client.25723 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:11:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.667+0000 7f36198c3740 10 client.25723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:11:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.667+0000 7f36198c3740 20 client.25723 populate_metadata read hostname 'smithi103' 2024-09-11T01:11:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.667+0000 7f36198c3740 1 --2- 172.21.15.103:0/3890945152 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555c74585550 0x555c74587960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.667+0000 7f36198c3740 4 client.25723 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:11:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.667+0000 7f36198c3740 1 -- 172.21.15.103:0/3890945152 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c744e5600 con 0x555c74585550 2024-09-11T01:11:42.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.668+0000 7f360fe00640 1 --2- 172.21.15.103:0/3890945152 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555c74585550 0x555c74587960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.669+0000 7f360fe00640 1 --2- 172.21.15.103:0/3890945152 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555c74585550 0x555c74587960 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=219fa999ebf138a8 server_cookie=4e00b14b66ee38ef in_seq=0 out_seq=0 2024-09-11T01:11:42.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.669+0000 7f35f9600640 10 client.25723 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.670+0000 7f35f9600640 1 -- 172.21.15.103:0/3890945152 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555c744e5600 con 0x555c74585550 2024-09-11T01:11:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.670+0000 7f35f9600640 10 client.25723 handle_command_reply: tid=0 2024-09-11T01:11:42.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.670+0000 7f36198c3740 1 client.25723 shutdown 2024-09-11T01:11:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.671+0000 7f36198c3740 1 -- 172.21.15.103:0/3890945152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c745730c0 msgr2=0x555c7457a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.671+0000 7f36198c3740 1 --2- 172.21.15.103:0/3890945152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c745730c0 0x555c7457a680 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00bcd0 tx=0x7f35fc01ddd0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.672 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.671+0000 7f36198c3740 1 -- 172.21.15.103:0/3890945152 shutdown_connections 2024-09-11T01:11:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.671+0000 7f36198c3740 1 --2- 172.21.15.103:0/3890945152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c74575b00 0x555c7457b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.671+0000 7f36198c3740 1 --2- 172.21.15.103:0/3890945152 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555c74585550 0x555c74587960 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.671+0000 7f36198c3740 1 --2- 172.21.15.103:0/3890945152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c745730c0 0x555c7457a680 secure :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f35fc00bcd0 tx=0x7f35fc01ddd0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.671+0000 7f36198c3740 1 --2- 172.21.15.103:0/3890945152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 0x555c74579fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.671+0000 7f35f9600640 0 client.25723 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:42.673 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.671+0000 7f36198c3740 1 -- 172.21.15.103:0/3890945152 >> 172.21.15.103:0/3890945152 conn(0x555c7456b8e0 msgr2=0x555c7456aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.672+0000 7f36198c3740 1 -- 172.21.15.103:0/3890945152 shutdown_connections 2024-09-11T01:11:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.672+0000 7f36198c3740 1 -- 172.21.15.103:0/3890945152 wait complete. 2024-09-11T01:11:42.674 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.672+0000 7f36198c3740 20 client.25723 trim_cache size 0 max 16384 2024-09-11T01:11:42.723 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.722+0000 7f36198c3740 1 Processor -- start 2024-09-11T01:11:42.724 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.723+0000 7f36198c3740 1 -- start start 2024-09-11T01:11:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.723+0000 7f36198c3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 0x555c745765f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.723+0000 7f36198c3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74575b00 0x555c7456c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.723+0000 7f36198c3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c74582260 0x555c7456c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.723+0000 7f36198c3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f36101b4400 con 0x555c74582260 2024-09-11T01:11:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.723+0000 7f36198c3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f36101b1ca0 con 0x555c74570790 2024-09-11T01:11:42.725 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.723+0000 7f36198c3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f36101afba0 con 0x555c74575b00 2024-09-11T01:11:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.724+0000 7f360f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74575b00 0x555c7456c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.724+0000 7f360f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74575b00 0x555c7456c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:35256/0 (socket says 172.21.15.103:35256) 2024-09-11T01:11:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.724+0000 7f360fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 0x555c745765f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.724+0000 7f360fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 0x555c745765f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:39224/0 (socket says 172.21.15.103:39224) 2024-09-11T01:11:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.724+0000 7f360fe00640 1 -- 172.21.15.103:0/1426163900 learned_addr learned my addr 172.21.15.103:0/1426163900 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.724+0000 7f360fe00640 1 -- 172.21.15.103:0/1426163900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74575b00 msgr2=0x555c7456c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:42.726 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.724+0000 7f360fe00640 1 --2- 172.21.15.103:0/1426163900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74575b00 0x555c7456c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.724+0000 7f360fe00640 1 -- 172.21.15.103:0/1426163900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c74582260 msgr2=0x555c7456c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.724+0000 7f360fe00640 1 --2- 172.21.15.103:0/1426163900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c74582260 0x555c7456c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.724+0000 7f360fe00640 1 -- 172.21.15.103:0/1426163900 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c74572ef0 con 0x555c74570790 2024-09-11T01:11:42.727 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.725+0000 7f360fe00640 1 --2- 172.21.15.103:0/1426163900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 0x555c745765f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f360000c6a0 tx=0x7f36000a8040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2225cbc136314f1d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.727+0000 7f35fbe00640 1 -- 172.21.15.103:0/1426163900 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36000acea0 con 0x555c74570790 2024-09-11T01:11:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.727+0000 7f35fbe00640 1 -- 172.21.15.103:0/1426163900 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36000cf040 con 0x555c74570790 2024-09-11T01:11:42.728 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.727+0000 7f35fbe00640 1 -- 172.21.15.103:0/1426163900 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36000051b0 con 0x555c74570790 2024-09-11T01:11:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.729+0000 7f36198c3740 1 -- 172.21.15.103:0/1426163900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 msgr2=0x555c745765f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:42.730 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.729+0000 7f36198c3740 1 --2- 172.21.15.103:0/1426163900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 0x555c745765f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f360000c6a0 tx=0x7f36000a8040 comp rx=0 tx=0).stop 2024-09-11T01:11:42.735 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.734+0000 7f36198c3740 1 -- 172.21.15.103:0/1426163900 shutdown_connections 2024-09-11T01:11:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.734+0000 7f36198c3740 1 --2- 172.21.15.103:0/1426163900 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c74582260 0x555c7456c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.734+0000 7f36198c3740 1 --2- 172.21.15.103:0/1426163900 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74575b00 0x555c7456c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.734+0000 7f36198c3740 1 --2- 172.21.15.103:0/1426163900 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 0x555c745765f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.736 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.734+0000 7f36198c3740 1 -- 172.21.15.103:0/1426163900 >> 172.21.15.103:0/1426163900 conn(0x555c7456b8e0 msgr2=0x555c74575ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.736+0000 7f36198c3740 1 -- 172.21.15.103:0/1426163900 shutdown_connections 2024-09-11T01:11:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.736+0000 7f36198c3740 1 -- 172.21.15.103:0/1426163900 wait complete. 2024-09-11T01:11:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.736+0000 7f36198c3740 1 -- start start 2024-09-11T01:11:42.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.737+0000 7f36198c3740 1 Processor -- start 2024-09-11T01:11:42.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.740+0000 7f36198c3740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 0x555c74580ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.740+0000 7f36198c3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c74575b00 0x555c745811e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.740+0000 7f36198c3740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74582260 0x555c7457f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.741+0000 7f36198c3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f36101b0160 con 0x555c74575b00 2024-09-11T01:11:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.741+0000 7f36198c3740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f36101b15d0 con 0x555c74570790 2024-09-11T01:11:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.741+0000 7f36198c3740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f36101b0830 con 0x555c74582260 2024-09-11T01:11:42.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.741+0000 7f36198c3740 10 client.0 _ll_register_callbacks cb 0x7f35fc00bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:11:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.741+0000 7f3614a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74582260 0x555c7457f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.741+0000 7f3614a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74582260 0x555c7457f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:35260/0 (socket says 172.21.15.103:35260) 2024-09-11T01:11:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.742+0000 7f3614a00640 1 -- 172.21.15.103:0/729190872 learned_addr learned my addr 172.21.15.103:0/729190872 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:11:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.742+0000 7f360fe00640 1 --2- 172.21.15.103:0/729190872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 0x555c74580ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:42.744 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.743+0000 7f360f400640 1 --2- 172.21.15.103:0/729190872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c74575b00 0x555c745811e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.743+0000 7f3614a00640 1 -- 172.21.15.103:0/729190872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 msgr2=0x555c74580ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.743+0000 7f3614a00640 1 --2- 172.21.15.103:0/729190872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 0x555c74580ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.743+0000 7f3614a00640 1 -- 172.21.15.103:0/729190872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c74575b00 msgr2=0x555c745811e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:11:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.743+0000 7f3614a00640 1 --2- 172.21.15.103:0/729190872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c74575b00 0x555c745811e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.743+0000 7f3614a00640 1 -- 172.21.15.103:0/729190872 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c74581a70 con 0x555c74582260 2024-09-11T01:11:42.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.743+0000 7f360f400640 1 --2- 172.21.15.103:0/729190872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c74575b00 0x555c745811e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:11:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.744+0000 7f3614a00640 1 --2- 172.21.15.103:0/729190872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74582260 0x555c7457f8c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3608009ca0 tx=0x7f3608003d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a78682de41f5cc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:11:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.744+0000 7f35f9600640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:11:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.744+0000 7f35f9600640 1 -- 172.21.15.103:0/729190872 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360804c070 con 0x555c74582260 2024-09-11T01:11:42.746 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.745+0000 7f35f9600640 1 -- 172.21.15.103:0/729190872 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f360802f660 con 0x555c74582260 2024-09-11T01:11:42.747 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.745+0000 7f36198c3740 1 -- 172.21.15.103:0/729190872 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36000cf040 con 0x555c74582260 2024-09-11T01:11:42.748 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.745+0000 7f35f9600640 1 -- 172.21.15.103:0/729190872 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3608056050 con 0x555c74582260 2024-09-11T01:11:42.748 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.746+0000 7f36198c3740 10 client.25729 fetch_fsmap learned FSMap version 28 2024-09-11T01:11:42.748 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.746+0000 7f36198c3740 1 -- 172.21.15.103:0/729190872 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x555c745f2ae0 con 0x555c74582260 2024-09-11T01:11:42.748 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.746+0000 7f35f9600640 1 -- 172.21.15.103:0/729190872 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f36000cf040 con 0x555c74582260 2024-09-11T01:11:42.749 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.747+0000 7f35f9600640 1 -- 172.21.15.103:0/729190872 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 28) ==== 8366+0+0 (secure 0 0 0) 0x7f3608030990 con 0x555c74582260 2024-09-11T01:11:42.749 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.747+0000 7f36198c3740 10 client.25729 fetch_fsmap finished waiting for FSMap version 28 2024-09-11T01:11:42.749 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.747+0000 7f36198c3740 10 client.25729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:11:42.749 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.747+0000 7f36198c3740 20 client.25729 populate_metadata read hostname 'smithi103' 2024-09-11T01:11:42.749 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.747+0000 7f36198c3740 1 --2- 172.21.15.103:0/729190872 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555c745f3570 0x555c745f5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:11:42.749 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.747+0000 7f36198c3740 4 client.25729 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:11:42.749 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.747+0000 7f36198c3740 1 -- 172.21.15.103:0/729190872 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555c744e10b0 con 0x555c745f3570 2024-09-11T01:11:42.749 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.748+0000 7f360fe00640 1 --2- 172.21.15.103:0/729190872 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555c745f3570 0x555c745f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:11:42.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.751+0000 7f360fe00640 1 --2- 172.21.15.103:0/729190872 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555c745f3570 0x555c745f5990 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d86b6863057a4419 server_cookie=df0d4ff7c9c87af9 in_seq=0 out_seq=0 2024-09-11T01:11:42.753 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:42.751+0000 7f35f9600640 10 client.25729 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:42 smithi103 ceph-mon[30562]: pgmap v500: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 66 MiB/s wr, 8.86k op/s 2024-09-11T01:11:42.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:42 smithi117 ceph-mon[35358]: pgmap v500: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 66 MiB/s wr, 8.86k op/s 2024-09-11T01:11:42.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:42 smithi183 ceph-mon[34992]: pgmap v500: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 66 MiB/s wr, 8.86k op/s 2024-09-11T01:11:43.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:11:43.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:11:43.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:11:43.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:11:43.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:11:43.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:11:43.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:11:43.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:11:43.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:11:44.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:44 smithi117 ceph-mon[35358]: pgmap v501: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 78 MiB/s wr, 10.21k op/s 2024-09-11T01:11:44.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:44 smithi183 ceph-mon[34992]: pgmap v501: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 78 MiB/s wr, 10.21k op/s 2024-09-11T01:11:45.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:44 smithi103 ceph-mon[30562]: pgmap v501: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 78 MiB/s wr, 10.21k op/s 2024-09-11T01:11:47.088 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:46 smithi103 ceph-mon[30562]: pgmap v502: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 75 MiB/s wr, 9.70k op/s 2024-09-11T01:11:47.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:46 smithi117 ceph-mon[35358]: pgmap v502: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 75 MiB/s wr, 9.70k op/s 2024-09-11T01:11:47.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:46 smithi183 ceph-mon[34992]: pgmap v502: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 75 MiB/s wr, 9.70k op/s 2024-09-11T01:11:48.095 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:47 smithi103 ceph-mon[30562]: pgmap v503: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 71 MiB/s wr, 9.01k op/s 2024-09-11T01:11:48.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:47 smithi117 ceph-mon[35358]: pgmap v503: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 71 MiB/s wr, 9.01k op/s 2024-09-11T01:11:48.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:47 smithi183 ceph-mon[34992]: pgmap v503: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 71 MiB/s wr, 9.01k op/s 2024-09-11T01:11:51.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:50 smithi103 ceph-mon[30562]: pgmap v504: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 83 MiB/s wr, 10.32k op/s 2024-09-11T01:11:51.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:50 smithi117 ceph-mon[35358]: pgmap v504: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 83 MiB/s wr, 10.32k op/s 2024-09-11T01:11:51.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:50 smithi183 ceph-mon[34992]: pgmap v504: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 83 MiB/s wr, 10.32k op/s 2024-09-11T01:11:52.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:51 smithi103 ceph-mon[30562]: pgmap v505: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 73 MiB/s wr, 9.01k op/s 2024-09-11T01:11:52.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:51 smithi117 ceph-mon[35358]: pgmap v505: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 73 MiB/s wr, 9.01k op/s 2024-09-11T01:11:52.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:51 smithi183 ceph-mon[34992]: pgmap v505: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 73 MiB/s wr, 9.01k op/s 2024-09-11T01:11:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.661+0000 7f35f9600640 1 -- 172.21.15.103:0/729190872 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555c744e10b0 con 0x555c745f3570 2024-09-11T01:11:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.661+0000 7f35f9600640 10 client.25729 handle_command_reply: tid=0 2024-09-11T01:11:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.661+0000 7f36198c3740 1 client.25729 shutdown 2024-09-11T01:11:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.662+0000 7f36198c3740 1 -- 172.21.15.103:0/729190872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74582260 msgr2=0x555c7457f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.662+0000 7f36198c3740 1 --2- 172.21.15.103:0/729190872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74582260 0x555c7457f8c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3608009ca0 tx=0x7f3608003d40 comp rx=0 tx=0).stop 2024-09-11T01:11:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.662+0000 7f36198c3740 1 -- 172.21.15.103:0/729190872 shutdown_connections 2024-09-11T01:11:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.662+0000 7f36198c3740 1 --2- 172.21.15.103:0/729190872 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555c745f3570 0x555c745f5990 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.662+0000 7f36198c3740 1 --2- 172.21.15.103:0/729190872 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555c74582260 0x555c7457f8c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.662+0000 7f36198c3740 1 --2- 172.21.15.103:0/729190872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555c74575b00 0x555c745811e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.662+0000 7f36198c3740 1 --2- 172.21.15.103:0/729190872 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555c74570790 0x555c74580ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.662+0000 7f36198c3740 1 -- 172.21.15.103:0/729190872 >> 172.21.15.103:0/729190872 conn(0x555c7456b8e0 msgr2=0x555c7456c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.662+0000 7f35f9600640 0 client.25729 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:11:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.664+0000 7f36198c3740 1 -- 172.21.15.103:0/729190872 shutdown_connections 2024-09-11T01:11:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.664+0000 7f36198c3740 1 -- 172.21.15.103:0/729190872 wait complete. 2024-09-11T01:11:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.665+0000 7f36198c3740 20 client.25729 trim_cache size 0 max 16384 2024-09-11T01:11:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:11:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:11:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:11:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:11:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.666+0000 7f3616a00640 1 -- 172.21.15.103:0/475593676 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f35f40b54b0 msgr2=0x7f35f40b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.666+0000 7f3616a00640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f35f40b54b0 0x7f35f40b7970 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3608006010 tx=0x7f36080093f0 comp rx=0 tx=0).stop 2024-09-11T01:11:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.666+0000 7f3616a00640 1 -- 172.21.15.103:0/475593676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3610077a20 msgr2=0x7f361019f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:11:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.666+0000 7f3616a00640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3610077a20 0x7f361019f370 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f360000e9f0 tx=0x7f360000edf0 comp rx=0 tx=0).stop 2024-09-11T01:11:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.666+0000 7f3616a00640 1 -- 172.21.15.103:0/475593676 shutdown_connections 2024-09-11T01:11:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.666+0000 7f3616a00640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f35f40b54b0 0x7f35f40b7970 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.666+0000 7f3616a00640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3610079530 0x7f36101a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.666+0000 7f3616a00640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3610078b70 0x7f361019f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.666+0000 7f3616a00640 1 --2- 172.21.15.103:0/475593676 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3610077a20 0x7f361019f370 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:11:54.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.666+0000 7f3616a00640 1 -- 172.21.15.103:0/475593676 >> 172.21.15.103:0/475593676 conn(0x7f3610100410 msgr2=0x7f3610101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:11:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.669+0000 7f3616a00640 1 -- 172.21.15.103:0/475593676 shutdown_connections 2024-09-11T01:11:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:11:54.670+0000 7f3616a00640 1 -- 172.21.15.103:0/475593676 wait complete. 2024-09-11T01:11:55.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:54 smithi103 ceph-mon[30562]: pgmap v506: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 83 MiB/s wr, 10.28k op/s 2024-09-11T01:11:55.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:54 smithi117 ceph-mon[35358]: pgmap v506: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 83 MiB/s wr, 10.28k op/s 2024-09-11T01:11:55.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:54 smithi183 ceph-mon[34992]: pgmap v506: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 83 MiB/s wr, 10.28k op/s 2024-09-11T01:11:57.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:56 smithi103 ceph-mon[30562]: pgmap v507: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 75 MiB/s wr, 9.18k op/s 2024-09-11T01:11:57.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:56 smithi117 ceph-mon[35358]: pgmap v507: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 75 MiB/s wr, 9.18k op/s 2024-09-11T01:11:57.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:56 smithi183 ceph-mon[34992]: pgmap v507: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 75 MiB/s wr, 9.18k op/s 2024-09-11T01:11:59.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:58 smithi103 ceph-mon[30562]: pgmap v508: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 69 MiB/s wr, 8.35k op/s 2024-09-11T01:11:59.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:58 smithi117 ceph-mon[35358]: pgmap v508: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 69 MiB/s wr, 8.35k op/s 2024-09-11T01:11:59.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:58 smithi117 ceph-mon[35358]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:11:59.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:58 smithi183 ceph-mon[34992]: pgmap v508: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 69 MiB/s wr, 8.35k op/s 2024-09-11T01:11:59.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:58 smithi183 ceph-mon[34992]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:11:59.586 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:59 smithi103 ceph-mon[30562]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:12:00.069 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:11:59 smithi183 ceph-mon[34992]: pgmap v509: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 84 MiB/s wr, 10.18k op/s 2024-09-11T01:12:00.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:11:59 smithi103 ceph-mon[30562]: pgmap v509: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 84 MiB/s wr, 10.18k op/s 2024-09-11T01:12:00.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:11:59 smithi117 ceph-mon[35358]: pgmap v509: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 84 MiB/s wr, 10.18k op/s 2024-09-11T01:12:03.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:02 smithi103 ceph-mon[30562]: pgmap v510: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 75 MiB/s wr, 9.10k op/s 2024-09-11T01:12:03.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:02 smithi117 ceph-mon[35358]: pgmap v510: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 75 MiB/s wr, 9.10k op/s 2024-09-11T01:12:03.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:02 smithi183 ceph-mon[34992]: pgmap v510: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 200 KiB/s rd, 75 MiB/s wr, 9.10k op/s 2024-09-11T01:12:05.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:04 smithi103 ceph-mon[30562]: pgmap v511: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 79 MiB/s wr, 9.69k op/s 2024-09-11T01:12:05.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:04 smithi117 ceph-mon[35358]: pgmap v511: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 79 MiB/s wr, 9.69k op/s 2024-09-11T01:12:05.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:04 smithi183 ceph-mon[34992]: pgmap v511: 129 pgs: 129 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 79 MiB/s wr, 9.69k op/s 2024-09-11T01:12:06.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:05 smithi103 ceph-mon[30562]: pgmap v512: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 72 MiB/s wr, 8.81k op/s 2024-09-11T01:12:06.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:05 smithi117 ceph-mon[35358]: pgmap v512: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 72 MiB/s wr, 8.81k op/s 2024-09-11T01:12:06.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:05 smithi183 ceph-mon[34992]: pgmap v512: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 72 MiB/s wr, 8.81k op/s 2024-09-11T01:12:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.893+0000 7f7d57200640 1 -- 172.21.15.103:0/2206481083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d5806b470 msgr2=0x7f7d58103150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.893+0000 7f7d57200640 1 --2- 172.21.15.103:0/2206481083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d5806b470 0x7f7d58103150 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009900 tx=0x7f7d4802a3f0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.893+0000 7f7d57200640 1 -- 172.21.15.103:0/2206481083 shutdown_connections 2024-09-11T01:12:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.893+0000 7f7d57200640 1 --2- 172.21.15.103:0/2206481083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d58106290 0x7f7d58106740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.893+0000 7f7d57200640 1 --2- 172.21.15.103:0/2206481083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d581036e0 0x7f7d58105b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.893+0000 7f7d57200640 1 --2- 172.21.15.103:0/2206481083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d5806b470 0x7f7d58103150 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.893+0000 7f7d57200640 1 -- 172.21.15.103:0/2206481083 >> 172.21.15.103:0/2206481083 conn(0x7f7d580fcf30 msgr2=0x7f7d580ff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.893+0000 7f7d57200640 1 -- 172.21.15.103:0/2206481083 shutdown_connections 2024-09-11T01:12:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.893+0000 7f7d57200640 1 -- 172.21.15.103:0/2206481083 wait complete. 2024-09-11T01:12:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.895+0000 7f7d57200640 1 Processor -- start 2024-09-11T01:12:07.896 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.895+0000 7f7d57200640 1 -- start start 2024-09-11T01:12:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.895+0000 7f7d57200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d5806b470 0x7f7d5819f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.895+0000 7f7d57200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d581036e0 0x7f7d5819f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.895+0000 7f7d57200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d58106290 0x7f7d581a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.895+0000 7f7d57200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58114a40 con 0x7f7d58106290 2024-09-11T01:12:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.895+0000 7f7d57200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581148c0 con 0x7f7d5806b470 2024-09-11T01:12:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.895+0000 7f7d57200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7d58114bc0 con 0x7f7d581036e0 2024-09-11T01:12:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.896+0000 7f7d55400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d581036e0 0x7f7d5819f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.896+0000 7f7d55400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d581036e0 0x7f7d5819f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:54562/0 (socket says 172.21.15.103:54562) 2024-09-11T01:12:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.896+0000 7f7d55400640 1 -- 172.21.15.103:0/2895288138 learned_addr learned my addr 172.21.15.103:0/2895288138 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:12:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.896+0000 7f7d55e00640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d5806b470 0x7f7d5819f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.896+0000 7f7d56800640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d58106290 0x7f7d581a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.896+0000 7f7d55400640 1 -- 172.21.15.103:0/2895288138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d5806b470 msgr2=0x7f7d5819f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.896+0000 7f7d55400640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d5806b470 0x7f7d5819f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.896+0000 7f7d55400640 1 -- 172.21.15.103:0/2895288138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d58106290 msgr2=0x7f7d581a0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.896+0000 7f7d55400640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d58106290 0x7f7d581a0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.896+0000 7f7d55400640 1 -- 172.21.15.103:0/2895288138 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d581a0cd0 con 0x7f7d581036e0 2024-09-11T01:12:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.896+0000 7f7d55e00640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d5806b470 0x7f7d5819f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:12:07.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.897+0000 7f7d55400640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d581036e0 0x7f7d5819f7e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400e9f0 tx=0x7f7d4400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.897+0000 7f7d4ea00640 1 -- 172.21.15.103:0/2895288138 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d4400cd80 con 0x7f7d581036e0 2024-09-11T01:12:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.897+0000 7f7d57200640 1 -- 172.21.15.103:0/2895288138 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d581a0fc0 con 0x7f7d581036e0 2024-09-11T01:12:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.897+0000 7f7d4ea00640 1 -- 172.21.15.103:0/2895288138 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d440054d0 con 0x7f7d581036e0 2024-09-11T01:12:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.897+0000 7f7d57200640 1 -- 172.21.15.103:0/2895288138 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d581a7690 con 0x7f7d581036e0 2024-09-11T01:12:07.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.897+0000 7f7d4ea00640 1 -- 172.21.15.103:0/2895288138 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d44010430 con 0x7f7d581036e0 2024-09-11T01:12:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.901+0000 7f7d4ea00640 1 -- 172.21.15.103:0/2895288138 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f7d440046c0 con 0x7f7d581036e0 2024-09-11T01:12:07.903 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.902+0000 7f7d5fed6740 1 Processor -- start 2024-09-11T01:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.902+0000 7f7d5fed6740 1 -- start start 2024-09-11T01:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.902+0000 7f7d5fed6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 0x55fb6a12ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.902+0000 7f7d5fed6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12f2a0 0x55fb6a131690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.902+0000 7f7d5fed6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a131ce0 0x55fb6a1341a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.902+0000 7f7d5fed6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fb6a09f6b0 con 0x55fb6a12f2a0 2024-09-11T01:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.902+0000 7f7d5fed6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fb6a08eae0 con 0x55fb6a131ce0 2024-09-11T01:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.902+0000 7f7d5fed6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fb6a0928f0 con 0x55fb6a12c970 2024-09-11T01:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.903+0000 7f7d56800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 0x55fb6a12ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.903+0000 7f7d56800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 0x55fb6a12ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:54564/0 (socket says 172.21.15.103:54564) 2024-09-11T01:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.903+0000 7f7d56800640 1 -- 172.21.15.103:0/1345983851 learned_addr learned my addr 172.21.15.103:0/1345983851 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.903+0000 7f7d55400640 1 --2- 172.21.15.103:0/1345983851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a131ce0 0x55fb6a1341a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.903+0000 7f7d55e00640 1 --2- 172.21.15.103:0/1345983851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12f2a0 0x55fb6a131690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.903+0000 7f7d4ea00640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7d3c0b5360 0x7f7d3c0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.903+0000 7f7d55400640 1 -- 172.21.15.103:0/1345983851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 msgr2=0x55fb6a12ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.903+0000 7f7d55400640 1 --2- 172.21.15.103:0/1345983851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 0x55fb6a12ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.903+0000 7f7d55400640 1 -- 172.21.15.103:0/1345983851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12f2a0 msgr2=0x55fb6a131690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.903+0000 7f7d55400640 1 --2- 172.21.15.103:0/1345983851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12f2a0 0x55fb6a131690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.903+0000 7f7d55400640 1 -- 172.21.15.103:0/1345983851 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb6a05b780 con 0x55fb6a131ce0 2024-09-11T01:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.903+0000 7f7d55e00640 1 --2- 172.21.15.103:0/1345983851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12f2a0 0x55fb6a131690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.904+0000 7f7d4ea00640 1 -- 172.21.15.103:0/2895288138 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f7d440e62d0 con 0x7f7d581036e0 2024-09-11T01:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.904+0000 7f7d56800640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7d3c0b5360 0x7f7d3c0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.904+0000 7f7d55400640 1 --2- 172.21.15.103:0/1345983851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a131ce0 0x55fb6a1341a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7d440e3960 tx=0x7f7d44009720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=354249e850fc10a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.904+0000 7f7d43400640 1 -- 172.21.15.103:0/1345983851 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d440ac450 con 0x55fb6a131ce0 2024-09-11T01:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.904+0000 7f7d43400640 1 -- 172.21.15.103:0/1345983851 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d440ac190 con 0x55fb6a131ce0 2024-09-11T01:12:07.908 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.904+0000 7f7d43400640 1 -- 172.21.15.103:0/1345983851 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d440abdf0 con 0x55fb6a131ce0 2024-09-11T01:12:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.905+0000 7f7d5fed6740 1 -- 172.21.15.103:0/1345983851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a131ce0 msgr2=0x55fb6a1341a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.905+0000 7f7d56800640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7d3c0b5360 0x7f7d3c0b7820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7d50010650 tx=0x7f7d50004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.905+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/1345983851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a131ce0 0x55fb6a1341a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f7d440e3960 tx=0x7f7d44009720 comp rx=0 tx=0).stop 2024-09-11T01:12:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.905+0000 7f7d5fed6740 1 -- 172.21.15.103:0/1345983851 shutdown_connections 2024-09-11T01:12:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.905+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/1345983851 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a131ce0 0x55fb6a1341a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.905+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/1345983851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12f2a0 0x55fb6a131690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.905+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/1345983851 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 0x55fb6a12ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.905+0000 7f7d5fed6740 1 -- 172.21.15.103:0/1345983851 >> 172.21.15.103:0/1345983851 conn(0x55fb6a127ac0 msgr2=0x55fb6a128850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:07.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.905+0000 7f7d5fed6740 1 -- 172.21.15.103:0/1345983851 shutdown_connections 2024-09-11T01:12:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.905+0000 7f7d5fed6740 1 -- 172.21.15.103:0/1345983851 wait complete. 2024-09-11T01:12:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.906+0000 7f7d5fed6740 1 -- start start 2024-09-11T01:12:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.906+0000 7f7d5fed6740 1 Processor -- start 2024-09-11T01:12:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.906+0000 7f7d5fed6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 0x55fb6a136010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.906+0000 7f7d5fed6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12f2a0 0x55fb6a1366b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.906+0000 7f7d5fed6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a131ce0 0x55fb6a137280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.906+0000 7f7d5fed6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fb69fc6ab0 con 0x55fb6a12f2a0 2024-09-11T01:12:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.906+0000 7f7d5fed6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fb6a035570 con 0x55fb6a131ce0 2024-09-11T01:12:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.906+0000 7f7d5fed6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fb6a134c00 con 0x55fb6a12c970 2024-09-11T01:12:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.906+0000 7f7d5fed6740 10 client.0 _ll_register_callbacks cb 0x55fb6a044100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:12:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.907+0000 7f7d55e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 0x55fb6a136010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.907+0000 7f7d55e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 0x55fb6a136010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:54574/0 (socket says 172.21.15.103:54574) 2024-09-11T01:12:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.907+0000 7f7d55e00640 1 -- 172.21.15.103:0/294958237 learned_addr learned my addr 172.21.15.103:0/294958237 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:12:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.907+0000 7f7d55400640 1 --2- 172.21.15.103:0/294958237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12f2a0 0x55fb6a1366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.907+0000 7f7d56800640 1 --2- 172.21.15.103:0/294958237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a131ce0 0x55fb6a137280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.907+0000 7f7d56800640 1 -- 172.21.15.103:0/294958237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 msgr2=0x55fb6a136010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.907+0000 7f7d56800640 1 --2- 172.21.15.103:0/294958237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 0x55fb6a136010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.907+0000 7f7d56800640 1 -- 172.21.15.103:0/294958237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12f2a0 msgr2=0x55fb6a1366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.907+0000 7f7d56800640 1 --2- 172.21.15.103:0/294958237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12f2a0 0x55fb6a1366b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.907+0000 7f7d56800640 1 -- 172.21.15.103:0/294958237 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb69df0790 con 0x55fb6a131ce0 2024-09-11T01:12:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.908+0000 7f7d56800640 1 --2- 172.21.15.103:0/294958237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a131ce0 0x55fb6a137280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009fd0 tx=0x7f7d50004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9f9696fe30f9654 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.908+0000 7f7d37e00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:12:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.908+0000 7f7d37e00640 1 -- 172.21.15.103:0/294958237 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d5000fc40 con 0x55fb6a131ce0 2024-09-11T01:12:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.908+0000 7f7d5fed6740 1 -- 172.21.15.103:0/294958237 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d440ac190 con 0x55fb6a131ce0 2024-09-11T01:12:07.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.908+0000 7f7d37e00640 1 -- 172.21.15.103:0/294958237 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f7d5000fde0 con 0x55fb6a131ce0 2024-09-11T01:12:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.908+0000 7f7d37e00640 1 -- 172.21.15.103:0/294958237 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7d50004b20 con 0x55fb6a131ce0 2024-09-11T01:12:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.908+0000 7f7d5fed6740 10 client.25772 fetch_fsmap learned FSMap version 29 2024-09-11T01:12:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.908+0000 7f7d5fed6740 1 -- 172.21.15.103:0/294958237 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fb69e69620 con 0x55fb6a131ce0 2024-09-11T01:12:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.908+0000 7f7d37e00640 1 -- 172.21.15.103:0/294958237 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d440ac190 con 0x55fb6a131ce0 2024-09-11T01:12:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.908+0000 7f7d37e00640 1 -- 172.21.15.103:0/294958237 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7d50005290 con 0x55fb6a131ce0 2024-09-11T01:12:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.909+0000 7f7d5fed6740 10 client.25772 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T01:12:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.909+0000 7f7d5fed6740 10 client.25772 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:12:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.909+0000 7f7d5fed6740 20 client.25772 populate_metadata read hostname 'smithi103' 2024-09-11T01:12:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.909+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/294958237 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fb6a141960 0x55fb6a143d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.909+0000 7f7d5fed6740 4 client.25772 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:12:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.909+0000 7f7d5fed6740 1 -- 172.21.15.103:0/294958237 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb6a0a1600 con 0x55fb6a141960 2024-09-11T01:12:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.909+0000 7f7d55e00640 1 --2- 172.21.15.103:0/294958237 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fb6a141960 0x55fb6a143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.909+0000 7f7d55e00640 1 --2- 172.21.15.103:0/294958237 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fb6a141960 0x55fb6a143d50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e40baffb66720b9b server_cookie=3a6bd7af128ba4cf in_seq=0 out_seq=0 2024-09-11T01:12:07.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.909+0000 7f7d37e00640 10 client.25772 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:12:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.910+0000 7f7d37e00640 1 -- 172.21.15.103:0/294958237 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fb6a0a1600 con 0x55fb6a141960 2024-09-11T01:12:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.910+0000 7f7d37e00640 10 client.25772 handle_command_reply: tid=0 2024-09-11T01:12:07.916 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.911+0000 7f7d5fed6740 1 client.25772 shutdown 2024-09-11T01:12:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.911+0000 7f7d5fed6740 1 -- 172.21.15.103:0/294958237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a131ce0 msgr2=0x55fb6a137280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.911+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/294958237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a131ce0 0x55fb6a137280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009fd0 tx=0x7f7d50004ab0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.911+0000 7f7d5fed6740 1 -- 172.21.15.103:0/294958237 shutdown_connections 2024-09-11T01:12:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.911+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/294958237 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a131ce0 0x55fb6a137280 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.911+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/294958237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12f2a0 0x55fb6a1366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.911+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/294958237 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fb6a141960 0x55fb6a143d50 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.911+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/294958237 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 0x55fb6a136010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.917 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.911+0000 7f7d37e00640 0 client.25772 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:12:07.918 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.911+0000 7f7d5fed6740 1 -- 172.21.15.103:0/294958237 >> 172.21.15.103:0/294958237 conn(0x55fb6a127ac0 msgr2=0x55fb6a126bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:07.918 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.911+0000 7f7d5fed6740 1 -- 172.21.15.103:0/294958237 shutdown_connections 2024-09-11T01:12:07.918 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.911+0000 7f7d5fed6740 1 -- 172.21.15.103:0/294958237 wait complete. 2024-09-11T01:12:07.918 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.911+0000 7f7d5fed6740 20 client.25772 trim_cache size 0 max 16384 2024-09-11T01:12:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.942+0000 7f7d5fed6740 1 Processor -- start 2024-09-11T01:12:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.942+0000 7f7d5fed6740 1 -- start start 2024-09-11T01:12:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.943+0000 7f7d5fed6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 0x55fb6a1283e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.943+0000 7f7d5fed6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a12f2a0 0x55fb6a128920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.943+0000 7f7d5fed6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a131ce0 0x55fb6a12a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.943+0000 7f7d5fed6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581b4440 con 0x55fb6a131ce0 2024-09-11T01:12:07.945 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.943+0000 7f7d5fed6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581b1d10 con 0x55fb6a12f2a0 2024-09-11T01:12:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.943+0000 7f7d5fed6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581afb60 con 0x55fb6a12c970 2024-09-11T01:12:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.943+0000 7f7d55400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a12f2a0 0x55fb6a128920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.943+0000 7f7d55400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a12f2a0 0x55fb6a128920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:45026/0 (socket says 172.21.15.103:45026) 2024-09-11T01:12:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.943+0000 7f7d55400640 1 -- 172.21.15.103:0/2510047702 learned_addr learned my addr 172.21.15.103:0/2510047702 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:12:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.943+0000 7f7d56800640 1 --2- 172.21.15.103:0/2510047702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a131ce0 0x55fb6a12a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.943+0000 7f7d55400640 1 -- 172.21.15.103:0/2510047702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 msgr2=0x55fb6a1283e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.943+0000 7f7d55400640 1 --2- 172.21.15.103:0/2510047702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 0x55fb6a1283e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.944+0000 7f7d55400640 1 -- 172.21.15.103:0/2510047702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a131ce0 msgr2=0x55fb6a12a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.944+0000 7f7d55400640 1 --2- 172.21.15.103:0/2510047702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a131ce0 0x55fb6a12a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.944+0000 7f7d55400640 1 -- 172.21.15.103:0/2510047702 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb6a1440c0 con 0x55fb6a12f2a0 2024-09-11T01:12:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.944+0000 7f7d55400640 1 --2- 172.21.15.103:0/2510047702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a12f2a0 0x55fb6a128920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7d440ac610 tx=0x7f7d44005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b3c4dcd3b4110ae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.944+0000 7f7d42a00640 1 -- 172.21.15.103:0/2510047702 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d440abfd0 con 0x55fb6a12f2a0 2024-09-11T01:12:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.944+0000 7f7d42a00640 1 -- 172.21.15.103:0/2510047702 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d440ac680 con 0x55fb6a12f2a0 2024-09-11T01:12:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.944+0000 7f7d42a00640 1 -- 172.21.15.103:0/2510047702 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d440a88f0 con 0x55fb6a12f2a0 2024-09-11T01:12:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.945+0000 7f7d5fed6740 1 -- 172.21.15.103:0/2510047702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a12f2a0 msgr2=0x55fb6a128920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.945+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/2510047702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a12f2a0 0x55fb6a128920 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7d440ac610 tx=0x7f7d44005740 comp rx=0 tx=0).stop 2024-09-11T01:12:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.945+0000 7f7d5fed6740 1 -- 172.21.15.103:0/2510047702 shutdown_connections 2024-09-11T01:12:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.945+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/2510047702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a131ce0 0x55fb6a12a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.945+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/2510047702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a12f2a0 0x55fb6a128920 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.945+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/2510047702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a12c970 0x55fb6a1283e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.945+0000 7f7d5fed6740 1 -- 172.21.15.103:0/2510047702 >> 172.21.15.103:0/2510047702 conn(0x55fb6a127ac0 msgr2=0x55fb6a132150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.945+0000 7f7d5fed6740 1 -- 172.21.15.103:0/2510047702 shutdown_connections 2024-09-11T01:12:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.945+0000 7f7d5fed6740 1 -- 172.21.15.103:0/2510047702 wait complete. 2024-09-11T01:12:07.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.946+0000 7f7d5fed6740 1 -- start start 2024-09-11T01:12:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.947+0000 7f7d5fed6740 1 Processor -- start 2024-09-11T01:12:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.947+0000 7f7d5fed6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12c970 0x55fb6a13d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.947+0000 7f7d5fed6740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a12f2a0 0x55fb6a13c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.947+0000 7f7d5fed6740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a131ce0 0x55fb6a13c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.947+0000 7f7d5fed6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581b01d0 con 0x55fb6a12c970 2024-09-11T01:12:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.947+0000 7f7d5fed6740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581b1640 con 0x55fb6a12f2a0 2024-09-11T01:12:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.947+0000 7f7d5fed6740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7d581b08a0 con 0x55fb6a131ce0 2024-09-11T01:12:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.947+0000 7f7d5fed6740 10 client.0 _ll_register_callbacks cb 0x7f7d50009760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:12:07.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.948+0000 7f7d55400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a12f2a0 0x55fb6a13c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.948+0000 7f7d55400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a12f2a0 0x55fb6a13c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:45028/0 (socket says 172.21.15.103:45028) 2024-09-11T01:12:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.948+0000 7f7d55400640 1 -- 172.21.15.103:0/559490187 learned_addr learned my addr 172.21.15.103:0/559490187 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:12:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.948+0000 7f7d55e00640 1 --2- 172.21.15.103:0/559490187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12c970 0x55fb6a13d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.948+0000 7f7d56800640 1 --2- 172.21.15.103:0/559490187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a131ce0 0x55fb6a13c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.948+0000 7f7d56800640 1 -- 172.21.15.103:0/559490187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a12f2a0 msgr2=0x55fb6a13c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.948+0000 7f7d56800640 1 --2- 172.21.15.103:0/559490187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a12f2a0 0x55fb6a13c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.948+0000 7f7d56800640 1 -- 172.21.15.103:0/559490187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12c970 msgr2=0x55fb6a13d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:07.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.948+0000 7f7d56800640 1 --2- 172.21.15.103:0/559490187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12c970 0x55fb6a13d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.949+0000 7f7d56800640 1 -- 172.21.15.103:0/559490187 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb6a13cb60 con 0x55fb6a131ce0 2024-09-11T01:12:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.949+0000 7f7d55400640 1 --2- 172.21.15.103:0/559490187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a12f2a0 0x55fb6a13c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:12:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.949+0000 7f7d56800640 1 --2- 172.21.15.103:0/559490187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a131ce0 0x55fb6a13c620 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d50005850 tx=0x7f7d5000f950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4613cc5de34e3a01 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.949+0000 7f7d37e00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:12:07.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.950+0000 7f7d37e00640 1 -- 172.21.15.103:0/559490187 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50039070 con 0x55fb6a131ce0 2024-09-11T01:12:07.953 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.950+0000 7f7d5fed6740 1 -- 172.21.15.103:0/559490187 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fb6a09d0b0 con 0x55fb6a131ce0 2024-09-11T01:12:07.953 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.951+0000 7f7d37e00640 1 -- 172.21.15.103:0/559490187 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f7d5001d800 con 0x55fb6a131ce0 2024-09-11T01:12:07.953 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.951+0000 7f7d37e00640 1 -- 172.21.15.103:0/559490187 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7d5001da00 con 0x55fb6a131ce0 2024-09-11T01:12:07.953 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.951+0000 7f7d5fed6740 10 client.25744 fetch_fsmap learned FSMap version 29 2024-09-11T01:12:07.953 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.951+0000 7f7d5fed6740 1 -- 172.21.15.103:0/559490187 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fb6a1af580 con 0x55fb6a131ce0 2024-09-11T01:12:07.953 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.951+0000 7f7d37e00640 1 -- 172.21.15.103:0/559490187 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55fb6a09d0b0 con 0x55fb6a131ce0 2024-09-11T01:12:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.953+0000 7f7d37e00640 1 -- 172.21.15.103:0/559490187 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f7d50004cc0 con 0x55fb6a131ce0 2024-09-11T01:12:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.953+0000 7f7d5fed6740 10 client.25744 fetch_fsmap finished waiting for FSMap version 29 2024-09-11T01:12:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.953+0000 7f7d5fed6740 10 client.25744 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:12:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.953+0000 7f7d5fed6740 20 client.25744 populate_metadata read hostname 'smithi103' 2024-09-11T01:12:07.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.953+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/559490187 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fb6a1aff60 0x55fb6a1b2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:07.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.953+0000 7f7d5fed6740 4 client.25744 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:12:07.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.953+0000 7f7d5fed6740 1 -- 172.21.15.103:0/559490187 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fb6a09a4e0 con 0x55fb6a1aff60 2024-09-11T01:12:07.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.953+0000 7f7d55e00640 1 --2- 172.21.15.103:0/559490187 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fb6a1aff60 0x55fb6a1b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:07.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.954+0000 7f7d55e00640 1 --2- 172.21.15.103:0/559490187 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fb6a1aff60 0x55fb6a1b2380 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a30b0df1c95750bd server_cookie=1548cb05e6ef1938 in_seq=0 out_seq=0 2024-09-11T01:12:07.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:07.954+0000 7f7d37e00640 10 client.25744 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:12:09.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:08 smithi103 ceph-mon[30562]: pgmap v513: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 63 MiB/s wr, 7.76k op/s 2024-09-11T01:12:09.144 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:08 smithi117 ceph-mon[35358]: pgmap v513: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 63 MiB/s wr, 7.76k op/s 2024-09-11T01:12:09.177 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:08 smithi183 ceph-mon[34992]: pgmap v513: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 63 MiB/s wr, 7.76k op/s 2024-09-11T01:12:10.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:09 smithi103 ceph-mon[30562]: pgmap v514: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 85 MiB/s wr, 10.25k op/s 2024-09-11T01:12:10.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:09 smithi117 ceph-mon[35358]: pgmap v514: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 85 MiB/s wr, 10.25k op/s 2024-09-11T01:12:10.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:09 smithi183 ceph-mon[34992]: pgmap v514: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 85 MiB/s wr, 10.25k op/s 2024-09-11T01:12:12.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:11 smithi103 ceph-mon[30562]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:12:12.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:11 smithi103 ceph-mon[30562]: pgmap v515: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 69 MiB/s wr, 8.21k op/s 2024-09-11T01:12:12.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:11 smithi117 ceph-mon[35358]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:12:12.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:11 smithi117 ceph-mon[35358]: pgmap v515: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 69 MiB/s wr, 8.21k op/s 2024-09-11T01:12:12.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:11 smithi183 ceph-mon[34992]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:12:12.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:11 smithi183 ceph-mon[34992]: pgmap v515: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 69 MiB/s wr, 8.21k op/s 2024-09-11T01:12:13.664 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.658+0000 7f7d37e00640 1 -- 172.21.15.103:0/559490187 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fb6a09a4e0 con 0x55fb6a1aff60 2024-09-11T01:12:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.658+0000 7f7d37e00640 10 client.25744 handle_command_reply: tid=0 2024-09-11T01:12:13.665 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.662+0000 7f7d5fed6740 1 client.25744 shutdown 2024-09-11T01:12:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.665+0000 7f7d5fed6740 1 -- 172.21.15.103:0/559490187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a131ce0 msgr2=0x55fb6a13c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.665+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/559490187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a131ce0 0x55fb6a13c620 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d50005850 tx=0x7f7d5000f950 comp rx=0 tx=0).stop 2024-09-11T01:12:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.665+0000 7f7d5fed6740 1 -- 172.21.15.103:0/559490187 shutdown_connections 2024-09-11T01:12:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.665+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/559490187 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fb6a1aff60 0x55fb6a1b2380 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.665+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/559490187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fb6a131ce0 0x55fb6a13c620 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.665+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/559490187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fb6a12f2a0 0x55fb6a13c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.665+0000 7f7d37e00640 0 client.25744 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:12:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.665+0000 7f7d5fed6740 1 --2- 172.21.15.103:0/559490187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb6a12c970 0x55fb6a13d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:13.668 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.665+0000 7f7d5fed6740 1 -- 172.21.15.103:0/559490187 >> 172.21.15.103:0/559490187 conn(0x55fb6a127ac0 msgr2=0x55fb6a12ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.665+0000 7f7d5fed6740 1 -- 172.21.15.103:0/559490187 shutdown_connections 2024-09-11T01:12:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.665+0000 7f7d5fed6740 1 -- 172.21.15.103:0/559490187 wait complete. 2024-09-11T01:12:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.666+0000 7f7d5fed6740 20 client.25744 trim_cache size 0 max 16384 2024-09-11T01:12:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:12:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:12:13.669 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:12:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:12:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.667+0000 7f7d57200640 1 -- 172.21.15.103:0/2895288138 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7d3c0b5360 msgr2=0x7f7d3c0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.667+0000 7f7d57200640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7d3c0b5360 0x7f7d3c0b7820 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7d50010650 tx=0x7f7d50004a40 comp rx=0 tx=0).stop 2024-09-11T01:12:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.667+0000 7f7d57200640 1 -- 172.21.15.103:0/2895288138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d581036e0 msgr2=0x7f7d5819f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.667+0000 7f7d57200640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d581036e0 0x7f7d5819f7e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7d4400e9f0 tx=0x7f7d4400edf0 comp rx=0 tx=0).stop 2024-09-11T01:12:13.670 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.667+0000 7f7d57200640 1 -- 172.21.15.103:0/2895288138 shutdown_connections 2024-09-11T01:12:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.667+0000 7f7d57200640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7d3c0b5360 0x7f7d3c0b7820 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.667+0000 7f7d57200640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7d58106290 0x7f7d581a0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.667+0000 7f7d57200640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7d581036e0 0x7f7d5819f7e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.667+0000 7f7d57200640 1 --2- 172.21.15.103:0/2895288138 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7d5806b470 0x7f7d5819f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.667+0000 7f7d57200640 1 -- 172.21.15.103:0/2895288138 >> 172.21.15.103:0/2895288138 conn(0x7f7d580fcf30 msgr2=0x7f7d58104480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.668+0000 7f7d57200640 1 -- 172.21.15.103:0/2895288138 shutdown_connections 2024-09-11T01:12:13.671 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:13.668+0000 7f7d57200640 1 -- 172.21.15.103:0/2895288138 wait complete. 2024-09-11T01:12:15.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:14 smithi103 ceph-mon[30562]: pgmap v516: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 80 MiB/s wr, 9.39k op/s 2024-09-11T01:12:15.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:14 smithi117 ceph-mon[35358]: pgmap v516: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 80 MiB/s wr, 9.39k op/s 2024-09-11T01:12:15.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:14 smithi183 ceph-mon[34992]: pgmap v516: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 80 MiB/s wr, 9.39k op/s 2024-09-11T01:12:16.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:15 smithi103 ceph-mon[30562]: pgmap v517: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 83 MiB/s wr, 9.84k op/s 2024-09-11T01:12:16.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:15 smithi117 ceph-mon[35358]: pgmap v517: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 83 MiB/s wr, 9.84k op/s 2024-09-11T01:12:16.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:15 smithi183 ceph-mon[34992]: pgmap v517: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 83 MiB/s wr, 9.84k op/s 2024-09-11T01:12:18.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:17 smithi103 ceph-mon[30562]: pgmap v518: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 75 MiB/s wr, 8.85k op/s 2024-09-11T01:12:18.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:17 smithi117 ceph-mon[35358]: pgmap v518: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 75 MiB/s wr, 8.85k op/s 2024-09-11T01:12:18.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:17 smithi183 ceph-mon[34992]: pgmap v518: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 75 MiB/s wr, 8.85k op/s 2024-09-11T01:12:19.377 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-11T01:12:19.377 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-11T01:12:19.377 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:12:19.759 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:19 smithi103 ceph-mon[30562]: pgmap v519: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 90 MiB/s wr, 10.77k op/s 2024-09-11T01:12:20.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:19 smithi117 ceph-mon[35358]: pgmap v519: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 90 MiB/s wr, 10.77k op/s 2024-09-11T01:12:20.154 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:12:20.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:19 smithi183 ceph-mon[34992]: pgmap v519: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 90 MiB/s wr, 10.77k op/s 2024-09-11T01:12:22.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:21 smithi103 ceph-mon[30562]: pgmap v520: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 72 MiB/s wr, 8.62k op/s 2024-09-11T01:12:22.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:21 smithi117 ceph-mon[35358]: pgmap v520: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 72 MiB/s wr, 8.62k op/s 2024-09-11T01:12:22.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:21 smithi183 ceph-mon[34992]: pgmap v520: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 72 MiB/s wr, 8.62k op/s 2024-09-11T01:12:24.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:23 smithi103 ceph-mon[30562]: pgmap v521: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 84 MiB/s wr, 9.92k op/s 2024-09-11T01:12:24.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:23 smithi117 ceph-mon[35358]: pgmap v521: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 84 MiB/s wr, 9.92k op/s 2024-09-11T01:12:24.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:23 smithi183 ceph-mon[34992]: pgmap v521: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 84 MiB/s wr, 9.92k op/s 2024-09-11T01:12:26.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:25 smithi103 ceph-mon[30562]: pgmap v522: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 81 MiB/s wr, 9.53k op/s 2024-09-11T01:12:26.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:25 smithi117 ceph-mon[35358]: pgmap v522: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 81 MiB/s wr, 9.53k op/s 2024-09-11T01:12:26.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:25 smithi183 ceph-mon[34992]: pgmap v522: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 81 MiB/s wr, 9.53k op/s 2024-09-11T01:12:26.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.792+0000 7f6285a00640 1 -- 172.21.15.103:0/1862457702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6280105b00 msgr2=0x7f6280105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.795 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.792+0000 7f6285a00640 1 --2- 172.21.15.103:0/1862457702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6280105b00 0x7f6280105f80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f626c009930 tx=0x7f626c02a420 comp rx=0 tx=0).stop 2024-09-11T01:12:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.792+0000 7f6285a00640 1 -- 172.21.15.103:0/1862457702 shutdown_connections 2024-09-11T01:12:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.792+0000 7f6285a00640 1 --2- 172.21.15.103:0/1862457702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62801064c0 0x7f628010ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.792+0000 7f6285a00640 1 --2- 172.21.15.103:0/1862457702 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6280105b00 0x7f6280105f80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.792+0000 7f6285a00640 1 --2- 172.21.15.103:0/1862457702 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62801049b0 0x7f6280104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.792+0000 7f6285a00640 1 -- 172.21.15.103:0/1862457702 >> 172.21.15.103:0/1862457702 conn(0x7f6280100250 msgr2=0x7f6280102690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.792+0000 7f6285a00640 1 -- 172.21.15.103:0/1862457702 shutdown_connections 2024-09-11T01:12:26.796 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.793+0000 7f6285a00640 1 -- 172.21.15.103:0/1862457702 wait complete. 2024-09-11T01:12:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.793+0000 7f6285a00640 1 Processor -- start 2024-09-11T01:12:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.793+0000 7f6285a00640 1 -- start start 2024-09-11T01:12:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.794+0000 7f6285a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62801049b0 0x7f628019ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.794+0000 7f6285a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6280105b00 0x7f628019b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.794+0000 7f6285a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62801064c0 0x7f628019c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.794+0000 7f6285a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6280110670 con 0x7f6280105b00 2024-09-11T01:12:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.794+0000 7f6285a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f62801104f0 con 0x7f62801049b0 2024-09-11T01:12:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.794+0000 7f6285a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f62801107f0 con 0x7f62801064c0 2024-09-11T01:12:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.794+0000 7f627f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6280105b00 0x7f628019b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.794+0000 7f627fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62801049b0 0x7f628019ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.794+0000 7f627f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6280105b00 0x7f628019b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39224/0 (socket says 172.21.15.103:39224) 2024-09-11T01:12:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.794+0000 7f627f400640 1 -- 172.21.15.103:0/893045398 learned_addr learned my addr 172.21.15.103:0/893045398 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:12:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.794+0000 7f6285000640 1 --2- 172.21.15.103:0/893045398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62801064c0 0x7f628019c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.794+0000 7f627fe00640 1 -- 172.21.15.103:0/893045398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62801064c0 msgr2=0x7f628019c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.795+0000 7f627fe00640 1 --2- 172.21.15.103:0/893045398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62801064c0 0x7f628019c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.795+0000 7f627fe00640 1 -- 172.21.15.103:0/893045398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6280105b00 msgr2=0x7f628019b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.795+0000 7f627fe00640 1 --2- 172.21.15.103:0/893045398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6280105b00 0x7f628019b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.795+0000 7f627fe00640 1 -- 172.21.15.103:0/893045398 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628019c940 con 0x7f62801049b0 2024-09-11T01:12:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.795+0000 7f627f400640 1 --2- 172.21.15.103:0/893045398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6280105b00 0x7f628019b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:12:26.800 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.795+0000 7f627fe00640 1 --2- 172.21.15.103:0/893045398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62801049b0 0x7f628019ae00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f627000e9f0 tx=0x7f627000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:26.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.795+0000 7f627cc00640 1 -- 172.21.15.103:0/893045398 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627000ccc0 con 0x7f62801049b0 2024-09-11T01:12:26.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.795+0000 7f627cc00640 1 -- 172.21.15.103:0/893045398 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6270005020 con 0x7f62801049b0 2024-09-11T01:12:26.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.795+0000 7f6285a00640 1 -- 172.21.15.103:0/893045398 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628019cc30 con 0x7f62801049b0 2024-09-11T01:12:26.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.795+0000 7f627cc00640 1 -- 172.21.15.103:0/893045398 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627000ce60 con 0x7f62801049b0 2024-09-11T01:12:26.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.795+0000 7f6285a00640 1 -- 172.21.15.103:0/893045398 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62801a3300 con 0x7f62801049b0 2024-09-11T01:12:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.798+0000 7f6289e51740 1 Processor -- start 2024-09-11T01:12:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.798+0000 7f6289e51740 1 -- start start 2024-09-11T01:12:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.798+0000 7f6289e51740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a524970 0x55b54a526d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.798+0000 7f627cc00640 1 -- 172.21.15.103:0/893045398 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f6270004a40 con 0x7f62801049b0 2024-09-11T01:12:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.798+0000 7f6289e51740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 0x55b54a529690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f6289e51740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a529ce0 0x55b54a52c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f6289e51740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b54a4976b0 con 0x55b54a529ce0 2024-09-11T01:12:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f6289e51740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b54a486ae0 con 0x55b54a524970 2024-09-11T01:12:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f6289e51740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b54a48a8f0 con 0x55b54a5272a0 2024-09-11T01:12:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f6285000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a524970 0x55b54a526d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f627fe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 0x55b54a529690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f6285000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a524970 0x55b54a526d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:57238/0 (socket says 172.21.15.103:57238) 2024-09-11T01:12:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f6285000640 1 -- 172.21.15.103:0/3859723964 learned_addr learned my addr 172.21.15.103:0/3859723964 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:12:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f627f400640 1 --2- 172.21.15.103:0/3859723964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a529ce0 0x55b54a52c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f6285000640 1 -- 172.21.15.103:0/3859723964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 msgr2=0x55b54a529690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f6285000640 1 --2- 172.21.15.103:0/3859723964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 0x55b54a529690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f6285000640 1 -- 172.21.15.103:0/3859723964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a529ce0 msgr2=0x55b54a52c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f6285000640 1 --2- 172.21.15.103:0/3859723964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a529ce0 0x55b54a52c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f6285000640 1 -- 172.21.15.103:0/3859723964 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b54a453780 con 0x55b54a524970 2024-09-11T01:12:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f627f400640 1 --2- 172.21.15.103:0/3859723964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a529ce0 0x55b54a52c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:12:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.799+0000 7f6285000640 1 --2- 172.21.15.103:0/3859723964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a524970 0x55b54a526d60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6278009fa0 tx=0x7f62780118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9442e1c214ddebb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.800+0000 7f6275600640 1 -- 172.21.15.103:0/3859723964 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278004d20 con 0x55b54a524970 2024-09-11T01:12:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.800+0000 7f6275600640 1 -- 172.21.15.103:0/3859723964 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6278004050 con 0x55b54a524970 2024-09-11T01:12:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.800+0000 7f6275600640 1 -- 172.21.15.103:0/3859723964 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278005220 con 0x55b54a524970 2024-09-11T01:12:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.800+0000 7f627cc00640 1 --2- 172.21.15.103:0/893045398 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f62640b5360 0x7f62640b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.800+0000 7f627cc00640 1 -- 172.21.15.103:0/893045398 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f62700e5ee0 con 0x7f62801049b0 2024-09-11T01:12:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.800+0000 7f6289e51740 1 -- 172.21.15.103:0/3859723964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a524970 msgr2=0x55b54a526d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.800+0000 7f6289e51740 1 --2- 172.21.15.103:0/3859723964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a524970 0x55b54a526d60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6278009fa0 tx=0x7f62780118d0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.800+0000 7f627fe00640 1 --2- 172.21.15.103:0/893045398 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f62640b5360 0x7f62640b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.801+0000 7f6289e51740 1 -- 172.21.15.103:0/3859723964 shutdown_connections 2024-09-11T01:12:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.801+0000 7f6289e51740 1 --2- 172.21.15.103:0/3859723964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a529ce0 0x55b54a52c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.801+0000 7f6289e51740 1 --2- 172.21.15.103:0/3859723964 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 0x55b54a529690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.801+0000 7f6289e51740 1 --2- 172.21.15.103:0/3859723964 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a524970 0x55b54a526d60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.801+0000 7f6289e51740 1 -- 172.21.15.103:0/3859723964 >> 172.21.15.103:0/3859723964 conn(0x55b54a51fac0 msgr2=0x55b54a520850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.801+0000 7f6289e51740 1 -- 172.21.15.103:0/3859723964 shutdown_connections 2024-09-11T01:12:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.801+0000 7f6289e51740 1 -- 172.21.15.103:0/3859723964 wait complete. 2024-09-11T01:12:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.801+0000 7f627fe00640 1 --2- 172.21.15.103:0/893045398 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f62640b5360 0x7f62640b7820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f62700e6180 tx=0x7f62700e9920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.801+0000 7f6289e51740 1 -- start start 2024-09-11T01:12:26.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.801+0000 7f6289e51740 1 Processor -- start 2024-09-11T01:12:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.802+0000 7f6289e51740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a52e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.802+0000 7f6289e51740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 0x55b54a52e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.802+0000 7f6289e51740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a529ce0 0x55b54a52f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.802+0000 7f6289e51740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b54a3beab0 con 0x55b54a524970 2024-09-11T01:12:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.802+0000 7f6289e51740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55b54a42d570 con 0x55b54a529ce0 2024-09-11T01:12:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.802+0000 7f6289e51740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55b54a52ccc0 con 0x55b54a5272a0 2024-09-11T01:12:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.802+0000 7f6289e51740 10 client.0 _ll_register_callbacks cb 0x55b54a43c100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:12:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.802+0000 7f6285000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a52e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.802+0000 7f627f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 0x55b54a52e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.802+0000 7f6285000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a52e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39244/0 (socket says 172.21.15.103:39244) 2024-09-11T01:12:26.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.802+0000 7f627f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 0x55b54a52e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:43210/0 (socket says 172.21.15.103:43210) 2024-09-11T01:12:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.802+0000 7f6285000640 1 -- 172.21.15.103:0/841935146 learned_addr learned my addr 172.21.15.103:0/841935146 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:12:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.803+0000 7f6285000640 1 --2- 172.21.15.103:0/841935146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a529ce0 0x55b54a52f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.803+0000 7f6285000640 1 -- 172.21.15.103:0/841935146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 msgr2=0x55b54a52e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.803+0000 7f6285000640 1 --2- 172.21.15.103:0/841935146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 0x55b54a52e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.803+0000 7f6285000640 1 -- 172.21.15.103:0/841935146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a529ce0 msgr2=0x55b54a52f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.803+0000 7f6285000640 1 --2- 172.21.15.103:0/841935146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a529ce0 0x55b54a52f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.803+0000 7f6285000640 1 -- 172.21.15.103:0/841935146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b54a1e8790 con 0x55b54a524970 2024-09-11T01:12:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.803+0000 7f6285000640 1 --2- 172.21.15.103:0/841935146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a52e100 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f627801b040 tx=0x7f6278009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9a2338ce95afad server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.803+0000 7f626a000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:12:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.803+0000 7f626a000640 1 -- 172.21.15.103:0/841935146 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627801d040 con 0x55b54a524970 2024-09-11T01:12:26.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.803+0000 7f626a000640 1 -- 172.21.15.103:0/841935146 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f6278003a30 con 0x55b54a524970 2024-09-11T01:12:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.803+0000 7f6289e51740 1 -- 172.21.15.103:0/841935146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6278004050 con 0x55b54a524970 2024-09-11T01:12:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.804+0000 7f626a000640 1 -- 172.21.15.103:0/841935146 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6278034050 con 0x55b54a524970 2024-09-11T01:12:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.804+0000 7f6289e51740 10 client.15741 fetch_fsmap learned FSMap version 30 2024-09-11T01:12:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.804+0000 7f6289e51740 1 -- 172.21.15.103:0/841935146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b54a261620 con 0x55b54a524970 2024-09-11T01:12:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.804+0000 7f626a000640 1 -- 172.21.15.103:0/841935146 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6278004050 con 0x55b54a524970 2024-09-11T01:12:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.804+0000 7f626a000640 1 -- 172.21.15.103:0/841935146 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f627800f4e0 con 0x55b54a524970 2024-09-11T01:12:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.804+0000 7f6289e51740 10 client.15741 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T01:12:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.804+0000 7f6289e51740 10 client.15741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:12:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.804+0000 7f6289e51740 20 client.15741 populate_metadata read hostname 'smithi103' 2024-09-11T01:12:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.804+0000 7f6289e51740 1 --2- 172.21.15.103:0/841935146 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b54a5396b0 0x55b54a53baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.804+0000 7f6289e51740 4 client.15741 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:12:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.804+0000 7f6289e51740 1 -- 172.21.15.103:0/841935146 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b54a499600 con 0x55b54a5396b0 2024-09-11T01:12:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.805+0000 7f627f400640 1 --2- 172.21.15.103:0/841935146 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b54a5396b0 0x55b54a53baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.805+0000 7f627f400640 1 --2- 172.21.15.103:0/841935146 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b54a5396b0 0x55b54a53baf0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c504377f1ba1624a server_cookie=d4d71991184601b9 in_seq=0 out_seq=0 2024-09-11T01:12:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.805+0000 7f626a000640 10 client.15741 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:12:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f626a000640 1 -- 172.21.15.103:0/841935146 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b54a499600 con 0x55b54a5396b0 2024-09-11T01:12:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f626a000640 10 client.15741 handle_command_reply: tid=0 2024-09-11T01:12:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f6289e51740 1 client.15741 shutdown 2024-09-11T01:12:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f6289e51740 1 -- 172.21.15.103:0/841935146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 msgr2=0x55b54a52e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f6289e51740 1 --2- 172.21.15.103:0/841935146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a52e100 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f627801b040 tx=0x7f6278009d10 comp rx=0 tx=0).stop 2024-09-11T01:12:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f6289e51740 1 -- 172.21.15.103:0/841935146 shutdown_connections 2024-09-11T01:12:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f6289e51740 1 --2- 172.21.15.103:0/841935146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a529ce0 0x55b54a52f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f6289e51740 1 --2- 172.21.15.103:0/841935146 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b54a5396b0 0x55b54a53baf0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f6289e51740 1 --2- 172.21.15.103:0/841935146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 0x55b54a52e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f6289e51740 1 --2- 172.21.15.103:0/841935146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a52e100 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f626a000640 0 client.15741 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:12:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f6289e51740 1 -- 172.21.15.103:0/841935146 >> 172.21.15.103:0/841935146 conn(0x55b54a51fac0 msgr2=0x55b54a51ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f6289e51740 1 -- 172.21.15.103:0/841935146 shutdown_connections 2024-09-11T01:12:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f6289e51740 1 -- 172.21.15.103:0/841935146 wait complete. 2024-09-11T01:12:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.806+0000 7f6289e51740 20 client.15741 trim_cache size 0 max 16384 2024-09-11T01:12:26.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.821+0000 7f6289e51740 1 Processor -- start 2024-09-11T01:12:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f6289e51740 1 -- start start 2024-09-11T01:12:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f6289e51740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a523010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f6289e51740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a5272a0 0x55b54a540400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f6289e51740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a529ce0 0x55b54a540940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f6289e51740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f62801b0010 con 0x55b54a524970 2024-09-11T01:12:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f6289e51740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f62801ad8e0 con 0x55b54a5272a0 2024-09-11T01:12:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f6289e51740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f62801ab730 con 0x55b54a529ce0 2024-09-11T01:12:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f6285000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a523010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f627f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a5272a0 0x55b54a540400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f627f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a5272a0 0x55b54a540400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:57256/0 (socket says 172.21.15.103:57256) 2024-09-11T01:12:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f627f400640 1 -- 172.21.15.103:0/3660598744 learned_addr learned my addr 172.21.15.103:0/3660598744 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:12:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f6285000640 1 --2- 172.21.15.103:0/3660598744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a529ce0 0x55b54a540940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f627f400640 1 -- 172.21.15.103:0/3660598744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a529ce0 msgr2=0x55b54a540940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f627f400640 1 --2- 172.21.15.103:0/3660598744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a529ce0 0x55b54a540940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f627f400640 1 -- 172.21.15.103:0/3660598744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 msgr2=0x55b54a523010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f627f400640 1 --2- 172.21.15.103:0/3660598744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a523010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f627f400640 1 -- 172.21.15.103:0/3660598744 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b54a5270d0 con 0x55b54a5272a0 2024-09-11T01:12:26.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.822+0000 7f6285000640 1 --2- 172.21.15.103:0/3660598744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a523010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:12:26.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.823+0000 7f627f400640 1 --2- 172.21.15.103:0/3660598744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a5272a0 0x55b54a540400 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f626c005ab0 tx=0x7f626c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eacd402f67309f37 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:26.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.823+0000 7f6274c00640 1 -- 172.21.15.103:0/3660598744 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c035040 con 0x55b54a5272a0 2024-09-11T01:12:26.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.823+0000 7f6274c00640 1 -- 172.21.15.103:0/3660598744 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f626c0315a0 con 0x55b54a5272a0 2024-09-11T01:12:26.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.823+0000 7f6274c00640 1 -- 172.21.15.103:0/3660598744 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f626c046640 con 0x55b54a5272a0 2024-09-11T01:12:26.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.823+0000 7f6289e51740 1 -- 172.21.15.103:0/3660598744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a5272a0 msgr2=0x55b54a540400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:26.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.823+0000 7f6289e51740 1 --2- 172.21.15.103:0/3660598744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a5272a0 0x55b54a540400 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f626c005ab0 tx=0x7f626c009260 comp rx=0 tx=0).stop 2024-09-11T01:12:26.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.823+0000 7f6289e51740 1 -- 172.21.15.103:0/3660598744 shutdown_connections 2024-09-11T01:12:26.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.823+0000 7f6289e51740 1 --2- 172.21.15.103:0/3660598744 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a529ce0 0x55b54a540940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.823+0000 7f6289e51740 1 --2- 172.21.15.103:0/3660598744 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a5272a0 0x55b54a540400 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.823+0000 7f6289e51740 1 --2- 172.21.15.103:0/3660598744 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a523010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.823+0000 7f6289e51740 1 -- 172.21.15.103:0/3660598744 >> 172.21.15.103:0/3660598744 conn(0x55b54a51fac0 msgr2=0x55b54a5218f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.823+0000 7f6289e51740 1 -- 172.21.15.103:0/3660598744 shutdown_connections 2024-09-11T01:12:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.824+0000 7f6289e51740 1 -- 172.21.15.103:0/3660598744 wait complete. 2024-09-11T01:12:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.824+0000 7f6289e51740 1 -- start start 2024-09-11T01:12:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.824+0000 7f6289e51740 1 Processor -- start 2024-09-11T01:12:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6289e51740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a535f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6289e51740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 0x55b54a5aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6289e51740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a529ce0 0x55b54a5ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6289e51740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f62801abda0 con 0x55b54a524970 2024-09-11T01:12:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6289e51740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f62801ad210 con 0x55b54a529ce0 2024-09-11T01:12:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6289e51740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f62801ac470 con 0x55b54a5272a0 2024-09-11T01:12:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6289e51740 10 client.0 _ll_register_callbacks cb 0x7f62700e97f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:12:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6285000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a535f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f627f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 0x55b54a5aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6285000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a535f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39260/0 (socket says 172.21.15.103:39260) 2024-09-11T01:12:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6285000640 1 -- 172.21.15.103:0/2833798146 learned_addr learned my addr 172.21.15.103:0/2833798146 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:12:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6285000640 1 --2- 172.21.15.103:0/2833798146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a529ce0 0x55b54a5ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6285000640 1 -- 172.21.15.103:0/2833798146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 msgr2=0x55b54a5aaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6285000640 1 --2- 172.21.15.103:0/2833798146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 0x55b54a5aaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6285000640 1 -- 172.21.15.103:0/2833798146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a529ce0 msgr2=0x55b54a5ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:12:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6285000640 1 --2- 172.21.15.103:0/2833798146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a529ce0 0x55b54a5ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:26.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6285000640 1 -- 172.21.15.103:0/2833798146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b54a5ade90 con 0x55b54a524970 2024-09-11T01:12:26.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f6285000640 1 --2- 172.21.15.103:0/2833798146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a535f10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6278009c90 tx=0x7f62780118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facba3a2b39d8982 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:26.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.825+0000 7f626a000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:12:26.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.826+0000 7f626a000640 1 -- 172.21.15.103:0/2833798146 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627801d040 con 0x55b54a524970 2024-09-11T01:12:26.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.826+0000 7f626a000640 1 -- 172.21.15.103:0/2833798146 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f6278004660 con 0x55b54a524970 2024-09-11T01:12:26.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.826+0000 7f6289e51740 1 -- 172.21.15.103:0/2833798146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f626c0315a0 con 0x55b54a524970 2024-09-11T01:12:26.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.826+0000 7f626a000640 1 -- 172.21.15.103:0/2833798146 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6278047050 con 0x55b54a524970 2024-09-11T01:12:26.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.826+0000 7f6289e51740 10 client.15747 fetch_fsmap learned FSMap version 30 2024-09-11T01:12:26.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.826+0000 7f6289e51740 1 -- 172.21.15.103:0/2833798146 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b54a5af140 con 0x55b54a524970 2024-09-11T01:12:26.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.826+0000 7f626a000640 1 -- 172.21.15.103:0/2833798146 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f626c0315a0 con 0x55b54a524970 2024-09-11T01:12:26.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.826+0000 7f626a000640 1 -- 172.21.15.103:0/2833798146 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f6278038430 con 0x55b54a524970 2024-09-11T01:12:26.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.826+0000 7f6289e51740 10 client.15747 fetch_fsmap finished waiting for FSMap version 30 2024-09-11T01:12:26.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.826+0000 7f6289e51740 10 client.15747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:12:26.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.826+0000 7f6289e51740 20 client.15747 populate_metadata read hostname 'smithi103' 2024-09-11T01:12:26.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.827+0000 7f6289e51740 1 --2- 172.21.15.103:0/2833798146 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b54a5afb80 0x55b54a5b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:26.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.827+0000 7f6289e51740 4 client.15747 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:12:26.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.827+0000 7f6289e51740 1 -- 172.21.15.103:0/2833798146 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b54a4950b0 con 0x55b54a5afb80 2024-09-11T01:12:26.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.827+0000 7f627f400640 1 --2- 172.21.15.103:0/2833798146 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b54a5afb80 0x55b54a5b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:26.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.827+0000 7f626a000640 10 client.15747 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:12:26.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:26.827+0000 7f627f400640 1 --2- 172.21.15.103:0/2833798146 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b54a5afb80 0x55b54a5b1fa0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79aec4639b05b5f8 server_cookie=b3a01daa5b79983a in_seq=0 out_seq=0 2024-09-11T01:12:28.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:27 smithi103 ceph-mon[30562]: pgmap v523: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 69 MiB/s wr, 7.94k op/s 2024-09-11T01:12:28.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:27 smithi117 ceph-mon[35358]: pgmap v523: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 69 MiB/s wr, 7.94k op/s 2024-09-11T01:12:28.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:27 smithi183 ceph-mon[34992]: pgmap v523: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 69 MiB/s wr, 7.94k op/s 2024-09-11T01:12:30.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:29 smithi103 ceph-mon[30562]: pgmap v524: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 84 MiB/s wr, 9.27k op/s 2024-09-11T01:12:30.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:29 smithi117 ceph-mon[35358]: pgmap v524: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 84 MiB/s wr, 9.27k op/s 2024-09-11T01:12:30.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:29 smithi183 ceph-mon[34992]: pgmap v524: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 84 MiB/s wr, 9.27k op/s 2024-09-11T01:12:32.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:31 smithi103 ceph-mon[30562]: pgmap v525: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 71 MiB/s wr, 7.54k op/s 2024-09-11T01:12:32.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:31 smithi117 ceph-mon[35358]: pgmap v525: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 71 MiB/s wr, 7.54k op/s 2024-09-11T01:12:32.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:31 smithi183 ceph-mon[34992]: pgmap v525: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 177 KiB/s rd, 71 MiB/s wr, 7.54k op/s 2024-09-11T01:12:34.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:33 smithi103 ceph-mon[30562]: pgmap v526: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 78 MiB/s wr, 8.09k op/s 2024-09-11T01:12:34.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:33 smithi117 ceph-mon[35358]: pgmap v526: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 78 MiB/s wr, 8.09k op/s 2024-09-11T01:12:34.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:33 smithi183 ceph-mon[34992]: pgmap v526: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 78 MiB/s wr, 8.09k op/s 2024-09-11T01:12:36.086 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:35 smithi103 ceph-mon[30562]: pgmap v527: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 75 MiB/s wr, 7.76k op/s 2024-09-11T01:12:36.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:35 smithi117 ceph-mon[35358]: pgmap v527: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 75 MiB/s wr, 7.76k op/s 2024-09-11T01:12:36.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:35 smithi183 ceph-mon[34992]: pgmap v527: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 75 MiB/s wr, 7.76k op/s 2024-09-11T01:12:38.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:37 smithi103 ceph-mon[30562]: pgmap v528: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 60 MiB/s wr, 6.16k op/s 2024-09-11T01:12:38.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:37 smithi117 ceph-mon[35358]: pgmap v528: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 60 MiB/s wr, 6.16k op/s 2024-09-11T01:12:38.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:37 smithi183 ceph-mon[34992]: pgmap v528: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 60 MiB/s wr, 6.16k op/s 2024-09-11T01:12:39.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:39 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/53430620' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:12:39.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:39 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/53430620' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:12:39.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:39 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/53430620' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:12:40.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:40 smithi183 ceph-mon[34992]: pgmap v529: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 75 MiB/s wr, 7.60k op/s 2024-09-11T01:12:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:40 smithi103 ceph-mon[30562]: pgmap v529: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 75 MiB/s wr, 7.60k op/s 2024-09-11T01:12:40.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:40 smithi117 ceph-mon[35358]: pgmap v529: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 75 MiB/s wr, 7.60k op/s 2024-09-11T01:12:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.501+0000 7f626a000640 1 -- 172.21.15.103:0/2833798146 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b54a4950b0 con 0x55b54a5afb80 2024-09-11T01:12:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.501+0000 7f626a000640 10 client.15747 handle_command_reply: tid=0 2024-09-11T01:12:41.503 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.501+0000 7f6289e51740 1 client.15747 shutdown 2024-09-11T01:12:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.502+0000 7f6289e51740 1 -- 172.21.15.103:0/2833798146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 msgr2=0x55b54a535f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.502+0000 7f6289e51740 1 --2- 172.21.15.103:0/2833798146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a535f10 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f6278009c90 tx=0x7f62780118d0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.502+0000 7f6289e51740 1 -- 172.21.15.103:0/2833798146 shutdown_connections 2024-09-11T01:12:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.502+0000 7f6289e51740 1 --2- 172.21.15.103:0/2833798146 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55b54a529ce0 0x55b54a5ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.502+0000 7f6289e51740 1 --2- 172.21.15.103:0/2833798146 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55b54a5afb80 0x55b54a5b1fa0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.502+0000 7f6289e51740 1 --2- 172.21.15.103:0/2833798146 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55b54a5272a0 0x55b54a5aaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.504 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.502+0000 7f6289e51740 1 --2- 172.21.15.103:0/2833798146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b54a524970 0x55b54a535f10 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.502+0000 7f6289e51740 1 -- 172.21.15.103:0/2833798146 >> 172.21.15.103:0/2833798146 conn(0x55b54a51fac0 msgr2=0x55b54a522110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.502+0000 7f626a000640 0 client.15747 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:12:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.502+0000 7f6289e51740 1 -- 172.21.15.103:0/2833798146 shutdown_connections 2024-09-11T01:12:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.502+0000 7f6289e51740 1 -- 172.21.15.103:0/2833798146 wait complete. 2024-09-11T01:12:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.503+0000 7f6289e51740 20 client.15747 trim_cache size 0 max 16384 2024-09-11T01:12:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:12:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:12:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:12:41.505 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:12:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.504+0000 7f6285a00640 1 -- 172.21.15.103:0/893045398 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f62640b5360 msgr2=0x7f62640b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.504+0000 7f6285a00640 1 --2- 172.21.15.103:0/893045398 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f62640b5360 0x7f62640b7820 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f62700e6180 tx=0x7f62700e9920 comp rx=0 tx=0).stop 2024-09-11T01:12:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.504+0000 7f6285a00640 1 -- 172.21.15.103:0/893045398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62801049b0 msgr2=0x7f628019ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.504+0000 7f6285a00640 1 --2- 172.21.15.103:0/893045398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62801049b0 0x7f628019ae00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f627000e9f0 tx=0x7f627000edf0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.506 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.504+0000 7f6285a00640 1 -- 172.21.15.103:0/893045398 shutdown_connections 2024-09-11T01:12:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.504+0000 7f6285a00640 1 --2- 172.21.15.103:0/893045398 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f62640b5360 0x7f62640b7820 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.504+0000 7f6285a00640 1 --2- 172.21.15.103:0/893045398 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f62801064c0 0x7f628019c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.504+0000 7f6285a00640 1 --2- 172.21.15.103:0/893045398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6280105b00 0x7f628019b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.504+0000 7f6285a00640 1 --2- 172.21.15.103:0/893045398 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f62801049b0 0x7f628019ae00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.504+0000 7f6285a00640 1 -- 172.21.15.103:0/893045398 >> 172.21.15.103:0/893045398 conn(0x7f6280100250 msgr2=0x7f6280108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.505+0000 7f6285a00640 1 -- 172.21.15.103:0/893045398 shutdown_connections 2024-09-11T01:12:41.507 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:12:41.505+0000 7f6285a00640 1 -- 172.21.15.103:0/893045398 wait complete. 2024-09-11T01:12:41.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:41 smithi183 ceph-mon[34992]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:12:41.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:41 smithi103 ceph-mon[30562]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:12:41.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:41 smithi117 ceph-mon[35358]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:12:42.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:42 smithi103 ceph-mon[30562]: pgmap v530: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 67 MiB/s wr, 6.91k op/s 2024-09-11T01:12:42.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:42 smithi117 ceph-mon[35358]: pgmap v530: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 67 MiB/s wr, 6.91k op/s 2024-09-11T01:12:42.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:42 smithi183 ceph-mon[34992]: pgmap v530: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 246 KiB/s rd, 67 MiB/s wr, 6.91k op/s 2024-09-11T01:12:43.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:43 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:12:43.848 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:12:43.848 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":30,"btime":"2024-09-11T01:12:10:773367+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:12:09.859849+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24665,24629,24619]},"id":1}]} 2024-09-11T01:12:43.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.961+0000 7f4277400640 1 -- 172.21.15.103:0/1326865263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427010a9c0 msgr2=0x7f427010ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.961+0000 7f4277400640 1 --2- 172.21.15.103:0/1326865263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427010a9c0 0x7f427010ae00 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f425c009900 tx=0x7f425c02a420 comp rx=0 tx=0).stop 2024-09-11T01:12:43.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.962+0000 7f4277400640 1 -- 172.21.15.103:0/1326865263 shutdown_connections 2024-09-11T01:12:43.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.962+0000 7f4277400640 1 --2- 172.21.15.103:0/1326865263 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f427010b340 0x7f4270111b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.962+0000 7f4277400640 1 --2- 172.21.15.103:0/1326865263 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427010a9c0 0x7f427010ae00 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.962+0000 7f4277400640 1 --2- 172.21.15.103:0/1326865263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4270104fb0 0x7f4270105390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.962+0000 7f4277400640 1 -- 172.21.15.103:0/1326865263 >> 172.21.15.103:0/1326865263 conn(0x7f4270100a20 msgr2=0x7f4270102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:43.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.963+0000 7f4277400640 1 -- 172.21.15.103:0/1326865263 shutdown_connections 2024-09-11T01:12:43.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.963+0000 7f4277400640 1 -- 172.21.15.103:0/1326865263 wait complete. 2024-09-11T01:12:43.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.966+0000 7f4277400640 1 Processor -- start 2024-09-11T01:12:43.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.967+0000 7f4277400640 1 -- start start 2024-09-11T01:12:43.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.968+0000 7f4277400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4270104fb0 0x7f42701118f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.968+0000 7f4277400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f427010a9c0 0x7f427010eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.968+0000 7f4277400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427010b340 0x7f427010f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.968+0000 7f4277400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4270115010 con 0x7f427010a9c0 2024-09-11T01:12:43.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.969+0000 7f4277400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4270114e90 con 0x7f427010b340 2024-09-11T01:12:43.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.969+0000 7f4277400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4270115190 con 0x7f4270104fb0 2024-09-11T01:12:43.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.969+0000 7f426fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f427010a9c0 0x7f427010eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:43.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.969+0000 7f426fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f427010a9c0 0x7f427010eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40432/0 (socket says 172.21.15.103:40432) 2024-09-11T01:12:43.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.969+0000 7f426fe00640 1 -- 172.21.15.103:0/53430620 learned_addr learned my addr 172.21.15.103:0/53430620 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:12:43.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.971+0000 7f426fe00640 1 -- 172.21.15.103:0/53430620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4270104fb0 msgr2=0x7f42701118f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T01:12:43.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.971+0000 7f426fe00640 1 --2- 172.21.15.103:0/53430620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4270104fb0 0x7f42701118f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.971+0000 7f426fe00640 1 -- 172.21.15.103:0/53430620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427010b340 msgr2=0x7f427010f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.971+0000 7f426fe00640 1 --2- 172.21.15.103:0/53430620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427010b340 0x7f427010f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.971+0000 7f426fe00640 1 -- 172.21.15.103:0/53430620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f427010f980 con 0x7f427010a9c0 2024-09-11T01:12:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.973+0000 7f426fe00640 1 --2- 172.21.15.103:0/53430620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f427010a9c0 0x7f427010eb40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f425c009230 tx=0x7f425c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.974+0000 7f426d600640 1 -- 172.21.15.103:0/53430620 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c03f070 con 0x7f427010a9c0 2024-09-11T01:12:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.974+0000 7f4277400640 1 -- 172.21.15.103:0/53430620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42701abe10 con 0x7f427010a9c0 2024-09-11T01:12:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.974+0000 7f4277400640 1 -- 172.21.15.103:0/53430620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42701ac310 con 0x7f427010a9c0 2024-09-11T01:12:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.974+0000 7f426d600640 1 -- 172.21.15.103:0/53430620 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f425c003e10 con 0x7f427010a9c0 2024-09-11T01:12:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.974+0000 7f426d600640 1 -- 172.21.15.103:0/53430620 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c035030 con 0x7f427010a9c0 2024-09-11T01:12:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.976+0000 7f4277400640 1 -- 172.21.15.103:0/53430620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4270105390 con 0x7f427010a9c0 2024-09-11T01:12:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.984+0000 7f426d600640 1 -- 172.21.15.103:0/53430620 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f425c04c060 con 0x7f427010a9c0 2024-09-11T01:12:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.987+0000 7f426d600640 1 --2- 172.21.15.103:0/53430620 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f42540b53e0 0x7f42540b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:12:43.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.988+0000 7f426d600640 1 -- 172.21.15.103:0/53430620 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f425c106480 con 0x7f427010a9c0 2024-09-11T01:12:43.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.992+0000 7f4274a00640 1 --2- 172.21.15.103:0/53430620 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f42540b53e0 0x7f42540b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:12:43.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.994+0000 7f4274a00640 1 --2- 172.21.15.103:0/53430620 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f42540b53e0 0x7f42540b78a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f42600096b0 tx=0x7f4260006c20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:12:43.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:38.997+0000 7f426d600640 1 -- 172.21.15.103:0/53430620 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f425c0ccf30 con 0x7f427010a9c0 2024-09-11T01:12:43.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:39.318+0000 7f4277400640 1 -- 172.21.15.103:0/53430620 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f427002e5c0 con 0x7f427010a9c0 2024-09-11T01:12:43.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:39.319+0000 7f426d600640 1 -- 172.21.15.103:0/53430620 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11931 (secure 0 0 0) 0x7f425c0cc830 con 0x7f427010a9c0 2024-09-11T01:12:43.852 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 30 2024-09-11T01:12:43.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:39.321+0000 7f4277400640 1 -- 172.21.15.103:0/53430620 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f42540b53e0 msgr2=0x7f42540b78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:39.321+0000 7f4277400640 1 --2- 172.21.15.103:0/53430620 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f42540b53e0 0x7f42540b78a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f42600096b0 tx=0x7f4260006c20 comp rx=0 tx=0).stop 2024-09-11T01:12:43.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:39.321+0000 7f4277400640 1 -- 172.21.15.103:0/53430620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f427010a9c0 msgr2=0x7f427010eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:12:43.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:39.321+0000 7f4277400640 1 --2- 172.21.15.103:0/53430620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f427010a9c0 0x7f427010eb40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f425c009230 tx=0x7f425c003c20 comp rx=0 tx=0).stop 2024-09-11T01:12:43.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:39.321+0000 7f4277400640 1 -- 172.21.15.103:0/53430620 shutdown_connections 2024-09-11T01:12:43.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:39.321+0000 7f4277400640 1 --2- 172.21.15.103:0/53430620 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f42540b53e0 0x7f42540b78a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:39.321+0000 7f4277400640 1 --2- 172.21.15.103:0/53430620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f427010b340 0x7f427010f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:39.321+0000 7f4277400640 1 --2- 172.21.15.103:0/53430620 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f427010a9c0 0x7f427010eb40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:39.321+0000 7f4277400640 1 --2- 172.21.15.103:0/53430620 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4270104fb0 0x7f42701118f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:12:43.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:39.321+0000 7f4277400640 1 -- 172.21.15.103:0/53430620 >> 172.21.15.103:0/53430620 conn(0x7f4270100a20 msgr2=0x7f4270102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:12:43.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:39.321+0000 7f4277400640 1 -- 172.21.15.103:0/53430620 shutdown_connections 2024-09-11T01:12:43.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:12:39.321+0000 7f4277400640 1 -- 172.21.15.103:0/53430620 wait complete. 2024-09-11T01:12:43.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:43 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:12:43.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:43 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:12:44.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:44 smithi117 ceph-mon[35358]: pgmap v531: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 76 MiB/s wr, 7.91k op/s 2024-09-11T01:12:44.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:44 smithi183 ceph-mon[34992]: pgmap v531: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 76 MiB/s wr, 7.91k op/s 2024-09-11T01:12:45.545 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:44 smithi103 ceph-mon[30562]: pgmap v531: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 286 KiB/s rd, 76 MiB/s wr, 7.91k op/s 2024-09-11T01:12:46.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:45 smithi103 ceph-mon[30562]: pgmap v532: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 73 MiB/s wr, 7.68k op/s 2024-09-11T01:12:46.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:45 smithi117 ceph-mon[35358]: pgmap v532: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 73 MiB/s wr, 7.68k op/s 2024-09-11T01:12:46.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:45 smithi183 ceph-mon[34992]: pgmap v532: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 73 MiB/s wr, 7.68k op/s 2024-09-11T01:12:48.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:48 smithi183 ceph-mon[34992]: pgmap v533: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 63 MiB/s wr, 6.68k op/s 2024-09-11T01:12:48.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:48 smithi103 ceph-mon[30562]: pgmap v533: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 63 MiB/s wr, 6.68k op/s 2024-09-11T01:12:48.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:48 smithi117 ceph-mon[35358]: pgmap v533: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 63 MiB/s wr, 6.68k op/s 2024-09-11T01:12:49.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:12:49.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:12:49.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:49 smithi183 ceph-mon[34992]: pgmap v534: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 77 MiB/s wr, 8.31k op/s 2024-09-11T01:12:49.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:12:49.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:12:49.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:12:49.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:49 smithi103 ceph-mon[30562]: pgmap v534: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 77 MiB/s wr, 8.31k op/s 2024-09-11T01:12:49.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:12:49.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:12:49.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:12:49.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:49 smithi117 ceph-mon[35358]: pgmap v534: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 232 KiB/s rd, 77 MiB/s wr, 8.31k op/s 2024-09-11T01:12:49.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:12:50.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:50 smithi183 ceph-mon[34992]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-11T01:12:50.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:50 smithi103 ceph-mon[30562]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-11T01:12:50.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:50 smithi117 ceph-mon[35358]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-11T01:12:51.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:51 smithi103 ceph-mon[30562]: pgmap v535: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 70 MiB/s wr, 7.69k op/s 2024-09-11T01:12:51.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:51 smithi117 ceph-mon[35358]: pgmap v535: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 70 MiB/s wr, 7.69k op/s 2024-09-11T01:12:51.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:51 smithi183 ceph-mon[34992]: pgmap v535: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 70 MiB/s wr, 7.69k op/s 2024-09-11T01:12:53.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:53 smithi117 ceph-mon[35358]: pgmap v536: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 60 MiB/s wr, 6.59k op/s 2024-09-11T01:12:53.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:53 smithi183 ceph-mon[34992]: pgmap v536: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 60 MiB/s wr, 6.59k op/s 2024-09-11T01:12:54.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:53 smithi103 ceph-mon[30562]: pgmap v536: 129 pgs: 129 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 60 MiB/s wr, 6.59k op/s 2024-09-11T01:12:55.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:55 smithi117 ceph-mon[35358]: pgmap v537: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 71 MiB/s wr, 7.27k op/s 2024-09-11T01:12:55.921 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:55 smithi183 ceph-mon[34992]: pgmap v537: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 71 MiB/s wr, 7.27k op/s 2024-09-11T01:12:56.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:55 smithi103 ceph-mon[30562]: pgmap v537: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 71 MiB/s wr, 7.27k op/s 2024-09-11T01:12:57.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:57 smithi117 ceph-mon[35358]: pgmap v538: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 64 MiB/s wr, 6.62k op/s 2024-09-11T01:12:57.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:57 smithi183 ceph-mon[34992]: pgmap v538: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 64 MiB/s wr, 6.62k op/s 2024-09-11T01:12:58.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:57 smithi103 ceph-mon[30562]: pgmap v538: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 64 MiB/s wr, 6.62k op/s 2024-09-11T01:12:59.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:12:59 smithi183 ceph-mon[34992]: pgmap v539: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 80 MiB/s wr, 8.45k op/s 2024-09-11T01:13:00.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:12:59 smithi103 ceph-mon[30562]: pgmap v539: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 80 MiB/s wr, 8.45k op/s 2024-09-11T01:13:00.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:12:59 smithi117 ceph-mon[35358]: pgmap v539: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 80 MiB/s wr, 8.45k op/s 2024-09-11T01:13:01.886 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:01 smithi103 ceph-mon[30562]: pgmap v540: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 70 MiB/s wr, 7.47k op/s 2024-09-11T01:13:01.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:01 smithi183 ceph-mon[34992]: pgmap v540: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 70 MiB/s wr, 7.47k op/s 2024-09-11T01:13:02.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:01 smithi117 ceph-mon[35358]: pgmap v540: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 70 MiB/s wr, 7.47k op/s 2024-09-11T01:13:03.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:03 smithi183 ceph-mon[34992]: pgmap v541: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 63 MiB/s wr, 6.65k op/s 2024-09-11T01:13:04.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:03 smithi103 ceph-mon[30562]: pgmap v541: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 63 MiB/s wr, 6.65k op/s 2024-09-11T01:13:04.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:03 smithi117 ceph-mon[35358]: pgmap v541: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 63 MiB/s wr, 6.65k op/s 2024-09-11T01:13:05.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:05 smithi183 ceph-mon[34992]: pgmap v542: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 81 MiB/s wr, 8.81k op/s 2024-09-11T01:13:06.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:05 smithi103 ceph-mon[30562]: pgmap v542: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 81 MiB/s wr, 8.81k op/s 2024-09-11T01:13:06.131 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:05 smithi117 ceph-mon[35358]: pgmap v542: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 81 MiB/s wr, 8.81k op/s 2024-09-11T01:13:07.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:07 smithi183 ceph-mon[34992]: pgmap v543: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 60 MiB/s wr, 6.99k op/s 2024-09-11T01:13:08.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:07 smithi103 ceph-mon[30562]: pgmap v543: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 60 MiB/s wr, 6.99k op/s 2024-09-11T01:13:08.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:07 smithi117 ceph-mon[35358]: pgmap v543: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 60 MiB/s wr, 6.99k op/s 2024-09-11T01:13:09.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:09 smithi183 ceph-mon[34992]: pgmap v544: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 70 MiB/s wr, 8.42k op/s 2024-09-11T01:13:10.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:09 smithi103 ceph-mon[30562]: pgmap v544: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 70 MiB/s wr, 8.42k op/s 2024-09-11T01:13:10.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:09 smithi117 ceph-mon[35358]: pgmap v544: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 70 MiB/s wr, 8.42k op/s 2024-09-11T01:13:12.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:11 smithi103 ceph-mon[30562]: pgmap v545: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 58 MiB/s wr, 7.25k op/s 2024-09-11T01:13:12.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:11 smithi117 ceph-mon[35358]: pgmap v545: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 58 MiB/s wr, 7.25k op/s 2024-09-11T01:13:12.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:11 smithi183 ceph-mon[34992]: pgmap v545: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 58 MiB/s wr, 7.25k op/s 2024-09-11T01:13:14.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:13 smithi103 ceph-mon[30562]: pgmap v546: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 55 MiB/s wr, 6.82k op/s 2024-09-11T01:13:14.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:13 smithi117 ceph-mon[35358]: pgmap v546: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 55 MiB/s wr, 6.82k op/s 2024-09-11T01:13:14.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:13 smithi183 ceph-mon[34992]: pgmap v546: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 55 MiB/s wr, 6.82k op/s 2024-09-11T01:13:16.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:15 smithi103 ceph-mon[30562]: pgmap v547: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 64 MiB/s wr, 8.23k op/s 2024-09-11T01:13:16.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:15 smithi117 ceph-mon[35358]: pgmap v547: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 64 MiB/s wr, 8.23k op/s 2024-09-11T01:13:16.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:15 smithi183 ceph-mon[34992]: pgmap v547: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 64 MiB/s wr, 8.23k op/s 2024-09-11T01:13:18.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:17 smithi103 ceph-mon[30562]: pgmap v548: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 49 MiB/s wr, 6.62k op/s 2024-09-11T01:13:18.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:17 smithi117 ceph-mon[35358]: pgmap v548: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 49 MiB/s wr, 6.62k op/s 2024-09-11T01:13:18.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:17 smithi183 ceph-mon[34992]: pgmap v548: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 49 MiB/s wr, 6.62k op/s 2024-09-11T01:13:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.054+0000 7f8cf1a00640 1 -- 172.21.15.103:0/1504895643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ce40058f0 msgr2=0x7f8ce4098110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.054+0000 7f8cf1a00640 1 --2- 172.21.15.103:0/1504895643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ce40058f0 0x7f8ce4098110 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8cec068a60 tx=0x7f8cec097a40 comp rx=0 tx=0).stop 2024-09-11T01:13:20.057 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.055+0000 7f8cf1a00640 1 -- 172.21.15.103:0/1504895643 shutdown_connections 2024-09-11T01:13:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.055+0000 7f8cf1a00640 1 --2- 172.21.15.103:0/1504895643 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ce409b250 0x7f8ce409d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.055+0000 7f8cf1a00640 1 --2- 172.21.15.103:0/1504895643 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ce40986a0 0x7f8ce409ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.055+0000 7f8cf1a00640 1 --2- 172.21.15.103:0/1504895643 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ce40058f0 0x7f8ce4098110 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.058 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.055+0000 7f8cf1a00640 1 -- 172.21.15.103:0/1504895643 >> 172.21.15.103:0/1504895643 conn(0x7f8ce408fce0 msgr2=0x7f8ce4092120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.057+0000 7f8cf1a00640 1 -- 172.21.15.103:0/1504895643 shutdown_connections 2024-09-11T01:13:20.059 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.057+0000 7f8cf1a00640 1 -- 172.21.15.103:0/1504895643 wait complete. 2024-09-11T01:13:20.062 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.060+0000 7f8cf1a00640 1 Processor -- start 2024-09-11T01:13:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.060+0000 7f8cf1a00640 1 -- start start 2024-09-11T01:13:20.063 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.061+0000 7f8cf1a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ce40058f0 0x7f8ce4095850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.061+0000 7f8cf1a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ce40986a0 0x7f8ce40940b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.061+0000 7f8cf1a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ce409b250 0x7f8ce40945f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.061+0000 7f8cf1a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce40a10f0 con 0x7f8ce409b250 2024-09-11T01:13:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.061+0000 7f8cf1a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce40a0f70 con 0x7f8ce40986a0 2024-09-11T01:13:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.061+0000 7f8cf1a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce40a1270 con 0x7f8ce40058f0 2024-09-11T01:13:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.061+0000 7f8cebe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ce40058f0 0x7f8ce4095850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.061+0000 7f8cebe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ce40058f0 0x7f8ce4095850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:58706/0 (socket says 172.21.15.103:58706) 2024-09-11T01:13:20.064 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.061+0000 7f8ceb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ce40986a0 0x7f8ce40940b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.061+0000 7f8cebe00640 1 -- 172.21.15.103:0/3576171815 learned_addr learned my addr 172.21.15.103:0/3576171815 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:13:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.062+0000 7f8cebe00640 1 -- 172.21.15.103:0/3576171815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ce40986a0 msgr2=0x7f8ce40940b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.062+0000 7f8cebe00640 1 --2- 172.21.15.103:0/3576171815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ce40986a0 0x7f8ce40940b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.062+0000 7f8cebe00640 1 -- 172.21.15.103:0/3576171815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ce409b250 msgr2=0x7f8ce40945f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.062+0000 7f8cebe00640 1 --2- 172.21.15.103:0/3576171815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ce409b250 0x7f8ce40945f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.062+0000 7f8cebe00640 1 -- 172.21.15.103:0/3576171815 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce4094e60 con 0x7f8ce40058f0 2024-09-11T01:13:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.062+0000 7f8cebe00640 1 --2- 172.21.15.103:0/3576171815 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ce40058f0 0x7f8ce4095850 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8cec052890 tx=0x7f8cec06b380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.062+0000 7f8ce8c00640 1 -- 172.21.15.103:0/3576171815 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec0aa020 con 0x7f8ce40058f0 2024-09-11T01:13:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.063+0000 7f8ce8c00640 1 -- 172.21.15.103:0/3576171815 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cec09c470 con 0x7f8ce40058f0 2024-09-11T01:13:20.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.064+0000 7f8cf1a00640 1 -- 172.21.15.103:0/3576171815 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce412b3d0 con 0x7f8ce40058f0 2024-09-11T01:13:20.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.064+0000 7f8cf1a00640 1 -- 172.21.15.103:0/3576171815 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce412b8f0 con 0x7f8ce40058f0 2024-09-11T01:13:20.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.064+0000 7f8ce8c00640 1 -- 172.21.15.103:0/3576171815 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec077b80 con 0x7f8ce40058f0 2024-09-11T01:13:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.071+0000 7f8ce8c00640 1 -- 172.21.15.103:0/3576171815 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f8cec09c620 con 0x7f8ce40058f0 2024-09-11T01:13:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.073+0000 7f8ce8c00640 1 --2- 172.21.15.103:0/3576171815 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8cd40bdbb0 0x7f8cd40c0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.077 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.074+0000 7f8ceb400640 1 --2- 172.21.15.103:0/3576171815 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8cd40bdbb0 0x7f8cd40c0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.075+0000 7f8ce8c00640 1 -- 172.21.15.103:0/3576171815 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f8cec1731a0 con 0x7f8ce40058f0 2024-09-11T01:13:20.078 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.075+0000 7f8ceb400640 1 --2- 172.21.15.103:0/3576171815 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8cd40bdbb0 0x7f8cd40c0070 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80058c0 tx=0x7f8cd800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:20.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:19 smithi103 ceph-mon[30562]: pgmap v549: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 60 MiB/s wr, 8.06k op/s 2024-09-11T01:13:20.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:19 smithi117 ceph-mon[35358]: pgmap v549: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 60 MiB/s wr, 8.06k op/s 2024-09-11T01:13:20.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:19 smithi183 ceph-mon[34992]: pgmap v549: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 60 MiB/s wr, 8.06k op/s 2024-09-11T01:13:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.566+0000 7f8cf6008740 1 Processor -- start 2024-09-11T01:13:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.567+0000 7f8cf6008740 1 -- start start 2024-09-11T01:13:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.567+0000 7f8cf6008740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d72f980 0x55d51d731d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.570 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.567+0000 7f8cf6008740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d7322b0 0x55d51d7346a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.567+0000 7f8cf6008740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d734cf0 0x55d51d7371b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.567+0000 7f8cf6008740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d51d6916b0 con 0x55d51d734cf0 2024-09-11T01:13:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.567+0000 7f8cf6008740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d51d680ae0 con 0x55d51d7322b0 2024-09-11T01:13:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.567+0000 7f8cf6008740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d51d6848f0 con 0x55d51d72f980 2024-09-11T01:13:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.568+0000 7f8ceb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d7322b0 0x55d51d7346a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.571 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.568+0000 7f8ceb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d7322b0 0x55d51d7346a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:33252/0 (socket says 172.21.15.103:33252) 2024-09-11T01:13:20.572 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.568+0000 7f8ceb400640 1 -- 172.21.15.103:0/3470257082 learned_addr learned my addr 172.21.15.103:0/3470257082 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:13:20.572 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.570+0000 7f8cebe00640 1 --2- 172.21.15.103:0/3470257082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d72f980 0x55d51d731d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.572 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.570+0000 7f8cebe00640 1 -- 172.21.15.103:0/3470257082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d7322b0 msgr2=0x55d51d7346a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:13:20.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.570+0000 7f8cebe00640 1 --2- 172.21.15.103:0/3470257082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d7322b0 0x55d51d7346a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.570+0000 7f8cebe00640 1 -- 172.21.15.103:0/3470257082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d734cf0 msgr2=0x55d51d7371b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:13:20.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.570+0000 7f8cebe00640 1 --2- 172.21.15.103:0/3470257082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d734cf0 0x55d51d7371b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.570+0000 7f8cebe00640 1 -- 172.21.15.103:0/3470257082 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d51d64d780 con 0x55d51d72f980 2024-09-11T01:13:20.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.570+0000 7f8ceb400640 1 --2- 172.21.15.103:0/3470257082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d7322b0 0x55d51d7346a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:13:20.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.570+0000 7f8cebe00640 1 --2- 172.21.15.103:0/3470257082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d72f980 0x55d51d731d70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8cec170920 tx=0x7f8cec135df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adcc166bac7a3d09 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:20.574 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.571+0000 7f8cdd600640 1 -- 172.21.15.103:0/3470257082 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec138de0 con 0x55d51d72f980 2024-09-11T01:13:20.574 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.572+0000 7f8cdd600640 1 -- 172.21.15.103:0/3470257082 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cec139180 con 0x55d51d72f980 2024-09-11T01:13:20.574 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.572+0000 7f8cdd600640 1 -- 172.21.15.103:0/3470257082 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec142b70 con 0x55d51d72f980 2024-09-11T01:13:20.576 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.574+0000 7f8cf6008740 1 -- 172.21.15.103:0/3470257082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d72f980 msgr2=0x55d51d731d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:20.576 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.574+0000 7f8cf6008740 1 --2- 172.21.15.103:0/3470257082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d72f980 0x55d51d731d70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8cec170920 tx=0x7f8cec135df0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.576 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.574+0000 7f8cf6008740 1 -- 172.21.15.103:0/3470257082 shutdown_connections 2024-09-11T01:13:20.576 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.574+0000 7f8cf6008740 1 --2- 172.21.15.103:0/3470257082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d734cf0 0x55d51d7371b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.576 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.574+0000 7f8cf6008740 1 --2- 172.21.15.103:0/3470257082 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d7322b0 0x55d51d7346a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.576 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.574+0000 7f8cf6008740 1 --2- 172.21.15.103:0/3470257082 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d72f980 0x55d51d731d70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.577 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.574+0000 7f8cf6008740 1 -- 172.21.15.103:0/3470257082 >> 172.21.15.103:0/3470257082 conn(0x55d51d719ac0 msgr2=0x55d51d71a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:20.577 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.574+0000 7f8cf6008740 1 -- 172.21.15.103:0/3470257082 shutdown_connections 2024-09-11T01:13:20.577 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.574+0000 7f8cf6008740 1 -- 172.21.15.103:0/3470257082 wait complete. 2024-09-11T01:13:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.575+0000 7f8cf6008740 1 -- start start 2024-09-11T01:13:20.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.576+0000 7f8cf6008740 1 Processor -- start 2024-09-11T01:13:20.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.578+0000 7f8cf6008740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d72f980 0x55d51d738de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.579+0000 7f8cf6008740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d7322b0 0x55d51d739480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.579+0000 7f8cebe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d72f980 0x55d51d738de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.579+0000 7f8cebe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d72f980 0x55d51d738de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:58722/0 (socket says 172.21.15.103:58722) 2024-09-11T01:13:20.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.579+0000 7f8cebe00640 1 -- 172.21.15.103:0/547540881 learned_addr learned my addr 172.21.15.103:0/547540881 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:13:20.582 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.579+0000 7f8cf6008740 1 --2- 172.21.15.103:0/547540881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d734cf0 0x55d51d73a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.579+0000 7f8ceb400640 1 --2- 172.21.15.103:0/547540881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d7322b0 0x55d51d739480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.580+0000 7f8cf6008740 1 -- 172.21.15.103:0/547540881 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55d51d5b8ab0 con 0x55d51d734cf0 2024-09-11T01:13:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.580+0000 7f8cf6008740 1 -- 172.21.15.103:0/547540881 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55d51d627570 con 0x55d51d7322b0 2024-09-11T01:13:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.580+0000 7f8cf6008740 1 -- 172.21.15.103:0/547540881 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55d51d737a90 con 0x55d51d72f980 2024-09-11T01:13:20.583 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.580+0000 7f8cf6008740 10 client.0 _ll_register_callbacks cb 0x55d51d636100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:13:20.584 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.582+0000 7f8cf1000640 1 --2- 172.21.15.103:0/547540881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d734cf0 0x55d51d73a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.585 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.582+0000 7f8ceb400640 1 -- 172.21.15.103:0/547540881 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d72f980 msgr2=0x55d51d738de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:13:20.585 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.582+0000 7f8ceb400640 1 --2- 172.21.15.103:0/547540881 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d72f980 0x55d51d738de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.585 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.582+0000 7f8ceb400640 1 -- 172.21.15.103:0/547540881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d734cf0 msgr2=0x55d51d73a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:13:20.585 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.582+0000 7f8ceb400640 1 --2- 172.21.15.103:0/547540881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d734cf0 0x55d51d73a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.585 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.582+0000 7f8ceb400640 1 -- 172.21.15.103:0/547540881 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d51d3e2790 con 0x55d51d7322b0 2024-09-11T01:13:20.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.584+0000 7f8ceb400640 1 --2- 172.21.15.103:0/547540881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d7322b0 0x55d51d739480 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800a4f0 tx=0x7f8cd8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fa0a9cdfb573a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:20.590 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.584+0000 7f8cd2000640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:13:20.590 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.588+0000 7f8cd2000640 1 -- 172.21.15.103:0/547540881 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8016070 con 0x55d51d7322b0 2024-09-11T01:13:20.591 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.588+0000 7f8cd2000640 1 -- 172.21.15.103:0/547540881 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f8cd801c8f0 con 0x55d51d7322b0 2024-09-11T01:13:20.591 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.588+0000 7f8cf6008740 1 -- 172.21.15.103:0/547540881 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cec139180 con 0x55d51d7322b0 2024-09-11T01:13:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.589+0000 7f8cd2000640 1 -- 172.21.15.103:0/547540881 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8cd8030050 con 0x55d51d7322b0 2024-09-11T01:13:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.589+0000 7f8cf6008740 10 client.25811 fetch_fsmap learned FSMap version 31 2024-09-11T01:13:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.589+0000 7f8cf6008740 1 -- 172.21.15.103:0/547540881 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d51d45b620 con 0x55d51d7322b0 2024-09-11T01:13:20.593 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.590+0000 7f8cd2000640 1 -- 172.21.15.103:0/547540881 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8cec139180 con 0x55d51d7322b0 2024-09-11T01:13:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.591+0000 7f8cd2000640 1 -- 172.21.15.103:0/547540881 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f8cd80048c0 con 0x55d51d7322b0 2024-09-11T01:13:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.591+0000 7f8cf6008740 10 client.25811 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:13:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.591+0000 7f8cf6008740 10 client.25811 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:13:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.591+0000 7f8cf6008740 20 client.25811 populate_metadata read hostname 'smithi103' 2024-09-11T01:13:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.591+0000 7f8cf6008740 1 --2- 172.21.15.103:0/547540881 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55d51d7446e0 0x55d51d746ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.591+0000 7f8cf6008740 4 client.25811 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:13:20.594 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.591+0000 7f8cf6008740 1 -- 172.21.15.103:0/547540881 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d51d693600 con 0x55d51d7446e0 2024-09-11T01:13:20.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.591+0000 7f8cebe00640 1 --2- 172.21.15.103:0/547540881 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55d51d7446e0 0x55d51d746ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.592+0000 7f8cd2000640 10 client.25811 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:13:20.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.592+0000 7f8cebe00640 1 --2- 172.21.15.103:0/547540881 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55d51d7446e0 0x55d51d746ad0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1376d9d97211197 server_cookie=c621bea20a515c8d in_seq=0 out_seq=0 2024-09-11T01:13:20.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.592+0000 7f8cd2000640 1 -- 172.21.15.103:0/547540881 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d51d693600 con 0x55d51d7446e0 2024-09-11T01:13:20.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.592+0000 7f8cd2000640 10 client.25811 handle_command_reply: tid=0 2024-09-11T01:13:20.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.592+0000 7f8cf6008740 1 client.25811 shutdown 2024-09-11T01:13:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.593+0000 7f8cf6008740 1 -- 172.21.15.103:0/547540881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d7322b0 msgr2=0x55d51d739480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.593+0000 7f8cf6008740 1 --2- 172.21.15.103:0/547540881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d7322b0 0x55d51d739480 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800a4f0 tx=0x7f8cd8004730 comp rx=0 tx=0).stop 2024-09-11T01:13:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.593+0000 7f8cf6008740 1 -- 172.21.15.103:0/547540881 shutdown_connections 2024-09-11T01:13:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.593+0000 7f8cf6008740 1 --2- 172.21.15.103:0/547540881 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d734cf0 0x55d51d73a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.593+0000 7f8cf6008740 1 --2- 172.21.15.103:0/547540881 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d7322b0 0x55d51d739480 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.593+0000 7f8cf6008740 1 --2- 172.21.15.103:0/547540881 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55d51d7446e0 0x55d51d746ad0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.593+0000 7f8cf6008740 1 --2- 172.21.15.103:0/547540881 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d72f980 0x55d51d738de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.593+0000 7f8cf6008740 1 -- 172.21.15.103:0/547540881 >> 172.21.15.103:0/547540881 conn(0x55d51d719ac0 msgr2=0x55d51d718bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.593+0000 7f8cd2000640 0 client.25811 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:13:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.593+0000 7f8cf6008740 1 -- 172.21.15.103:0/547540881 shutdown_connections 2024-09-11T01:13:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.593+0000 7f8cf6008740 1 -- 172.21.15.103:0/547540881 wait complete. 2024-09-11T01:13:20.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.593+0000 7f8cf6008740 20 client.25811 trim_cache size 0 max 16384 2024-09-11T01:13:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.609+0000 7f8cf6008740 1 Processor -- start 2024-09-11T01:13:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.609+0000 7f8cf6008740 1 -- start start 2024-09-11T01:13:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.609+0000 7f8cf6008740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d72f980 0x55d51d714ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.609+0000 7f8cf6008740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d7322b0 0x55d51d71cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.609+0000 7f8cf6008740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d734cf0 0x55d51d71d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.609+0000 7f8cf6008740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce413e8e0 con 0x55d51d72f980 2024-09-11T01:13:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.609+0000 7f8cf6008740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce413c1b0 con 0x55d51d734cf0 2024-09-11T01:13:20.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.609+0000 7f8cf6008740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce413a000 con 0x55d51d7322b0 2024-09-11T01:13:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.610+0000 7f8cf1000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d734cf0 0x55d51d71d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.610+0000 7f8ceb400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d7322b0 0x55d51d71cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.610+0000 7f8cebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d72f980 0x55d51d714ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.610+0000 7f8cf1000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d734cf0 0x55d51d71d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:33266/0 (socket says 172.21.15.103:33266) 2024-09-11T01:13:20.614 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.610+0000 7f8cf1000640 1 -- 172.21.15.103:0/3202539802 learned_addr learned my addr 172.21.15.103:0/3202539802 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:13:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.610+0000 7f8cf1000640 1 -- 172.21.15.103:0/3202539802 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d7322b0 msgr2=0x55d51d71cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:13:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.610+0000 7f8cf1000640 1 --2- 172.21.15.103:0/3202539802 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d7322b0 0x55d51d71cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.610+0000 7f8cf1000640 1 -- 172.21.15.103:0/3202539802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d72f980 msgr2=0x55d51d714ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:13:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.610+0000 7f8cf1000640 1 --2- 172.21.15.103:0/3202539802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d72f980 0x55d51d714ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.610+0000 7f8cf1000640 1 -- 172.21.15.103:0/3202539802 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d51d715460 con 0x55d51d734cf0 2024-09-11T01:13:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.610+0000 7f8cebe00640 1 --2- 172.21.15.103:0/3202539802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d72f980 0x55d51d714ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:13:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.610+0000 7f8cf1000640 1 --2- 172.21.15.103:0/3202539802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d734cf0 0x55d51d71d050 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000c9e0 tx=0x7f8ce000cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=250aacefab953506 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.611+0000 7f8cdcc00640 1 -- 172.21.15.103:0/3202539802 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000ee30 con 0x55d51d734cf0 2024-09-11T01:13:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.611+0000 7f8cdcc00640 1 -- 172.21.15.103:0/3202539802 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ce00108e0 con 0x55d51d734cf0 2024-09-11T01:13:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.611+0000 7f8cdcc00640 1 -- 172.21.15.103:0/3202539802 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000f9c0 con 0x55d51d734cf0 2024-09-11T01:13:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.611+0000 7f8cf6008740 1 -- 172.21.15.103:0/3202539802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d734cf0 msgr2=0x55d51d71d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.611+0000 7f8cf6008740 1 --2- 172.21.15.103:0/3202539802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d734cf0 0x55d51d71d050 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000c9e0 tx=0x7f8ce000cea0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.611+0000 7f8cf6008740 1 -- 172.21.15.103:0/3202539802 shutdown_connections 2024-09-11T01:13:20.615 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.611+0000 7f8cf6008740 1 --2- 172.21.15.103:0/3202539802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d734cf0 0x55d51d71d050 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.611+0000 7f8cf6008740 1 --2- 172.21.15.103:0/3202539802 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d7322b0 0x55d51d71cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.611+0000 7f8cf6008740 1 --2- 172.21.15.103:0/3202539802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d72f980 0x55d51d714ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.611+0000 7f8cf6008740 1 -- 172.21.15.103:0/3202539802 >> 172.21.15.103:0/3202539802 conn(0x55d51d719ac0 msgr2=0x55d51d71de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.611+0000 7f8cf6008740 1 -- 172.21.15.103:0/3202539802 shutdown_connections 2024-09-11T01:13:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.612+0000 7f8cf6008740 1 -- 172.21.15.103:0/3202539802 wait complete. 2024-09-11T01:13:20.616 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.612+0000 7f8cf6008740 1 -- start start 2024-09-11T01:13:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.612+0000 7f8cf6008740 1 Processor -- start 2024-09-11T01:13:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.612+0000 7f8cf6008740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d72f980 0x55d51d73f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.612+0000 7f8cf6008740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d7322b0 0x55d51d73fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.612+0000 7f8cf6008740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d734cf0 0x55d51d7402e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.612+0000 7f8cf6008740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce413a670 con 0x55d51d72f980 2024-09-11T01:13:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.612+0000 7f8cf6008740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce413bae0 con 0x55d51d734cf0 2024-09-11T01:13:20.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.612+0000 7f8cf6008740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce413ad40 con 0x55d51d7322b0 2024-09-11T01:13:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8cf6008740 10 client.0 _ll_register_callbacks cb 0x7f8cd8005b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:13:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8cebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d72f980 0x55d51d73f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8ceb400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d7322b0 0x55d51d73fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8cf1000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d734cf0 0x55d51d7402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8cebe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d72f980 0x55d51d73f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51126/0 (socket says 172.21.15.103:51126) 2024-09-11T01:13:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8ceb400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d7322b0 0x55d51d73fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:58742/0 (socket says 172.21.15.103:58742) 2024-09-11T01:13:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8cebe00640 1 -- 172.21.15.103:0/2956171657 learned_addr learned my addr 172.21.15.103:0/2956171657 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:13:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8cebe00640 1 -- 172.21.15.103:0/2956171657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d7322b0 msgr2=0x55d51d73fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:13:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8cebe00640 1 --2- 172.21.15.103:0/2956171657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d7322b0 0x55d51d73fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8cebe00640 1 -- 172.21.15.103:0/2956171657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d734cf0 msgr2=0x55d51d7402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:13:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8cebe00640 1 --2- 172.21.15.103:0/2956171657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d734cf0 0x55d51d7402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8cebe00640 1 -- 172.21.15.103:0/2956171657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d51d73e400 con 0x55d51d72f980 2024-09-11T01:13:20.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8cf1000640 1 --2- 172.21.15.103:0/2956171657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d734cf0 0x55d51d7402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8cebe00640 1 --2- 172.21.15.103:0/2956171657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d72f980 0x55d51d73f860 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8cec052430 tx=0x7f8cec068f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637249e03adb7b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.613+0000 7f8cd2000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.614+0000 7f8cd2000640 1 -- 172.21.15.103:0/2956171657 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec139180 con 0x55d51d72f980 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.614+0000 7f8cd2000640 1 -- 172.21.15.103:0/2956171657 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f8cec1604a0 con 0x55d51d72f980 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.614+0000 7f8cf6008740 1 -- 172.21.15.103:0/2956171657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8ce00108e0 con 0x55d51d72f980 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.614+0000 7f8cd2000640 1 -- 172.21.15.103:0/2956171657 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8cec139d70 con 0x55d51d72f980 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.614+0000 7f8cf6008740 10 client.15759 fetch_fsmap learned FSMap version 31 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.614+0000 7f8cf6008740 1 -- 172.21.15.103:0/2956171657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d51d7b19c0 con 0x55d51d72f980 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.614+0000 7f8cd2000640 1 -- 172.21.15.103:0/2956171657 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8ce00108e0 con 0x55d51d72f980 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.614+0000 7f8cd2000640 1 -- 172.21.15.103:0/2956171657 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f8cec09c940 con 0x55d51d72f980 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.614+0000 7f8cf6008740 10 client.15759 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.614+0000 7f8cf6008740 10 client.15759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.614+0000 7f8cf6008740 20 client.15759 populate_metadata read hostname 'smithi103' 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.614+0000 7f8cf6008740 1 --2- 172.21.15.103:0/2956171657 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55d51d7b21e0 0x55d51d7b4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:13:20.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.614+0000 7f8cf6008740 4 client.15759 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:13:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.614+0000 7f8cf6008740 1 -- 172.21.15.103:0/2956171657 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d51d68f0b0 con 0x55d51d7b21e0 2024-09-11T01:13:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.615+0000 7f8ceb400640 1 --2- 172.21.15.103:0/2956171657 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55d51d7b21e0 0x55d51d7b4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:13:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.615+0000 7f8ceb400640 1 --2- 172.21.15.103:0/2956171657 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55d51d7b21e0 0x55d51d7b4600 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e77457567056420e server_cookie=5dc96e562fb18f4e in_seq=0 out_seq=0 2024-09-11T01:13:20.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:20.615+0000 7f8cd2000640 10 client.15759 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:13:22.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:21 smithi103 ceph-mon[30562]: pgmap v550: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 51 MiB/s wr, 6.87k op/s 2024-09-11T01:13:22.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:21 smithi117 ceph-mon[35358]: pgmap v550: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 51 MiB/s wr, 6.87k op/s 2024-09-11T01:13:22.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:21 smithi183 ceph-mon[34992]: pgmap v550: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 51 MiB/s wr, 6.87k op/s 2024-09-11T01:13:24.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:23 smithi103 ceph-mon[30562]: pgmap v551: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 42 MiB/s wr, 5.75k op/s 2024-09-11T01:13:24.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:23 smithi117 ceph-mon[35358]: pgmap v551: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 42 MiB/s wr, 5.75k op/s 2024-09-11T01:13:24.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:23 smithi183 ceph-mon[34992]: pgmap v551: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 42 MiB/s wr, 5.75k op/s 2024-09-11T01:13:26.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:25 smithi103 ceph-mon[30562]: pgmap v552: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 52 MiB/s wr, 7.27k op/s 2024-09-11T01:13:26.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:25 smithi117 ceph-mon[35358]: pgmap v552: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 52 MiB/s wr, 7.27k op/s 2024-09-11T01:13:26.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:25 smithi183 ceph-mon[34992]: pgmap v552: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 52 MiB/s wr, 7.27k op/s 2024-09-11T01:13:28.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:27 smithi103 ceph-mon[30562]: pgmap v553: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 42 MiB/s wr, 6.02k op/s 2024-09-11T01:13:28.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:27 smithi117 ceph-mon[35358]: pgmap v553: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 42 MiB/s wr, 6.02k op/s 2024-09-11T01:13:28.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:27 smithi183 ceph-mon[34992]: pgmap v553: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 42 MiB/s wr, 6.02k op/s 2024-09-11T01:13:30.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:29 smithi103 ceph-mon[30562]: pgmap v554: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 48 MiB/s wr, 6.80k op/s 2024-09-11T01:13:30.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:29 smithi117 ceph-mon[35358]: pgmap v554: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 48 MiB/s wr, 6.80k op/s 2024-09-11T01:13:30.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:29 smithi183 ceph-mon[34992]: pgmap v554: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 48 MiB/s wr, 6.80k op/s 2024-09-11T01:13:32.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:31 smithi103 ceph-mon[30562]: pgmap v555: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 46 MiB/s wr, 6.50k op/s 2024-09-11T01:13:32.504 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:31 smithi183 ceph-mon[34992]: pgmap v555: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 46 MiB/s wr, 6.50k op/s 2024-09-11T01:13:32.504 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:31 smithi117 ceph-mon[35358]: pgmap v555: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 46 MiB/s wr, 6.50k op/s 2024-09-11T01:13:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.526+0000 7f8cd2000640 1 -- 172.21.15.103:0/2956171657 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d51d68f0b0 con 0x55d51d7b21e0 2024-09-11T01:13:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.526+0000 7f8cd2000640 10 client.15759 handle_command_reply: tid=0 2024-09-11T01:13:32.528 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.526+0000 7f8cf6008740 1 client.15759 shutdown 2024-09-11T01:13:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.527+0000 7f8cf6008740 1 -- 172.21.15.103:0/2956171657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d72f980 msgr2=0x55d51d73f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.527+0000 7f8cf6008740 1 --2- 172.21.15.103:0/2956171657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d72f980 0x55d51d73f860 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8cec052430 tx=0x7f8cec068f10 comp rx=0 tx=0).stop 2024-09-11T01:13:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.527+0000 7f8cf6008740 1 -- 172.21.15.103:0/2956171657 shutdown_connections 2024-09-11T01:13:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.527+0000 7f8cf6008740 1 --2- 172.21.15.103:0/2956171657 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55d51d734cf0 0x55d51d7402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.529 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.527+0000 7f8cf6008740 1 --2- 172.21.15.103:0/2956171657 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55d51d7b21e0 0x55d51d7b4600 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.527+0000 7f8cf6008740 1 --2- 172.21.15.103:0/2956171657 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55d51d7322b0 0x55d51d73fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.527+0000 7f8cf6008740 1 --2- 172.21.15.103:0/2956171657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55d51d72f980 0x55d51d73f860 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.527+0000 7f8cf6008740 1 -- 172.21.15.103:0/2956171657 >> 172.21.15.103:0/2956171657 conn(0x55d51d719ac0 msgr2=0x55d51d71da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.527+0000 7f8cd2000640 0 client.15759 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:13:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.527+0000 7f8cf6008740 1 -- 172.21.15.103:0/2956171657 shutdown_connections 2024-09-11T01:13:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.528+0000 7f8cf6008740 1 -- 172.21.15.103:0/2956171657 wait complete. 2024-09-11T01:13:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.528+0000 7f8cf6008740 20 client.15759 trim_cache size 0 max 16384 2024-09-11T01:13:32.530 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:13:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:13:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:13:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:13:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.529+0000 7f8cf1a00640 1 -- 172.21.15.103:0/3576171815 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8cd40bdbb0 msgr2=0x7f8cd40c0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.529+0000 7f8cf1a00640 1 --2- 172.21.15.103:0/3576171815 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8cd40bdbb0 0x7f8cd40c0070 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8cd80058c0 tx=0x7f8cd800a2d0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.530+0000 7f8cf1a00640 1 -- 172.21.15.103:0/3576171815 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ce40058f0 msgr2=0x7f8ce4095850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:13:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.530+0000 7f8cf1a00640 1 --2- 172.21.15.103:0/3576171815 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ce40058f0 0x7f8ce4095850 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8cec052890 tx=0x7f8cec06b380 comp rx=0 tx=0).stop 2024-09-11T01:13:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.530+0000 7f8cf1a00640 1 -- 172.21.15.103:0/3576171815 shutdown_connections 2024-09-11T01:13:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.530+0000 7f8cf1a00640 1 --2- 172.21.15.103:0/3576171815 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8cd40bdbb0 0x7f8cd40c0070 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.530+0000 7f8cf1a00640 1 --2- 172.21.15.103:0/3576171815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8ce409b250 0x7f8ce40945f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.530+0000 7f8cf1a00640 1 --2- 172.21.15.103:0/3576171815 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8ce40986a0 0x7f8ce40940b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.530+0000 7f8cf1a00640 1 --2- 172.21.15.103:0/3576171815 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8ce40058f0 0x7f8ce4095850 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:13:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.530+0000 7f8cf1a00640 1 -- 172.21.15.103:0/3576171815 >> 172.21.15.103:0/3576171815 conn(0x7f8ce408fce0 msgr2=0x7f8ce40969c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:13:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.530+0000 7f8cf1a00640 1 -- 172.21.15.103:0/3576171815 shutdown_connections 2024-09-11T01:13:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:13:32.531+0000 7f8cf1a00640 1 -- 172.21.15.103:0/3576171815 wait complete. 2024-09-11T01:13:34.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:33 smithi103 ceph-mon[30562]: pgmap v556: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 40 MiB/s wr, 5.65k op/s 2024-09-11T01:13:34.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:33 smithi117 ceph-mon[35358]: pgmap v556: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 40 MiB/s wr, 5.65k op/s 2024-09-11T01:13:34.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:33 smithi183 ceph-mon[34992]: pgmap v556: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 40 MiB/s wr, 5.65k op/s 2024-09-11T01:13:36.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:35 smithi103 ceph-mon[30562]: pgmap v557: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 54 MiB/s wr, 7.58k op/s 2024-09-11T01:13:36.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:35 smithi117 ceph-mon[35358]: pgmap v557: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 54 MiB/s wr, 7.58k op/s 2024-09-11T01:13:36.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:35 smithi183 ceph-mon[34992]: pgmap v557: 129 pgs: 129 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 54 MiB/s wr, 7.58k op/s 2024-09-11T01:13:38.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:37 smithi103 ceph-mon[30562]: pgmap v558: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 50 MiB/s wr, 6.90k op/s 2024-09-11T01:13:38.125 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:37 smithi117 ceph-mon[35358]: pgmap v558: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 50 MiB/s wr, 6.90k op/s 2024-09-11T01:13:38.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:37 smithi183 ceph-mon[34992]: pgmap v558: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 50 MiB/s wr, 6.90k op/s 2024-09-11T01:13:40.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:39 smithi103 ceph-mon[30562]: pgmap v559: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 54 MiB/s wr, 7.17k op/s 2024-09-11T01:13:40.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:39 smithi117 ceph-mon[35358]: pgmap v559: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 54 MiB/s wr, 7.17k op/s 2024-09-11T01:13:40.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:39 smithi183 ceph-mon[34992]: pgmap v559: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 54 MiB/s wr, 7.17k op/s 2024-09-11T01:13:42.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:41 smithi103 ceph-mon[30562]: pgmap v560: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 51 MiB/s wr, 6.64k op/s 2024-09-11T01:13:42.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:41 smithi117 ceph-mon[35358]: pgmap v560: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 51 MiB/s wr, 6.64k op/s 2024-09-11T01:13:42.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:41 smithi183 ceph-mon[34992]: pgmap v560: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 218 KiB/s rd, 51 MiB/s wr, 6.64k op/s 2024-09-11T01:13:42.928 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24665 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-11T01:13:42.929 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24665 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-11T01:13:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:42 smithi103 ceph-mon[30562]: pgmap v561: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 45 MiB/s wr, 5.81k op/s 2024-09-11T01:13:43.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:42 smithi117 ceph-mon[35358]: pgmap v561: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 45 MiB/s wr, 5.81k op/s 2024-09-11T01:13:43.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:42 smithi183 ceph-mon[34992]: pgmap v561: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 45 MiB/s wr, 5.81k op/s 2024-09-11T01:13:45.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:45 smithi183 ceph-mon[34992]: pgmap v562: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 61 MiB/s wr, 7.95k op/s 2024-09-11T01:13:46.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:45 smithi103 ceph-mon[30562]: pgmap v562: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 61 MiB/s wr, 7.95k op/s 2024-09-11T01:13:46.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:45 smithi117 ceph-mon[35358]: pgmap v562: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 61 MiB/s wr, 7.95k op/s 2024-09-11T01:13:47.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:47 smithi183 ceph-mon[34992]: pgmap v563: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 57 MiB/s wr, 7.12k op/s 2024-09-11T01:13:48.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:47 smithi103 ceph-mon[30562]: pgmap v563: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 57 MiB/s wr, 7.12k op/s 2024-09-11T01:13:48.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:47 smithi117 ceph-mon[35358]: pgmap v563: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 57 MiB/s wr, 7.12k op/s 2024-09-11T01:13:49.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:49 smithi183 ceph-mon[34992]: pgmap v564: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 59 MiB/s wr, 7.11k op/s 2024-09-11T01:13:49.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:13:49.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:13:49.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:13:49.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:13:50.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:49 smithi103 ceph-mon[30562]: pgmap v564: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 59 MiB/s wr, 7.11k op/s 2024-09-11T01:13:50.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:13:50.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:13:50.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:13:50.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:13:50.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:49 smithi117 ceph-mon[35358]: pgmap v564: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 59 MiB/s wr, 7.11k op/s 2024-09-11T01:13:50.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:13:50.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:13:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:13:50.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:13:50.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:50 smithi183 ceph-mon[34992]: pgmap v565: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 62 MiB/s wr, 7.42k op/s 2024-09-11T01:13:50.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:50 smithi183 ceph-mon[34992]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-11T01:13:50.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:50 smithi183 ceph-mon[34992]: Cluster is now healthy 2024-09-11T01:13:51.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:50 smithi103 ceph-mon[30562]: pgmap v565: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 62 MiB/s wr, 7.42k op/s 2024-09-11T01:13:51.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:50 smithi103 ceph-mon[30562]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-11T01:13:51.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:50 smithi103 ceph-mon[30562]: Cluster is now healthy 2024-09-11T01:13:51.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:50 smithi117 ceph-mon[35358]: pgmap v565: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 62 MiB/s wr, 7.42k op/s 2024-09-11T01:13:51.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:50 smithi117 ceph-mon[35358]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-11T01:13:51.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:50 smithi117 ceph-mon[35358]: Cluster is now healthy 2024-09-11T01:13:52.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:52 smithi183 ceph-mon[34992]: pgmap v566: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 65 MiB/s wr, 7.89k op/s 2024-09-11T01:13:53.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:52 smithi103 ceph-mon[30562]: pgmap v566: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 65 MiB/s wr, 7.89k op/s 2024-09-11T01:13:53.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:52 smithi117 ceph-mon[35358]: pgmap v566: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 65 MiB/s wr, 7.89k op/s 2024-09-11T01:13:55.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:54 smithi103 ceph-mon[30562]: pgmap v567: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 60 MiB/s wr, 7.27k op/s 2024-09-11T01:13:55.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:54 smithi117 ceph-mon[35358]: pgmap v567: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 60 MiB/s wr, 7.27k op/s 2024-09-11T01:13:55.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:54 smithi183 ceph-mon[34992]: pgmap v567: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 60 MiB/s wr, 7.27k op/s 2024-09-11T01:13:57.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:56 smithi103 ceph-mon[30562]: pgmap v568: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 64 MiB/s wr, 7.58k op/s 2024-09-11T01:13:57.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:56 smithi117 ceph-mon[35358]: pgmap v568: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 64 MiB/s wr, 7.58k op/s 2024-09-11T01:13:57.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:56 smithi183 ceph-mon[34992]: pgmap v568: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 64 MiB/s wr, 7.58k op/s 2024-09-11T01:13:59.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:13:58 smithi103 ceph-mon[30562]: pgmap v569: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 63 MiB/s wr, 7.47k op/s 2024-09-11T01:13:59.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:13:58 smithi117 ceph-mon[35358]: pgmap v569: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 63 MiB/s wr, 7.47k op/s 2024-09-11T01:13:59.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:13:58 smithi183 ceph-mon[34992]: pgmap v569: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 63 MiB/s wr, 7.47k op/s 2024-09-11T01:14:01.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:00 smithi103 ceph-mon[30562]: pgmap v570: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 64 MiB/s wr, 7.83k op/s 2024-09-11T01:14:01.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:00 smithi117 ceph-mon[35358]: pgmap v570: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 64 MiB/s wr, 7.83k op/s 2024-09-11T01:14:01.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:00 smithi183 ceph-mon[34992]: pgmap v570: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 64 MiB/s wr, 7.83k op/s 2024-09-11T01:14:02.970 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:02 smithi183 ceph-mon[34992]: pgmap v571: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 61 MiB/s wr, 7.52k op/s 2024-09-11T01:14:03.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:02 smithi103 ceph-mon[30562]: pgmap v571: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 61 MiB/s wr, 7.52k op/s 2024-09-11T01:14:03.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:02 smithi117 ceph-mon[35358]: pgmap v571: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 61 MiB/s wr, 7.52k op/s 2024-09-11T01:14:05.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:04 smithi103 ceph-mon[30562]: pgmap v572: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 55 MiB/s wr, 6.83k op/s 2024-09-11T01:14:05.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:04 smithi117 ceph-mon[35358]: pgmap v572: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 55 MiB/s wr, 6.83k op/s 2024-09-11T01:14:05.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:04 smithi183 ceph-mon[34992]: pgmap v572: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 55 MiB/s wr, 6.83k op/s 2024-09-11T01:14:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.187+0000 7f16cfe00640 1 -- 172.21.15.103:0/81470212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16c8104ba0 msgr2=0x7f16c8104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.187+0000 7f16cfe00640 1 --2- 172.21.15.103:0/81470212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16c8104ba0 0x7f16c8104fa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009930 tx=0x7f16bc02a420 comp rx=0 tx=0).stop 2024-09-11T01:14:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.187+0000 7f16cfe00640 1 -- 172.21.15.103:0/81470212 shutdown_connections 2024-09-11T01:14:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.187+0000 7f16cfe00640 1 --2- 172.21.15.103:0/81470212 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c81066b0 0x7f16c810d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.187+0000 7f16cfe00640 1 --2- 172.21.15.103:0/81470212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16c8105cf0 0x7f16c8106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.187+0000 7f16cfe00640 1 --2- 172.21.15.103:0/81470212 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16c8104ba0 0x7f16c8104fa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.187+0000 7f16cfe00640 1 -- 172.21.15.103:0/81470212 >> 172.21.15.103:0/81470212 conn(0x7f16c8100440 msgr2=0x7f16c8102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:14:06.190 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.187+0000 7f16cfe00640 1 -- 172.21.15.103:0/81470212 shutdown_connections 2024-09-11T01:14:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.187+0000 7f16cfe00640 1 -- 172.21.15.103:0/81470212 wait complete. 2024-09-11T01:14:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.188+0000 7f16cfe00640 1 Processor -- start 2024-09-11T01:14:06.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.189+0000 7f16cfe00640 1 -- start start 2024-09-11T01:14:06.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.189+0000 7f16cfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16c8104ba0 0x7f16c819afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.189+0000 7f16cfe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c8105cf0 0x7f16c819b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.189+0000 7f16cfe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16c81066b0 0x7f16c819c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.189+0000 7f16cfe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f16c8110860 con 0x7f16c8104ba0 2024-09-11T01:14:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.189+0000 7f16cfe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81106e0 con 0x7f16c8105cf0 2024-09-11T01:14:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.189+0000 7f16cfe00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81109e0 con 0x7f16c81066b0 2024-09-11T01:14:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.189+0000 7f16cd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16c8104ba0 0x7f16c819afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.189+0000 7f16cde00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16c81066b0 0x7f16c819c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.189+0000 7f16cd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16c8104ba0 0x7f16c819afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51564/0 (socket says 172.21.15.103:51564) 2024-09-11T01:14:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.189+0000 7f16cd400640 1 -- 172.21.15.103:0/68617130 learned_addr learned my addr 172.21.15.103:0/68617130 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:14:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.189+0000 7f16cca00640 1 --2- 172.21.15.103:0/68617130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c8105cf0 0x7f16c819b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.190+0000 7f16cde00640 1 -- 172.21.15.103:0/68617130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c8105cf0 msgr2=0x7f16c819b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.190+0000 7f16cde00640 1 --2- 172.21.15.103:0/68617130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c8105cf0 0x7f16c819b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.190+0000 7f16cde00640 1 -- 172.21.15.103:0/68617130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16c8104ba0 msgr2=0x7f16c819afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.190+0000 7f16cde00640 1 --2- 172.21.15.103:0/68617130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16c8104ba0 0x7f16c819afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.190+0000 7f16cde00640 1 -- 172.21.15.103:0/68617130 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c819caf0 con 0x7f16c81066b0 2024-09-11T01:14:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.190+0000 7f16cd400640 1 --2- 172.21.15.103:0/68617130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16c8104ba0 0x7f16c819afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:14:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.190+0000 7f16cde00640 1 --2- 172.21.15.103:0/68617130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16c81066b0 0x7f16c819c230 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009fd0 tx=0x7f16c000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:14:06.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.190+0000 7f16c6000640 1 -- 172.21.15.103:0/68617130 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c000ce20 con 0x7f16c81066b0 2024-09-11T01:14:06.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.190+0000 7f16c6000640 1 -- 172.21.15.103:0/68617130 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16c0005020 con 0x7f16c81066b0 2024-09-11T01:14:06.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.190+0000 7f16c6000640 1 -- 172.21.15.103:0/68617130 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c0010690 con 0x7f16c81066b0 2024-09-11T01:14:06.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.190+0000 7f16cfe00640 1 -- 172.21.15.103:0/68617130 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c819cde0 con 0x7f16c81066b0 2024-09-11T01:14:06.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.191+0000 7f16cfe00640 1 -- 172.21.15.103:0/68617130 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c81a34b0 con 0x7f16c81066b0 2024-09-11T01:14:06.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.194+0000 7f16d2c22740 1 Processor -- start 2024-09-11T01:14:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.194+0000 7f16c6000640 1 -- 172.21.15.103:0/68617130 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f16c00054d0 con 0x7f16c81066b0 2024-09-11T01:14:06.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.194+0000 7f16d2c22740 1 -- start start 2024-09-11T01:14:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.194+0000 7f16d2c22740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13eb790 0x55f0c13edb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.194+0000 7f16d2c22740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16d2c22740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13f0b00 0x55f0c13f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16d2c22740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f0c135e6b0 con 0x55f0c13ee0c0 2024-09-11T01:14:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16d2c22740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f0c134dae0 con 0x55f0c13eb790 2024-09-11T01:14:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16d2c22740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f0c13518f0 con 0x55f0c13f0b00 2024-09-11T01:14:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16cca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13eb790 0x55f0c13edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16cd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16cca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13eb790 0x55f0c13edb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:51956/0 (socket says 172.21.15.103:51956) 2024-09-11T01:14:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16cca00640 1 -- 172.21.15.103:0/1596918291 learned_addr learned my addr 172.21.15.103:0/1596918291 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:14:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16cca00640 1 --2- 172.21.15.103:0/1596918291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13f0b00 0x55f0c13f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16cca00640 1 -- 172.21.15.103:0/1596918291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13f0b00 msgr2=0x55f0c13f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:06.200 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16cca00640 1 --2- 172.21.15.103:0/1596918291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13f0b00 0x55f0c13f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16cca00640 1 -- 172.21.15.103:0/1596918291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 msgr2=0x55f0c13f04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16cca00640 1 --2- 172.21.15.103:0/1596918291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16cca00640 1 -- 172.21.15.103:0/1596918291 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0c131a780 con 0x55f0c13eb790 2024-09-11T01:14:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16cd400640 1 --2- 172.21.15.103:0/1596918291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:14:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.195+0000 7f16cca00640 1 --2- 172.21.15.103:0/1596918291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13eb790 0x55f0c13edb80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f16b4011850 tx=0x7f16b40097f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f92b7cd44776a4a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:14:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.196+0000 7f16ba600640 1 -- 172.21.15.103:0/1596918291 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4004030 con 0x55f0c13eb790 2024-09-11T01:14:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.196+0000 7f16ba600640 1 -- 172.21.15.103:0/1596918291 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16b400f7c0 con 0x55f0c13eb790 2024-09-11T01:14:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.196+0000 7f16ba600640 1 -- 172.21.15.103:0/1596918291 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4003850 con 0x55f0c13eb790 2024-09-11T01:14:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.196+0000 7f16c6000640 1 --2- 172.21.15.103:0/68617130 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f16b00b5360 0x7f16b00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.196+0000 7f16d2c22740 1 -- 172.21.15.103:0/1596918291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13eb790 msgr2=0x55f0c13edb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.196+0000 7f16d2c22740 1 --2- 172.21.15.103:0/1596918291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13eb790 0x55f0c13edb80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f16b4011850 tx=0x7f16b40097f0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.196+0000 7f16c6000640 1 -- 172.21.15.103:0/68617130 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f16c00e65e0 con 0x7f16c81066b0 2024-09-11T01:14:06.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.197+0000 7f16cd400640 1 --2- 172.21.15.103:0/68617130 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f16b00b5360 0x7f16b00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.197+0000 7f16d2c22740 1 -- 172.21.15.103:0/1596918291 shutdown_connections 2024-09-11T01:14:06.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.197+0000 7f16d2c22740 1 --2- 172.21.15.103:0/1596918291 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13f0b00 0x55f0c13f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.197+0000 7f16d2c22740 1 --2- 172.21.15.103:0/1596918291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.197+0000 7f16d2c22740 1 --2- 172.21.15.103:0/1596918291 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13eb790 0x55f0c13edb80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.197+0000 7f16d2c22740 1 -- 172.21.15.103:0/1596918291 >> 172.21.15.103:0/1596918291 conn(0x55f0c13e68e0 msgr2=0x55f0c13e7670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:14:06.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.197+0000 7f16d2c22740 1 -- 172.21.15.103:0/1596918291 shutdown_connections 2024-09-11T01:14:06.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.197+0000 7f16d2c22740 1 -- 172.21.15.103:0/1596918291 wait complete. 2024-09-11T01:14:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.197+0000 7f16d2c22740 1 -- start start 2024-09-11T01:14:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.197+0000 7f16cd400640 1 --2- 172.21.15.103:0/68617130 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f16b00b5360 0x7f16b00b7820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f16bc000c00 tx=0x7f16bc005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:14:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.198+0000 7f16d2c22740 1 Processor -- start 2024-09-11T01:14:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.198+0000 7f16d2c22740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13eb790 0x55f0c13f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.198+0000 7f16d2c22740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.198+0000 7f16d2c22740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13f0b00 0x55f0c13f6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.198+0000 7f16d2c22740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f0c1285ab0 con 0x55f0c13ee0c0 2024-09-11T01:14:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.198+0000 7f16d2c22740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55f0c12f4570 con 0x55f0c13f0b00 2024-09-11T01:14:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.198+0000 7f16d2c22740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55f0c13f3ae0 con 0x55f0c13eb790 2024-09-11T01:14:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.198+0000 7f16d2c22740 10 client.0 _ll_register_callbacks cb 0x55f0c1303100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:14:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.198+0000 7f16cca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.198+0000 7f16cca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51590/0 (socket says 172.21.15.103:51590) 2024-09-11T01:14:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.198+0000 7f16cca00640 1 -- 172.21.15.103:0/3126987441 learned_addr learned my addr 172.21.15.103:0/3126987441 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:14:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.198+0000 7f16cd400640 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13eb790 0x55f0c13f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.198+0000 7f16cde00640 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13f0b00 0x55f0c13f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.199+0000 7f16cca00640 1 -- 172.21.15.103:0/3126987441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13eb790 msgr2=0x55f0c13f4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.199+0000 7f16cca00640 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13eb790 0x55f0c13f4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.199+0000 7f16cca00640 1 -- 172.21.15.103:0/3126987441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13f0b00 msgr2=0x55f0c13f6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.199+0000 7f16cca00640 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13f0b00 0x55f0c13f6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.199+0000 7f16cca00640 1 -- 172.21.15.103:0/3126987441 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0c10af790 con 0x55f0c13ee0c0 2024-09-11T01:14:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.199+0000 7f16cde00640 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13f0b00 0x55f0c13f6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:14:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.199+0000 7f16cd400640 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13eb790 0x55f0c13f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:14:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.199+0000 7f16cca00640 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f5540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f16b400fe40 tx=0x7f16b400fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf60986300218f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:14:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.199+0000 7f16aea00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:14:06.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.199+0000 7f16aea00640 1 -- 172.21.15.103:0/3126987441 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4004050 con 0x55f0c13ee0c0 2024-09-11T01:14:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.199+0000 7f16aea00640 1 -- 172.21.15.103:0/3126987441 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f16b40041f0 con 0x55f0c13ee0c0 2024-09-11T01:14:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.199+0000 7f16d2c22740 1 -- 172.21.15.103:0/3126987441 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16b400f7c0 con 0x55f0c13ee0c0 2024-09-11T01:14:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.200+0000 7f16aea00640 1 -- 172.21.15.103:0/3126987441 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f16b4031050 con 0x55f0c13ee0c0 2024-09-11T01:14:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.200+0000 7f16d2c22740 10 client.15771 fetch_fsmap learned FSMap version 31 2024-09-11T01:14:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.200+0000 7f16d2c22740 1 -- 172.21.15.103:0/3126987441 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f0c1128620 con 0x55f0c13ee0c0 2024-09-11T01:14:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.200+0000 7f16aea00640 1 -- 172.21.15.103:0/3126987441 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16b400f7c0 con 0x55f0c13ee0c0 2024-09-11T01:14:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.200+0000 7f16aea00640 1 -- 172.21.15.103:0/3126987441 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f16b402b4b0 con 0x55f0c13ee0c0 2024-09-11T01:14:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.200+0000 7f16d2c22740 10 client.15771 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:14:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.200+0000 7f16d2c22740 10 client.15771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:14:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.200+0000 7f16d2c22740 20 client.15771 populate_metadata read hostname 'smithi103' 2024-09-11T01:14:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.200+0000 7f16d2c22740 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f0c1400470 0x55f0c1402860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.200+0000 7f16d2c22740 4 client.15771 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:14:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.200+0000 7f16d2c22740 1 -- 172.21.15.103:0/3126987441 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0c1360600 con 0x55f0c1400470 2024-09-11T01:14:06.208 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.201+0000 7f16cd400640 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f0c1400470 0x55f0c1402860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.201+0000 7f16cd400640 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f0c1400470 0x55f0c1402860 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c291ce6adadf4e8 server_cookie=71133c9e87965d8c in_seq=0 out_seq=0 2024-09-11T01:14:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.201+0000 7f16aea00640 10 client.15771 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:14:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.202+0000 7f16aea00640 1 -- 172.21.15.103:0/3126987441 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f0c1360600 con 0x55f0c1400470 2024-09-11T01:14:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.202+0000 7f16aea00640 10 client.15771 handle_command_reply: tid=0 2024-09-11T01:14:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.202+0000 7f16d2c22740 1 client.15771 shutdown 2024-09-11T01:14:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.202+0000 7f16d2c22740 1 -- 172.21.15.103:0/3126987441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 msgr2=0x55f0c13f5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.202+0000 7f16d2c22740 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f5540 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f16b400fe40 tx=0x7f16b400fe70 comp rx=0 tx=0).stop 2024-09-11T01:14:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.202+0000 7f16d2c22740 1 -- 172.21.15.103:0/3126987441 shutdown_connections 2024-09-11T01:14:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.202+0000 7f16d2c22740 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13f0b00 0x55f0c13f6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.202+0000 7f16d2c22740 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f5540 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.202+0000 7f16d2c22740 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f0c1400470 0x55f0c1402860 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.202+0000 7f16d2c22740 1 --2- 172.21.15.103:0/3126987441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13eb790 0x55f0c13f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.202+0000 7f16aea00640 0 client.15771 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:14:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.202+0000 7f16d2c22740 1 -- 172.21.15.103:0/3126987441 >> 172.21.15.103:0/3126987441 conn(0x55f0c13e68e0 msgr2=0x55f0c13e5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:14:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.202+0000 7f16d2c22740 1 -- 172.21.15.103:0/3126987441 shutdown_connections 2024-09-11T01:14:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.202+0000 7f16d2c22740 1 -- 172.21.15.103:0/3126987441 wait complete. 2024-09-11T01:14:06.210 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.203+0000 7f16d2c22740 20 client.15771 trim_cache size 0 max 16384 2024-09-11T01:14:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.218+0000 7f16d2c22740 1 Processor -- start 2024-09-11T01:14:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.218+0000 7f16d2c22740 1 -- start start 2024-09-11T01:14:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.218+0000 7f16d2c22740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13eb790 0x55f0c13f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.218+0000 7f16d2c22740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.218+0000 7f16d2c22740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13f0b00 0x55f0c13f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.218+0000 7f16d2c22740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81b0220 con 0x55f0c13ee0c0 2024-09-11T01:14:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.218+0000 7f16d2c22740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81adaf0 con 0x55f0c13eb790 2024-09-11T01:14:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.218+0000 7f16d2c22740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81ab940 con 0x55f0c13f0b00 2024-09-11T01:14:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.218+0000 7f16cca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.218+0000 7f16cde00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13f0b00 0x55f0c13f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.218+0000 7f16cca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51594/0 (socket says 172.21.15.103:51594) 2024-09-11T01:14:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.218+0000 7f16cca00640 1 -- 172.21.15.103:0/641204307 learned_addr learned my addr 172.21.15.103:0/641204307 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:14:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.218+0000 7f16cd400640 1 --2- 172.21.15.103:0/641204307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13eb790 0x55f0c13f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.219+0000 7f16cde00640 1 -- 172.21.15.103:0/641204307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13eb790 msgr2=0x55f0c13f0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.219+0000 7f16cde00640 1 --2- 172.21.15.103:0/641204307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13eb790 0x55f0c13f0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.219+0000 7f16cde00640 1 -- 172.21.15.103:0/641204307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 msgr2=0x55f0c13f1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.219+0000 7f16cde00640 1 --2- 172.21.15.103:0/641204307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.219+0000 7f16cde00640 1 -- 172.21.15.103:0/641204307 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0c1402bd0 con 0x55f0c13f0b00 2024-09-11T01:14:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.219+0000 7f16cca00640 1 --2- 172.21.15.103:0/641204307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:14:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.219+0000 7f16cd400640 1 --2- 172.21.15.103:0/641204307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13eb790 0x55f0c13f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:14:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.219+0000 7f16cde00640 1 --2- 172.21.15.103:0/641204307 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13f0b00 0x55f0c13f4ea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f16c00ac960 tx=0x7f16c00a90a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=703a5eebcf73ef95 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:14:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.219+0000 7f16b9c00640 1 -- 172.21.15.103:0/641204307 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c00d3070 con 0x55f0c13f0b00 2024-09-11T01:14:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.219+0000 7f16b9c00640 1 -- 172.21.15.103:0/641204307 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16c00b14b0 con 0x55f0c13f0b00 2024-09-11T01:14:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.219+0000 7f16b9c00640 1 -- 172.21.15.103:0/641204307 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c00b5ad0 con 0x55f0c13f0b00 2024-09-11T01:14:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.220+0000 7f16d2c22740 1 -- 172.21.15.103:0/641204307 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13f0b00 msgr2=0x55f0c13f4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.220+0000 7f16d2c22740 1 --2- 172.21.15.103:0/641204307 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13f0b00 0x55f0c13f4ea0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f16c00ac960 tx=0x7f16c00a90a0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.220+0000 7f16d2c22740 1 -- 172.21.15.103:0/641204307 shutdown_connections 2024-09-11T01:14:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.220+0000 7f16d2c22740 1 --2- 172.21.15.103:0/641204307 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13f0b00 0x55f0c13f4ea0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.220+0000 7f16d2c22740 1 --2- 172.21.15.103:0/641204307 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13ee0c0 0x55f0c13f1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.220+0000 7f16d2c22740 1 --2- 172.21.15.103:0/641204307 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13eb790 0x55f0c13f0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.220+0000 7f16d2c22740 1 -- 172.21.15.103:0/641204307 >> 172.21.15.103:0/641204307 conn(0x55f0c13e68e0 msgr2=0x55f0c13eac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:14:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.220+0000 7f16d2c22740 1 -- 172.21.15.103:0/641204307 shutdown_connections 2024-09-11T01:14:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.220+0000 7f16d2c22740 1 -- 172.21.15.103:0/641204307 wait complete. 2024-09-11T01:14:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.221+0000 7f16d2c22740 1 -- start start 2024-09-11T01:14:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.221+0000 7f16d2c22740 1 Processor -- start 2024-09-11T01:14:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.221+0000 7f16d2c22740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13eb790 0x55f0c13fca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.221+0000 7f16d2c22740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13ee0c0 0x55f0c13fb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.221+0000 7f16d2c22740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13f0b00 0x55f0c13fbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.221+0000 7f16d2c22740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81abfb0 con 0x55f0c13eb790 2024-09-11T01:14:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.221+0000 7f16d2c22740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81ad420 con 0x55f0c13f0b00 2024-09-11T01:14:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.221+0000 7f16d2c22740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f16c81ac680 con 0x55f0c13ee0c0 2024-09-11T01:14:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.221+0000 7f16d2c22740 10 client.0 _ll_register_callbacks cb 0x7f16c00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:14:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.221+0000 7f16cd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13eb790 0x55f0c13fca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.221+0000 7f16cd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13eb790 0x55f0c13fca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51608/0 (socket says 172.21.15.103:51608) 2024-09-11T01:14:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.221+0000 7f16cd400640 1 -- 172.21.15.103:0/2292319355 learned_addr learned my addr 172.21.15.103:0/2292319355 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:14:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.222+0000 7f16cca00640 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13ee0c0 0x55f0c13fb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.222+0000 7f16cde00640 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13f0b00 0x55f0c13fbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.222+0000 7f16cd400640 1 -- 172.21.15.103:0/2292319355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13ee0c0 msgr2=0x55f0c13fb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.222+0000 7f16cd400640 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13ee0c0 0x55f0c13fb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.222+0000 7f16cd400640 1 -- 172.21.15.103:0/2292319355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13f0b00 msgr2=0x55f0c13fbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.222+0000 7f16cd400640 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13f0b00 0x55f0c13fbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.222+0000 7f16cd400640 1 -- 172.21.15.103:0/2292319355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0c13fc590 con 0x55f0c13eb790 2024-09-11T01:14:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.222+0000 7f16cde00640 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13f0b00 0x55f0c13fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:14:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.222+0000 7f16cca00640 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13ee0c0 0x55f0c13fb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:14:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.222+0000 7f16cd400640 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13eb790 0x55f0c13fca60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f16bc005ab0 tx=0x7f16bc02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d70f7b0b170f8a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:14:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.222+0000 7f16aea00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:14:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.222+0000 7f16aea00640 1 -- 172.21.15.103:0/2292319355 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc060060 con 0x55f0c13eb790 2024-09-11T01:14:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.222+0000 7f16aea00640 1 -- 172.21.15.103:0/2292319355 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f16bc042030 con 0x55f0c13eb790 2024-09-11T01:14:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.222+0000 7f16d2c22740 1 -- 172.21.15.103:0/2292319355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16c00b14b0 con 0x55f0c13eb790 2024-09-11T01:14:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.223+0000 7f16aea00640 1 -- 172.21.15.103:0/2292319355 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f16bc067050 con 0x55f0c13eb790 2024-09-11T01:14:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.223+0000 7f16d2c22740 10 client.15777 fetch_fsmap learned FSMap version 31 2024-09-11T01:14:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.223+0000 7f16d2c22740 1 -- 172.21.15.103:0/2292319355 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f0c146d570 con 0x55f0c13eb790 2024-09-11T01:14:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.223+0000 7f16aea00640 1 -- 172.21.15.103:0/2292319355 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f16c00b14b0 con 0x55f0c13eb790 2024-09-11T01:14:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.223+0000 7f16aea00640 1 -- 172.21.15.103:0/2292319355 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f16bc056a30 con 0x55f0c13eb790 2024-09-11T01:14:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.223+0000 7f16d2c22740 10 client.15777 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:14:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.223+0000 7f16d2c22740 10 client.15777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:14:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.223+0000 7f16d2c22740 20 client.15777 populate_metadata read hostname 'smithi103' 2024-09-11T01:14:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.223+0000 7f16d2c22740 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f0c146df00 0x55f0c1470320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.223+0000 7f16d2c22740 4 client.15777 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:14:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.223+0000 7f16d2c22740 1 -- 172.21.15.103:0/2292319355 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f0c13f3ca0 con 0x55f0c146df00 2024-09-11T01:14:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.224+0000 7f16cca00640 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f0c146df00 0x55f0c1470320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.224+0000 7f16cca00640 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f0c146df00 0x55f0c1470320 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13503607a0d5ca3 server_cookie=9292402035194b23 in_seq=0 out_seq=0 2024-09-11T01:14:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:06.224+0000 7f16aea00640 10 client.15777 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:14:07.086 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:06 smithi103 ceph-mon[30562]: pgmap v573: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 71 MiB/s wr, 8.83k op/s 2024-09-11T01:14:07.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:06 smithi117 ceph-mon[35358]: pgmap v573: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 71 MiB/s wr, 8.83k op/s 2024-09-11T01:14:07.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:06 smithi183 ceph-mon[34992]: pgmap v573: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 71 MiB/s wr, 8.83k op/s 2024-09-11T01:14:09.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:08 smithi103 ceph-mon[30562]: pgmap v574: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 MiB/s wr, 7.46k op/s 2024-09-11T01:14:09.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:08 smithi117 ceph-mon[35358]: pgmap v574: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 MiB/s wr, 7.46k op/s 2024-09-11T01:14:09.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:08 smithi183 ceph-mon[34992]: pgmap v574: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 60 MiB/s wr, 7.46k op/s 2024-09-11T01:14:11.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:10 smithi103 ceph-mon[30562]: pgmap v575: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 63 MiB/s wr, 8.10k op/s 2024-09-11T01:14:11.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:10 smithi117 ceph-mon[35358]: pgmap v575: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 63 MiB/s wr, 8.10k op/s 2024-09-11T01:14:11.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:10 smithi183 ceph-mon[34992]: pgmap v575: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 63 MiB/s wr, 8.10k op/s 2024-09-11T01:14:13.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:12 smithi103 ceph-mon[30562]: pgmap v576: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 55 MiB/s wr, 7.25k op/s 2024-09-11T01:14:13.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:12 smithi117 ceph-mon[35358]: pgmap v576: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 55 MiB/s wr, 7.25k op/s 2024-09-11T01:14:13.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:12 smithi183 ceph-mon[34992]: pgmap v576: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 55 MiB/s wr, 7.25k op/s 2024-09-11T01:14:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.532+0000 7f16aea00640 1 -- 172.21.15.103:0/2292319355 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f0c13f3ca0 con 0x55f0c146df00 2024-09-11T01:14:13.535 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.532+0000 7f16aea00640 10 client.15777 handle_command_reply: tid=0 2024-09-11T01:14:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.532+0000 7f16d2c22740 1 client.15777 shutdown 2024-09-11T01:14:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.533+0000 7f16d2c22740 1 -- 172.21.15.103:0/2292319355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13eb790 msgr2=0x55f0c13fca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.533+0000 7f16d2c22740 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13eb790 0x55f0c13fca60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f16bc005ab0 tx=0x7f16bc02a420 comp rx=0 tx=0).stop 2024-09-11T01:14:13.536 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.533+0000 7f16d2c22740 1 -- 172.21.15.103:0/2292319355 shutdown_connections 2024-09-11T01:14:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.533+0000 7f16d2c22740 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55f0c13f0b00 0x55f0c13fbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.533+0000 7f16d2c22740 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55f0c146df00 0x55f0c1470320 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.533+0000 7f16d2c22740 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55f0c13ee0c0 0x55f0c13fb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.533+0000 7f16d2c22740 1 --2- 172.21.15.103:0/2292319355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f0c13eb790 0x55f0c13fca60 secure :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f16bc005ab0 tx=0x7f16bc02a420 comp rx=0 tx=0).stop 2024-09-11T01:14:13.537 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.533+0000 7f16d2c22740 1 -- 172.21.15.103:0/2292319355 >> 172.21.15.103:0/2292319355 conn(0x55f0c13e68e0 msgr2=0x55f0c13f0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:14:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.534+0000 7f16aea00640 0 client.15777 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:14:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.534+0000 7f16d2c22740 1 -- 172.21.15.103:0/2292319355 shutdown_connections 2024-09-11T01:14:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.535+0000 7f16d2c22740 1 -- 172.21.15.103:0/2292319355 wait complete. 2024-09-11T01:14:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.535+0000 7f16d2c22740 20 client.15777 trim_cache size 0 max 16384 2024-09-11T01:14:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:14:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:14:13.538 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:14:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:14:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.536+0000 7f16cfe00640 1 -- 172.21.15.103:0/68617130 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f16b00b5360 msgr2=0x7f16b00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:13.539 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.536+0000 7f16cfe00640 1 --2- 172.21.15.103:0/68617130 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f16b00b5360 0x7f16b00b7820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f16bc000c00 tx=0x7f16bc005a20 comp rx=0 tx=0).stop 2024-09-11T01:14:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.536+0000 7f16cfe00640 1 -- 172.21.15.103:0/68617130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16c81066b0 msgr2=0x7f16c819c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.536+0000 7f16cfe00640 1 --2- 172.21.15.103:0/68617130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16c81066b0 0x7f16c819c230 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f16c0009fd0 tx=0x7f16c000ef10 comp rx=0 tx=0).stop 2024-09-11T01:14:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.536+0000 7f16cfe00640 1 -- 172.21.15.103:0/68617130 shutdown_connections 2024-09-11T01:14:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.537+0000 7f16cfe00640 1 --2- 172.21.15.103:0/68617130 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f16b00b5360 0x7f16b00b7820 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.537+0000 7f16cfe00640 1 --2- 172.21.15.103:0/68617130 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f16c81066b0 0x7f16c819c230 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.537+0000 7f16cfe00640 1 --2- 172.21.15.103:0/68617130 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16c8105cf0 0x7f16c819b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.537+0000 7f16cfe00640 1 --2- 172.21.15.103:0/68617130 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16c8104ba0 0x7f16c819afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.537+0000 7f16cfe00640 1 -- 172.21.15.103:0/68617130 >> 172.21.15.103:0/68617130 conn(0x7f16c8100440 msgr2=0x7f16c8109080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:14:13.540 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.537+0000 7f16cfe00640 1 -- 172.21.15.103:0/68617130 shutdown_connections 2024-09-11T01:14:13.541 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:13.538+0000 7f16cfe00640 1 -- 172.21.15.103:0/68617130 wait complete. 2024-09-11T01:14:15.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:14 smithi103 ceph-mon[30562]: pgmap v577: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 53 MiB/s wr, 7.00k op/s 2024-09-11T01:14:15.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:14 smithi117 ceph-mon[35358]: pgmap v577: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 53 MiB/s wr, 7.00k op/s 2024-09-11T01:14:15.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:14 smithi183 ceph-mon[34992]: pgmap v577: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 53 MiB/s wr, 7.00k op/s 2024-09-11T01:14:17.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:16 smithi103 ceph-mon[30562]: pgmap v578: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 61 MiB/s wr, 8.12k op/s 2024-09-11T01:14:17.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:16 smithi117 ceph-mon[35358]: pgmap v578: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 61 MiB/s wr, 8.12k op/s 2024-09-11T01:14:17.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:16 smithi183 ceph-mon[34992]: pgmap v578: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 61 MiB/s wr, 8.12k op/s 2024-09-11T01:14:19.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:18 smithi103 ceph-mon[30562]: pgmap v579: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 51 MiB/s wr, 6.96k op/s 2024-09-11T01:14:19.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:18 smithi117 ceph-mon[35358]: pgmap v579: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 51 MiB/s wr, 6.96k op/s 2024-09-11T01:14:19.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:18 smithi183 ceph-mon[34992]: pgmap v579: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 51 MiB/s wr, 6.96k op/s 2024-09-11T01:14:21.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:20 smithi103 ceph-mon[30562]: pgmap v580: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 54 MiB/s wr, 7.65k op/s 2024-09-11T01:14:21.125 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:20 smithi117 ceph-mon[35358]: pgmap v580: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 54 MiB/s wr, 7.65k op/s 2024-09-11T01:14:21.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:20 smithi183 ceph-mon[34992]: pgmap v580: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 54 MiB/s wr, 7.65k op/s 2024-09-11T01:14:23.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:22 smithi103 ceph-mon[30562]: pgmap v581: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 50 MiB/s wr, 6.99k op/s 2024-09-11T01:14:23.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:22 smithi117 ceph-mon[35358]: pgmap v581: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 50 MiB/s wr, 6.99k op/s 2024-09-11T01:14:23.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:22 smithi183 ceph-mon[34992]: pgmap v581: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 50 MiB/s wr, 6.99k op/s 2024-09-11T01:14:25.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:24 smithi103 ceph-mon[30562]: pgmap v582: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 52 MiB/s wr, 7.21k op/s 2024-09-11T01:14:25.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:24 smithi117 ceph-mon[35358]: pgmap v582: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 52 MiB/s wr, 7.21k op/s 2024-09-11T01:14:25.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:24 smithi183 ceph-mon[34992]: pgmap v582: 129 pgs: 129 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 52 MiB/s wr, 7.21k op/s 2024-09-11T01:14:26.672 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:14:26.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.802+0000 7f6332a00640 1 -- 172.21.15.103:0/4150757795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f632c100860 msgr2=0x7f632c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:26.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.802+0000 7f6332a00640 1 --2- 172.21.15.103:0/4150757795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f632c100860 0x7f632c100c60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6324009ca0 tx=0x7f632402a8d0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.807+0000 7f6332a00640 1 -- 172.21.15.103:0/4150757795 shutdown_connections 2024-09-11T01:14:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.808+0000 7f6332a00640 1 --2- 172.21.15.103:0/4150757795 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f632c102260 0x7f632c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.809 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.808+0000 7f6332a00640 1 --2- 172.21.15.103:0/4150757795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f632c1018a0 0x7f632c101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.808+0000 7f6332a00640 1 --2- 172.21.15.103:0/4150757795 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f632c100860 0x7f632c100c60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.810 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.808+0000 7f6332a00640 1 -- 172.21.15.103:0/4150757795 >> 172.21.15.103:0/4150757795 conn(0x7f632c0fc440 msgr2=0x7f632c0fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:14:26.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.813+0000 7f6332a00640 1 -- 172.21.15.103:0/4150757795 shutdown_connections 2024-09-11T01:14:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.813+0000 7f6332a00640 1 -- 172.21.15.103:0/4150757795 wait complete. 2024-09-11T01:14:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.814+0000 7f6332a00640 1 Processor -- start 2024-09-11T01:14:26.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.815+0000 7f6332a00640 1 -- start start 2024-09-11T01:14:26.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.815+0000 7f6332a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f632c100860 0x7f632c10d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.815+0000 7f6332a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f632c1018a0 0x7f632c10dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.815+0000 7f6332a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f632c102260 0x7f632c10e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.816+0000 7f632be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f632c100860 0x7f632c10d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.816+0000 7f6330a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f632c102260 0x7f632c10e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.816+0000 7f6330a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f632c102260 0x7f632c10e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:48122/0 (socket says 172.21.15.103:48122) 2024-09-11T01:14:26.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.816+0000 7f6330a00640 1 -- 172.21.15.103:0/1670108160 learned_addr learned my addr 172.21.15.103:0/1670108160 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:14:26.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.817+0000 7f6332a00640 1 -- 172.21.15.103:0/1670108160 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f632c114c90 con 0x7f632c1018a0 2024-09-11T01:14:26.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.817+0000 7f6332a00640 1 -- 172.21.15.103:0/1670108160 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f632c114b10 con 0x7f632c100860 2024-09-11T01:14:26.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.817+0000 7f6332a00640 1 -- 172.21.15.103:0/1670108160 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f632c114e10 con 0x7f632c102260 2024-09-11T01:14:26.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.817+0000 7f6330a00640 1 -- 172.21.15.103:0/1670108160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f632c100860 msgr2=0x7f632c10d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:26.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.817+0000 7f6330a00640 1 --2- 172.21.15.103:0/1670108160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f632c100860 0x7f632c10d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.817+0000 7f632b400640 1 --2- 172.21.15.103:0/1670108160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f632c1018a0 0x7f632c10dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.817+0000 7f6330a00640 1 -- 172.21.15.103:0/1670108160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f632c1018a0 msgr2=0x7f632c10dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:26.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.817+0000 7f6330a00640 1 --2- 172.21.15.103:0/1670108160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f632c1018a0 0x7f632c10dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.818+0000 7f6330a00640 1 -- 172.21.15.103:0/1670108160 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f632c10f0c0 con 0x7f632c102260 2024-09-11T01:14:26.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.818+0000 7f632b400640 1 --2- 172.21.15.103:0/1670108160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f632c1018a0 0x7f632c10dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:14:26.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.818+0000 7f6330a00640 1 --2- 172.21.15.103:0/1670108160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f632c102260 0x7f632c10e800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f631800b3f0 tx=0x7f631800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:14:26.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.819+0000 7f6328c00640 1 -- 172.21.15.103:0/1670108160 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6318015020 con 0x7f632c102260 2024-09-11T01:14:26.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.819+0000 7f6328c00640 1 -- 172.21.15.103:0/1670108160 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6318011ce0 con 0x7f632c102260 2024-09-11T01:14:26.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.819+0000 7f6328c00640 1 -- 172.21.15.103:0/1670108160 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6318010da0 con 0x7f632c102260 2024-09-11T01:14:26.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.819+0000 7f6332a00640 1 -- 172.21.15.103:0/1670108160 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f632c10f3b0 con 0x7f632c102260 2024-09-11T01:14:26.822 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.820+0000 7f6332a00640 1 -- 172.21.15.103:0/1670108160 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f632c10fad0 con 0x7f632c102260 2024-09-11T01:14:26.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.826+0000 7f633583d740 1 Processor -- start 2024-09-11T01:14:26.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.829+0000 7f633583d740 1 -- start start 2024-09-11T01:14:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.830+0000 7f6328c00640 1 -- 172.21.15.103:0/1670108160 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f6318011830 con 0x7f632c102260 2024-09-11T01:14:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.830+0000 7f633583d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef41790 0x55ac2ef43b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.830+0000 7f633583d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef440c0 0x55ac2ef464b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.830+0000 7f633583d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef46b00 0x55ac2ef48fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.830+0000 7f633583d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ac2eeb46b0 con 0x55ac2ef46b00 2024-09-11T01:14:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.830+0000 7f633583d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ac2eea3ae0 con 0x55ac2ef41790 2024-09-11T01:14:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.830+0000 7f633583d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ac2eea78f0 con 0x55ac2ef440c0 2024-09-11T01:14:26.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.831+0000 7f632be00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef440c0 0x55ac2ef464b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.831+0000 7f632be00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef440c0 0x55ac2ef464b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:48138/0 (socket says 172.21.15.103:48138) 2024-09-11T01:14:26.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.831+0000 7f632be00640 1 -- 172.21.15.103:0/100862238 learned_addr learned my addr 172.21.15.103:0/100862238 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:14:26.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.832+0000 7f632b400640 1 --2- 172.21.15.103:0/100862238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef46b00 0x55ac2ef48fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.832+0000 7f632b400640 1 --2- 172.21.15.103:0/100862238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef41790 0x55ac2ef43b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.833+0000 7f632be00640 1 -- 172.21.15.103:0/100862238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef41790 msgr2=0x55ac2ef43b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:26.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.833+0000 7f632be00640 1 --2- 172.21.15.103:0/100862238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef41790 0x55ac2ef43b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.833+0000 7f632be00640 1 -- 172.21.15.103:0/100862238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef46b00 msgr2=0x55ac2ef48fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:26.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.833+0000 7f632be00640 1 --2- 172.21.15.103:0/100862238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef46b00 0x55ac2ef48fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.833+0000 7f632be00640 1 -- 172.21.15.103:0/100862238 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac2ee70780 con 0x55ac2ef440c0 2024-09-11T01:14:26.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.834+0000 7f632be00640 1 --2- 172.21.15.103:0/100862238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef440c0 0x55ac2ef464b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6324031b60 tx=0x7f6324009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c5ea854a381cea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:14:26.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.834+0000 7f6321200640 1 -- 172.21.15.103:0/100862238 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324031660 con 0x55ac2ef440c0 2024-09-11T01:14:26.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.834+0000 7f6321200640 1 -- 172.21.15.103:0/100862238 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6324036040 con 0x55ac2ef440c0 2024-09-11T01:14:26.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.834+0000 7f6321200640 1 -- 172.21.15.103:0/100862238 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6324004730 con 0x55ac2ef440c0 2024-09-11T01:14:26.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.834+0000 7f6328c00640 1 --2- 172.21.15.103:0/1670108160 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f63100b54b0 0x7f63100b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.837 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.835+0000 7f6328c00640 1 -- 172.21.15.103:0/1670108160 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f63180e5a20 con 0x7f632c102260 2024-09-11T01:14:26.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.836+0000 7f633583d740 1 -- 172.21.15.103:0/100862238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef440c0 msgr2=0x55ac2ef464b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:26.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.836+0000 7f633583d740 1 --2- 172.21.15.103:0/100862238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef440c0 0x55ac2ef464b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6324031b60 tx=0x7f6324009780 comp rx=0 tx=0).stop 2024-09-11T01:14:26.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.836+0000 7f632b400640 1 --2- 172.21.15.103:0/1670108160 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f63100b54b0 0x7f63100b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.839 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.838+0000 7f632b400640 1 --2- 172.21.15.103:0/1670108160 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f63100b54b0 0x7f63100b7970 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f631c00bfd0 tx=0x7f631c00b330 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:14:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.841+0000 7f633583d740 1 -- 172.21.15.103:0/100862238 shutdown_connections 2024-09-11T01:14:26.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.841+0000 7f633583d740 1 --2- 172.21.15.103:0/100862238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef46b00 0x55ac2ef48fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.841+0000 7f633583d740 1 --2- 172.21.15.103:0/100862238 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef440c0 0x55ac2ef464b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.841+0000 7f633583d740 1 --2- 172.21.15.103:0/100862238 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef41790 0x55ac2ef43b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.841+0000 7f633583d740 1 -- 172.21.15.103:0/100862238 >> 172.21.15.103:0/100862238 conn(0x55ac2ef3c8e0 msgr2=0x55ac2ef3d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:14:26.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.841+0000 7f633583d740 1 -- 172.21.15.103:0/100862238 shutdown_connections 2024-09-11T01:14:26.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.841+0000 7f633583d740 1 -- 172.21.15.103:0/100862238 wait complete. 2024-09-11T01:14:26.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.842+0000 7f633583d740 1 -- start start 2024-09-11T01:14:26.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.842+0000 7f633583d740 1 Processor -- start 2024-09-11T01:14:26.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.843+0000 7f633583d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef41790 0x55ac2ef5be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.844+0000 7f633583d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef440c0 0x55ac2ef5c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.844+0000 7f633583d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef46b00 0x55ac2ef5d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.844+0000 7f632b400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef440c0 0x55ac2ef5c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.844+0000 7f632b400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef440c0 0x55ac2ef5c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:48140/0 (socket says 172.21.15.103:48140) 2024-09-11T01:14:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.844+0000 7f633583d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ac2eddbab0 con 0x55ac2ef41790 2024-09-11T01:14:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.844+0000 7f633583d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55ac2ee4a570 con 0x55ac2ef46b00 2024-09-11T01:14:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.844+0000 7f633583d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55ac2ef5aa90 con 0x55ac2ef440c0 2024-09-11T01:14:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.844+0000 7f6330a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef46b00 0x55ac2ef5d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.844+0000 7f6330a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef46b00 0x55ac2ef5d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:43040/0 (socket says 172.21.15.103:43040) 2024-09-11T01:14:26.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.844+0000 7f6330a00640 1 -- 172.21.15.103:0/87733792 learned_addr learned my addr 172.21.15.103:0/87733792 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:14:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.845+0000 7f633583d740 10 client.0 _ll_register_callbacks cb 0x55ac2ee59100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:14:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.845+0000 7f6330a00640 1 -- 172.21.15.103:0/87733792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef440c0 msgr2=0x55ac2ef5c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.845+0000 7f6330a00640 1 --2- 172.21.15.103:0/87733792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef440c0 0x55ac2ef5c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.845+0000 7f6330a00640 1 -- 172.21.15.103:0/87733792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef41790 msgr2=0x55ac2ef5be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.845+0000 7f6330a00640 1 --2- 172.21.15.103:0/87733792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef41790 0x55ac2ef5be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.847 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.845+0000 7f6330a00640 1 -- 172.21.15.103:0/87733792 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac2ec05790 con 0x55ac2ef46b00 2024-09-11T01:14:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.846+0000 7f6330a00640 1 --2- 172.21.15.103:0/87733792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef46b00 0x55ac2ef5d0b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6318004790 tx=0x7f63180ab720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f5a9f8aafd80a0f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:14:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.846+0000 7f633583d740 1 -- 172.21.15.103:0/87733792 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6324036040 con 0x55ac2ef46b00 2024-09-11T01:14:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.846+0000 7f6315600640 10 client.25847 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:14:26.848 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.847+0000 7f6315600640 1 -- 172.21.15.103:0/87733792 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180ac4d0 con 0x55ac2ef46b00 2024-09-11T01:14:26.849 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.847+0000 7f6315600640 1 -- 172.21.15.103:0/87733792 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f63180a8040 con 0x55ac2ef46b00 2024-09-11T01:14:26.849 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.847+0000 7f6315600640 1 -- 172.21.15.103:0/87733792 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f63180abdd0 con 0x55ac2ef46b00 2024-09-11T01:14:26.849 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.847+0000 7f633583d740 10 client.25847 fetch_fsmap learned FSMap version 31 2024-09-11T01:14:26.849 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.847+0000 7f633583d740 1 -- 172.21.15.103:0/87733792 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55ac2ec7e620 con 0x55ac2ef46b00 2024-09-11T01:14:26.849 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.848+0000 7f6315600640 1 -- 172.21.15.103:0/87733792 <== mon.2 v2:172.21.15.117:3300/0 4 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f63180b4ed0 con 0x55ac2ef46b00 2024-09-11T01:14:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.848+0000 7f633583d740 10 client.25847 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:14:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.848+0000 7f633583d740 10 client.25847 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:14:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.848+0000 7f633583d740 20 client.25847 populate_metadata read hostname 'smithi103' 2024-09-11T01:14:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.848+0000 7f633583d740 1 --2- 172.21.15.103:0/87733792 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ac2ef675a0 0x55ac2ef699f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.848+0000 7f633583d740 4 client.25847 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:14:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.848+0000 7f633583d740 1 -- 172.21.15.103:0/87733792 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac2eeb6600 con 0x55ac2ef675a0 2024-09-11T01:14:26.850 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.849+0000 7f632be00640 1 --2- 172.21.15.103:0/87733792 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ac2ef675a0 0x55ac2ef699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.850+0000 7f632be00640 1 --2- 172.21.15.103:0/87733792 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ac2ef675a0 0x55ac2ef699f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b11af8627ee8f6d4 server_cookie=1930bb36b7e39e64 in_seq=0 out_seq=0 2024-09-11T01:14:26.852 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.850+0000 7f6315600640 10 client.25847 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:14:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.852+0000 7f6315600640 1 -- 172.21.15.103:0/87733792 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ac2eeb6600 con 0x55ac2ef675a0 2024-09-11T01:14:26.853 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.852+0000 7f6315600640 10 client.25847 handle_command_reply: tid=0 2024-09-11T01:14:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.852+0000 7f633583d740 1 client.25847 shutdown 2024-09-11T01:14:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.853+0000 7f633583d740 1 -- 172.21.15.103:0/87733792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef46b00 msgr2=0x55ac2ef5d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:26.854 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.853+0000 7f633583d740 1 --2- 172.21.15.103:0/87733792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef46b00 0x55ac2ef5d0b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6318004790 tx=0x7f63180ab720 comp rx=0 tx=0).stop 2024-09-11T01:14:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.853+0000 7f633583d740 1 -- 172.21.15.103:0/87733792 shutdown_connections 2024-09-11T01:14:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.853+0000 7f633583d740 1 --2- 172.21.15.103:0/87733792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef46b00 0x55ac2ef5d0b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.855 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.854+0000 7f633583d740 1 --2- 172.21.15.103:0/87733792 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ac2ef675a0 0x55ac2ef699f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.856 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.854+0000 7f633583d740 1 --2- 172.21.15.103:0/87733792 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef440c0 0x55ac2ef5c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.856 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.854+0000 7f633583d740 1 --2- 172.21.15.103:0/87733792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef41790 0x55ac2ef5be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.856 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.854+0000 7f6315600640 0 client.25847 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:14:26.856 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.854+0000 7f633583d740 1 -- 172.21.15.103:0/87733792 >> 172.21.15.103:0/87733792 conn(0x55ac2ef3c8e0 msgr2=0x55ac2ef3ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:14:26.856 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.855+0000 7f633583d740 1 -- 172.21.15.103:0/87733792 shutdown_connections 2024-09-11T01:14:26.856 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.855+0000 7f633583d740 1 -- 172.21.15.103:0/87733792 wait complete. 2024-09-11T01:14:26.857 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.855+0000 7f633583d740 20 client.25847 trim_cache size 0 max 16384 2024-09-11T01:14:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.881+0000 7f633583d740 1 Processor -- start 2024-09-11T01:14:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.881+0000 7f633583d740 1 -- start start 2024-09-11T01:14:26.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.881+0000 7f633583d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef41790 0x55ac2ef3d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.882+0000 7f633583d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef440c0 0x55ac2ef6e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.882+0000 7f633583d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef46b00 0x55ac2ef6e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.882+0000 7f633583d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f632c1b4570 con 0x55ac2ef41790 2024-09-11T01:14:26.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.882+0000 7f633583d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f632c1b1e40 con 0x55ac2ef440c0 2024-09-11T01:14:26.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.882+0000 7f633583d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f632c073c50 con 0x55ac2ef46b00 2024-09-11T01:14:26.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.882+0000 7f632be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef41790 0x55ac2ef3d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.882+0000 7f632be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef41790 0x55ac2ef3d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33048/0 (socket says 172.21.15.103:33048) 2024-09-11T01:14:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.882+0000 7f632be00640 1 -- 172.21.15.103:0/3421107928 learned_addr learned my addr 172.21.15.103:0/3421107928 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:14:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.882+0000 7f632b400640 1 --2- 172.21.15.103:0/3421107928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef440c0 0x55ac2ef6e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.883+0000 7f632be00640 1 -- 172.21.15.103:0/3421107928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef46b00 msgr2=0x55ac2ef6e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.883+0000 7f632be00640 1 --2- 172.21.15.103:0/3421107928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef46b00 0x55ac2ef6e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.883+0000 7f632be00640 1 -- 172.21.15.103:0/3421107928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef440c0 msgr2=0x55ac2ef6e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.883+0000 7f632be00640 1 --2- 172.21.15.103:0/3421107928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef440c0 0x55ac2ef6e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.883+0000 7f632be00640 1 -- 172.21.15.103:0/3421107928 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac2ef6a040 con 0x55ac2ef41790 2024-09-11T01:14:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.883+0000 7f632be00640 1 --2- 172.21.15.103:0/3421107928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef41790 0x55ac2ef3d8f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6324031a30 tx=0x7f632402a8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad04db117fc1d38 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:14:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.883+0000 7f6317e00640 1 -- 172.21.15.103:0/3421107928 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632405a070 con 0x55ac2ef41790 2024-09-11T01:14:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.883+0000 7f6317e00640 1 -- 172.21.15.103:0/3421107928 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6324005bf0 con 0x55ac2ef41790 2024-09-11T01:14:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.884+0000 7f6317e00640 1 -- 172.21.15.103:0/3421107928 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632402f980 con 0x55ac2ef41790 2024-09-11T01:14:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.884+0000 7f633583d740 1 -- 172.21.15.103:0/3421107928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef41790 msgr2=0x55ac2ef3d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:26.886 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.884+0000 7f633583d740 1 --2- 172.21.15.103:0/3421107928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef41790 0x55ac2ef3d8f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6324031a30 tx=0x7f632402a8d0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.885+0000 7f633583d740 1 -- 172.21.15.103:0/3421107928 shutdown_connections 2024-09-11T01:14:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.885+0000 7f633583d740 1 --2- 172.21.15.103:0/3421107928 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef46b00 0x55ac2ef6e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.887 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.885+0000 7f633583d740 1 --2- 172.21.15.103:0/3421107928 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef440c0 0x55ac2ef6e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.885+0000 7f633583d740 1 --2- 172.21.15.103:0/3421107928 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef41790 0x55ac2ef3d8f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.885+0000 7f633583d740 1 -- 172.21.15.103:0/3421107928 >> 172.21.15.103:0/3421107928 conn(0x55ac2ef3c8e0 msgr2=0x55ac2ef3d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:14:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.885+0000 7f633583d740 1 -- 172.21.15.103:0/3421107928 shutdown_connections 2024-09-11T01:14:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.885+0000 7f633583d740 1 -- 172.21.15.103:0/3421107928 wait complete. 2024-09-11T01:14:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.885+0000 7f633583d740 1 -- start start 2024-09-11T01:14:26.888 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.886+0000 7f633583d740 1 Processor -- start 2024-09-11T01:14:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.886+0000 7f633583d740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef41790 0x55ac2ef63690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.886+0000 7f633583d740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef440c0 0x55ac2ef61f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.886+0000 7f633583d740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef46b00 0x55ac2ef62450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.886+0000 7f633583d740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f632c0742c0 con 0x55ac2ef440c0 2024-09-11T01:14:26.890 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.886+0000 7f633583d740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f632c1b1770 con 0x55ac2ef46b00 2024-09-11T01:14:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.886+0000 7f633583d740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f632c074990 con 0x55ac2ef41790 2024-09-11T01:14:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.886+0000 7f633583d740 10 client.0 _ll_register_callbacks cb 0x7f63180046e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:14:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.886+0000 7f6330a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef46b00 0x55ac2ef62450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.886+0000 7f6330a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef46b00 0x55ac2ef62450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:43058/0 (socket says 172.21.15.103:43058) 2024-09-11T01:14:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.886+0000 7f6330a00640 1 -- 172.21.15.103:0/3531256219 learned_addr learned my addr 172.21.15.103:0/3531256219 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:14:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.886+0000 7f632b400640 1 --2- 172.21.15.103:0/3531256219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef440c0 0x55ac2ef61f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.886+0000 7f632be00640 1 --2- 172.21.15.103:0/3531256219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef41790 0x55ac2ef63690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.887+0000 7f6330a00640 1 -- 172.21.15.103:0/3531256219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef41790 msgr2=0x55ac2ef63690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.887+0000 7f6330a00640 1 --2- 172.21.15.103:0/3531256219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef41790 0x55ac2ef63690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.887+0000 7f6330a00640 1 -- 172.21.15.103:0/3531256219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef440c0 msgr2=0x55ac2ef61f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:14:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.887+0000 7f6330a00640 1 --2- 172.21.15.103:0/3531256219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef440c0 0x55ac2ef61f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:26.891 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.887+0000 7f6330a00640 1 -- 172.21.15.103:0/3531256219 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac2ef62a10 con 0x55ac2ef46b00 2024-09-11T01:14:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.887+0000 7f6330a00640 1 --2- 172.21.15.103:0/3531256219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef46b00 0x55ac2ef62450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f63180abad0 tx=0x7f63180e2fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc2c7a0c4752cd63 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:14:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.887+0000 7f6315600640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:14:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.887+0000 7f6315600640 1 -- 172.21.15.103:0/3531256219 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63180a7c70 con 0x55ac2ef46b00 2024-09-11T01:14:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.887+0000 7f633583d740 1 -- 172.21.15.103:0/3531256219 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6324005bf0 con 0x55ac2ef46b00 2024-09-11T01:14:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.887+0000 7f6315600640 1 -- 172.21.15.103:0/3531256219 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f63180cd270 con 0x55ac2ef46b00 2024-09-11T01:14:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.888+0000 7f6315600640 1 -- 172.21.15.103:0/3531256219 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f63180bd050 con 0x55ac2ef46b00 2024-09-11T01:14:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.888+0000 7f633583d740 10 client.25853 fetch_fsmap learned FSMap version 31 2024-09-11T01:14:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.888+0000 7f633583d740 1 -- 172.21.15.103:0/3531256219 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ac2efd5300 con 0x55ac2ef46b00 2024-09-11T01:14:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.888+0000 7f6315600640 1 -- 172.21.15.103:0/3531256219 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6324005bf0 con 0x55ac2ef46b00 2024-09-11T01:14:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.888+0000 7f6315600640 1 -- 172.21.15.103:0/3531256219 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f63180a7720 con 0x55ac2ef46b00 2024-09-11T01:14:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.888+0000 7f633583d740 10 client.25853 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:14:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.888+0000 7f633583d740 10 client.25853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:14:26.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.888+0000 7f633583d740 20 client.25853 populate_metadata read hostname 'smithi103' 2024-09-11T01:14:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.888+0000 7f633583d740 1 --2- 172.21.15.103:0/3531256219 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ac2efd5ac0 0x55ac2efd7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.888+0000 7f633583d740 4 client.25853 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:14:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.888+0000 7f633583d740 1 -- 172.21.15.103:0/3531256219 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ac2eeb20b0 con 0x55ac2efd5ac0 2024-09-11T01:14:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.888+0000 7f632be00640 1 --2- 172.21.15.103:0/3531256219 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ac2efd5ac0 0x55ac2efd7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.889+0000 7f632be00640 1 --2- 172.21.15.103:0/3531256219 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ac2efd5ac0 0x55ac2efd7eb0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=221f8c6d81fb4674 server_cookie=c19eeae34a2565b6 in_seq=0 out_seq=0 2024-09-11T01:14:26.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:26.889+0000 7f6315600640 10 client.25853 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:14:27.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:26 smithi103 ceph-mon[30562]: pgmap v583: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 59 MiB/s wr, 8.06k op/s 2024-09-11T01:14:27.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:26 smithi117 ceph-mon[35358]: pgmap v583: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 59 MiB/s wr, 8.06k op/s 2024-09-11T01:14:27.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:26 smithi183 ceph-mon[34992]: pgmap v583: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 59 MiB/s wr, 8.06k op/s 2024-09-11T01:14:29.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:28 smithi103 ceph-mon[30562]: pgmap v584: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 50 MiB/s wr, 6.78k op/s 2024-09-11T01:14:29.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:28 smithi117 ceph-mon[35358]: pgmap v584: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 50 MiB/s wr, 6.78k op/s 2024-09-11T01:14:29.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:28 smithi183 ceph-mon[34992]: pgmap v584: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 50 MiB/s wr, 6.78k op/s 2024-09-11T01:14:31.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:30 smithi103 ceph-mon[30562]: pgmap v585: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 59 MiB/s wr, 7.92k op/s 2024-09-11T01:14:31.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:30 smithi117 ceph-mon[35358]: pgmap v585: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 59 MiB/s wr, 7.92k op/s 2024-09-11T01:14:31.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:30 smithi183 ceph-mon[34992]: pgmap v585: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 181 KiB/s rd, 59 MiB/s wr, 7.92k op/s 2024-09-11T01:14:32.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:31 smithi117 ceph-mon[35358]: pgmap v586: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 54 MiB/s wr, 7.11k op/s 2024-09-11T01:14:32.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:31 smithi183 ceph-mon[34992]: pgmap v586: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 54 MiB/s wr, 7.11k op/s 2024-09-11T01:14:32.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:31 smithi103 ceph-mon[30562]: pgmap v586: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 54 MiB/s wr, 7.11k op/s 2024-09-11T01:14:34.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:34 smithi117 ceph-mon[35358]: pgmap v587: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 52 MiB/s wr, 7.00k op/s 2024-09-11T01:14:34.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:34 smithi183 ceph-mon[34992]: pgmap v587: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 52 MiB/s wr, 7.00k op/s 2024-09-11T01:14:34.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:34 smithi103 ceph-mon[30562]: pgmap v587: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 52 MiB/s wr, 7.00k op/s 2024-09-11T01:14:36.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:36 smithi117 ceph-mon[35358]: pgmap v588: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 56 MiB/s wr, 7.50k op/s 2024-09-11T01:14:36.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:36 smithi183 ceph-mon[34992]: pgmap v588: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 56 MiB/s wr, 7.50k op/s 2024-09-11T01:14:36.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:36 smithi103 ceph-mon[30562]: pgmap v588: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 56 MiB/s wr, 7.50k op/s 2024-09-11T01:14:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.248+0000 7f6315600640 1 -- 172.21.15.103:0/3531256219 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ac2eeb20b0 con 0x55ac2efd5ac0 2024-09-11T01:14:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.248+0000 7f6315600640 10 client.25853 handle_command_reply: tid=0 2024-09-11T01:14:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.248+0000 7f633583d740 1 client.25853 shutdown 2024-09-11T01:14:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.249+0000 7f633583d740 1 -- 172.21.15.103:0/3531256219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef46b00 msgr2=0x55ac2ef62450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.249+0000 7f633583d740 1 --2- 172.21.15.103:0/3531256219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef46b00 0x55ac2ef62450 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f63180abad0 tx=0x7f63180e2fe0 comp rx=0 tx=0).stop 2024-09-11T01:14:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.250+0000 7f633583d740 1 -- 172.21.15.103:0/3531256219 shutdown_connections 2024-09-11T01:14:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.250+0000 7f633583d740 1 --2- 172.21.15.103:0/3531256219 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55ac2ef46b00 0x55ac2ef62450 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:38.252 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.250+0000 7f633583d740 1 --2- 172.21.15.103:0/3531256219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ac2ef440c0 0x55ac2ef61f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:38.252 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.250+0000 7f633583d740 1 --2- 172.21.15.103:0/3531256219 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55ac2efd5ac0 0x55ac2efd7eb0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:38.252 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.250+0000 7f633583d740 1 --2- 172.21.15.103:0/3531256219 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55ac2ef41790 0x55ac2ef63690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:38.252 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.250+0000 7f633583d740 1 -- 172.21.15.103:0/3531256219 >> 172.21.15.103:0/3531256219 conn(0x55ac2ef3c8e0 msgr2=0x55ac2ef3b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:14:38.252 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.250+0000 7f6315600640 0 client.25853 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:14:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.252+0000 7f633583d740 1 -- 172.21.15.103:0/3531256219 shutdown_connections 2024-09-11T01:14:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.252+0000 7f633583d740 1 -- 172.21.15.103:0/3531256219 wait complete. 2024-09-11T01:14:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.252+0000 7f633583d740 20 client.25853 trim_cache size 0 max 16384 2024-09-11T01:14:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:14:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:14:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:14:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:14:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.254+0000 7f6332a00640 1 -- 172.21.15.103:0/1670108160 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f63100b54b0 msgr2=0x7f63100b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.254+0000 7f6332a00640 1 --2- 172.21.15.103:0/1670108160 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f63100b54b0 0x7f63100b7970 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f631c00bfd0 tx=0x7f631c00b330 comp rx=0 tx=0).stop 2024-09-11T01:14:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.254+0000 7f6332a00640 1 -- 172.21.15.103:0/1670108160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f632c102260 msgr2=0x7f632c10e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.254+0000 7f6332a00640 1 --2- 172.21.15.103:0/1670108160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f632c102260 0x7f632c10e800 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f631800b3f0 tx=0x7f631800b8b0 comp rx=0 tx=0).stop 2024-09-11T01:14:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.254+0000 7f6332a00640 1 -- 172.21.15.103:0/1670108160 shutdown_connections 2024-09-11T01:14:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.254+0000 7f6332a00640 1 --2- 172.21.15.103:0/1670108160 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f63100b54b0 0x7f63100b7970 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.254+0000 7f6332a00640 1 --2- 172.21.15.103:0/1670108160 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f632c102260 0x7f632c10e800 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.254+0000 7f6332a00640 1 --2- 172.21.15.103:0/1670108160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f632c1018a0 0x7f632c10dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.254+0000 7f6332a00640 1 --2- 172.21.15.103:0/1670108160 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f632c100860 0x7f632c10d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.254+0000 7f6332a00640 1 -- 172.21.15.103:0/1670108160 >> 172.21.15.103:0/1670108160 conn(0x7f632c0fc440 msgr2=0x7f632c102bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:14:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.255+0000 7f6332a00640 1 -- 172.21.15.103:0/1670108160 shutdown_connections 2024-09-11T01:14:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:38.255+0000 7f6332a00640 1 -- 172.21.15.103:0/1670108160 wait complete. 2024-09-11T01:14:38.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:38 smithi117 ceph-mon[35358]: pgmap v589: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 49 MiB/s wr, 6.57k op/s 2024-09-11T01:14:38.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:38 smithi183 ceph-mon[34992]: pgmap v589: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 49 MiB/s wr, 6.57k op/s 2024-09-11T01:14:38.765 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:38 smithi103 ceph-mon[30562]: pgmap v589: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 49 MiB/s wr, 6.57k op/s 2024-09-11T01:14:40.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:40 smithi117 ceph-mon[35358]: pgmap v590: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 60 MiB/s wr, 8k op/s 2024-09-11T01:14:40.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:40 smithi183 ceph-mon[34992]: pgmap v590: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 60 MiB/s wr, 8k op/s 2024-09-11T01:14:40.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:40 smithi103 ceph-mon[30562]: pgmap v590: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 60 MiB/s wr, 8k op/s 2024-09-11T01:14:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:42 smithi183 ceph-mon[34992]: pgmap v591: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 49 MiB/s wr, 6.60k op/s 2024-09-11T01:14:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:42 smithi103 ceph-mon[30562]: pgmap v591: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 49 MiB/s wr, 6.60k op/s 2024-09-11T01:14:42.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:42 smithi117 ceph-mon[35358]: pgmap v591: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 49 MiB/s wr, 6.60k op/s 2024-09-11T01:14:44.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:44 smithi183 ceph-mon[34992]: pgmap v592: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 50 MiB/s wr, 6.76k op/s 2024-09-11T01:14:44.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:44 smithi103 ceph-mon[30562]: pgmap v592: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 50 MiB/s wr, 6.76k op/s 2024-09-11T01:14:44.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:44 smithi117 ceph-mon[35358]: pgmap v592: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 50 MiB/s wr, 6.76k op/s 2024-09-11T01:14:46.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:46 smithi183 ceph-mon[34992]: pgmap v593: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 54 MiB/s wr, 7.27k op/s 2024-09-11T01:14:46.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:46 smithi103 ceph-mon[30562]: pgmap v593: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 54 MiB/s wr, 7.27k op/s 2024-09-11T01:14:46.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:46 smithi117 ceph-mon[35358]: pgmap v593: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 54 MiB/s wr, 7.27k op/s 2024-09-11T01:14:48.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:48 smithi103 ceph-mon[30562]: pgmap v594: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 49 MiB/s wr, 6.67k op/s 2024-09-11T01:14:48.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:48 smithi183 ceph-mon[34992]: pgmap v594: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 49 MiB/s wr, 6.67k op/s 2024-09-11T01:14:48.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:48 smithi117 ceph-mon[35358]: pgmap v594: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 49 MiB/s wr, 6.67k op/s 2024-09-11T01:14:49.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:49 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:14:49.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:49 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:14:49.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:49 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:14:50.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:50 smithi183 ceph-mon[34992]: pgmap v595: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 57 MiB/s wr, 8.01k op/s 2024-09-11T01:14:50.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:50 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:50.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:50 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:50.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:50 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:50.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:50 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:50.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:50 smithi103 ceph-mon[30562]: pgmap v595: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 57 MiB/s wr, 8.01k op/s 2024-09-11T01:14:50.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:50 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:50.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:50 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:50.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:50 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:50.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:50 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:50 smithi117 ceph-mon[35358]: pgmap v595: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 57 MiB/s wr, 8.01k op/s 2024-09-11T01:14:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:50 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:50 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:50 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:50.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:50 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:51.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:51 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi117 to 176.0M 2024-09-11T01:14:51.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:51 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi117 to 176.0M 2024-09-11T01:14:51.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:51 smithi117 ceph-mon[35358]: Unable to set osd_memory_target on smithi117 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-11T01:14:51.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:51 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi117 to 176.0M 2024-09-11T01:14:51.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:51 smithi183 ceph-mon[34992]: Unable to set osd_memory_target on smithi117 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-11T01:14:52.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:52 smithi103 ceph-mon[30562]: Unable to set osd_memory_target on smithi117 to 184588185: error parsing value: Value '184588185' is below minimum 939524096 2024-09-11T01:14:52.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:52 smithi103 ceph-mon[30562]: pgmap v596: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 46 MiB/s wr, 6.70k op/s 2024-09-11T01:14:52.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:52 smithi117 ceph-mon[35358]: pgmap v596: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 46 MiB/s wr, 6.70k op/s 2024-09-11T01:14:52.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:52 smithi183 ceph-mon[34992]: pgmap v596: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 46 MiB/s wr, 6.70k op/s 2024-09-11T01:14:54.834 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:54 smithi103 ceph-mon[30562]: pgmap v597: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 45 MiB/s wr, 6.53k op/s 2024-09-11T01:14:54.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:54 smithi117 ceph-mon[35358]: pgmap v597: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 45 MiB/s wr, 6.53k op/s 2024-09-11T01:14:54.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:54 smithi183 ceph-mon[34992]: pgmap v597: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 45 MiB/s wr, 6.53k op/s 2024-09-11T01:14:56.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:56 smithi103 ceph-mon[30562]: pgmap v598: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 49 MiB/s wr, 7.48k op/s 2024-09-11T01:14:56.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:56 smithi117 ceph-mon[35358]: pgmap v598: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 49 MiB/s wr, 7.48k op/s 2024-09-11T01:14:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:56 smithi183 ceph-mon[34992]: pgmap v598: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 160 KiB/s rd, 49 MiB/s wr, 7.48k op/s 2024-09-11T01:14:58.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:58 smithi103 ceph-mon[30562]: pgmap v599: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 41 MiB/s wr, 6.45k op/s 2024-09-11T01:14:58.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:58 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:58.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:58 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:58.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:58 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:58.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:58 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:58.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:58 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:14:58.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:58 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:14:58.836 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:58 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:14:58.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:58 smithi117 ceph-mon[35358]: pgmap v599: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 41 MiB/s wr, 6.45k op/s 2024-09-11T01:14:58.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:58 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:58.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:58 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:58.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:58 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:58.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:58 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:58.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:58 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:14:58.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:58 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:14:58.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:58 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:14:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:58 smithi183 ceph-mon[34992]: pgmap v599: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 41 MiB/s wr, 6.45k op/s 2024-09-11T01:14:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:58 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:58 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:58 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:58 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-11T01:14:58.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:58 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:14:58.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:58 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:14:58.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:58 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:14:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.325+0000 7f7873200640 1 -- 172.21.15.103:0/2043716417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7874078b70 msgr2=0x7f7874078ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.325+0000 7f7873200640 1 --2- 172.21.15.103:0/2043716417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7874078b70 0x7f7874078ff0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f786001a910 tx=0x7f786003b450 comp rx=0 tx=0).stop 2024-09-11T01:14:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.325+0000 7f7873200640 1 -- 172.21.15.103:0/2043716417 shutdown_connections 2024-09-11T01:14:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.325+0000 7f7873200640 1 --2- 172.21.15.103:0/2043716417 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7874079530 0x7f7874079e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.326+0000 7f7873200640 1 --2- 172.21.15.103:0/2043716417 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7874078b70 0x7f7874078ff0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.326+0000 7f7873200640 1 --2- 172.21.15.103:0/2043716417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7874077a20 0x7f7874077e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.326+0000 7f7873200640 1 -- 172.21.15.103:0/2043716417 >> 172.21.15.103:0/2043716417 conn(0x7f7874100270 msgr2=0x7f7874102690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:14:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.326+0000 7f7873200640 1 -- 172.21.15.103:0/2043716417 shutdown_connections 2024-09-11T01:14:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.326+0000 7f7873200640 1 -- 172.21.15.103:0/2043716417 wait complete. 2024-09-11T01:14:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.329+0000 7f7873200640 1 Processor -- start 2024-09-11T01:14:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.329+0000 7f7873200640 1 -- start start 2024-09-11T01:14:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.330+0000 7f7873200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7874077a20 0x7f7874196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.330+0000 7f7873200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7874078b70 0x7f7874197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.330+0000 7f7873200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7874079530 0x7f7874197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.330+0000 7f7873200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7874106320 con 0x7f7874079530 2024-09-11T01:14:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.330+0000 7f7873200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f78741061a0 con 0x7f7874077a20 2024-09-11T01:14:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.330+0000 7f7873200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f78741064a0 con 0x7f7874078b70 2024-09-11T01:14:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.331+0000 7f7871e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7874077a20 0x7f7874196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.331+0000 7f7871e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7874077a20 0x7f7874196af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:45810/0 (socket says 172.21.15.103:45810) 2024-09-11T01:14:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.331+0000 7f7871e00640 1 -- 172.21.15.103:0/400528594 learned_addr learned my addr 172.21.15.103:0/400528594 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:14:59.334 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.331+0000 7f7872800640 1 --2- 172.21.15.103:0/400528594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7874079530 0x7f7874197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.332+0000 7f7872800640 1 -- 172.21.15.103:0/400528594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7874078b70 msgr2=0x7f7874197140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T01:14:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.332+0000 7f7872800640 1 --2- 172.21.15.103:0/400528594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7874078b70 0x7f7874197140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.332+0000 7f7872800640 1 -- 172.21.15.103:0/400528594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7874077a20 msgr2=0x7f7874196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:14:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.332+0000 7f7872800640 1 --2- 172.21.15.103:0/400528594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7874077a20 0x7f7874196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:14:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.332+0000 7f7872800640 1 -- 172.21.15.103:0/400528594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7874198630 con 0x7f7874079530 2024-09-11T01:14:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.333+0000 7f7872800640 1 --2- 172.21.15.103:0/400528594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7874079530 0x7f7874197d70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f786c00be00 tx=0x7f786c00bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:14:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.334+0000 7f786aa00640 1 -- 172.21.15.103:0/400528594 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c019070 con 0x7f7874079530 2024-09-11T01:14:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.334+0000 7f786aa00640 1 -- 172.21.15.103:0/400528594 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f786c0148f0 con 0x7f7874079530 2024-09-11T01:14:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.334+0000 7f7873200640 1 -- 172.21.15.103:0/400528594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7874198920 con 0x7f7874079530 2024-09-11T01:14:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.335+0000 7f786aa00640 1 -- 172.21.15.103:0/400528594 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c012830 con 0x7f7874079530 2024-09-11T01:14:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.337+0000 7f7873200640 1 -- 172.21.15.103:0/400528594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787419eff0 con 0x7f7874079530 2024-09-11T01:14:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.340+0000 7f786aa00640 1 -- 172.21.15.103:0/400528594 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f786c014440 con 0x7f7874079530 2024-09-11T01:14:59.345 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.343+0000 7f786aa00640 1 --2- 172.21.15.103:0/400528594 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f78580b53a0 0x7f78580b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:14:59.346 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.344+0000 7f786aa00640 1 -- 172.21.15.103:0/400528594 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f786c0e9170 con 0x7f7874079530 2024-09-11T01:14:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.344+0000 7f7871e00640 1 --2- 172.21.15.103:0/400528594 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f78580b53a0 0x7f78580b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:14:59.347 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:14:59.345+0000 7f7871e00640 1 --2- 172.21.15.103:0/400528594 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f78580b53a0 0x7f78580b7860 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7864009950 tx=0x7f7864008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:14:59.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:59 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi183 to 176.0M 2024-09-11T01:14:59.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:14:59 smithi117 ceph-mon[35358]: Unable to set osd_memory_target on smithi183 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-11T01:14:59.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:59 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi183 to 176.0M 2024-09-11T01:14:59.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:14:59 smithi183 ceph-mon[34992]: Unable to set osd_memory_target on smithi183 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-11T01:15:00.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:59 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi183 to 176.0M 2024-09-11T01:15:00.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:14:59 smithi103 ceph-mon[30562]: Unable to set osd_memory_target on smithi183 to 184574566: error parsing value: Value '184574566' is below minimum 939524096 2024-09-11T01:15:00.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:00 smithi117 ceph-mon[35358]: pgmap v600: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 50 MiB/s wr, 8.03k op/s 2024-09-11T01:15:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:00 smithi183 ceph-mon[34992]: pgmap v600: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 50 MiB/s wr, 8.03k op/s 2024-09-11T01:15:01.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.028+0000 7f787b8ab740 1 Processor -- start 2024-09-11T01:15:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.032+0000 7f787b8ab740 1 -- start start 2024-09-11T01:15:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.032+0000 7f787b8ab740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565204607970 0x565204609d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.032+0000 7f787b8ab740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56520460a2a0 0x56520460c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.032+0000 7f787b8ab740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460cce0 0x56520460f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.032+0000 7f787b8ab740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56520457a6b0 con 0x56520460a2a0 2024-09-11T01:15:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.032+0000 7f787b8ab740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x565204569ae0 con 0x56520460cce0 2024-09-11T01:15:01.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.032+0000 7f787b8ab740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56520456d8f0 con 0x565204607970 2024-09-11T01:15:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.033+0000 7f7871e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565204607970 0x565204609d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.033+0000 7f7871e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565204607970 0x565204609d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:39440/0 (socket says 172.21.15.103:39440) 2024-09-11T01:15:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.033+0000 7f7871e00640 1 -- 172.21.15.103:0/2758643472 learned_addr learned my addr 172.21.15.103:0/2758643472 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:15:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.033+0000 7f7871e00640 1 -- 172.21.15.103:0/2758643472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460cce0 msgr2=0x56520460f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.033+0000 7f7871e00640 1 --2- 172.21.15.103:0/2758643472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460cce0 0x56520460f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.033+0000 7f7871e00640 1 -- 172.21.15.103:0/2758643472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56520460a2a0 msgr2=0x56520460c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.033+0000 7f7871e00640 1 --2- 172.21.15.103:0/2758643472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56520460a2a0 0x56520460c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.033+0000 7f7871e00640 1 -- 172.21.15.103:0/2758643472 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565204536780 con 0x565204607970 2024-09-11T01:15:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.034+0000 7f7871e00640 1 --2- 172.21.15.103:0/2758643472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565204607970 0x565204609d60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f786400d910 tx=0x7f7864010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ecac9350b959fbd server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.034+0000 7f785f000640 1 -- 172.21.15.103:0/2758643472 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7864024070 con 0x565204607970 2024-09-11T01:15:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.034+0000 7f785f000640 1 -- 172.21.15.103:0/2758643472 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7864014bc0 con 0x565204607970 2024-09-11T01:15:01.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.034+0000 7f785f000640 1 -- 172.21.15.103:0/2758643472 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78640123e0 con 0x565204607970 2024-09-11T01:15:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.035+0000 7f787b8ab740 1 -- 172.21.15.103:0/2758643472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565204607970 msgr2=0x565204609d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.035+0000 7f787b8ab740 1 --2- 172.21.15.103:0/2758643472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565204607970 0x565204609d60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f786400d910 tx=0x7f7864010000 comp rx=0 tx=0).stop 2024-09-11T01:15:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.036+0000 7f787b8ab740 1 -- 172.21.15.103:0/2758643472 shutdown_connections 2024-09-11T01:15:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.036+0000 7f787b8ab740 1 --2- 172.21.15.103:0/2758643472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460cce0 0x56520460f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.036+0000 7f787b8ab740 1 --2- 172.21.15.103:0/2758643472 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56520460a2a0 0x56520460c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.036+0000 7f787b8ab740 1 --2- 172.21.15.103:0/2758643472 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x565204607970 0x565204609d60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.036+0000 7f787b8ab740 1 -- 172.21.15.103:0/2758643472 >> 172.21.15.103:0/2758643472 conn(0x565204602ac0 msgr2=0x565204603850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:15:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.036+0000 7f787b8ab740 1 -- 172.21.15.103:0/2758643472 shutdown_connections 2024-09-11T01:15:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.036+0000 7f787b8ab740 1 -- 172.21.15.103:0/2758643472 wait complete. 2024-09-11T01:15:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.037+0000 7f787b8ab740 1 -- start start 2024-09-11T01:15:01.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.037+0000 7f787b8ab740 1 Processor -- start 2024-09-11T01:15:01.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.038+0000 7f787b8ab740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 0x5652046221a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:01.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.042+0000 7f787b8ab740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460a2a0 0x565204622840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.042+0000 7f787b8ab740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460cce0 0x565204623410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.042+0000 7f787b8ab740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5652044a1ab0 con 0x565204607970 2024-09-11T01:15:01.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.043+0000 7f787b8ab740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x565204510570 con 0x56520460a2a0 2024-09-11T01:15:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.043+0000 7f7872800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460cce0 0x565204623410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.043+0000 7f787b8ab740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x565204620cd0 con 0x56520460cce0 2024-09-11T01:15:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.043+0000 7f7872800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460cce0 0x565204623410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:39448/0 (socket says 172.21.15.103:39448) 2024-09-11T01:15:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.043+0000 7f7872800640 1 -- 172.21.15.103:0/2084292836 learned_addr learned my addr 172.21.15.103:0/2084292836 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:15:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.043+0000 7f787b8ab740 10 client.0 _ll_register_callbacks cb 0x56520451f100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:15:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.043+0000 7f7871e00640 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 0x5652046221a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:01.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.043+0000 7f7872800640 1 -- 172.21.15.103:0/2084292836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460a2a0 msgr2=0x565204622840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.043+0000 7f7871400640 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460a2a0 0x565204622840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.044+0000 7f7872800640 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460a2a0 0x565204622840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.044+0000 7f7872800640 1 -- 172.21.15.103:0/2084292836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 msgr2=0x5652046221a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.044+0000 7f7872800640 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 0x5652046221a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.044+0000 7f7872800640 1 -- 172.21.15.103:0/2084292836 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652042cb790 con 0x56520460cce0 2024-09-11T01:15:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.044+0000 7f7871e00640 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 0x5652046221a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:15:01.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.045+0000 7f7872800640 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460cce0 0x565204623410 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f786c009340 tx=0x7f786c0aba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa41ac32d21c59ed server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.045+0000 7f7853400640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:15:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.045+0000 7f7853400640 1 -- 172.21.15.103:0/2084292836 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c0ea060 con 0x56520460cce0 2024-09-11T01:15:01.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.045+0000 7f7853400640 1 -- 172.21.15.103:0/2084292836 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f786c0b4d60 con 0x56520460cce0 2024-09-11T01:15:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.045+0000 7f787b8ab740 1 -- 172.21.15.103:0/2084292836 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7864014bc0 con 0x56520460cce0 2024-09-11T01:15:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.046+0000 7f7871400640 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460a2a0 0x565204622840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:15:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.046+0000 7f7853400640 1 -- 172.21.15.103:0/2084292836 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f786c0a73d0 con 0x56520460cce0 2024-09-11T01:15:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.047+0000 7f787b8ab740 10 client.25816 fetch_fsmap learned FSMap version 31 2024-09-11T01:15:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.047+0000 7f787b8ab740 1 -- 172.21.15.103:0/2084292836 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x565204344620 con 0x56520460cce0 2024-09-11T01:15:01.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.047+0000 7f7853400640 1 -- 172.21.15.103:0/2084292836 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7864014bc0 con 0x56520460cce0 2024-09-11T01:15:01.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.047+0000 7f7853400640 1 -- 172.21.15.103:0/2084292836 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f786c0b01d0 con 0x56520460cce0 2024-09-11T01:15:01.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.047+0000 7f787b8ab740 10 client.25816 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:15:01.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.047+0000 7f787b8ab740 10 client.25816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:15:01.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.047+0000 7f787b8ab740 20 client.25816 populate_metadata read hostname 'smithi103' 2024-09-11T01:15:01.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.048+0000 7f787b8ab740 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56520462d9a0 0x56520462fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:01.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.048+0000 7f787b8ab740 4 client.25816 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:15:01.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.048+0000 7f787b8ab740 1 -- 172.21.15.103:0/2084292836 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56520457c600 con 0x56520462d9a0 2024-09-11T01:15:01.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.048+0000 7f7871e00640 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56520462d9a0 0x56520462fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:01.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.050+0000 7f7871e00640 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56520462d9a0 0x56520462fdd0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7aefaad6adb52d7f server_cookie=9406bf063db5eec3 in_seq=0 out_seq=0 2024-09-11T01:15:01.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.050+0000 7f7853400640 10 client.25816 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:15:01.054 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.051+0000 7f7853400640 1 -- 172.21.15.103:0/2084292836 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56520457c600 con 0x56520462d9a0 2024-09-11T01:15:01.054 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.051+0000 7f7853400640 10 client.25816 handle_command_reply: tid=0 2024-09-11T01:15:01.054 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.051+0000 7f787b8ab740 1 client.25816 shutdown 2024-09-11T01:15:01.055 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.052+0000 7f787b8ab740 1 -- 172.21.15.103:0/2084292836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460cce0 msgr2=0x565204623410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:01.055 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.052+0000 7f787b8ab740 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460cce0 0x565204623410 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f786c009340 tx=0x7f786c0aba30 comp rx=0 tx=0).stop 2024-09-11T01:15:01.056 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.052+0000 7f787b8ab740 1 -- 172.21.15.103:0/2084292836 shutdown_connections 2024-09-11T01:15:01.056 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.052+0000 7f787b8ab740 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56520462d9a0 0x56520462fdd0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.056 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.052+0000 7f787b8ab740 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460cce0 0x565204623410 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.056 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.052+0000 7f787b8ab740 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460a2a0 0x565204622840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.056 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.052+0000 7f787b8ab740 1 --2- 172.21.15.103:0/2084292836 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 0x5652046221a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.056 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.052+0000 7f787b8ab740 1 -- 172.21.15.103:0/2084292836 >> 172.21.15.103:0/2084292836 conn(0x565204602ac0 msgr2=0x565204601bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:15:01.056 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.052+0000 7f7853400640 0 client.25816 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:15:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.057+0000 7f787b8ab740 1 -- 172.21.15.103:0/2084292836 shutdown_connections 2024-09-11T01:15:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.057+0000 7f787b8ab740 1 -- 172.21.15.103:0/2084292836 wait complete. 2024-09-11T01:15:01.060 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.057+0000 7f787b8ab740 20 client.25816 trim_cache size 0 max 16384 2024-09-11T01:15:01.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:00 smithi103 ceph-mon[30562]: pgmap v600: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 50 MiB/s wr, 8.03k op/s 2024-09-11T01:15:01.092 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.090+0000 7f787b8ab740 1 Processor -- start 2024-09-11T01:15:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.090+0000 7f787b8ab740 1 -- start start 2024-09-11T01:15:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.090+0000 7f787b8ab740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 0x565204606ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.090+0000 7f787b8ab740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460a2a0 0x565204621340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.091+0000 7f787b8ab740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460cce0 0x565204621880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.091+0000 7f787b8ab740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f78741a3620 con 0x565204607970 2024-09-11T01:15:01.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.091+0000 7f787b8ab740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f78741a0ef0 con 0x56520460a2a0 2024-09-11T01:15:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.091+0000 7f787b8ab740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7874074ea0 con 0x56520460cce0 2024-09-11T01:15:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.091+0000 7f7871400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460a2a0 0x565204621340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.091+0000 7f7871400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460a2a0 0x565204621340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:43420/0 (socket says 172.21.15.103:43420) 2024-09-11T01:15:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.091+0000 7f7872800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460cce0 0x565204621880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.091+0000 7f7871400640 1 -- 172.21.15.103:0/1203663992 learned_addr learned my addr 172.21.15.103:0/1203663992 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:15:01.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.092+0000 7f7871e00640 1 --2- 172.21.15.103:0/1203663992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 0x565204606ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.092+0000 7f7872800640 1 -- 172.21.15.103:0/1203663992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460a2a0 msgr2=0x565204621340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.092+0000 7f7872800640 1 --2- 172.21.15.103:0/1203663992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460a2a0 0x565204621340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.092+0000 7f7872800640 1 -- 172.21.15.103:0/1203663992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 msgr2=0x565204606ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.092+0000 7f7872800640 1 --2- 172.21.15.103:0/1203663992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 0x565204606ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.092+0000 7f7872800640 1 -- 172.21.15.103:0/1203663992 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56520460a0d0 con 0x56520460cce0 2024-09-11T01:15:01.095 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.093+0000 7f7872800640 1 --2- 172.21.15.103:0/1203663992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460cce0 0x565204621880 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f786c0b0540 tx=0x7f786c0acf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4836f4f2ff745f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:01.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.094+0000 7f785e600640 1 -- 172.21.15.103:0/1203663992 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c0e52d0 con 0x56520460cce0 2024-09-11T01:15:01.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.095+0000 7f785e600640 1 -- 172.21.15.103:0/1203663992 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f786c0ab770 con 0x56520460cce0 2024-09-11T01:15:01.097 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.095+0000 7f785e600640 1 -- 172.21.15.103:0/1203663992 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c00b0b0 con 0x56520460cce0 2024-09-11T01:15:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.096+0000 7f787b8ab740 1 -- 172.21.15.103:0/1203663992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460cce0 msgr2=0x565204621880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:01.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.096+0000 7f787b8ab740 1 --2- 172.21.15.103:0/1203663992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460cce0 0x565204621880 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f786c0b0540 tx=0x7f786c0acf90 comp rx=0 tx=0).stop 2024-09-11T01:15:01.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.099+0000 7f787b8ab740 1 -- 172.21.15.103:0/1203663992 shutdown_connections 2024-09-11T01:15:01.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.099+0000 7f787b8ab740 1 --2- 172.21.15.103:0/1203663992 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460cce0 0x565204621880 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.099+0000 7f787b8ab740 1 --2- 172.21.15.103:0/1203663992 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460a2a0 0x565204621340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.099+0000 7f787b8ab740 1 --2- 172.21.15.103:0/1203663992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 0x565204606ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.099+0000 7f787b8ab740 1 -- 172.21.15.103:0/1203663992 >> 172.21.15.103:0/1203663992 conn(0x565204602ac0 msgr2=0x56520462f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:15:01.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.099+0000 7f787b8ab740 1 -- 172.21.15.103:0/1203663992 shutdown_connections 2024-09-11T01:15:01.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.099+0000 7f787b8ab740 1 -- 172.21.15.103:0/1203663992 wait complete. 2024-09-11T01:15:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.100+0000 7f787b8ab740 1 -- start start 2024-09-11T01:15:01.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.100+0000 7f787b8ab740 1 Processor -- start 2024-09-11T01:15:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.101+0000 7f787b8ab740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 0x5652046299e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.101+0000 7f787b8ab740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460a2a0 0x5652046286e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:01.104 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.101+0000 7f787b8ab740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460cce0 0x565204628c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.101+0000 7f787b8ab740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f787419f3b0 con 0x565204607970 2024-09-11T01:15:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.101+0000 7f787b8ab740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f78741a0820 con 0x56520460cce0 2024-09-11T01:15:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.101+0000 7f787b8ab740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f787419fa80 con 0x56520460a2a0 2024-09-11T01:15:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.101+0000 7f787b8ab740 10 client.0 _ll_register_callbacks cb 0x7f786c0e8070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:15:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.102+0000 7f7871400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460a2a0 0x5652046286e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.103+0000 7f7871400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460a2a0 0x5652046286e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:39478/0 (socket says 172.21.15.103:39478) 2024-09-11T01:15:01.105 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.102+0000 7f7872800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460cce0 0x565204628c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.103+0000 7f7872800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460cce0 0x565204628c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:43434/0 (socket says 172.21.15.103:43434) 2024-09-11T01:15:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.103+0000 7f7872800640 1 -- 172.21.15.103:0/334234501 learned_addr learned my addr 172.21.15.103:0/334234501 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:15:01.106 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.103+0000 7f7871e00640 1 --2- 172.21.15.103:0/334234501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 0x5652046299e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:01.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.104+0000 7f7872800640 1 -- 172.21.15.103:0/334234501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460a2a0 msgr2=0x5652046286e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:01.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.105+0000 7f7872800640 1 --2- 172.21.15.103:0/334234501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460a2a0 0x5652046286e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.105+0000 7f7872800640 1 -- 172.21.15.103:0/334234501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 msgr2=0x5652046299e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:01.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.105+0000 7f7872800640 1 --2- 172.21.15.103:0/334234501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 0x5652046299e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:01.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.105+0000 7f7872800640 1 -- 172.21.15.103:0/334234501 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565204629190 con 0x56520460cce0 2024-09-11T01:15:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.106+0000 7f7871e00640 1 --2- 172.21.15.103:0/334234501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 0x5652046299e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:15:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.106+0000 7f7871400640 1 --2- 172.21.15.103:0/334234501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460a2a0 0x5652046286e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:15:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.106+0000 7f7872800640 1 --2- 172.21.15.103:0/334234501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460cce0 0x565204628c20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f786c00cfb0 tx=0x7f786c0aba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c0010c060992095 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:01.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.106+0000 7f7853400640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:15:01.110 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.107+0000 7f7853400640 1 -- 172.21.15.103:0/334234501 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f786c0ab5b0 con 0x56520460cce0 2024-09-11T01:15:01.110 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.107+0000 7f7853400640 1 -- 172.21.15.103:0/334234501 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f786c0b4f60 con 0x56520460cce0 2024-09-11T01:15:01.110 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.107+0000 7f787b8ab740 1 -- 172.21.15.103:0/334234501 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f786c0ab770 con 0x56520460cce0 2024-09-11T01:15:01.110 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.108+0000 7f7853400640 1 -- 172.21.15.103:0/334234501 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f786c0b51f0 con 0x56520460cce0 2024-09-11T01:15:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.108+0000 7f787b8ab740 10 client.25865 fetch_fsmap learned FSMap version 31 2024-09-11T01:15:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.108+0000 7f787b8ab740 1 -- 172.21.15.103:0/334234501 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x565204628050 con 0x56520460cce0 2024-09-11T01:15:01.111 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.109+0000 7f7853400640 1 -- 172.21.15.103:0/334234501 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f786c0ab770 con 0x56520460cce0 2024-09-11T01:15:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.110+0000 7f7853400640 1 -- 172.21.15.103:0/334234501 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f786c009020 con 0x56520460cce0 2024-09-11T01:15:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.110+0000 7f787b8ab740 10 client.25865 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:15:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.110+0000 7f787b8ab740 10 client.25865 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:15:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.110+0000 7f787b8ab740 20 client.25865 populate_metadata read hostname 'smithi103' 2024-09-11T01:15:01.113 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.110+0000 7f787b8ab740 1 --2- 172.21.15.103:0/334234501 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56520469ad80 0x56520469d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.114+0000 7f787b8ab740 4 client.25865 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:15:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.114+0000 7f787b8ab740 1 -- 172.21.15.103:0/334234501 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5652045780b0 con 0x56520469ad80 2024-09-11T01:15:01.117 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.114+0000 7f7871e00640 1 --2- 172.21.15.103:0/334234501 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56520469ad80 0x56520469d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:01.118 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.115+0000 7f7871e00640 1 --2- 172.21.15.103:0/334234501 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56520469ad80 0x56520469d1a0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a509d29bbb9f6ba server_cookie=212204b5fc3fa74 in_seq=0 out_seq=0 2024-09-11T01:15:01.118 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:01.115+0000 7f7853400640 10 client.25865 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:15:02.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:02 smithi183 ceph-mon[34992]: pgmap v601: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 41 MiB/s wr, 6.47k op/s 2024-09-11T01:15:03.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:02 smithi103 ceph-mon[30562]: pgmap v601: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 41 MiB/s wr, 6.47k op/s 2024-09-11T01:15:03.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:02 smithi117 ceph-mon[35358]: pgmap v601: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 41 MiB/s wr, 6.47k op/s 2024-09-11T01:15:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:04 smithi183 ceph-mon[34992]: pgmap v602: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 37 MiB/s wr, 5.85k op/s 2024-09-11T01:15:05.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:04 smithi103 ceph-mon[30562]: pgmap v602: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 37 MiB/s wr, 5.85k op/s 2024-09-11T01:15:05.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:04 smithi117 ceph-mon[35358]: pgmap v602: 129 pgs: 129 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 37 MiB/s wr, 5.85k op/s 2024-09-11T01:15:06.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:06 smithi183 ceph-mon[34992]: pgmap v603: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 51 MiB/s wr, 8.01k op/s 2024-09-11T01:15:07.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:06 smithi103 ceph-mon[30562]: pgmap v603: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 51 MiB/s wr, 8.01k op/s 2024-09-11T01:15:07.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:06 smithi117 ceph-mon[35358]: pgmap v603: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 279 KiB/s rd, 51 MiB/s wr, 8.01k op/s 2024-09-11T01:15:08.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:08 smithi183 ceph-mon[34992]: pgmap v604: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 41 MiB/s wr, 6.27k op/s 2024-09-11T01:15:09.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:08 smithi103 ceph-mon[30562]: pgmap v604: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 41 MiB/s wr, 6.27k op/s 2024-09-11T01:15:09.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:08 smithi117 ceph-mon[35358]: pgmap v604: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 41 MiB/s wr, 6.27k op/s 2024-09-11T01:15:11.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:10 smithi103 ceph-mon[30562]: pgmap v605: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 50 MiB/s wr, 7.75k op/s 2024-09-11T01:15:11.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:10 smithi117 ceph-mon[35358]: pgmap v605: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 50 MiB/s wr, 7.75k op/s 2024-09-11T01:15:11.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:10 smithi183 ceph-mon[34992]: pgmap v605: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 299 KiB/s rd, 50 MiB/s wr, 7.75k op/s 2024-09-11T01:15:13.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:12 smithi103 ceph-mon[30562]: pgmap v606: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 41 MiB/s wr, 6.37k op/s 2024-09-11T01:15:13.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:12 smithi117 ceph-mon[35358]: pgmap v606: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 41 MiB/s wr, 6.37k op/s 2024-09-11T01:15:13.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:12 smithi183 ceph-mon[34992]: pgmap v606: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 41 MiB/s wr, 6.37k op/s 2024-09-11T01:15:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.736+0000 7f7853400640 1 -- 172.21.15.103:0/334234501 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5652045780b0 con 0x56520469ad80 2024-09-11T01:15:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.736+0000 7f7853400640 10 client.25865 handle_command_reply: tid=0 2024-09-11T01:15:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.736+0000 7f787b8ab740 1 client.25865 shutdown 2024-09-11T01:15:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.736+0000 7f787b8ab740 1 -- 172.21.15.103:0/334234501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460cce0 msgr2=0x565204628c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:14.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.736+0000 7f787b8ab740 1 --2- 172.21.15.103:0/334234501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460cce0 0x565204628c20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f786c00cfb0 tx=0x7f786c0aba30 comp rx=0 tx=0).stop 2024-09-11T01:15:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.737+0000 7f787b8ab740 1 -- 172.21.15.103:0/334234501 shutdown_connections 2024-09-11T01:15:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.737+0000 7f787b8ab740 1 --2- 172.21.15.103:0/334234501 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56520460cce0 0x565204628c20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.737+0000 7f787b8ab740 1 --2- 172.21.15.103:0/334234501 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56520469ad80 0x56520469d1a0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.737+0000 7f787b8ab740 1 --2- 172.21.15.103:0/334234501 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56520460a2a0 0x5652046286e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.737+0000 7f787b8ab740 1 --2- 172.21.15.103:0/334234501 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x565204607970 0x5652046299e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.737+0000 7f787b8ab740 1 -- 172.21.15.103:0/334234501 >> 172.21.15.103:0/334234501 conn(0x565204602ac0 msgr2=0x565204621340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:15:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.737+0000 7f7853400640 0 client.25865 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:15:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.737+0000 7f787b8ab740 1 -- 172.21.15.103:0/334234501 shutdown_connections 2024-09-11T01:15:14.739 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.737+0000 7f787b8ab740 1 -- 172.21.15.103:0/334234501 wait complete. 2024-09-11T01:15:14.740 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.738+0000 7f787b8ab740 20 client.25865 trim_cache size 0 max 16384 2024-09-11T01:15:14.740 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:15:14.740 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:15:14.740 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:15:14.740 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:15:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.739+0000 7f7873200640 1 -- 172.21.15.103:0/400528594 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f78580b53a0 msgr2=0x7f78580b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.739+0000 7f7873200640 1 --2- 172.21.15.103:0/400528594 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f78580b53a0 0x7f78580b7860 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7864009950 tx=0x7f7864008040 comp rx=0 tx=0).stop 2024-09-11T01:15:14.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.739+0000 7f7873200640 1 -- 172.21.15.103:0/400528594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7874079530 msgr2=0x7f7874197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.739+0000 7f7873200640 1 --2- 172.21.15.103:0/400528594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7874079530 0x7f7874197d70 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f786c00be00 tx=0x7f786c00bef0 comp rx=0 tx=0).stop 2024-09-11T01:15:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.740+0000 7f7873200640 1 -- 172.21.15.103:0/400528594 shutdown_connections 2024-09-11T01:15:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.740+0000 7f7873200640 1 --2- 172.21.15.103:0/400528594 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f78580b53a0 0x7f78580b7860 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.740+0000 7f7873200640 1 --2- 172.21.15.103:0/400528594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7874079530 0x7f7874197d70 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.740+0000 7f7873200640 1 --2- 172.21.15.103:0/400528594 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7874078b70 0x7f7874197140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.740+0000 7f7873200640 1 --2- 172.21.15.103:0/400528594 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7874077a20 0x7f7874196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.740+0000 7f7873200640 1 -- 172.21.15.103:0/400528594 >> 172.21.15.103:0/400528594 conn(0x7f7874100270 msgr2=0x7f7874101d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:15:14.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.740+0000 7f7873200640 1 -- 172.21.15.103:0/400528594 shutdown_connections 2024-09-11T01:15:14.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:14.740+0000 7f7873200640 1 -- 172.21.15.103:0/400528594 wait complete. 2024-09-11T01:15:15.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:14 smithi103 ceph-mon[30562]: pgmap v607: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 39 MiB/s wr, 6.03k op/s 2024-09-11T01:15:15.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:14 smithi117 ceph-mon[35358]: pgmap v607: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 39 MiB/s wr, 6.03k op/s 2024-09-11T01:15:15.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:14 smithi183 ceph-mon[34992]: pgmap v607: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 39 MiB/s wr, 6.03k op/s 2024-09-11T01:15:17.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:16 smithi103 ceph-mon[30562]: pgmap v608: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 55 MiB/s wr, 8.17k op/s 2024-09-11T01:15:17.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:16 smithi117 ceph-mon[35358]: pgmap v608: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 55 MiB/s wr, 8.17k op/s 2024-09-11T01:15:17.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:16 smithi183 ceph-mon[34992]: pgmap v608: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 55 MiB/s wr, 8.17k op/s 2024-09-11T01:15:19.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:18 smithi103 ceph-mon[30562]: pgmap v609: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 40 MiB/s wr, 5.98k op/s 2024-09-11T01:15:19.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:18 smithi117 ceph-mon[35358]: pgmap v609: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 40 MiB/s wr, 5.98k op/s 2024-09-11T01:15:19.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:18 smithi183 ceph-mon[34992]: pgmap v609: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 40 MiB/s wr, 5.98k op/s 2024-09-11T01:15:21.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:20 smithi103 ceph-mon[30562]: pgmap v610: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 44 MiB/s wr, 6.71k op/s 2024-09-11T01:15:21.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:20 smithi117 ceph-mon[35358]: pgmap v610: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 44 MiB/s wr, 6.71k op/s 2024-09-11T01:15:21.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:20 smithi183 ceph-mon[34992]: pgmap v610: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 44 MiB/s wr, 6.71k op/s 2024-09-11T01:15:23.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:22 smithi103 ceph-mon[30562]: pgmap v611: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 43 MiB/s wr, 6.46k op/s 2024-09-11T01:15:23.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:22 smithi117 ceph-mon[35358]: pgmap v611: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 43 MiB/s wr, 6.46k op/s 2024-09-11T01:15:23.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:22 smithi183 ceph-mon[34992]: pgmap v611: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 43 MiB/s wr, 6.46k op/s 2024-09-11T01:15:25.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:24 smithi103 ceph-mon[30562]: pgmap v612: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 37 MiB/s wr, 5.55k op/s 2024-09-11T01:15:25.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:24 smithi117 ceph-mon[35358]: pgmap v612: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 37 MiB/s wr, 5.55k op/s 2024-09-11T01:15:25.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:24 smithi183 ceph-mon[34992]: pgmap v612: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 37 MiB/s wr, 5.55k op/s 2024-09-11T01:15:27.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:26 smithi103 ceph-mon[30562]: pgmap v613: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 50 MiB/s wr, 7.76k op/s 2024-09-11T01:15:27.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:26 smithi117 ceph-mon[35358]: pgmap v613: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 50 MiB/s wr, 7.76k op/s 2024-09-11T01:15:27.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:26 smithi183 ceph-mon[34992]: pgmap v613: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 50 MiB/s wr, 7.76k op/s 2024-09-11T01:15:29.086 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:28 smithi103 ceph-mon[30562]: pgmap v614: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 35 MiB/s wr, 5.74k op/s 2024-09-11T01:15:29.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:28 smithi117 ceph-mon[35358]: pgmap v614: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 35 MiB/s wr, 5.74k op/s 2024-09-11T01:15:29.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:28 smithi183 ceph-mon[34992]: pgmap v614: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 35 MiB/s wr, 5.74k op/s 2024-09-11T01:15:31.087 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:30 smithi103 ceph-mon[30562]: pgmap v615: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 39 MiB/s wr, 6.48k op/s 2024-09-11T01:15:31.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:30 smithi117 ceph-mon[35358]: pgmap v615: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 39 MiB/s wr, 6.48k op/s 2024-09-11T01:15:31.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:30 smithi183 ceph-mon[34992]: pgmap v615: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 39 MiB/s wr, 6.48k op/s 2024-09-11T01:15:33.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:32 smithi103 ceph-mon[30562]: pgmap v616: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 43 MiB/s wr, 7.09k op/s 2024-09-11T01:15:33.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:32 smithi117 ceph-mon[35358]: pgmap v616: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 43 MiB/s wr, 7.09k op/s 2024-09-11T01:15:33.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:32 smithi183 ceph-mon[34992]: pgmap v616: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 43 MiB/s wr, 7.09k op/s 2024-09-11T01:15:35.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:34 smithi103 ceph-mon[30562]: pgmap v617: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 34 MiB/s wr, 5.65k op/s 2024-09-11T01:15:35.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:34 smithi117 ceph-mon[35358]: pgmap v617: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 34 MiB/s wr, 5.65k op/s 2024-09-11T01:15:35.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:34 smithi183 ceph-mon[34992]: pgmap v617: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 34 MiB/s wr, 5.65k op/s 2024-09-11T01:15:37.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:37 smithi183 ceph-mon[34992]: pgmap v618: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 46 MiB/s wr, 7.52k op/s 2024-09-11T01:15:37.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:37 smithi103 ceph-mon[30562]: pgmap v618: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 46 MiB/s wr, 7.52k op/s 2024-09-11T01:15:37.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:37 smithi117 ceph-mon[35358]: pgmap v618: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 46 MiB/s wr, 7.52k op/s 2024-09-11T01:15:38.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:38 smithi183 ceph-mon[34992]: pgmap v619: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 36 MiB/s wr, 5.85k op/s 2024-09-11T01:15:38.583 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:38 smithi103 ceph-mon[30562]: pgmap v619: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 36 MiB/s wr, 5.85k op/s 2024-09-11T01:15:38.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:38 smithi117 ceph-mon[35358]: pgmap v619: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 36 MiB/s wr, 5.85k op/s 2024-09-11T01:15:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.100+0000 7f4af1800640 1 -- 172.21.15.103:0/2707415822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec074290 msgr2=0x7f4aec074690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.100+0000 7f4af1800640 1 --2- 172.21.15.103:0/2707415822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec074290 0x7f4aec074690 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4adc009900 tx=0x7f4adc02a3e0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.100+0000 7f4af1800640 1 -- 172.21.15.103:0/2707415822 shutdown_connections 2024-09-11T01:15:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.100+0000 7f4af1800640 1 --2- 172.21.15.103:0/2707415822 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4aec10ab10 0x7f4aec1158a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.100+0000 7f4af1800640 1 --2- 172.21.15.103:0/2707415822 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aec10a150 0x7f4aec10a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.100+0000 7f4af1800640 1 --2- 172.21.15.103:0/2707415822 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec074290 0x7f4aec074690 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.100+0000 7f4af1800640 1 -- 172.21.15.103:0/2707415822 >> 172.21.15.103:0/2707415822 conn(0x7f4aec06fa40 msgr2=0x7f4aec071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:15:40.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.101+0000 7f4af1800640 1 -- 172.21.15.103:0/2707415822 shutdown_connections 2024-09-11T01:15:40.104 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.102+0000 7f4af1800640 1 -- 172.21.15.103:0/2707415822 wait complete. 2024-09-11T01:15:40.104 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.103+0000 7f4af1800640 1 Processor -- start 2024-09-11T01:15:40.107 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.106+0000 7f4af1800640 1 -- start start 2024-09-11T01:15:40.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.107+0000 7f4af1800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec074290 0x7f4aec1a7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.107+0000 7f4af1800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4aec10a150 0x7f4aec1a81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.107+0000 7f4af1800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aec10ab10 0x7f4aec1a8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.107+0000 7f4af1800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec10eac0 con 0x7f4aec074290 2024-09-11T01:15:40.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.107+0000 7f4af1800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec10e940 con 0x7f4aec10ab10 2024-09-11T01:15:40.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.107+0000 7f4af1800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec10ec40 con 0x7f4aec10a150 2024-09-11T01:15:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.107+0000 7f4aeaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec074290 0x7f4aec1a7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.108+0000 7f4aeaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec074290 0x7f4aec1a7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59460/0 (socket says 172.21.15.103:59460) 2024-09-11T01:15:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.108+0000 7f4aeaa00640 1 -- 172.21.15.103:0/2023332267 learned_addr learned my addr 172.21.15.103:0/2023332267 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:15:40.110 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.108+0000 7f4aea000640 1 --2- 172.21.15.103:0/2023332267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4aec10a150 0x7f4aec1a81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.108+0000 7f4aeaa00640 1 -- 172.21.15.103:0/2023332267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4aec10a150 msgr2=0x7f4aec1a81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.108+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/2023332267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4aec10a150 0x7f4aec1a81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.108+0000 7f4aeaa00640 1 -- 172.21.15.103:0/2023332267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aec10ab10 msgr2=0x7f4aec1a8e10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-11T01:15:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.108+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/2023332267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aec10ab10 0x7f4aec1a8e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.108+0000 7f4aeaa00640 1 -- 172.21.15.103:0/2023332267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec1a96d0 con 0x7f4aec074290 2024-09-11T01:15:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.109+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/2023332267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec074290 0x7f4aec1a7b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4adc005ab0 tx=0x7f4adc003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.110+0000 7f4ae3400640 1 -- 172.21.15.103:0/2023332267 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc03f070 con 0x7f4aec074290 2024-09-11T01:15:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.110+0000 7f4ae3400640 1 -- 172.21.15.103:0/2023332267 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4adc031c50 con 0x7f4aec074290 2024-09-11T01:15:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.110+0000 7f4ae3400640 1 -- 172.21.15.103:0/2023332267 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc035030 con 0x7f4aec074290 2024-09-11T01:15:40.112 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.110+0000 7f4aea000640 1 --2- 172.21.15.103:0/2023332267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4aec10a150 0x7f4aec1a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:15:40.113 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.110+0000 7f4af1800640 1 -- 172.21.15.103:0/2023332267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aec1a9960 con 0x7f4aec074290 2024-09-11T01:15:40.113 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.111+0000 7f4af1800640 1 -- 172.21.15.103:0/2023332267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aec1afeb0 con 0x7f4aec074290 2024-09-11T01:15:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.116+0000 7f4af464f740 1 Processor -- start 2024-09-11T01:15:40.118 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.116+0000 7f4af464f740 1 -- start start 2024-09-11T01:15:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.120+0000 7f4ae3400640 1 -- 172.21.15.103:0/2023332267 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f4adc03bce0 con 0x7f4aec074290 2024-09-11T01:15:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.121+0000 7f4af464f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdb9e790 0x5599fdba0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.121+0000 7f4af464f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba10c0 0x5599fdba34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.121+0000 7f4af464f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba3b00 0x5599fdba5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.121+0000 7f4af464f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5599fdb116b0 con 0x5599fdb9e790 2024-09-11T01:15:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.121+0000 7f4af464f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5599fdb00ae0 con 0x5599fdba10c0 2024-09-11T01:15:40.123 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.121+0000 7f4af464f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5599fdb048f0 con 0x5599fdba3b00 2024-09-11T01:15:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.122+0000 7f4aea000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba3b00 0x5599fdba5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.122+0000 7f4aea000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba3b00 0x5599fdba5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:41986/0 (socket says 172.21.15.103:41986) 2024-09-11T01:15:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.122+0000 7f4aea000640 1 -- 172.21.15.103:0/293776155 learned_addr learned my addr 172.21.15.103:0/293776155 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:15:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.122+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/293776155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba10c0 0x5599fdba34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.122+0000 7f4aea000640 1 -- 172.21.15.103:0/293776155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba10c0 msgr2=0x5599fdba34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:40.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.123+0000 7f4aea000640 1 --2- 172.21.15.103:0/293776155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba10c0 0x5599fdba34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.123+0000 7f4aea000640 1 -- 172.21.15.103:0/293776155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdb9e790 msgr2=0x5599fdba0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.123+0000 7f4aea000640 1 --2- 172.21.15.103:0/293776155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdb9e790 0x5599fdba0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.123+0000 7f4aea000640 1 -- 172.21.15.103:0/293776155 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599fdacd780 con 0x5599fdba3b00 2024-09-11T01:15:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.123+0000 7f4ae3400640 1 --2- 172.21.15.103:0/2023332267 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4ad00b5430 0x7f4ad00b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.124+0000 7f4aea000640 1 --2- 172.21.15.103:0/293776155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba3b00 0x5599fdba5fc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009c60 tx=0x7f4ad8010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f96fe1ae5aead74 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:40.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.125+0000 7f4ad7e00640 1 -- 172.21.15.103:0/293776155 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8005020 con 0x5599fdba3b00 2024-09-11T01:15:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.125+0000 7f4ad7e00640 1 -- 172.21.15.103:0/293776155 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ad80047a0 con 0x5599fdba3b00 2024-09-11T01:15:40.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.125+0000 7f4ad7e00640 1 -- 172.21.15.103:0/293776155 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad80126b0 con 0x5599fdba3b00 2024-09-11T01:15:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.126+0000 7f4aeb400640 1 --2- 172.21.15.103:0/2023332267 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4ad00b5430 0x7f4ad00b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.126+0000 7f4af464f740 1 -- 172.21.15.103:0/293776155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba3b00 msgr2=0x5599fdba5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.126+0000 7f4af464f740 1 --2- 172.21.15.103:0/293776155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba3b00 0x5599fdba5fc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4ad8009c60 tx=0x7f4ad8010740 comp rx=0 tx=0).stop 2024-09-11T01:15:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.127+0000 7f4af464f740 1 -- 172.21.15.103:0/293776155 shutdown_connections 2024-09-11T01:15:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.127+0000 7f4af464f740 1 --2- 172.21.15.103:0/293776155 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba3b00 0x5599fdba5fc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.127+0000 7f4af464f740 1 --2- 172.21.15.103:0/293776155 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba10c0 0x5599fdba34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.127+0000 7f4af464f740 1 --2- 172.21.15.103:0/293776155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdb9e790 0x5599fdba0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.127+0000 7f4af464f740 1 -- 172.21.15.103:0/293776155 >> 172.21.15.103:0/293776155 conn(0x5599fdb998e0 msgr2=0x5599fdb9a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:15:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.128+0000 7f4ae3400640 1 -- 172.21.15.103:0/2023332267 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f4adc106a00 con 0x7f4aec074290 2024-09-11T01:15:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.128+0000 7f4aeb400640 1 --2- 172.21.15.103:0/2023332267 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4ad00b5430 0x7f4ad00b78f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4005c40 tx=0x7f4ae4005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:40.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.129+0000 7f4af464f740 1 -- 172.21.15.103:0/293776155 shutdown_connections 2024-09-11T01:15:40.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.129+0000 7f4af464f740 1 -- 172.21.15.103:0/293776155 wait complete. 2024-09-11T01:15:40.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.130+0000 7f4af464f740 1 -- start start 2024-09-11T01:15:40.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.130+0000 7f4af464f740 1 Processor -- start 2024-09-11T01:15:40.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.133+0000 7f4af464f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdb9e790 0x5599fdba7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.134+0000 7f4af464f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba10c0 0x5599fdba8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.134+0000 7f4af464f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdba3b00 0x5599fdba9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.134+0000 7f4aeaa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdb9e790 0x5599fdba7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.134+0000 7f4aeaa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdb9e790 0x5599fdba7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:40996/0 (socket says 172.21.15.103:40996) 2024-09-11T01:15:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.134+0000 7f4af464f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5599fda38ab0 con 0x5599fdba3b00 2024-09-11T01:15:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.134+0000 7f4aeb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdba3b00 0x5599fdba9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.135+0000 7f4af464f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5599fdaa7570 con 0x5599fdb9e790 2024-09-11T01:15:40.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.135+0000 7f4af464f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5599fdba6ae0 con 0x5599fdba10c0 2024-09-11T01:15:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.135+0000 7f4af464f740 10 client.0 _ll_register_callbacks cb 0x5599fdab6100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:15:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.135+0000 7f4aeb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdba3b00 0x5599fdba9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59466/0 (socket says 172.21.15.103:59466) 2024-09-11T01:15:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.135+0000 7f4aeb400640 1 -- 172.21.15.103:0/1269045021 learned_addr learned my addr 172.21.15.103:0/1269045021 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:15:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.136+0000 7f4aea000640 1 --2- 172.21.15.103:0/1269045021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba10c0 0x5599fdba8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.136+0000 7f4aeaa00640 1 -- 172.21.15.103:0/1269045021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba10c0 msgr2=0x5599fdba8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.136+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/1269045021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba10c0 0x5599fdba8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.136+0000 7f4aeaa00640 1 -- 172.21.15.103:0/1269045021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdba3b00 msgr2=0x5599fdba9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.136+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/1269045021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdba3b00 0x5599fdba9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.137+0000 7f4aeaa00640 1 -- 172.21.15.103:0/1269045021 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599fd862790 con 0x5599fdb9e790 2024-09-11T01:15:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.137+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/1269045021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdb9e790 0x5599fdba7ed0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4adc1041a0 tx=0x7f4adc02a3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=684ba62c5be83ff1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:40.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.137+0000 7f4ad4c00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:15:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.137+0000 7f4ad4c00640 1 -- 172.21.15.103:0/1269045021 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4adc049070 con 0x5599fdb9e790 2024-09-11T01:15:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.137+0000 7f4ad4c00640 1 -- 172.21.15.103:0/1269045021 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f4adc0d5f10 con 0x5599fdb9e790 2024-09-11T01:15:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.138+0000 7f4af464f740 1 -- 172.21.15.103:0/1269045021 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ad80047a0 con 0x5599fdb9e790 2024-09-11T01:15:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.138+0000 7f4ad4c00640 1 -- 172.21.15.103:0/1269045021 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4adc0ccbe0 con 0x5599fdb9e790 2024-09-11T01:15:40.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.138+0000 7f4af464f740 10 client.25874 fetch_fsmap learned FSMap version 31 2024-09-11T01:15:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.138+0000 7f4af464f740 1 -- 172.21.15.103:0/1269045021 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5599fd8db620 con 0x5599fdb9e790 2024-09-11T01:15:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.139+0000 7f4ad4c00640 1 -- 172.21.15.103:0/1269045021 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ad80047a0 con 0x5599fdb9e790 2024-09-11T01:15:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.139+0000 7f4ad4c00640 1 -- 172.21.15.103:0/1269045021 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f4adc0cc070 con 0x5599fdb9e790 2024-09-11T01:15:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.139+0000 7f4af464f740 10 client.25874 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:15:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.139+0000 7f4af464f740 10 client.25874 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:15:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.139+0000 7f4af464f740 20 client.25874 populate_metadata read hostname 'smithi103' 2024-09-11T01:15:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.139+0000 7f4af464f740 1 --2- 172.21.15.103:0/1269045021 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5599fdbb36e0 0x5599fdbb5b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.139+0000 7f4af464f740 4 client.25874 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:15:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.139+0000 7f4af464f740 1 -- 172.21.15.103:0/1269045021 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599fdb13600 con 0x5599fdbb36e0 2024-09-11T01:15:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.139+0000 7f4aea000640 1 --2- 172.21.15.103:0/1269045021 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5599fdbb36e0 0x5599fdbb5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.140+0000 7f4aea000640 1 --2- 172.21.15.103:0/1269045021 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5599fdbb36e0 0x5599fdbb5b50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4ce1d8bdcb6472f server_cookie=16992aed693e49fc in_seq=0 out_seq=0 2024-09-11T01:15:40.142 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.140+0000 7f4ad4c00640 10 client.25874 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:15:40.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.141+0000 7f4ad4c00640 1 -- 172.21.15.103:0/1269045021 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5599fdb13600 con 0x5599fdbb36e0 2024-09-11T01:15:40.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.141+0000 7f4ad4c00640 10 client.25874 handle_command_reply: tid=0 2024-09-11T01:15:40.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.141+0000 7f4af464f740 1 client.25874 shutdown 2024-09-11T01:15:40.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.142+0000 7f4af464f740 1 -- 172.21.15.103:0/1269045021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdb9e790 msgr2=0x5599fdba7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:40.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.142+0000 7f4af464f740 1 --2- 172.21.15.103:0/1269045021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdb9e790 0x5599fdba7ed0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4adc1041a0 tx=0x7f4adc02a3e0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.144+0000 7f4af464f740 1 -- 172.21.15.103:0/1269045021 shutdown_connections 2024-09-11T01:15:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.144+0000 7f4af464f740 1 --2- 172.21.15.103:0/1269045021 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdba3b00 0x5599fdba9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.144+0000 7f4af464f740 1 --2- 172.21.15.103:0/1269045021 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5599fdbb36e0 0x5599fdbb5b50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.144+0000 7f4af464f740 1 --2- 172.21.15.103:0/1269045021 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba10c0 0x5599fdba8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.144+0000 7f4af464f740 1 --2- 172.21.15.103:0/1269045021 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdb9e790 0x5599fdba7ed0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.144+0000 7f4ad4c00640 0 client.25874 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:15:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.144+0000 7f4af464f740 1 -- 172.21.15.103:0/1269045021 >> 172.21.15.103:0/1269045021 conn(0x5599fdb998e0 msgr2=0x5599fdb98a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:15:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.144+0000 7f4af464f740 1 -- 172.21.15.103:0/1269045021 shutdown_connections 2024-09-11T01:15:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.144+0000 7f4af464f740 1 -- 172.21.15.103:0/1269045021 wait complete. 2024-09-11T01:15:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.144+0000 7f4af464f740 20 client.25874 trim_cache size 0 max 16384 2024-09-11T01:15:40.190 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.188+0000 7f4af464f740 1 Processor -- start 2024-09-11T01:15:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.189+0000 7f4af464f740 1 -- start start 2024-09-11T01:15:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.189+0000 7f4af464f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdb9e790 0x5599fdb9a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.189+0000 7f4af464f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba10c0 0x5599fdb9b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.191 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.189+0000 7f4af464f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba3b00 0x5599fdb9bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.189+0000 7f4af464f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1bcd50 con 0x5599fdb9e790 2024-09-11T01:15:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.189+0000 7f4af464f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1ba620 con 0x5599fdba3b00 2024-09-11T01:15:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.189+0000 7f4af464f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1b8470 con 0x5599fdba10c0 2024-09-11T01:15:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.190+0000 7f4aeb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba3b00 0x5599fdb9bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.190+0000 7f4aeb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba3b00 0x5599fdb9bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:41000/0 (socket says 172.21.15.103:41000) 2024-09-11T01:15:40.192 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.190+0000 7f4aeb400640 1 -- 172.21.15.103:0/991057403 learned_addr learned my addr 172.21.15.103:0/991057403 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:15:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.190+0000 7f4aea000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba10c0 0x5599fdb9b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.191+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/991057403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdb9e790 0x5599fdb9a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.191+0000 7f4aea000640 1 -- 172.21.15.103:0/991057403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba3b00 msgr2=0x5599fdb9bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.191+0000 7f4aea000640 1 --2- 172.21.15.103:0/991057403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba3b00 0x5599fdb9bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.191+0000 7f4aea000640 1 -- 172.21.15.103:0/991057403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdb9e790 msgr2=0x5599fdb9a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.191+0000 7f4aea000640 1 --2- 172.21.15.103:0/991057403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdb9e790 0x5599fdb9a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.192+0000 7f4aea000640 1 -- 172.21.15.103:0/991057403 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599fdba0ef0 con 0x5599fdba10c0 2024-09-11T01:15:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.192+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/991057403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdb9e790 0x5599fdb9a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:15:40.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.192+0000 7f4aea000640 1 --2- 172.21.15.103:0/991057403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba10c0 0x5599fdb9b710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x5599fdbb6370 tx=0x7f4ad8009890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86688dd6dad018ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:40.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.193+0000 7f4ad7400640 1 -- 172.21.15.103:0/991057403 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8005040 con 0x5599fdba10c0 2024-09-11T01:15:40.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.193+0000 7f4ad7400640 1 -- 172.21.15.103:0/991057403 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ad80046d0 con 0x5599fdba10c0 2024-09-11T01:15:40.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.193+0000 7f4ad7400640 1 -- 172.21.15.103:0/991057403 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8005040 con 0x5599fdba10c0 2024-09-11T01:15:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.195+0000 7f4af464f740 1 -- 172.21.15.103:0/991057403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba10c0 msgr2=0x5599fdb9b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.195+0000 7f4af464f740 1 --2- 172.21.15.103:0/991057403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba10c0 0x5599fdb9b710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x5599fdbb6370 tx=0x7f4ad8009890 comp rx=0 tx=0).stop 2024-09-11T01:15:40.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.195+0000 7f4af464f740 1 -- 172.21.15.103:0/991057403 shutdown_connections 2024-09-11T01:15:40.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.195+0000 7f4af464f740 1 --2- 172.21.15.103:0/991057403 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba3b00 0x5599fdb9bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.195+0000 7f4af464f740 1 --2- 172.21.15.103:0/991057403 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdba10c0 0x5599fdb9b710 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.195+0000 7f4af464f740 1 --2- 172.21.15.103:0/991057403 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdb9e790 0x5599fdb9a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.195+0000 7f4af464f740 1 -- 172.21.15.103:0/991057403 >> 172.21.15.103:0/991057403 conn(0x5599fdb998e0 msgr2=0x5599fdb9a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:15:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.199+0000 7f4af464f740 1 -- 172.21.15.103:0/991057403 shutdown_connections 2024-09-11T01:15:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.199+0000 7f4af464f740 1 -- 172.21.15.103:0/991057403 wait complete. 2024-09-11T01:15:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.199+0000 7f4af464f740 1 -- start start 2024-09-11T01:15:40.201 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.200+0000 7f4af464f740 1 Processor -- start 2024-09-11T01:15:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.201+0000 7f4af464f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdb9e790 0x5599fdbac010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.202 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.201+0000 7f4af464f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdba10c0 0x5599fdbac690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.201+0000 7f4af464f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba3b00 0x5599fdbad210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.201+0000 7f4af464f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1b8ae0 con 0x5599fdba10c0 2024-09-11T01:15:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.201+0000 7f4af464f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1b9f50 con 0x5599fdba3b00 2024-09-11T01:15:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.201+0000 7f4af464f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec1b91b0 con 0x5599fdb9e790 2024-09-11T01:15:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.202+0000 7f4aeb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba3b00 0x5599fdbad210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.202+0000 7f4aeb400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba3b00 0x5599fdbad210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:41002/0 (socket says 172.21.15.103:41002) 2024-09-11T01:15:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.202+0000 7f4aeb400640 1 -- 172.21.15.103:0/3809541410 learned_addr learned my addr 172.21.15.103:0/3809541410 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:15:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.202+0000 7f4af464f740 10 client.0 _ll_register_callbacks cb 0x7f4adc005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:15:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.202+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/3809541410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdb9e790 0x5599fdbac010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.202+0000 7f4aeb400640 1 -- 172.21.15.103:0/3809541410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdb9e790 msgr2=0x5599fdbac010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.202+0000 7f4aeb400640 1 --2- 172.21.15.103:0/3809541410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdb9e790 0x5599fdbac010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.202+0000 7f4aeb400640 1 -- 172.21.15.103:0/3809541410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdba10c0 msgr2=0x5599fdbac690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-11T01:15:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.202+0000 7f4aeb400640 1 --2- 172.21.15.103:0/3809541410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdba10c0 0x5599fdbac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.202+0000 7f4aeb400640 1 -- 172.21.15.103:0/3809541410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599fdba94b0 con 0x5599fdba3b00 2024-09-11T01:15:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.203+0000 7f4ad4c00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:15:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.203+0000 7f4aeb400640 1 --2- 172.21.15.103:0/3809541410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba3b00 0x5599fdbad210 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4ae401dc10 tx=0x7f4ae4009500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42f65de56d449e7a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.203+0000 7f4ad4c00640 1 -- 172.21.15.103:0/3809541410 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae402b060 con 0x5599fdba3b00 2024-09-11T01:15:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.204+0000 7f4ad4c00640 1 -- 172.21.15.103:0/3809541410 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f4ae40263f0 con 0x5599fdba3b00 2024-09-11T01:15:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.204+0000 7f4af464f740 1 -- 172.21.15.103:0/3809541410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ad80046d0 con 0x5599fdba3b00 2024-09-11T01:15:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.204+0000 7f4ad4c00640 1 -- 172.21.15.103:0/3809541410 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4ae40265f0 con 0x5599fdba3b00 2024-09-11T01:15:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.205+0000 7f4af464f740 10 client.25880 fetch_fsmap learned FSMap version 31 2024-09-11T01:15:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.205+0000 7f4af464f740 1 -- 172.21.15.103:0/3809541410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5599fdc31f60 con 0x5599fdba3b00 2024-09-11T01:15:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.205+0000 7f4ad4c00640 1 -- 172.21.15.103:0/3809541410 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4ad80046d0 con 0x5599fdba3b00 2024-09-11T01:15:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.205+0000 7f4ad4c00640 1 -- 172.21.15.103:0/3809541410 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f4ae4025070 con 0x5599fdba3b00 2024-09-11T01:15:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.206+0000 7f4af464f740 10 client.25880 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:15:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.206+0000 7f4af464f740 10 client.25880 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:15:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.206+0000 7f4af464f740 20 client.25880 populate_metadata read hostname 'smithi103' 2024-09-11T01:15:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.206+0000 7f4af464f740 1 --2- 172.21.15.103:0/3809541410 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5599fdc328d0 0x5599fdc34d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.206+0000 7f4af464f740 4 client.25880 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:15:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.206+0000 7f4af464f740 1 -- 172.21.15.103:0/3809541410 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5599fdb0f0b0 con 0x5599fdc328d0 2024-09-11T01:15:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.206+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/3809541410 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5599fdc328d0 0x5599fdc34d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.207+0000 7f4ad4c00640 10 client.25880 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:15:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:15:40.208+0000 7f4aeaa00640 1 --2- 172.21.15.103:0/3809541410 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5599fdc328d0 0x5599fdc34d30 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaacd3dcc661cf7f server_cookie=b2c26601a667057c in_seq=0 out_seq=0 2024-09-11T01:15:40.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.313+0000 7fecbd400640 1 --2- 172.21.15.103:0/2710443852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecb8117e00 0x7fecb811a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:15:40.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.315+0000 7fecbf400640 1 -- 172.21.15.103:0/2710443852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecb810a150 msgr2=0x7fecb810a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:40.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.315+0000 7fecbf400640 1 --2- 172.21.15.103:0/2710443852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecb810a150 0x7fecb810a530 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7feca8009930 tx=0x7feca802a4f0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.316+0000 7fecbf400640 1 -- 172.21.15.103:0/2710443852 shutdown_connections 2024-09-11T01:15:40.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.316+0000 7fecbf400640 1 --2- 172.21.15.103:0/2710443852 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecb8117e00 0x7fecb811a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.316+0000 7fecbf400640 1 --2- 172.21.15.103:0/2710443852 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb810aa70 0x7fecb81178c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.316+0000 7fecbf400640 1 --2- 172.21.15.103:0/2710443852 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecb810a150 0x7fecb810a530 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.316+0000 7fecbf400640 1 -- 172.21.15.103:0/2710443852 >> 172.21.15.103:0/2710443852 conn(0x7fecb806e2e0 msgr2=0x7fecb806e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:15:40.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.317+0000 7fecbf400640 1 -- 172.21.15.103:0/2710443852 shutdown_connections 2024-09-11T01:15:40.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.317+0000 7fecbf400640 1 -- 172.21.15.103:0/2710443852 wait complete. 2024-09-11T01:15:40.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.320+0000 7fecbf400640 1 Processor -- start 2024-09-11T01:15:40.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.321+0000 7fecbf400640 1 -- start start 2024-09-11T01:15:40.326 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.324+0000 7fecbf400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecb810a150 0x7fecb811b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.328 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.326+0000 7fecbf400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb810aa70 0x7fecb811bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.327+0000 7fecbf400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecb8117e00 0x7fecb81228d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.327+0000 7fecb7e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb810aa70 0x7fecb811bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.329 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.327+0000 7fecb7e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb810aa70 0x7fecb811bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:42054/0 (socket says 172.21.15.103:42054) 2024-09-11T01:15:40.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.328+0000 7fecbca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecb810a150 0x7fecb811b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.328+0000 7fecbca00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecb810a150 0x7fecb811b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:41022/0 (socket says 172.21.15.103:41022) 2024-09-11T01:15:40.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.330+0000 7fecb7e00640 1 -- 172.21.15.103:0/3276960691 learned_addr learned my addr 172.21.15.103:0/3276960691 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:15:40.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.330+0000 7fecbf400640 1 -- 172.21.15.103:0/3276960691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fecb810f460 con 0x7fecb8117e00 2024-09-11T01:15:40.331 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.330+0000 7fecbf400640 1 -- 172.21.15.103:0/3276960691 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fecb810f2e0 con 0x7fecb810a150 2024-09-11T01:15:40.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.330+0000 7fecbf400640 1 -- 172.21.15.103:0/3276960691 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fecb810f5e0 con 0x7fecb810aa70 2024-09-11T01:15:40.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.330+0000 7fecb7e00640 1 -- 172.21.15.103:0/3276960691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecb810a150 msgr2=0x7fecb811b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:40.332 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.330+0000 7fecb7e00640 1 --2- 172.21.15.103:0/3276960691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fecb810a150 0x7fecb811b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.330+0000 7fecb7e00640 1 -- 172.21.15.103:0/3276960691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecb8117e00 msgr2=0x7fecb81228d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-11T01:15:40.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.332+0000 7fecb7e00640 1 --2- 172.21.15.103:0/3276960691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fecb8117e00 0x7fecb81228d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:40.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.332+0000 7fecb7e00640 1 -- 172.21.15.103:0/3276960691 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecb8122e40 con 0x7fecb810aa70 2024-09-11T01:15:40.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.333+0000 7fecb7e00640 1 --2- 172.21.15.103:0/3276960691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fecb810aa70 0x7fecb811bdb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feca400b4d0 tx=0x7feca400b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:40.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.334+0000 7fecb5600640 1 -- 172.21.15.103:0/3276960691 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca4014070 con 0x7fecb810aa70 2024-09-11T01:15:40.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.335+0000 7fecb5600640 1 -- 172.21.15.103:0/3276960691 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feca4010d20 con 0x7fecb810aa70 2024-09-11T01:15:40.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.335+0000 7fecbf400640 1 -- 172.21.15.103:0/3276960691 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecb8123130 con 0x7fecb810aa70 2024-09-11T01:15:40.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.335+0000 7fecbf400640 1 -- 172.21.15.103:0/3276960691 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecb8123740 con 0x7fecb810aa70 2024-09-11T01:15:40.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.335+0000 7fecb5600640 1 -- 172.21.15.103:0/3276960691 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca400fe10 con 0x7fecb810aa70 2024-09-11T01:15:40.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.344+0000 7fecb5600640 1 -- 172.21.15.103:0/3276960691 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7feca4010870 con 0x7fecb810aa70 2024-09-11T01:15:40.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.349+0000 7fecb5600640 1 --2- 172.21.15.103:0/3276960691 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fec9c0b53e0 0x7fec9c0b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:40.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.350+0000 7fecb5600640 1 -- 172.21.15.103:0/3276960691 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7feca40e56d0 con 0x7fecb810aa70 2024-09-11T01:15:40.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.350+0000 7fecbca00640 1 --2- 172.21.15.103:0/3276960691 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fec9c0b53e0 0x7fec9c0b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:40.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:40.351+0000 7fecbca00640 1 --2- 172.21.15.103:0/3276960691 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fec9c0b53e0 0x7fec9c0b78a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feca8005ab0 tx=0x7feca8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:40.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:40 smithi103 ceph-mon[30562]: pgmap v620: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 40 MiB/s wr, 6.40k op/s 2024-09-11T01:15:40.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:40 smithi117 ceph-mon[35358]: pgmap v620: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 40 MiB/s wr, 6.40k op/s 2024-09-11T01:15:40.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:40 smithi183 ceph-mon[34992]: pgmap v620: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 40 MiB/s wr, 6.40k op/s 2024-09-11T01:15:41.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.035+0000 7fecc1e36740 1 Processor -- start 2024-09-11T01:15:41.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.036+0000 7fecc1e36740 1 -- start start 2024-09-11T01:15:41.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.036+0000 7fecc1e36740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849a180 0x5614d849a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:41.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.037+0000 7fecc1e36740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849aaa0 0x5614d84a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:41.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.037+0000 7fecc1e36740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d84a6a30 0x5614d84a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:41.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.037+0000 7fecc1e36740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5614d840fca0 con 0x5614d849a180 2024-09-11T01:15:41.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.037+0000 7fecc1e36740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5614d83ff0d0 con 0x5614d849aaa0 2024-09-11T01:15:41.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.037+0000 7fecc1e36740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5614d8402ee0 con 0x5614d84a6a30 2024-09-11T01:15:41.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.038+0000 7fecbca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849a180 0x5614d849a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:41.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.038+0000 7fecbca00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849a180 0x5614d849a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59504/0 (socket says 172.21.15.103:59504) 2024-09-11T01:15:41.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.038+0000 7fecbca00640 1 -- 172.21.15.103:0/87875811 learned_addr learned my addr 172.21.15.103:0/87875811 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:15:41.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.039+0000 7fecbca00640 1 -- 172.21.15.103:0/87875811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d84a6a30 msgr2=0x5614d84a8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:41.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.039+0000 7fecbd400640 1 --2- 172.21.15.103:0/87875811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d84a6a30 0x5614d84a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:41.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.039+0000 7fecbca00640 1 --2- 172.21.15.103:0/87875811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d84a6a30 0x5614d84a8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.039+0000 7fecbca00640 1 -- 172.21.15.103:0/87875811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849aaa0 msgr2=0x5614d84a64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:41.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.039+0000 7fecb7e00640 1 --2- 172.21.15.103:0/87875811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849aaa0 0x5614d84a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:41.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.040+0000 7fecbca00640 1 --2- 172.21.15.103:0/87875811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849aaa0 0x5614d84a64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.040+0000 7fecbca00640 1 -- 172.21.15.103:0/87875811 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614d83b1400 con 0x5614d849a180 2024-09-11T01:15:41.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.040+0000 7fecbd400640 1 --2- 172.21.15.103:0/87875811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d84a6a30 0x5614d84a8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:15:41.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.040+0000 7fecb7e00640 1 --2- 172.21.15.103:0/87875811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849aaa0 0x5614d84a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:15:41.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.041+0000 7fecbca00640 1 --2- 172.21.15.103:0/87875811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849a180 0x5614d849a560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7feca8006010 tx=0x7feca803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2385111edc3a360c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:41.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.042+0000 7fecadc00640 1 -- 172.21.15.103:0/87875811 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca8035040 con 0x5614d849a180 2024-09-11T01:15:41.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.042+0000 7fecadc00640 1 -- 172.21.15.103:0/87875811 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feca804e070 con 0x5614d849a180 2024-09-11T01:15:41.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.042+0000 7fecadc00640 1 -- 172.21.15.103:0/87875811 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca8003d30 con 0x5614d849a180 2024-09-11T01:15:41.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.044+0000 7fecc1e36740 1 -- 172.21.15.103:0/87875811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849a180 msgr2=0x5614d849a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:41.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.044+0000 7fecc1e36740 1 --2- 172.21.15.103:0/87875811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849a180 0x5614d849a560 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7feca8006010 tx=0x7feca803d000 comp rx=0 tx=0).stop 2024-09-11T01:15:41.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.044+0000 7fecc1e36740 1 -- 172.21.15.103:0/87875811 shutdown_connections 2024-09-11T01:15:41.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.044+0000 7fecc1e36740 1 --2- 172.21.15.103:0/87875811 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d84a6a30 0x5614d84a8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.044+0000 7fecc1e36740 1 --2- 172.21.15.103:0/87875811 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849aaa0 0x5614d84a64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.044+0000 7fecc1e36740 1 --2- 172.21.15.103:0/87875811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849a180 0x5614d849a560 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.046+0000 7fecc1e36740 1 -- 172.21.15.103:0/87875811 >> 172.21.15.103:0/87875811 conn(0x5614d8497fb0 msgr2=0x5614d8499150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:15:41.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.046+0000 7fecc1e36740 1 -- 172.21.15.103:0/87875811 shutdown_connections 2024-09-11T01:15:41.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.046+0000 7fecc1e36740 1 -- 172.21.15.103:0/87875811 wait complete. 2024-09-11T01:15:41.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.047+0000 7fecc1e36740 1 -- start start 2024-09-11T01:15:41.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.048+0000 7fecc1e36740 1 Processor -- start 2024-09-11T01:15:41.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.051+0000 7fecc1e36740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849a180 0x5614d84a6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:41.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.051+0000 7fecc1e36740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849aaa0 0x5614d84a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:41.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.051+0000 7fecc1e36740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d84a6a30 0x5614d84a3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:41.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.051+0000 7fecc1e36740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5614d82607a0 con 0x5614d849aaa0 2024-09-11T01:15:41.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.052+0000 7fecc1e36740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5614d83a4a10 con 0x5614d849a180 2024-09-11T01:15:41.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.052+0000 7fecc1e36740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5614d84a9650 con 0x5614d84a6a30 2024-09-11T01:15:41.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.052+0000 7fecc1e36740 10 client.0 _ll_register_callbacks cb 0x5614d83b4be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:15:41.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.052+0000 7fecb7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849aaa0 0x5614d84a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:41.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.052+0000 7fecb7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849aaa0 0x5614d84a36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59516/0 (socket says 172.21.15.103:59516) 2024-09-11T01:15:41.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.052+0000 7fecb7e00640 1 -- 172.21.15.103:0/1944182102 learned_addr learned my addr 172.21.15.103:0/1944182102 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:15:41.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.052+0000 7fecbca00640 1 --2- 172.21.15.103:0/1944182102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849a180 0x5614d84a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:41.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.051+0000 7fecbd400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d84a6a30 0x5614d84a3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:41.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.052+0000 7fecbd400640 1 -- 172.21.15.103:0/1944182102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849a180 msgr2=0x5614d84a6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:41.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.052+0000 7fecbd400640 1 --2- 172.21.15.103:0/1944182102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849a180 0x5614d84a6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.052+0000 7fecbd400640 1 -- 172.21.15.103:0/1944182102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849aaa0 msgr2=0x5614d84a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:41.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.052+0000 7fecbd400640 1 --2- 172.21.15.103:0/1944182102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849aaa0 0x5614d84a36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.053+0000 7fecbd400640 1 -- 172.21.15.103:0/1944182102 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614d816cb90 con 0x5614d84a6a30 2024-09-11T01:15:41.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.053+0000 7fecb7e00640 1 --2- 172.21.15.103:0/1944182102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849aaa0 0x5614d84a36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:15:41.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.053+0000 7fecbd400640 1 --2- 172.21.15.103:0/1944182102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d84a6a30 0x5614d84a3be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fecb000f5e0 tx=0x7fecb000faa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d97ab66128d00c41 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:41.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.053+0000 7feca2000640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:15:41.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.054+0000 7feca2000640 1 -- 172.21.15.103:0/1944182102 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb0004d20 con 0x5614d84a6a30 2024-09-11T01:15:41.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.055+0000 7feca2000640 1 -- 172.21.15.103:0/1944182102 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fecb0011710 con 0x5614d84a6a30 2024-09-11T01:15:41.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.056+0000 7fecc1e36740 1 -- 172.21.15.103:0/1944182102 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feca804e070 con 0x5614d84a6a30 2024-09-11T01:15:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.057+0000 7feca2000640 1 -- 172.21.15.103:0/1944182102 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fecb0011930 con 0x5614d84a6a30 2024-09-11T01:15:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.057+0000 7fecc1e36740 10 client.25837 fetch_fsmap learned FSMap version 31 2024-09-11T01:15:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.057+0000 7fecc1e36740 1 -- 172.21.15.103:0/1944182102 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5614d84b4f20 con 0x5614d84a6a30 2024-09-11T01:15:41.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.058+0000 7feca2000640 1 -- 172.21.15.103:0/1944182102 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7feca804e070 con 0x5614d84a6a30 2024-09-11T01:15:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.061+0000 7feca2000640 1 -- 172.21.15.103:0/1944182102 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fecb0025420 con 0x5614d84a6a30 2024-09-11T01:15:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.061+0000 7fecc1e36740 10 client.25837 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:15:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.061+0000 7fecc1e36740 10 client.25837 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:15:41.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.061+0000 7fecc1e36740 20 client.25837 populate_metadata read hostname 'smithi103' 2024-09-11T01:15:41.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.062+0000 7fecc1e36740 1 --2- 172.21.15.103:0/1944182102 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5614d84b64d0 0x5614d84b88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:41.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.063+0000 7fecc1e36740 4 client.25837 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:15:41.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.063+0000 7fecc1e36740 1 -- 172.21.15.103:0/1944182102 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614d8411bf0 con 0x5614d84b64d0 2024-09-11T01:15:41.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.064+0000 7fecbca00640 1 --2- 172.21.15.103:0/1944182102 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5614d84b64d0 0x5614d84b88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.064+0000 7fecbca00640 1 --2- 172.21.15.103:0/1944182102 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5614d84b64d0 0x5614d84b88c0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b10e364873e58d43 server_cookie=d33b83e483b4b1d in_seq=0 out_seq=0 2024-09-11T01:15:41.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.064+0000 7feca2000640 10 client.25837 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:15:41.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.065+0000 7feca2000640 1 -- 172.21.15.103:0/1944182102 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5614d8411bf0 con 0x5614d84b64d0 2024-09-11T01:15:41.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.065+0000 7feca2000640 10 client.25837 handle_command_reply: tid=0 2024-09-11T01:15:41.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.065+0000 7fecc1e36740 1 client.25837 shutdown 2024-09-11T01:15:41.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.066+0000 7fecc1e36740 1 -- 172.21.15.103:0/1944182102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d84a6a30 msgr2=0x5614d84a3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:41.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.066+0000 7fecc1e36740 1 --2- 172.21.15.103:0/1944182102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d84a6a30 0x5614d84a3be0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fecb000f5e0 tx=0x7fecb000faa0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.067+0000 7fecc1e36740 1 -- 172.21.15.103:0/1944182102 shutdown_connections 2024-09-11T01:15:41.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.067+0000 7fecc1e36740 1 --2- 172.21.15.103:0/1944182102 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5614d84b64d0 0x5614d84b88c0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.067+0000 7fecc1e36740 1 --2- 172.21.15.103:0/1944182102 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d84a6a30 0x5614d84a3be0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.067+0000 7fecc1e36740 1 --2- 172.21.15.103:0/1944182102 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849aaa0 0x5614d84a36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.067+0000 7fecc1e36740 1 --2- 172.21.15.103:0/1944182102 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849a180 0x5614d84a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.067+0000 7fecc1e36740 1 -- 172.21.15.103:0/1944182102 >> 172.21.15.103:0/1944182102 conn(0x5614d8497fb0 msgr2=0x5614d849db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:15:41.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.068+0000 7feca2000640 0 client.25837 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:15:41.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.068+0000 7fecc1e36740 1 -- 172.21.15.103:0/1944182102 shutdown_connections 2024-09-11T01:15:41.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.069+0000 7fecc1e36740 1 -- 172.21.15.103:0/1944182102 wait complete. 2024-09-11T01:15:41.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.069+0000 7fecc1e36740 20 client.25837 trim_cache size 0 max 16384 2024-09-11T01:15:41.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.106+0000 7fecc1e36740 1 Processor -- start 2024-09-11T01:15:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.106+0000 7fecc1e36740 1 -- start start 2024-09-11T01:15:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.107+0000 7fecc1e36740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d849a180 0x5614d84b2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.107+0000 7fecc1e36740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849aaa0 0x5614d849eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.107+0000 7fecc1e36740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d84a6a30 0x5614d8496fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.107+0000 7fecc1e36740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fec98012500 con 0x5614d849aaa0 2024-09-11T01:15:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.107+0000 7fecc1e36740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fec9800fdd0 con 0x5614d84a6a30 2024-09-11T01:15:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.107+0000 7fecc1e36740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fec9800dc20 con 0x5614d849a180 2024-09-11T01:15:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.107+0000 7fecbd400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d84a6a30 0x5614d8496fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.107+0000 7fecbd400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d84a6a30 0x5614d8496fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:41048/0 (socket says 172.21.15.103:41048) 2024-09-11T01:15:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.107+0000 7fecbd400640 1 -- 172.21.15.103:0/19439987 learned_addr learned my addr 172.21.15.103:0/19439987 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:15:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.108+0000 7fecbca00640 1 --2- 172.21.15.103:0/19439987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d849a180 0x5614d84b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:41.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.108+0000 7fecb7e00640 1 --2- 172.21.15.103:0/19439987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849aaa0 0x5614d849eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:41.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.108+0000 7fecbd400640 1 -- 172.21.15.103:0/19439987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d849a180 msgr2=0x5614d84b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:41.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.108+0000 7fecbd400640 1 --2- 172.21.15.103:0/19439987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d849a180 0x5614d84b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.108+0000 7fecbd400640 1 -- 172.21.15.103:0/19439987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849aaa0 msgr2=0x5614d849eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:41.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.108+0000 7fecbd400640 1 --2- 172.21.15.103:0/19439987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849aaa0 0x5614d849eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.108+0000 7fecbd400640 1 -- 172.21.15.103:0/19439987 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614d84b8c30 con 0x5614d84a6a30 2024-09-11T01:15:41.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.112+0000 7fecbd400640 1 --2- 172.21.15.103:0/19439987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d84a6a30 0x5614d8496fa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fecb000fae0 tx=0x7fecb0012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=133746735707cd40 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:41.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.113+0000 7fecad200640 1 -- 172.21.15.103:0/19439987 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb002a040 con 0x5614d84a6a30 2024-09-11T01:15:41.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.113+0000 7fecad200640 1 -- 172.21.15.103:0/19439987 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecb0025ab0 con 0x5614d84a6a30 2024-09-11T01:15:41.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.113+0000 7fecad200640 1 -- 172.21.15.103:0/19439987 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb0011d30 con 0x5614d84a6a30 2024-09-11T01:15:41.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.114+0000 7fecc1e36740 1 -- 172.21.15.103:0/19439987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d84a6a30 msgr2=0x5614d8496fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:15:41.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.114+0000 7fecc1e36740 1 --2- 172.21.15.103:0/19439987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d84a6a30 0x5614d8496fa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fecb000fae0 tx=0x7fecb0012000 comp rx=0 tx=0).stop 2024-09-11T01:15:41.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.114+0000 7fecc1e36740 1 -- 172.21.15.103:0/19439987 shutdown_connections 2024-09-11T01:15:41.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.115+0000 7fecc1e36740 1 --2- 172.21.15.103:0/19439987 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d84a6a30 0x5614d8496fa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.115+0000 7fecc1e36740 1 --2- 172.21.15.103:0/19439987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d849aaa0 0x5614d849eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.115+0000 7fecc1e36740 1 --2- 172.21.15.103:0/19439987 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d849a180 0x5614d84b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.115+0000 7fecc1e36740 1 -- 172.21.15.103:0/19439987 >> 172.21.15.103:0/19439987 conn(0x5614d8497fb0 msgr2=0x5614d8496890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:15:41.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.115+0000 7fecc1e36740 1 -- 172.21.15.103:0/19439987 shutdown_connections 2024-09-11T01:15:41.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.115+0000 7fecc1e36740 1 -- 172.21.15.103:0/19439987 wait complete. 2024-09-11T01:15:41.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.116+0000 7fecc1e36740 1 -- start start 2024-09-11T01:15:41.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.117+0000 7fecc1e36740 1 Processor -- start 2024-09-11T01:15:41.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.117+0000 7fecc1e36740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d849a180 0x5614d84ab0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:41.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.117+0000 7fecc1e36740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849aaa0 0x5614d84ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:41.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.117+0000 7fecc1e36740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d84a6a30 0x5614d85223b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:41.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.118+0000 7fecb7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849aaa0 0x5614d84ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:41.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.118+0000 7fecbca00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d849a180 0x5614d84ab0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:41.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.118+0000 7fecbca00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d849a180 0x5614d84ab0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:42106/0 (socket says 172.21.15.103:42106) 2024-09-11T01:15:41.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.118+0000 7fecc1e36740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fec9800e290 con 0x5614d84a6a30 2024-09-11T01:15:41.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.118+0000 7fecc1e36740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fec9800f700 con 0x5614d849aaa0 2024-09-11T01:15:41.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.118+0000 7fecc1e36740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fec9800e960 con 0x5614d849a180 2024-09-11T01:15:41.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.118+0000 7fecc1e36740 10 client.0 _ll_register_callbacks cb 0x7fecb0009820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:15:41.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.118+0000 7fecb7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849aaa0 0x5614d84ab5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:41052/0 (socket says 172.21.15.103:41052) 2024-09-11T01:15:41.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.118+0000 7fecb7e00640 1 -- 172.21.15.103:0/2280901969 learned_addr learned my addr 172.21.15.103:0/2280901969 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:15:41.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.119+0000 7fecb7e00640 1 -- 172.21.15.103:0/2280901969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d849a180 msgr2=0x5614d84ab0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:41.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.119+0000 7fecb7e00640 1 --2- 172.21.15.103:0/2280901969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d849a180 0x5614d84ab0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.119+0000 7fecb7e00640 1 -- 172.21.15.103:0/2280901969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d84a6a30 msgr2=0x5614d85223b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:15:41.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.119+0000 7fecb7e00640 1 --2- 172.21.15.103:0/2280901969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d84a6a30 0x5614d85223b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:15:41.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.119+0000 7fecb7e00640 1 -- 172.21.15.103:0/2280901969 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614d8522a20 con 0x5614d849aaa0 2024-09-11T01:15:41.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.120+0000 7fecb7e00640 1 --2- 172.21.15.103:0/2280901969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849aaa0 0x5614d84ab5f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feca400be90 tx=0x7feca40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8de50e3cba817014 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:15:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.122+0000 7feca2000640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:15:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.122+0000 7feca2000640 1 -- 172.21.15.103:0/2280901969 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feca401e040 con 0x5614d849aaa0 2024-09-11T01:15:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.122+0000 7feca2000640 1 -- 172.21.15.103:0/2280901969 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7feca40b02d0 con 0x5614d849aaa0 2024-09-11T01:15:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.122+0000 7fecc1e36740 1 -- 172.21.15.103:0/2280901969 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecb0025ab0 con 0x5614d849aaa0 2024-09-11T01:15:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.122+0000 7feca2000640 1 -- 172.21.15.103:0/2280901969 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7feca40aba80 con 0x5614d849aaa0 2024-09-11T01:15:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.122+0000 7fecc1e36740 10 client.25895 fetch_fsmap learned FSMap version 31 2024-09-11T01:15:41.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.122+0000 7fecc1e36740 1 -- 172.21.15.103:0/2280901969 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5614d8523d70 con 0x5614d849aaa0 2024-09-11T01:15:41.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.123+0000 7feca2000640 1 -- 172.21.15.103:0/2280901969 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fecb0025ab0 con 0x5614d849aaa0 2024-09-11T01:15:41.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.123+0000 7feca2000640 1 -- 172.21.15.103:0/2280901969 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7feca40e5040 con 0x5614d849aaa0 2024-09-11T01:15:41.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.123+0000 7fecc1e36740 10 client.25895 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:15:41.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.123+0000 7fecc1e36740 10 client.25895 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:15:41.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.123+0000 7fecc1e36740 20 client.25895 populate_metadata read hostname 'smithi103' 2024-09-11T01:15:41.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.123+0000 7fecc1e36740 1 --2- 172.21.15.103:0/2280901969 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5614d8524540 0x5614d8526980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:15:41.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.123+0000 7fecc1e36740 4 client.25895 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-11T01:15:41.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.123+0000 7fecc1e36740 1 -- 172.21.15.103:0/2280901969 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x5614d840d6a0 con 0x5614d8524540 2024-09-11T01:15:41.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.123+0000 7fecbca00640 1 --2- 172.21.15.103:0/2280901969 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5614d8524540 0x5614d8526980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:15:41.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.124+0000 7fecbca00640 1 --2- 172.21.15.103:0/2280901969 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5614d8524540 0x5614d8526980 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7e727e8f24194c6 server_cookie=5f4866eb9799ec8e in_seq=0 out_seq=0 2024-09-11T01:15:41.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:15:41.124+0000 7feca2000640 10 client.25895 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:15:42.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:42 smithi117 ceph-mon[35358]: pgmap v621: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 37 MiB/s wr, 5.98k op/s 2024-09-11T01:15:42.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:42 smithi183 ceph-mon[34992]: pgmap v621: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 37 MiB/s wr, 5.98k op/s 2024-09-11T01:15:42.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:42 smithi103 ceph-mon[30562]: pgmap v621: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 37 MiB/s wr, 5.98k op/s 2024-09-11T01:15:44.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:44 smithi117 ceph-mon[35358]: pgmap v622: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 32 MiB/s wr, 5.04k op/s 2024-09-11T01:15:44.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:44 smithi183 ceph-mon[34992]: pgmap v622: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 32 MiB/s wr, 5.04k op/s 2024-09-11T01:15:44.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:44 smithi103 ceph-mon[30562]: pgmap v622: 129 pgs: 129 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 32 MiB/s wr, 5.04k op/s 2024-09-11T01:15:46.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:46 smithi183 ceph-mon[34992]: pgmap v623: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 41 MiB/s wr, 6.80k op/s 2024-09-11T01:15:46.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:46 smithi103 ceph-mon[30562]: pgmap v623: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 41 MiB/s wr, 6.80k op/s 2024-09-11T01:15:46.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:46 smithi117 ceph-mon[35358]: pgmap v623: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 41 MiB/s wr, 6.80k op/s 2024-09-11T01:15:48.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:48 smithi183 ceph-mon[34992]: pgmap v624: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 MiB/s wr, 5.77k op/s 2024-09-11T01:15:48.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:48 smithi103 ceph-mon[30562]: pgmap v624: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 MiB/s wr, 5.77k op/s 2024-09-11T01:15:48.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:48 smithi117 ceph-mon[35358]: pgmap v624: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 34 MiB/s wr, 5.77k op/s 2024-09-11T01:15:50.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:50 smithi183 ceph-mon[34992]: pgmap v625: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 MiB/s wr, 5.97k op/s 2024-09-11T01:15:50.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:50 smithi103 ceph-mon[30562]: pgmap v625: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 MiB/s wr, 5.97k op/s 2024-09-11T01:15:50.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:50 smithi117 ceph-mon[35358]: pgmap v625: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 MiB/s wr, 5.97k op/s 2024-09-11T01:15:52.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:52 smithi183 ceph-mon[34992]: pgmap v626: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 44 MiB/s wr, 8.05k op/s 2024-09-11T01:15:52.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:52 smithi103 ceph-mon[30562]: pgmap v626: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 44 MiB/s wr, 8.05k op/s 2024-09-11T01:15:52.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:52 smithi117 ceph-mon[35358]: pgmap v626: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 44 MiB/s wr, 8.05k op/s 2024-09-11T01:15:54.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:54 smithi183 ceph-mon[34992]: pgmap v627: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 42 MiB/s wr, 7.86k op/s 2024-09-11T01:15:54.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:54 smithi103 ceph-mon[30562]: pgmap v627: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 42 MiB/s wr, 7.86k op/s 2024-09-11T01:15:54.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:54 smithi117 ceph-mon[35358]: pgmap v627: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 42 MiB/s wr, 7.86k op/s 2024-09-11T01:15:56.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:56 smithi183 ceph-mon[34992]: pgmap v628: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 49 MiB/s wr, 9.16k op/s 2024-09-11T01:15:56.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:56 smithi103 ceph-mon[30562]: pgmap v628: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 49 MiB/s wr, 9.16k op/s 2024-09-11T01:15:56.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:56 smithi117 ceph-mon[35358]: pgmap v628: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 49 MiB/s wr, 9.16k op/s 2024-09-11T01:15:58.674 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:58 smithi117 ceph-mon[35358]: pgmap v629: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 42 MiB/s wr, 7.89k op/s 2024-09-11T01:15:58.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:58 smithi103 ceph-mon[30562]: pgmap v629: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 42 MiB/s wr, 7.89k op/s 2024-09-11T01:15:58.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:58 smithi183 ceph-mon[34992]: pgmap v629: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 42 MiB/s wr, 7.89k op/s 2024-09-11T01:15:59.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:59 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:15:59.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:59 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:15:59.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:59 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:15:59.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:15:59 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:15:59.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:59 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:15:59.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:59 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:15:59.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:59 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:15:59.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:15:59 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:15:59.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:59 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:15:59.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:59 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:15:59.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:59 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:15:59.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:15:59 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:16:00.835 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:00 smithi103 ceph-mon[30562]: pgmap v630: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 40 MiB/s wr, 7.61k op/s 2024-09-11T01:16:00.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:00 smithi117 ceph-mon[35358]: pgmap v630: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 40 MiB/s wr, 7.61k op/s 2024-09-11T01:16:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:00 smithi183 ceph-mon[34992]: pgmap v630: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 40 MiB/s wr, 7.61k op/s 2024-09-11T01:16:02.720 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:02 smithi183 ceph-mon[34992]: pgmap v631: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 46 MiB/s wr, 8.70k op/s 2024-09-11T01:16:02.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:02 smithi103 ceph-mon[30562]: pgmap v631: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 46 MiB/s wr, 8.70k op/s 2024-09-11T01:16:02.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:02 smithi117 ceph-mon[35358]: pgmap v631: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 46 MiB/s wr, 8.70k op/s 2024-09-11T01:16:04.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:04 smithi103 ceph-mon[30562]: pgmap v632: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 32 MiB/s wr, 6.06k op/s 2024-09-11T01:16:04.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:04 smithi117 ceph-mon[35358]: pgmap v632: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 32 MiB/s wr, 6.06k op/s 2024-09-11T01:16:04.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:04 smithi183 ceph-mon[34992]: pgmap v632: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 32 MiB/s wr, 6.06k op/s 2024-09-11T01:16:05.595 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.593+0000 7f4ad4c00640 1 -- 172.21.15.103:0/3809541410 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5599fdb0f0b0 con 0x5599fdc328d0 2024-09-11T01:16:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.594+0000 7f4ad4c00640 10 client.25880 handle_command_reply: tid=0 2024-09-11T01:16:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.594+0000 7f4af464f740 1 client.25880 shutdown 2024-09-11T01:16:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.594+0000 7f4af464f740 1 -- 172.21.15.103:0/3809541410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba3b00 msgr2=0x5599fdbad210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:05.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.595+0000 7f4af464f740 1 --2- 172.21.15.103:0/3809541410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba3b00 0x5599fdbad210 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4ae401dc10 tx=0x7f4ae4009500 comp rx=0 tx=0).stop 2024-09-11T01:16:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.595+0000 7f4af464f740 1 -- 172.21.15.103:0/3809541410 shutdown_connections 2024-09-11T01:16:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.595+0000 7f4af464f740 1 --2- 172.21.15.103:0/3809541410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5599fdba3b00 0x5599fdbad210 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.595+0000 7f4af464f740 1 --2- 172.21.15.103:0/3809541410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599fdba10c0 0x5599fdbac690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.595+0000 7f4af464f740 1 --2- 172.21.15.103:0/3809541410 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5599fdc328d0 0x5599fdc34d30 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.595+0000 7f4af464f740 1 --2- 172.21.15.103:0/3809541410 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5599fdb9e790 0x5599fdbac010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.595+0000 7f4af464f740 1 -- 172.21.15.103:0/3809541410 >> 172.21.15.103:0/3809541410 conn(0x5599fdb998e0 msgr2=0x5599fdb98240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:05.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.595+0000 7f4ad4c00640 0 client.25880 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:16:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.595+0000 7f4af464f740 1 -- 172.21.15.103:0/3809541410 shutdown_connections 2024-09-11T01:16:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.596+0000 7f4af464f740 1 -- 172.21.15.103:0/3809541410 wait complete. 2024-09-11T01:16:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.596+0000 7f4af464f740 20 client.25880 trim_cache size 0 max 16384 2024-09-11T01:16:05.598 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:16:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:16:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:16:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:16:05.599 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.597+0000 7f4af1800640 1 -- 172.21.15.103:0/2023332267 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4ad00b5430 msgr2=0x7f4ad00b78f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.597+0000 7f4af1800640 1 --2- 172.21.15.103:0/2023332267 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4ad00b5430 0x7f4ad00b78f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4005c40 tx=0x7f4ae4005bd0 comp rx=0 tx=0).stop 2024-09-11T01:16:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.598+0000 7f4af1800640 1 -- 172.21.15.103:0/2023332267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec074290 msgr2=0x7f4aec1a7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.598+0000 7f4af1800640 1 --2- 172.21.15.103:0/2023332267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec074290 0x7f4aec1a7b90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4adc005ab0 tx=0x7f4adc003b90 comp rx=0 tx=0).stop 2024-09-11T01:16:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.598+0000 7f4af1800640 1 -- 172.21.15.103:0/2023332267 shutdown_connections 2024-09-11T01:16:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.598+0000 7f4af1800640 1 --2- 172.21.15.103:0/2023332267 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f4ad00b5430 0x7f4ad00b78f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.598+0000 7f4af1800640 1 --2- 172.21.15.103:0/2023332267 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4aec10ab10 0x7f4aec1a8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.598+0000 7f4af1800640 1 --2- 172.21.15.103:0/2023332267 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4aec10a150 0x7f4aec1a81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.598+0000 7f4af1800640 1 --2- 172.21.15.103:0/2023332267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4aec074290 0x7f4aec1a7b90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.598+0000 7f4af1800640 1 -- 172.21.15.103:0/2023332267 >> 172.21.15.103:0/2023332267 conn(0x7f4aec06fa40 msgr2=0x7f4aec10f490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:05.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.598+0000 7f4af1800640 1 -- 172.21.15.103:0/2023332267 shutdown_connections 2024-09-11T01:16:05.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:05.599+0000 7f4af1800640 1 -- 172.21.15.103:0/2023332267 wait complete. 2024-09-11T01:16:06.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:06 smithi103 ceph-mon[30562]: pgmap v633: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 39 MiB/s wr, 7.32k op/s 2024-09-11T01:16:06.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:06 smithi117 ceph-mon[35358]: pgmap v633: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 39 MiB/s wr, 7.32k op/s 2024-09-11T01:16:06.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:06 smithi183 ceph-mon[34992]: pgmap v633: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 39 MiB/s wr, 7.32k op/s 2024-09-11T01:16:08.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:08 smithi103 ceph-mon[30562]: pgmap v634: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 33 MiB/s wr, 6.03k op/s 2024-09-11T01:16:08.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:08 smithi117 ceph-mon[35358]: pgmap v634: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 33 MiB/s wr, 6.03k op/s 2024-09-11T01:16:08.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:08 smithi183 ceph-mon[34992]: pgmap v634: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 33 MiB/s wr, 6.03k op/s 2024-09-11T01:16:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:10 smithi103 ceph-mon[30562]: pgmap v635: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 29 MiB/s wr, 5.41k op/s 2024-09-11T01:16:10.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:10 smithi117 ceph-mon[35358]: pgmap v635: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 29 MiB/s wr, 5.41k op/s 2024-09-11T01:16:10.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:10 smithi183 ceph-mon[34992]: pgmap v635: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 29 MiB/s wr, 5.41k op/s 2024-09-11T01:16:12.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:12 smithi103 ceph-mon[30562]: pgmap v636: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 35 MiB/s wr, 6.35k op/s 2024-09-11T01:16:12.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:12 smithi117 ceph-mon[35358]: pgmap v636: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 35 MiB/s wr, 6.35k op/s 2024-09-11T01:16:12.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:12 smithi183 ceph-mon[34992]: pgmap v636: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 35 MiB/s wr, 6.35k op/s 2024-09-11T01:16:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:14 smithi103 ceph-mon[30562]: pgmap v637: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 27 MiB/s wr, 5.04k op/s 2024-09-11T01:16:14.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:14 smithi117 ceph-mon[35358]: pgmap v637: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 27 MiB/s wr, 5.04k op/s 2024-09-11T01:16:14.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:14 smithi183 ceph-mon[34992]: pgmap v637: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 27 MiB/s wr, 5.04k op/s 2024-09-11T01:16:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:16 smithi103 ceph-mon[30562]: pgmap v638: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 31 MiB/s wr, 5.63k op/s 2024-09-11T01:16:16.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:16 smithi117 ceph-mon[35358]: pgmap v638: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 31 MiB/s wr, 5.63k op/s 2024-09-11T01:16:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:16 smithi183 ceph-mon[34992]: pgmap v638: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 31 MiB/s wr, 5.63k op/s 2024-09-11T01:16:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.796+0000 7f5982000640 1 -- 172.21.15.103:0/1252292794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c105cf0 msgr2=0x7f597c106170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.796+0000 7f5982000640 1 --2- 172.21.15.103:0/1252292794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c105cf0 0x7f597c106170 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5968009860 tx=0x7f596802a340 comp rx=0 tx=0).stop 2024-09-11T01:16:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.798+0000 7f5982000640 1 -- 172.21.15.103:0/1252292794 shutdown_connections 2024-09-11T01:16:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.798+0000 7f5982000640 1 --2- 172.21.15.103:0/1252292794 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f597c1066b0 0x7f597c10d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.798+0000 7f5982000640 1 --2- 172.21.15.103:0/1252292794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c105cf0 0x7f597c106170 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.798+0000 7f5982000640 1 --2- 172.21.15.103:0/1252292794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f597c104ba0 0x7f597c104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.798+0000 7f5982000640 1 -- 172.21.15.103:0/1252292794 >> 172.21.15.103:0/1252292794 conn(0x7f597c100460 msgr2=0x7f597c102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:18.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.798+0000 7f5982000640 1 -- 172.21.15.103:0/1252292794 shutdown_connections 2024-09-11T01:16:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.798+0000 7f5982000640 1 -- 172.21.15.103:0/1252292794 wait complete. 2024-09-11T01:16:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.799+0000 7f5982000640 1 Processor -- start 2024-09-11T01:16:18.803 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.800+0000 7f5982000640 1 -- start start 2024-09-11T01:16:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.800+0000 7f5982000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c104ba0 0x7f597c19f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.800+0000 7f5982000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f597c105cf0 0x7f597c19fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.800+0000 7f5982000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f597c1066b0 0x7f597c1a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.800+0000 7f5982000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f597c077920 con 0x7f597c1066b0 2024-09-11T01:16:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.800+0000 7f5982000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f597c0777a0 con 0x7f597c104ba0 2024-09-11T01:16:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.800+0000 7f5982000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f597c077aa0 con 0x7f597c105cf0 2024-09-11T01:16:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.801+0000 7f597aa00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f597c105cf0 0x7f597c19fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.801+0000 7f597b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c104ba0 0x7f597c19f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.801+0000 7f597b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c104ba0 0x7f597c19f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38890/0 (socket says 172.21.15.103:38890) 2024-09-11T01:16:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.801+0000 7f597aa00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f597c105cf0 0x7f597c19fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:58584/0 (socket says 172.21.15.103:58584) 2024-09-11T01:16:18.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.801+0000 7f597b400640 1 -- 172.21.15.103:0/1486584846 learned_addr learned my addr 172.21.15.103:0/1486584846 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.802+0000 7f597aa00640 1 -- 172.21.15.103:0/1486584846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c104ba0 msgr2=0x7f597c19f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.802+0000 7f597aa00640 1 --2- 172.21.15.103:0/1486584846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c104ba0 0x7f597c19f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.802+0000 7f597aa00640 1 -- 172.21.15.103:0/1486584846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f597c1066b0 msgr2=0x7f597c1a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.802+0000 7f597aa00640 1 --2- 172.21.15.103:0/1486584846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f597c1066b0 0x7f597c1a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.802+0000 7f597aa00640 1 -- 172.21.15.103:0/1486584846 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f597c1a0ef0 con 0x7f597c105cf0 2024-09-11T01:16:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.802+0000 7f597aa00640 1 --2- 172.21.15.103:0/1486584846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f597c105cf0 0x7f597c19fa00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f596802a860 tx=0x7f5968030df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.802+0000 7f5973e00640 1 -- 172.21.15.103:0/1486584846 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968037040 con 0x7f597c105cf0 2024-09-11T01:16:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.802+0000 7f5982000640 1 -- 172.21.15.103:0/1486584846 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f597c1a1180 con 0x7f597c105cf0 2024-09-11T01:16:18.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.803+0000 7f5982000640 1 -- 172.21.15.103:0/1486584846 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f597c1a78b0 con 0x7f597c105cf0 2024-09-11T01:16:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.803+0000 7f5973e00640 1 -- 172.21.15.103:0/1486584846 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5968032880 con 0x7f597c105cf0 2024-09-11T01:16:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.803+0000 7f5973e00640 1 -- 172.21.15.103:0/1486584846 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5968003850 con 0x7f597c105cf0 2024-09-11T01:16:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.807+0000 7f598503c740 1 Processor -- start 2024-09-11T01:16:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.809+0000 7f5973e00640 1 -- 172.21.15.103:0/1486584846 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f5968003ab0 con 0x7f597c105cf0 2024-09-11T01:16:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.810+0000 7f598503c740 1 -- start start 2024-09-11T01:16:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.810+0000 7f598503c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad4790 0x56227aad6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.810+0000 7f598503c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad70c0 0x56227aad94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.810+0000 7f598503c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aadbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.810+0000 7f598503c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56227aa476b0 con 0x56227aad70c0 2024-09-11T01:16:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.810+0000 7f598503c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56227aa36ae0 con 0x56227aad4790 2024-09-11T01:16:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.810+0000 7f598503c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56227aa3a8f0 con 0x56227aad9b00 2024-09-11T01:16:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.810+0000 7f597be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad4790 0x56227aad6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.810+0000 7f597be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad4790 0x56227aad6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38896/0 (socket says 172.21.15.103:38896) 2024-09-11T01:16:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.810+0000 7f597be00640 1 -- 172.21.15.103:0/968267246 learned_addr learned my addr 172.21.15.103:0/968267246 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.811+0000 7f597b400640 1 --2- 172.21.15.103:0/968267246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad70c0 0x56227aad94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.811+0000 7f597aa00640 1 --2- 172.21.15.103:0/968267246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aadbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.811+0000 7f597be00640 1 -- 172.21.15.103:0/968267246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 msgr2=0x56227aadbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.811+0000 7f597be00640 1 --2- 172.21.15.103:0/968267246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aadbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.811+0000 7f597be00640 1 -- 172.21.15.103:0/968267246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad70c0 msgr2=0x56227aad94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.811+0000 7f597be00640 1 --2- 172.21.15.103:0/968267246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad70c0 0x56227aad94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.811+0000 7f597be00640 1 -- 172.21.15.103:0/968267246 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56227aa03780 con 0x56227aad4790 2024-09-11T01:16:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.811+0000 7f597aa00640 1 --2- 172.21.15.103:0/968267246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aadbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:16:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.811+0000 7f5973e00640 1 --2- 172.21.15.103:0/1486584846 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f59600b52e0 0x7f59600b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.811+0000 7f597be00640 1 --2- 172.21.15.103:0/968267246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad4790 0x56227aad6b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5974009cd0 tx=0x7f597400e6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e9560e307c32fc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.811+0000 7f5973e00640 1 -- 172.21.15.103:0/1486584846 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5968105900 con 0x7f597c105cf0 2024-09-11T01:16:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.812+0000 7f5967e00640 1 -- 172.21.15.103:0/968267246 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5974016070 con 0x56227aad4790 2024-09-11T01:16:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.812+0000 7f5967e00640 1 -- 172.21.15.103:0/968267246 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5974005020 con 0x56227aad4790 2024-09-11T01:16:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.812+0000 7f5967e00640 1 -- 172.21.15.103:0/968267246 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59740116d0 con 0x56227aad4790 2024-09-11T01:16:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.812+0000 7f597b400640 1 --2- 172.21.15.103:0/1486584846 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f59600b52e0 0x7f59600b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.813+0000 7f598503c740 1 -- 172.21.15.103:0/968267246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad4790 msgr2=0x56227aad6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.813+0000 7f598503c740 1 --2- 172.21.15.103:0/968267246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad4790 0x56227aad6b80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5974009cd0 tx=0x7f597400e6c0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.813+0000 7f598503c740 1 -- 172.21.15.103:0/968267246 shutdown_connections 2024-09-11T01:16:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.813+0000 7f598503c740 1 --2- 172.21.15.103:0/968267246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aadbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.813+0000 7f598503c740 1 --2- 172.21.15.103:0/968267246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad70c0 0x56227aad94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.813+0000 7f598503c740 1 --2- 172.21.15.103:0/968267246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad4790 0x56227aad6b80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.813+0000 7f598503c740 1 -- 172.21.15.103:0/968267246 >> 172.21.15.103:0/968267246 conn(0x56227aacf8e0 msgr2=0x56227aad0670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.816+0000 7f597b400640 1 --2- 172.21.15.103:0/1486584846 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f59600b52e0 0x7f59600b77a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f596c005fd0 tx=0x7f596c00b3a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.816+0000 7f598503c740 1 -- 172.21.15.103:0/968267246 shutdown_connections 2024-09-11T01:16:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.816+0000 7f598503c740 1 -- 172.21.15.103:0/968267246 wait complete. 2024-09-11T01:16:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.817+0000 7f598503c740 1 -- start start 2024-09-11T01:16:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.817+0000 7f598503c740 1 Processor -- start 2024-09-11T01:16:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.818+0000 7f598503c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad4790 0x56227aaeef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.818+0000 7f598503c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad70c0 0x56227aaef600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.820 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.818+0000 7f598503c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aaf01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.818+0000 7f598503c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56227a96eab0 con 0x56227aad70c0 2024-09-11T01:16:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.818+0000 7f598503c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x56227a9dd570 con 0x56227aad4790 2024-09-11T01:16:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.818+0000 7f598503c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x56227aaedaf0 con 0x56227aad9b00 2024-09-11T01:16:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.818+0000 7f598503c740 10 client.0 _ll_register_callbacks cb 0x56227a9ec100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:16:18.821 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.818+0000 7f597b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad4790 0x56227aaeef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.819+0000 7f597b400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad4790 0x56227aaeef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38908/0 (socket says 172.21.15.103:38908) 2024-09-11T01:16:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.819+0000 7f597b400640 1 -- 172.21.15.103:0/3927048114 learned_addr learned my addr 172.21.15.103:0/3927048114 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.819+0000 7f597aa00640 1 --2- 172.21.15.103:0/3927048114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad70c0 0x56227aaef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.819+0000 7f597be00640 1 --2- 172.21.15.103:0/3927048114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aaf01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.819+0000 7f597be00640 1 -- 172.21.15.103:0/3927048114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad4790 msgr2=0x56227aaeef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.820+0000 7f597be00640 1 --2- 172.21.15.103:0/3927048114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad4790 0x56227aaeef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.820+0000 7f597be00640 1 -- 172.21.15.103:0/3927048114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad70c0 msgr2=0x56227aaef600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:18.822 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.820+0000 7f597be00640 1 --2- 172.21.15.103:0/3927048114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad70c0 0x56227aaef600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.823 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.820+0000 7f597be00640 1 -- 172.21.15.103:0/3927048114 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56227a798790 con 0x56227aad9b00 2024-09-11T01:16:18.823 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.820+0000 7f597be00640 1 --2- 172.21.15.103:0/3927048114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aaf01d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5974009ca0 tx=0x7f59740097e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea454ea7af4c355b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:18.823 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.820+0000 7f5964c00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:16:18.823 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.822+0000 7f5964c00640 1 -- 172.21.15.103:0/3927048114 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5974016040 con 0x56227aad9b00 2024-09-11T01:16:18.823 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.822+0000 7f5964c00640 1 -- 172.21.15.103:0/3927048114 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5974003b80 con 0x56227aad9b00 2024-09-11T01:16:18.824 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.823+0000 7f598503c740 1 -- 172.21.15.103:0/3927048114 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5974005020 con 0x56227aad9b00 2024-09-11T01:16:18.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.824+0000 7f5964c00640 1 -- 172.21.15.103:0/3927048114 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5974003d80 con 0x56227aad9b00 2024-09-11T01:16:18.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.824+0000 7f598503c740 10 client.25852 fetch_fsmap learned FSMap version 31 2024-09-11T01:16:18.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.824+0000 7f598503c740 1 -- 172.21.15.103:0/3927048114 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56227a811620 con 0x56227aad9b00 2024-09-11T01:16:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.825+0000 7f5964c00640 1 -- 172.21.15.103:0/3927048114 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5974005020 con 0x56227aad9b00 2024-09-11T01:16:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.825+0000 7f5964c00640 1 -- 172.21.15.103:0/3927048114 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f597400f040 con 0x56227aad9b00 2024-09-11T01:16:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.825+0000 7f598503c740 10 client.25852 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:16:18.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.825+0000 7f598503c740 10 client.25852 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:16:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.826+0000 7f598503c740 20 client.25852 populate_metadata read hostname 'smithi103' 2024-09-11T01:16:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.826+0000 7f598503c740 1 --2- 172.21.15.103:0/3927048114 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56227aafa550 0x56227aafc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.826+0000 7f598503c740 4 client.25852 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:16:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.826+0000 7f598503c740 1 -- 172.21.15.103:0/3927048114 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56227aa49600 con 0x56227aafa550 2024-09-11T01:16:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.826+0000 7f597b400640 1 --2- 172.21.15.103:0/3927048114 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56227aafa550 0x56227aafc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.827+0000 7f597b400640 1 --2- 172.21.15.103:0/3927048114 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56227aafa550 0x56227aafc960 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53d07b996984a371 server_cookie=2854fc7fa5c6e806 in_seq=0 out_seq=0 2024-09-11T01:16:18.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.827+0000 7f5964c00640 10 client.25852 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:16:18.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.828+0000 7f5964c00640 1 -- 172.21.15.103:0/3927048114 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56227aa49600 con 0x56227aafa550 2024-09-11T01:16:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.828+0000 7f5964c00640 10 client.25852 handle_command_reply: tid=0 2024-09-11T01:16:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.828+0000 7f598503c740 1 client.25852 shutdown 2024-09-11T01:16:18.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.829+0000 7f598503c740 1 -- 172.21.15.103:0/3927048114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 msgr2=0x56227aaf01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.829+0000 7f598503c740 1 --2- 172.21.15.103:0/3927048114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aaf01d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5974009ca0 tx=0x7f59740097e0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.829+0000 7f598503c740 1 -- 172.21.15.103:0/3927048114 shutdown_connections 2024-09-11T01:16:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.829+0000 7f598503c740 1 --2- 172.21.15.103:0/3927048114 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56227aafa550 0x56227aafc960 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.829+0000 7f5964c00640 0 client.25852 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:16:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.829+0000 7f598503c740 1 --2- 172.21.15.103:0/3927048114 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aaf01d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.829+0000 7f598503c740 1 --2- 172.21.15.103:0/3927048114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad70c0 0x56227aaef600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.829+0000 7f598503c740 1 --2- 172.21.15.103:0/3927048114 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad4790 0x56227aaeef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.829+0000 7f598503c740 1 -- 172.21.15.103:0/3927048114 >> 172.21.15.103:0/3927048114 conn(0x56227aacf8e0 msgr2=0x56227aacea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.829+0000 7f598503c740 1 -- 172.21.15.103:0/3927048114 shutdown_connections 2024-09-11T01:16:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.830+0000 7f598503c740 1 -- 172.21.15.103:0/3927048114 wait complete. 2024-09-11T01:16:18.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.830+0000 7f598503c740 20 client.25852 trim_cache size 0 max 16384 2024-09-11T01:16:18.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:18 smithi103 ceph-mon[30562]: pgmap v639: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 24 MiB/s wr, 4.41k op/s 2024-09-11T01:16:18.858 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.856+0000 7f598503c740 1 Processor -- start 2024-09-11T01:16:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.856+0000 7f598503c740 1 -- start start 2024-09-11T01:16:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.856+0000 7f598503c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad4790 0x56227aad9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.856+0000 7f598503c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad70c0 0x56227aada420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.856+0000 7f598503c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad9b00 0x56227aad1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.856+0000 7f598503c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f595c0125e0 con 0x56227aad9b00 2024-09-11T01:16:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.856+0000 7f598503c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f595c00feb0 con 0x56227aad70c0 2024-09-11T01:16:18.859 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.856+0000 7f598503c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f595c00dd00 con 0x56227aad4790 2024-09-11T01:16:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.857+0000 7f597aa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad70c0 0x56227aada420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.857+0000 7f597be00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad9b00 0x56227aad1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.857+0000 7f597b400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad4790 0x56227aad9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.857+0000 7f597aa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad70c0 0x56227aada420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38920/0 (socket says 172.21.15.103:38920) 2024-09-11T01:16:18.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.857+0000 7f597aa00640 1 -- 172.21.15.103:0/2453948972 learned_addr learned my addr 172.21.15.103:0/2453948972 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.858+0000 7f597aa00640 1 -- 172.21.15.103:0/2453948972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad4790 msgr2=0x56227aad9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.858+0000 7f597aa00640 1 --2- 172.21.15.103:0/2453948972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad4790 0x56227aad9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.858+0000 7f597aa00640 1 -- 172.21.15.103:0/2453948972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad9b00 msgr2=0x56227aad1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.858+0000 7f597aa00640 1 --2- 172.21.15.103:0/2453948972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad9b00 0x56227aad1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.858+0000 7f597aa00640 1 -- 172.21.15.103:0/2453948972 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56227aad6ef0 con 0x56227aad70c0 2024-09-11T01:16:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.858+0000 7f597aa00640 1 --2- 172.21.15.103:0/2453948972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad70c0 0x56227aada420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5968031000 tx=0x7f5968005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86de69054c0a4054 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.859+0000 7f5967400640 1 -- 172.21.15.103:0/2453948972 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59680c7420 con 0x56227aad70c0 2024-09-11T01:16:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.859+0000 7f5967400640 1 -- 172.21.15.103:0/2453948972 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59680cb7c0 con 0x56227aad70c0 2024-09-11T01:16:18.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.859+0000 7f5967400640 1 -- 172.21.15.103:0/2453948972 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59680d4db0 con 0x56227aad70c0 2024-09-11T01:16:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.862+0000 7f598503c740 1 -- 172.21.15.103:0/2453948972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad70c0 msgr2=0x56227aada420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.862+0000 7f598503c740 1 --2- 172.21.15.103:0/2453948972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad70c0 0x56227aada420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5968031000 tx=0x7f5968005f90 comp rx=0 tx=0).stop 2024-09-11T01:16:18.864 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.863+0000 7f598503c740 1 -- 172.21.15.103:0/2453948972 shutdown_connections 2024-09-11T01:16:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.863+0000 7f598503c740 1 --2- 172.21.15.103:0/2453948972 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad9b00 0x56227aad1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.863+0000 7f598503c740 1 --2- 172.21.15.103:0/2453948972 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad70c0 0x56227aada420 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.863+0000 7f598503c740 1 --2- 172.21.15.103:0/2453948972 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad4790 0x56227aad9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.863+0000 7f598503c740 1 -- 172.21.15.103:0/2453948972 >> 172.21.15.103:0/2453948972 conn(0x56227aacf8e0 msgr2=0x56227aad0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.863+0000 7f598503c740 1 -- 172.21.15.103:0/2453948972 shutdown_connections 2024-09-11T01:16:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.863+0000 7f598503c740 1 -- 172.21.15.103:0/2453948972 wait complete. 2024-09-11T01:16:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.864+0000 7f598503c740 1 -- start start 2024-09-11T01:16:18.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.864+0000 7f598503c740 1 Processor -- start 2024-09-11T01:16:18.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.866+0000 7f598503c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad4790 0x56227aaf6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.867+0000 7f598503c740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad70c0 0x56227aaf5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.867+0000 7f598503c740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aaf5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.867+0000 7f598503c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f595c00e370 con 0x56227aad4790 2024-09-11T01:16:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.867+0000 7f598503c740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f595c00f7e0 con 0x56227aad70c0 2024-09-11T01:16:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.867+0000 7f598503c740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f595c00ea40 con 0x56227aad9b00 2024-09-11T01:16:18.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.867+0000 7f597be00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aaf5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.867+0000 7f597be00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aaf5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:58604/0 (socket says 172.21.15.103:58604) 2024-09-11T01:16:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.867+0000 7f597be00640 1 -- 172.21.15.103:0/3374478582 learned_addr learned my addr 172.21.15.103:0/3374478582 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.867+0000 7f597b400640 1 --2- 172.21.15.103:0/3374478582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad4790 0x56227aaf6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.868+0000 7f597be00640 1 -- 172.21.15.103:0/3374478582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad70c0 msgr2=0x56227aaf5820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-11T01:16:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.868+0000 7f597be00640 1 --2- 172.21.15.103:0/3374478582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad70c0 0x56227aaf5820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.868+0000 7f597be00640 1 -- 172.21.15.103:0/3374478582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad4790 msgr2=0x56227aaf6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.868+0000 7f597be00640 1 --2- 172.21.15.103:0/3374478582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad4790 0x56227aaf6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.868+0000 7f597be00640 1 -- 172.21.15.103:0/3374478582 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56227aaf4340 con 0x56227aad9b00 2024-09-11T01:16:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.868+0000 7f597b400640 1 --2- 172.21.15.103:0/3374478582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad4790 0x56227aaf6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:16:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.868+0000 7f598503c740 10 client.0 _ll_register_callbacks cb 0x7f5974009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:16:18.870 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.868+0000 7f598503c740 1 -- 172.21.15.103:0/3374478582 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59680cb7c0 con 0x56227aad9b00 2024-09-11T01:16:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.868+0000 7f597be00640 1 --2- 172.21.15.103:0/3374478582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aaf5ef0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5974002230 tx=0x7f597400ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=216e8c5abbc78740 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:18.871 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.868+0000 7f5964c00640 10 client.25858 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:16:18.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:18 smithi117 ceph-mon[35358]: pgmap v639: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 24 MiB/s wr, 4.41k op/s 2024-09-11T01:16:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.872+0000 7f5964c00640 1 -- 172.21.15.103:0/3374478582 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597403a050 con 0x56227aad9b00 2024-09-11T01:16:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.872+0000 7f5964c00640 1 -- 172.21.15.103:0/3374478582 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5974004800 con 0x56227aad9b00 2024-09-11T01:16:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.872+0000 7f5964c00640 1 -- 172.21.15.103:0/3374478582 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5974016070 con 0x56227aad9b00 2024-09-11T01:16:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.872+0000 7f598503c740 10 client.25858 fetch_fsmap learned FSMap version 31 2024-09-11T01:16:18.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.872+0000 7f598503c740 1 -- 172.21.15.103:0/3374478582 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({fsmap=31}) -- 0x56227ab675a0 con 0x56227aad9b00 2024-09-11T01:16:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.873+0000 7f5964c00640 1 -- 172.21.15.103:0/3374478582 <== mon.1 v2:172.21.15.183:3300/0 4 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f5974011470 con 0x56227aad9b00 2024-09-11T01:16:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.873+0000 7f598503c740 10 client.25858 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:16:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.873+0000 7f598503c740 10 client.25858 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:16:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.873+0000 7f598503c740 20 client.25858 populate_metadata read hostname 'smithi103' 2024-09-11T01:16:18.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.873+0000 7f598503c740 1 --2- 172.21.15.103:0/3374478582 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56227ab67e70 0x56227ab6a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:18.876 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.873+0000 7f598503c740 4 client.25858 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:16:18.876 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.873+0000 7f598503c740 1 -- 172.21.15.103:0/3374478582 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56227aa450b0 con 0x56227ab67e70 2024-09-11T01:16:18.876 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.873+0000 7f597b400640 1 --2- 172.21.15.103:0/3374478582 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56227ab67e70 0x56227ab6a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:18.876 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.874+0000 7f5964c00640 10 client.25858 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:16:18.876 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:18.874+0000 7f597b400640 1 --2- 172.21.15.103:0/3374478582 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56227ab67e70 0x56227ab6a290 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c532a8576cccca8f server_cookie=98057c3fc02d11fb in_seq=0 out_seq=0 2024-09-11T01:16:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:18 smithi183 ceph-mon[34992]: pgmap v639: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 24 MiB/s wr, 4.41k op/s 2024-09-11T01:16:20.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:20 smithi103 ceph-mon[30562]: pgmap v640: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 21 MiB/s wr, 3.78k op/s 2024-09-11T01:16:20.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:20 smithi117 ceph-mon[35358]: pgmap v640: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 21 MiB/s wr, 3.78k op/s 2024-09-11T01:16:20.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:20 smithi183 ceph-mon[34992]: pgmap v640: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 21 MiB/s wr, 3.78k op/s 2024-09-11T01:16:22.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:22 smithi103 ceph-mon[30562]: pgmap v641: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 29 MiB/s wr, 5.21k op/s 2024-09-11T01:16:22.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:22 smithi117 ceph-mon[35358]: pgmap v641: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 29 MiB/s wr, 5.21k op/s 2024-09-11T01:16:22.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:22 smithi183 ceph-mon[34992]: pgmap v641: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 29 MiB/s wr, 5.21k op/s 2024-09-11T01:16:24.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:24 smithi103 ceph-mon[30562]: pgmap v642: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 3.72k op/s 2024-09-11T01:16:24.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:24 smithi117 ceph-mon[35358]: pgmap v642: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 3.72k op/s 2024-09-11T01:16:24.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:24 smithi183 ceph-mon[34992]: pgmap v642: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 20 MiB/s wr, 3.72k op/s 2024-09-11T01:16:26.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.124+0000 7feca2000640 1 -- 172.21.15.103:0/2280901969 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: -115 ) ==== 8+0+595 (crc 0 0 0) 0x5614d840d6a0 con 0x5614d8524540 2024-09-11T01:16:26.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.124+0000 7feca2000640 10 client.25895 handle_command_reply: tid=0 2024-09-11T01:16:26.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.124+0000 7fecc1e36740 1 client.25895 shutdown 2024-09-11T01:16:26.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.125+0000 7fecc1e36740 1 -- 172.21.15.103:0/2280901969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849aaa0 msgr2=0x5614d84ab5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:26.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.125+0000 7fecc1e36740 1 --2- 172.21.15.103:0/2280901969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849aaa0 0x5614d84ab5f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feca400be90 tx=0x7feca40046c0 comp rx=0 tx=0).stop 2024-09-11T01:16:26.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.125+0000 7fecc1e36740 1 -- 172.21.15.103:0/2280901969 shutdown_connections 2024-09-11T01:16:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.125+0000 7fecc1e36740 1 --2- 172.21.15.103:0/2280901969 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5614d84a6a30 0x5614d85223b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.125+0000 7fecc1e36740 1 --2- 172.21.15.103:0/2280901969 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5614d849aaa0 0x5614d84ab5f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.125+0000 7fecc1e36740 1 --2- 172.21.15.103:0/2280901969 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5614d8524540 0x5614d8526980 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.125+0000 7fecc1e36740 1 --2- 172.21.15.103:0/2280901969 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5614d849a180 0x5614d84ab0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.125+0000 7feca2000640 0 client.25895 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:16:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.125+0000 7fecc1e36740 1 -- 172.21.15.103:0/2280901969 >> 172.21.15.103:0/2280901969 conn(0x5614d8497fb0 msgr2=0x5614d84970b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.125+0000 7fecc1e36740 1 -- 172.21.15.103:0/2280901969 shutdown_connections 2024-09-11T01:16:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.125+0000 7fecc1e36740 1 -- 172.21.15.103:0/2280901969 wait complete. 2024-09-11T01:16:26.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:26.125+0000 7fecc1e36740 20 client.25895 trim_cache size 0 max 16384 2024-09-11T01:16:26.128 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:16:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 31, 2024-09-11T01:16:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24665, 2024-09-11T01:16:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 13, 2024-09-11T01:16:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-09-11T01:16:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "286870a3": { 2024-09-11T01:16:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 13, 2024-09-11T01:16:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-09-11T01:16:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:16:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCING", 2024-09-11T01:16:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 45.0 2024-09-11T01:16:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:16:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-09-11T01:16:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 150.0, 2024-09-11T01:16:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-09-11T01:16:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-09-11T01:16:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-09-11T01:16:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:16:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCING", 2024-09-11T01:16:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 45.0 2024-09-11T01:16:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:16:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:16:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:16:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:16:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:16:26.130 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:16:26.131 INFO:teuthology.orchestra.run.smithi103.stderr:Error EINPROGRESS: 2024-09-11T01:16:26.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:26 smithi103 ceph-mon[30562]: pgmap v643: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 26 MiB/s wr, 4.70k op/s 2024-09-11T01:16:26.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:26 smithi117 ceph-mon[35358]: pgmap v643: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 26 MiB/s wr, 4.70k op/s 2024-09-11T01:16:26.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:26 smithi183 ceph-mon[34992]: pgmap v643: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 26 MiB/s wr, 4.70k op/s 2024-09-11T01:16:27.406 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.403+0000 7f5964c00640 1 -- 172.21.15.103:0/3374478582 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56227aa450b0 con 0x56227ab67e70 2024-09-11T01:16:27.406 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.403+0000 7f5964c00640 10 client.25858 handle_command_reply: tid=0 2024-09-11T01:16:27.406 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.404+0000 7f598503c740 1 client.25858 shutdown 2024-09-11T01:16:27.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.405+0000 7f598503c740 1 -- 172.21.15.103:0/3374478582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 msgr2=0x56227aaf5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:27.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.405+0000 7f598503c740 1 --2- 172.21.15.103:0/3374478582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aaf5ef0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5974002230 tx=0x7f597400ecf0 comp rx=0 tx=0).stop 2024-09-11T01:16:27.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.405+0000 7f598503c740 1 -- 172.21.15.103:0/3374478582 shutdown_connections 2024-09-11T01:16:27.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.405+0000 7f598503c740 1 --2- 172.21.15.103:0/3374478582 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x56227ab67e70 0x56227ab6a290 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:27.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.405+0000 7f598503c740 1 --2- 172.21.15.103:0/3374478582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56227aad9b00 0x56227aaf5ef0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:27.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.405+0000 7f598503c740 1 --2- 172.21.15.103:0/3374478582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56227aad70c0 0x56227aaf5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:27.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.405+0000 7f598503c740 1 --2- 172.21.15.103:0/3374478582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56227aad4790 0x56227aaf6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:27.407 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.405+0000 7f598503c740 1 -- 172.21.15.103:0/3374478582 >> 172.21.15.103:0/3374478582 conn(0x56227aacf8e0 msgr2=0x56227aad3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:27.408 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.405+0000 7f5964c00640 0 client.25858 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:16:27.408 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.405+0000 7f598503c740 1 -- 172.21.15.103:0/3374478582 shutdown_connections 2024-09-11T01:16:27.408 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.405+0000 7f598503c740 1 -- 172.21.15.103:0/3374478582 wait complete. 2024-09-11T01:16:27.408 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.406+0000 7f598503c740 20 client.25858 trim_cache size 0 max 16384 2024-09-11T01:16:27.408 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:16:27.408 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:16:27.408 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:16:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:16:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.407+0000 7f5982000640 1 -- 172.21.15.103:0/1486584846 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f59600b52e0 msgr2=0x7f59600b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.407+0000 7f5982000640 1 --2- 172.21.15.103:0/1486584846 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f59600b52e0 0x7f59600b77a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f596c005fd0 tx=0x7f596c00b3a0 comp rx=0 tx=0).stop 2024-09-11T01:16:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.407+0000 7f5982000640 1 -- 172.21.15.103:0/1486584846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f597c105cf0 msgr2=0x7f597c19fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.407+0000 7f5982000640 1 --2- 172.21.15.103:0/1486584846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f597c105cf0 0x7f597c19fa00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f596802a860 tx=0x7f5968030df0 comp rx=0 tx=0).stop 2024-09-11T01:16:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.407+0000 7f5982000640 1 -- 172.21.15.103:0/1486584846 shutdown_connections 2024-09-11T01:16:27.409 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.407+0000 7f5982000640 1 --2- 172.21.15.103:0/1486584846 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f59600b52e0 0x7f59600b77a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.407+0000 7f5982000640 1 --2- 172.21.15.103:0/1486584846 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f597c1066b0 0x7f597c1a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.407+0000 7f5982000640 1 --2- 172.21.15.103:0/1486584846 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f597c105cf0 0x7f597c19fa00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.407+0000 7f5982000640 1 --2- 172.21.15.103:0/1486584846 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f597c104ba0 0x7f597c19f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.407+0000 7f5982000640 1 -- 172.21.15.103:0/1486584846 >> 172.21.15.103:0/1486584846 conn(0x7f597c100460 msgr2=0x7f597c0782f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.408+0000 7f5982000640 1 -- 172.21.15.103:0/1486584846 shutdown_connections 2024-09-11T01:16:27.410 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:27.408+0000 7f5982000640 1 -- 172.21.15.103:0/1486584846 wait complete. 2024-09-11T01:16:28.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:28 smithi117 ceph-mon[35358]: pgmap v644: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 23 MiB/s wr, 4.24k op/s 2024-09-11T01:16:28.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:28 smithi183 ceph-mon[34992]: pgmap v644: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 23 MiB/s wr, 4.24k op/s 2024-09-11T01:16:29.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:28 smithi103 ceph-mon[30562]: pgmap v644: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 23 MiB/s wr, 4.24k op/s 2024-09-11T01:16:30.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:30 smithi117 ceph-mon[35358]: pgmap v645: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 MiB/s wr, 3.85k op/s 2024-09-11T01:16:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:30 smithi183 ceph-mon[34992]: pgmap v645: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 MiB/s wr, 3.85k op/s 2024-09-11T01:16:31.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:30 smithi103 ceph-mon[30562]: pgmap v645: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 21 MiB/s wr, 3.85k op/s 2024-09-11T01:16:32.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:32 smithi117 ceph-mon[35358]: pgmap v646: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 4.87k op/s 2024-09-11T01:16:32.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:32 smithi183 ceph-mon[34992]: pgmap v646: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 4.87k op/s 2024-09-11T01:16:33.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:32 smithi103 ceph-mon[30562]: pgmap v646: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 26 MiB/s wr, 4.87k op/s 2024-09-11T01:16:34.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:34 smithi117 ceph-mon[35358]: pgmap v647: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 4.54k op/s 2024-09-11T01:16:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:34 smithi183 ceph-mon[34992]: pgmap v647: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 4.54k op/s 2024-09-11T01:16:35.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:34 smithi103 ceph-mon[30562]: pgmap v647: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 23 MiB/s wr, 4.54k op/s 2024-09-11T01:16:36.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:36 smithi117 ceph-mon[35358]: pgmap v648: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 28 MiB/s wr, 5.56k op/s 2024-09-11T01:16:36.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:36 smithi183 ceph-mon[34992]: pgmap v648: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 28 MiB/s wr, 5.56k op/s 2024-09-11T01:16:37.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:36 smithi103 ceph-mon[30562]: pgmap v648: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 28 MiB/s wr, 5.56k op/s 2024-09-11T01:16:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:38 smithi117 ceph-mon[35358]: pgmap v649: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 MiB/s wr, 4.15k op/s 2024-09-11T01:16:38.884 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:38 smithi103 ceph-mon[30562]: pgmap v649: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 MiB/s wr, 4.15k op/s 2024-09-11T01:16:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:38 smithi183 ceph-mon[34992]: pgmap v649: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 20 MiB/s wr, 4.15k op/s 2024-09-11T01:16:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.538+0000 7f4864a00640 1 -- 172.21.15.103:0/1788340763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48601049b0 msgr2=0x7f4860104db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:40.541 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.538+0000 7f4864a00640 1 --2- 172.21.15.103:0/1788340763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48601049b0 0x7f4860104db0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4850009930 tx=0x7f485002a420 comp rx=0 tx=0).stop 2024-09-11T01:16:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.538+0000 7f4864a00640 1 -- 172.21.15.103:0/1788340763 shutdown_connections 2024-09-11T01:16:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.538+0000 7f4864a00640 1 --2- 172.21.15.103:0/1788340763 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f48601064c0 0x7f486010ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.538+0000 7f4864a00640 1 --2- 172.21.15.103:0/1788340763 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4860105b00 0x7f4860105f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.538+0000 7f4864a00640 1 --2- 172.21.15.103:0/1788340763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48601049b0 0x7f4860104db0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.538+0000 7f4864a00640 1 -- 172.21.15.103:0/1788340763 >> 172.21.15.103:0/1788340763 conn(0x7f4860100250 msgr2=0x7f4860102690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.539+0000 7f4864a00640 1 -- 172.21.15.103:0/1788340763 shutdown_connections 2024-09-11T01:16:40.542 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.539+0000 7f4864a00640 1 -- 172.21.15.103:0/1788340763 wait complete. 2024-09-11T01:16:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.539+0000 7f4864a00640 1 Processor -- start 2024-09-11T01:16:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.540+0000 7f4864a00640 1 -- start start 2024-09-11T01:16:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.540+0000 7f4864a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48601049b0 0x7f486019ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.540+0000 7f4864a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4860105b00 0x7f486019b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.544 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.540+0000 7f4864a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48601064c0 0x7f486019c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.540+0000 7f4864a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4860110650 con 0x7f48601064c0 2024-09-11T01:16:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.540+0000 7f4864a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48601104d0 con 0x7f48601049b0 2024-09-11T01:16:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.540+0000 7f4864a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f48601107d0 con 0x7f4860105b00 2024-09-11T01:16:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.540+0000 7f485f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48601064c0 0x7f486019c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.540+0000 7f485e800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48601049b0 0x7f486019ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.540+0000 7f485e800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48601049b0 0x7f486019ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:51208/0 (socket says 172.21.15.103:51208) 2024-09-11T01:16:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.540+0000 7f485e800640 1 -- 172.21.15.103:0/4053363841 learned_addr learned my addr 172.21.15.103:0/4053363841 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.540+0000 7f485de00640 1 --2- 172.21.15.103:0/4053363841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4860105b00 0x7f486019b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.541+0000 7f485e800640 1 -- 172.21.15.103:0/4053363841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4860105b00 msgr2=0x7f486019b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.541+0000 7f485e800640 1 --2- 172.21.15.103:0/4053363841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4860105b00 0x7f486019b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.541+0000 7f485e800640 1 -- 172.21.15.103:0/4053363841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48601064c0 msgr2=0x7f486019c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.541+0000 7f485e800640 1 --2- 172.21.15.103:0/4053363841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48601064c0 0x7f486019c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.541+0000 7f485e800640 1 -- 172.21.15.103:0/4053363841 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f486019c920 con 0x7f48601049b0 2024-09-11T01:16:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.541+0000 7f485e800640 1 --2- 172.21.15.103:0/4053363841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48601049b0 0x7f486019ade0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4850031500 tx=0x7f4850003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.541+0000 7f4857400640 1 -- 172.21.15.103:0/4053363841 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f485003f070 con 0x7f48601049b0 2024-09-11T01:16:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.541+0000 7f4864a00640 1 -- 172.21.15.103:0/4053363841 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f486019cbb0 con 0x7f48601049b0 2024-09-11T01:16:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.541+0000 7f4857400640 1 -- 172.21.15.103:0/4053363841 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4850031c50 con 0x7f48601049b0 2024-09-11T01:16:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.541+0000 7f4857400640 1 -- 172.21.15.103:0/4053363841 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4850035030 con 0x7f48601049b0 2024-09-11T01:16:40.546 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.542+0000 7f4864a00640 1 -- 172.21.15.103:0/4053363841 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48601a32e0 con 0x7f48601049b0 2024-09-11T01:16:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.545+0000 7f4868471740 1 Processor -- start 2024-09-11T01:16:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.545+0000 7f4868471740 1 -- start start 2024-09-11T01:16:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.545+0000 7f4857400640 1 -- 172.21.15.103:0/4053363841 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f485003b460 con 0x7f48601049b0 2024-09-11T01:16:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.545+0000 7f4868471740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc2970 0x55cbe2cc4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.545+0000 7f4868471740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cc7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.545+0000 7f4868471740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2cca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.545+0000 7f4868471740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cbe2c356b0 con 0x55cbe2cc2970 2024-09-11T01:16:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.545+0000 7f4868471740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cbe2c24ae0 con 0x55cbe2cc52a0 2024-09-11T01:16:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.545+0000 7f4868471740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cbe2c288f0 con 0x55cbe2cc7ce0 2024-09-11T01:16:40.549 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.545+0000 7f485f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc2970 0x55cbe2cc4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.545+0000 7f485f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc2970 0x55cbe2cc4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34706/0 (socket says 172.21.15.103:34706) 2024-09-11T01:16:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.545+0000 7f485f200640 1 -- 172.21.15.103:0/1365998791 learned_addr learned my addr 172.21.15.103:0/1365998791 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.545+0000 7f485de00640 1 --2- 172.21.15.103:0/1365998791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2cca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.546+0000 7f485e800640 1 --2- 172.21.15.103:0/1365998791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cc7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.546+0000 7f485f200640 1 -- 172.21.15.103:0/1365998791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc7ce0 msgr2=0x55cbe2cca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.546+0000 7f485f200640 1 --2- 172.21.15.103:0/1365998791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2cca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.546+0000 7f485f200640 1 -- 172.21.15.103:0/1365998791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 msgr2=0x55cbe2cc7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.546+0000 7f485f200640 1 --2- 172.21.15.103:0/1365998791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cc7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.546+0000 7f485f200640 1 -- 172.21.15.103:0/1365998791 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbe2bf1780 con 0x55cbe2cc2970 2024-09-11T01:16:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.546+0000 7f485e800640 1 --2- 172.21.15.103:0/1365998791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cc7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:16:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.546+0000 7f485f200640 1 --2- 172.21.15.103:0/1365998791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc2970 0x55cbe2cc4d60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4858009fc0 tx=0x7f4858010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681ccd42555dce1d server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.546+0000 7f484b400640 1 -- 172.21.15.103:0/1365998791 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858016070 con 0x55cbe2cc2970 2024-09-11T01:16:40.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.546+0000 7f484b400640 1 -- 172.21.15.103:0/1365998791 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4858004d20 con 0x55cbe2cc2970 2024-09-11T01:16:40.551 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.546+0000 7f484b400640 1 -- 172.21.15.103:0/1365998791 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858005380 con 0x55cbe2cc2970 2024-09-11T01:16:40.554 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.547+0000 7f4857400640 1 --2- 172.21.15.103:0/4053363841 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f48440b52e0 0x7f48440b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.547+0000 7f4868471740 1 -- 172.21.15.103:0/1365998791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc2970 msgr2=0x55cbe2cc4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.547+0000 7f4868471740 1 --2- 172.21.15.103:0/1365998791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc2970 0x55cbe2cc4d60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4858009fc0 tx=0x7f4858010800 comp rx=0 tx=0).stop 2024-09-11T01:16:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.547+0000 7f4857400640 1 -- 172.21.15.103:0/4053363841 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f4850106a80 con 0x7f48601049b0 2024-09-11T01:16:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.547+0000 7f4868471740 1 -- 172.21.15.103:0/1365998791 shutdown_connections 2024-09-11T01:16:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.547+0000 7f4868471740 1 --2- 172.21.15.103:0/1365998791 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2cca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.547+0000 7f4868471740 1 --2- 172.21.15.103:0/1365998791 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cc7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.547+0000 7f4868471740 1 --2- 172.21.15.103:0/1365998791 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc2970 0x55cbe2cc4d60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.547+0000 7f4868471740 1 -- 172.21.15.103:0/1365998791 >> 172.21.15.103:0/1365998791 conn(0x55cbe2cbdac0 msgr2=0x55cbe2cbe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.547+0000 7f485e800640 1 --2- 172.21.15.103:0/4053363841 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f48440b52e0 0x7f48440b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.547+0000 7f4868471740 1 -- 172.21.15.103:0/1365998791 shutdown_connections 2024-09-11T01:16:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.547+0000 7f4868471740 1 -- 172.21.15.103:0/1365998791 wait complete. 2024-09-11T01:16:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.548+0000 7f4868471740 1 -- start start 2024-09-11T01:16:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.548+0000 7f485e800640 1 --2- 172.21.15.103:0/4053363841 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f48440b52e0 0x7f48440b77a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f48500cce70 tx=0x7f485002a420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.548+0000 7f4868471740 1 Processor -- start 2024-09-11T01:16:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.548+0000 7f4868471740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 0x55cbe2ccc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.548+0000 7f4868471740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc52a0 0x55cbe2ccc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.548+0000 7f4868471740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2ccd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.548+0000 7f4868471740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cbe2b5cab0 con 0x55cbe2cc52a0 2024-09-11T01:16:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.548+0000 7f4868471740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cbe2bcb570 con 0x55cbe2cc7ce0 2024-09-11T01:16:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.548+0000 7f4868471740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cbe2ccacc0 con 0x55cbe2cc2970 2024-09-11T01:16:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.549+0000 7f4868471740 10 client.0 _ll_register_callbacks cb 0x55cbe2bda100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:16:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.549+0000 7f485de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc52a0 0x55cbe2ccc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.549+0000 7f485de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc52a0 0x55cbe2ccc770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34720/0 (socket says 172.21.15.103:34720) 2024-09-11T01:16:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.549+0000 7f485de00640 1 -- 172.21.15.103:0/3846428741 learned_addr learned my addr 172.21.15.103:0/3846428741 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.549+0000 7f485f200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 0x55cbe2ccc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.549+0000 7f485f200640 1 --2- 172.21.15.103:0/3846428741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2ccd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.549+0000 7f485de00640 1 -- 172.21.15.103:0/3846428741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 msgr2=0x55cbe2ccc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.549+0000 7f485de00640 1 --2- 172.21.15.103:0/3846428741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 0x55cbe2ccc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.549+0000 7f485de00640 1 -- 172.21.15.103:0/3846428741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc7ce0 msgr2=0x55cbe2ccd340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.549+0000 7f485de00640 1 --2- 172.21.15.103:0/3846428741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2ccd340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.549+0000 7f485de00640 1 -- 172.21.15.103:0/3846428741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbe2986790 con 0x55cbe2cc52a0 2024-09-11T01:16:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.549+0000 7f485de00640 1 --2- 172.21.15.103:0/3846428741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc52a0 0x55cbe2ccc770 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f484c012740 tx=0x7f484c012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501d101887a4895b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:40.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.549+0000 7f483fe00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:16:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.550+0000 7f483fe00640 1 -- 172.21.15.103:0/3846428741 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c00f920 con 0x55cbe2cc52a0 2024-09-11T01:16:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.550+0000 7f4868471740 1 -- 172.21.15.103:0/3846428741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4858004d20 con 0x55cbe2cc52a0 2024-09-11T01:16:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.550+0000 7f483fe00640 1 -- 172.21.15.103:0/3846428741 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f484c00fac0 con 0x55cbe2cc52a0 2024-09-11T01:16:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.550+0000 7f483fe00640 1 -- 172.21.15.103:0/3846428741 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f484c00fcc0 con 0x55cbe2cc52a0 2024-09-11T01:16:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.550+0000 7f4868471740 10 client.15837 fetch_fsmap learned FSMap version 31 2024-09-11T01:16:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.550+0000 7f4868471740 1 -- 172.21.15.103:0/3846428741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cbe29ff620 con 0x55cbe2cc52a0 2024-09-11T01:16:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.550+0000 7f483fe00640 1 -- 172.21.15.103:0/3846428741 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4858004d20 con 0x55cbe2cc52a0 2024-09-11T01:16:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.551+0000 7f483fe00640 1 -- 172.21.15.103:0/3846428741 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f484c01c420 con 0x55cbe2cc52a0 2024-09-11T01:16:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.551+0000 7f4868471740 10 client.15837 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:16:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.551+0000 7f4868471740 10 client.15837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:16:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.551+0000 7f4868471740 20 client.15837 populate_metadata read hostname 'smithi103' 2024-09-11T01:16:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.551+0000 7f4868471740 1 --2- 172.21.15.103:0/3846428741 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cbe2cd79c0 0x55cbe2cd9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.551+0000 7f4868471740 4 client.15837 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:16:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.551+0000 7f4868471740 1 -- 172.21.15.103:0/3846428741 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbe2c37600 con 0x55cbe2cd79c0 2024-09-11T01:16:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.551+0000 7f485f200640 1 --2- 172.21.15.103:0/3846428741 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cbe2cd79c0 0x55cbe2cd9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.552+0000 7f485f200640 1 --2- 172.21.15.103:0/3846428741 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cbe2cd79c0 0x55cbe2cd9e00 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb95207108b80144 server_cookie=2342718ab14f5900 in_seq=0 out_seq=0 2024-09-11T01:16:40.559 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.552+0000 7f483fe00640 10 client.15837 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:16:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.552+0000 7f483fe00640 1 -- 172.21.15.103:0/3846428741 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cbe2c37600 con 0x55cbe2cd79c0 2024-09-11T01:16:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.552+0000 7f483fe00640 10 client.15837 handle_command_reply: tid=0 2024-09-11T01:16:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.552+0000 7f4868471740 1 client.15837 shutdown 2024-09-11T01:16:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.553+0000 7f4868471740 1 -- 172.21.15.103:0/3846428741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc52a0 msgr2=0x55cbe2ccc770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.553+0000 7f4868471740 1 --2- 172.21.15.103:0/3846428741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc52a0 0x55cbe2ccc770 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f484c012740 tx=0x7f484c012c00 comp rx=0 tx=0).stop 2024-09-11T01:16:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.553+0000 7f4868471740 1 -- 172.21.15.103:0/3846428741 shutdown_connections 2024-09-11T01:16:40.560 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.553+0000 7f4868471740 1 --2- 172.21.15.103:0/3846428741 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2ccd340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.553+0000 7f4868471740 1 --2- 172.21.15.103:0/3846428741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc52a0 0x55cbe2ccc770 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.553+0000 7f4868471740 1 --2- 172.21.15.103:0/3846428741 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cbe2cd79c0 0x55cbe2cd9e00 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.553+0000 7f4868471740 1 --2- 172.21.15.103:0/3846428741 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 0x55cbe2ccc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.553+0000 7f483fe00640 0 client.15837 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:16:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.553+0000 7f4868471740 1 -- 172.21.15.103:0/3846428741 >> 172.21.15.103:0/3846428741 conn(0x55cbe2cbdac0 msgr2=0x55cbe2cbcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.553+0000 7f4868471740 1 -- 172.21.15.103:0/3846428741 shutdown_connections 2024-09-11T01:16:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.553+0000 7f4868471740 1 -- 172.21.15.103:0/3846428741 wait complete. 2024-09-11T01:16:40.561 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.553+0000 7f4868471740 20 client.15837 trim_cache size 0 max 16384 2024-09-11T01:16:40.572 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f4868471740 1 Processor -- start 2024-09-11T01:16:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f4868471740 1 -- start start 2024-09-11T01:16:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f4868471740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 0x55cbe2cc80c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f4868471740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cc8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f4868471740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2ccb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f4868471740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f48601b0010 con 0x55cbe2cc7ce0 2024-09-11T01:16:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f4868471740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48601ad8e0 con 0x55cbe2cc52a0 2024-09-11T01:16:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f4868471740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f48601ab730 con 0x55cbe2cc2970 2024-09-11T01:16:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f485f200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 0x55cbe2cc80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f485de00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cc8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f485f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2ccb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f485de00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cc8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:51238/0 (socket says 172.21.15.103:51238) 2024-09-11T01:16:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f485de00640 1 -- 172.21.15.103:0/1786454004 learned_addr learned my addr 172.21.15.103:0/1786454004 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:40.573 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f485de00640 1 -- 172.21.15.103:0/1786454004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 msgr2=0x55cbe2cc80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.569+0000 7f485de00640 1 --2- 172.21.15.103:0/1786454004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 0x55cbe2cc80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.570+0000 7f485de00640 1 -- 172.21.15.103:0/1786454004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc7ce0 msgr2=0x55cbe2ccb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.570+0000 7f485de00640 1 --2- 172.21.15.103:0/1786454004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2ccb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.570+0000 7f485de00640 1 -- 172.21.15.103:0/1786454004 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbe2cb9460 con 0x55cbe2cc52a0 2024-09-11T01:16:40.574 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.570+0000 7f485de00640 1 --2- 172.21.15.103:0/1786454004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cc8600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f484c000c00 tx=0x7f484c01dee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c77e49d6ca4d789f server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.570+0000 7f484aa00640 1 -- 172.21.15.103:0/1786454004 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c00f920 con 0x55cbe2cc52a0 2024-09-11T01:16:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.570+0000 7f484aa00640 1 -- 172.21.15.103:0/1786454004 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f484c012e50 con 0x55cbe2cc52a0 2024-09-11T01:16:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.570+0000 7f484aa00640 1 -- 172.21.15.103:0/1786454004 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f484c01c6a0 con 0x55cbe2cc52a0 2024-09-11T01:16:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.571+0000 7f4868471740 1 -- 172.21.15.103:0/1786454004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 msgr2=0x55cbe2cc8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.571+0000 7f4868471740 1 --2- 172.21.15.103:0/1786454004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cc8600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f484c000c00 tx=0x7f484c01dee0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.571+0000 7f4868471740 1 -- 172.21.15.103:0/1786454004 shutdown_connections 2024-09-11T01:16:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.571+0000 7f4868471740 1 --2- 172.21.15.103:0/1786454004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2ccb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.571+0000 7f4868471740 1 --2- 172.21.15.103:0/1786454004 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cc8600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.571+0000 7f4868471740 1 --2- 172.21.15.103:0/1786454004 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 0x55cbe2cc80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.571+0000 7f4868471740 1 -- 172.21.15.103:0/1786454004 >> 172.21.15.103:0/1786454004 conn(0x55cbe2cbdac0 msgr2=0x55cbe2cc1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.571+0000 7f4868471740 1 -- 172.21.15.103:0/1786454004 shutdown_connections 2024-09-11T01:16:40.578 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.571+0000 7f4868471740 1 -- 172.21.15.103:0/1786454004 wait complete. 2024-09-11T01:16:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.571+0000 7f4868471740 1 -- start start 2024-09-11T01:16:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.571+0000 7f4868471740 1 Processor -- start 2024-09-11T01:16:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.572+0000 7f4868471740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 0x55cbe2cd3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.572+0000 7f4868471740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cd28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.572+0000 7f4868471740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2cd2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.572+0000 7f4868471740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f48601abda0 con 0x55cbe2cc7ce0 2024-09-11T01:16:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.572+0000 7f4868471740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f48601ad210 con 0x55cbe2cc52a0 2024-09-11T01:16:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.572+0000 7f4868471740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f48601ac470 con 0x55cbe2cc2970 2024-09-11T01:16:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.572+0000 7f4868471740 10 client.0 _ll_register_callbacks cb 0x7f484c009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:16:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.572+0000 7f485f200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 0x55cbe2cd3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.572+0000 7f485f200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2cd2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.572+0000 7f485de00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cd28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.579 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.572+0000 7f485f200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 0x55cbe2cd3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:52724/0 (socket says 172.21.15.103:52724) 2024-09-11T01:16:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.572+0000 7f485f200640 1 -- 172.21.15.103:0/4273041330 learned_addr learned my addr 172.21.15.103:0/4273041330 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.573+0000 7f485f200640 1 -- 172.21.15.103:0/4273041330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 msgr2=0x55cbe2cd28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.573+0000 7f485f200640 1 --2- 172.21.15.103:0/4273041330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cd28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.573+0000 7f485f200640 1 -- 172.21.15.103:0/4273041330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc7ce0 msgr2=0x55cbe2cd2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.573+0000 7f485f200640 1 --2- 172.21.15.103:0/4273041330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2cd2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.573+0000 7f485f200640 1 -- 172.21.15.103:0/4273041330 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbe2cd14e0 con 0x55cbe2cc2970 2024-09-11T01:16:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.573+0000 7f485de00640 1 --2- 172.21.15.103:0/4273041330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cd28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:16:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.573+0000 7f485f200640 1 --2- 172.21.15.103:0/4273041330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 0x55cbe2cd3be0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4858009ee0 tx=0x7f485801c040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f8d5103cf4fcf5b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.573+0000 7f483fe00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:16:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.573+0000 7f483fe00640 1 -- 172.21.15.103:0/4273041330 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4858016040 con 0x55cbe2cc2970 2024-09-11T01:16:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.573+0000 7f4868471740 1 -- 172.21.15.103:0/4273041330 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f484c012e50 con 0x55cbe2cc2970 2024-09-11T01:16:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.573+0000 7f483fe00640 1 -- 172.21.15.103:0/4273041330 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f48580055a0 con 0x55cbe2cc2970 2024-09-11T01:16:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.573+0000 7f483fe00640 1 -- 172.21.15.103:0/4273041330 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4858023040 con 0x55cbe2cc2970 2024-09-11T01:16:40.580 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.573+0000 7f4868471740 10 client.25876 fetch_fsmap learned FSMap version 31 2024-09-11T01:16:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.573+0000 7f4868471740 1 -- 172.21.15.103:0/4273041330 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cbe2d44ac0 con 0x55cbe2cc2970 2024-09-11T01:16:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.574+0000 7f483fe00640 1 -- 172.21.15.103:0/4273041330 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f484c012e50 con 0x55cbe2cc2970 2024-09-11T01:16:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.574+0000 7f483fe00640 1 -- 172.21.15.103:0/4273041330 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f4858029040 con 0x55cbe2cc2970 2024-09-11T01:16:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.574+0000 7f4868471740 10 client.25876 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:16:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.574+0000 7f4868471740 10 client.25876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:16:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.574+0000 7f4868471740 20 client.25876 populate_metadata read hostname 'smithi103' 2024-09-11T01:16:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.574+0000 7f4868471740 1 --2- 172.21.15.103:0/4273041330 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cbe2d452c0 0x55cbe2d476e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.574+0000 7f4868471740 4 client.25876 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:16:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.574+0000 7f4868471740 1 -- 172.21.15.103:0/4273041330 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cbe2c330b0 con 0x55cbe2d452c0 2024-09-11T01:16:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.574+0000 7f485de00640 1 --2- 172.21.15.103:0/4273041330 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cbe2d452c0 0x55cbe2d476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.574+0000 7f485de00640 1 --2- 172.21.15.103:0/4273041330 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cbe2d452c0 0x55cbe2d476e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db8ae32f886c378 server_cookie=dcf8e6fcbe29af49 in_seq=0 out_seq=0 2024-09-11T01:16:40.581 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.575+0000 7f483fe00640 10 client.25876 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:16:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f483fe00640 1 -- 172.21.15.103:0/4273041330 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cbe2c330b0 con 0x55cbe2d452c0 2024-09-11T01:16:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f483fe00640 10 client.25876 handle_command_reply: tid=0 2024-09-11T01:16:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f4868471740 1 client.25876 shutdown 2024-09-11T01:16:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f4868471740 1 -- 172.21.15.103:0/4273041330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 msgr2=0x55cbe2cd3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f4868471740 1 --2- 172.21.15.103:0/4273041330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 0x55cbe2cd3be0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4858009ee0 tx=0x7f485801c040 comp rx=0 tx=0).stop 2024-09-11T01:16:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f4868471740 1 -- 172.21.15.103:0/4273041330 shutdown_connections 2024-09-11T01:16:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f4868471740 1 --2- 172.21.15.103:0/4273041330 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cbe2cc7ce0 0x55cbe2cd2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f4868471740 1 --2- 172.21.15.103:0/4273041330 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cbe2cc52a0 0x55cbe2cd28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f4868471740 1 --2- 172.21.15.103:0/4273041330 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cbe2d452c0 0x55cbe2d476e0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f4868471740 1 --2- 172.21.15.103:0/4273041330 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cbe2cc2970 0x55cbe2cd3be0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f483fe00640 0 client.25876 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:16:40.586 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f4868471740 1 -- 172.21.15.103:0/4273041330 >> 172.21.15.103:0/4273041330 conn(0x55cbe2cbdac0 msgr2=0x55cbe2ccb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f4868471740 1 -- 172.21.15.103:0/4273041330 shutdown_connections 2024-09-11T01:16:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f4868471740 1 -- 172.21.15.103:0/4273041330 wait complete. 2024-09-11T01:16:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.583+0000 7f4868471740 20 client.25876 trim_cache size 0 max 16384 2024-09-11T01:16:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:16:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:16:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:16:40.587 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:16:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.584+0000 7f4864a00640 1 -- 172.21.15.103:0/4053363841 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f48440b52e0 msgr2=0x7f48440b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.584+0000 7f4864a00640 1 --2- 172.21.15.103:0/4053363841 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f48440b52e0 0x7f48440b77a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f48500cce70 tx=0x7f485002a420 comp rx=0 tx=0).stop 2024-09-11T01:16:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.584+0000 7f4864a00640 1 -- 172.21.15.103:0/4053363841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48601049b0 msgr2=0x7f486019ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.584+0000 7f4864a00640 1 --2- 172.21.15.103:0/4053363841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48601049b0 0x7f486019ade0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4850031500 tx=0x7f4850003c10 comp rx=0 tx=0).stop 2024-09-11T01:16:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.584+0000 7f4864a00640 1 -- 172.21.15.103:0/4053363841 shutdown_connections 2024-09-11T01:16:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.584+0000 7f4864a00640 1 --2- 172.21.15.103:0/4053363841 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f48440b52e0 0x7f48440b77a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.584+0000 7f4864a00640 1 --2- 172.21.15.103:0/4053363841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f48601064c0 0x7f486019c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.584+0000 7f4864a00640 1 --2- 172.21.15.103:0/4053363841 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f4860105b00 0x7f486019b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.588 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.584+0000 7f4864a00640 1 --2- 172.21.15.103:0/4053363841 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f48601049b0 0x7f486019ade0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.584+0000 7f4864a00640 1 -- 172.21.15.103:0/4053363841 >> 172.21.15.103:0/4053363841 conn(0x7f4860100250 msgr2=0x7f4860108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.584+0000 7f4864a00640 1 -- 172.21.15.103:0/4053363841 shutdown_connections 2024-09-11T01:16:40.589 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:40.584+0000 7f4864a00640 1 -- 172.21.15.103:0/4053363841 wait complete. 2024-09-11T01:16:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:40 smithi117 ceph-mon[35358]: pgmap v650: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 3.84k op/s 2024-09-11T01:16:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:40 smithi183 ceph-mon[34992]: pgmap v650: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 3.84k op/s 2024-09-11T01:16:41.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:40 smithi103 ceph-mon[30562]: pgmap v650: 129 pgs: 129 active+clean; 13 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 19 MiB/s wr, 3.84k op/s 2024-09-11T01:16:42.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:42 smithi117 ceph-mon[35358]: pgmap v651: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 3.82k op/s 2024-09-11T01:16:42.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:42 smithi183 ceph-mon[34992]: pgmap v651: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 3.82k op/s 2024-09-11T01:16:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:42 smithi103 ceph-mon[30562]: pgmap v651: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 19 MiB/s wr, 3.82k op/s 2024-09-11T01:16:44.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:44 smithi183 ceph-mon[34992]: pgmap v652: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 2.72k op/s 2024-09-11T01:16:45.084 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:44 smithi103 ceph-mon[30562]: pgmap v652: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 2.72k op/s 2024-09-11T01:16:45.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:44 smithi117 ceph-mon[35358]: pgmap v652: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 2.72k op/s 2024-09-11T01:16:46.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:46 smithi183 ceph-mon[34992]: pgmap v653: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8.1 MiB/s wr, 1.69k op/s 2024-09-11T01:16:47.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:46 smithi103 ceph-mon[30562]: pgmap v653: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8.1 MiB/s wr, 1.69k op/s 2024-09-11T01:16:47.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:46 smithi117 ceph-mon[35358]: pgmap v653: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 8.1 MiB/s wr, 1.69k op/s 2024-09-11T01:16:48.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:48 smithi183 ceph-mon[34992]: pgmap v654: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.2 MiB/s wr, 1.03k op/s 2024-09-11T01:16:49.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:48 smithi103 ceph-mon[30562]: pgmap v654: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.2 MiB/s wr, 1.03k op/s 2024-09-11T01:16:49.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:48 smithi117 ceph-mon[35358]: pgmap v654: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.2 MiB/s wr, 1.03k op/s 2024-09-11T01:16:49.835 DEBUG:teuthology.orchestra.run:got remote process result: 115 2024-09-11T01:16:49.836 WARNING:tasks.quiescer.fs.[cephfs]:Set '286870a3' hasn't quiesced after 270.5 seconds (timeout: 90). Dumping ops with locks from all ranks. 2024-09-11T01:16:49.837 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:16:50.649 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:16:50.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:50 smithi183 ceph-mon[34992]: pgmap v655: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.9 MiB/s wr, 1.32k op/s 2024-09-11T01:16:50.985 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:50 smithi103 ceph-mon[30562]: pgmap v655: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.9 MiB/s wr, 1.32k op/s 2024-09-11T01:16:51.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:50 smithi117 ceph-mon[35358]: pgmap v655: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.9 MiB/s wr, 1.32k op/s 2024-09-11T01:16:52.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.337+0000 7f5086c00640 1 -- 172.21.15.103:0/3449049632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5080113b00 msgr2=0x7f5080115ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:52.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.337+0000 7f5086c00640 1 --2- 172.21.15.103:0/3449049632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5080113b00 0x7f5080115ef0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5078009900 tx=0x7f507802a410 comp rx=0 tx=0).stop 2024-09-11T01:16:52.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.337+0000 7f5086c00640 1 -- 172.21.15.103:0/3449049632 shutdown_connections 2024-09-11T01:16:52.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.337+0000 7f5086c00640 1 --2- 172.21.15.103:0/3449049632 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5080113b00 0x7f5080115ef0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:52.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.337+0000 7f5086c00640 1 --2- 172.21.15.103:0/3449049632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5080075e60 0x7f50801135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:52.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.337+0000 7f5086c00640 1 --2- 172.21.15.103:0/3449049632 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5080075540 0x7f5080075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:52.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.337+0000 7f5086c00640 1 -- 172.21.15.103:0/3449049632 >> 172.21.15.103:0/3449049632 conn(0x7f50800fe810 msgr2=0x7f5080100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:52.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.337+0000 7f5086c00640 1 -- 172.21.15.103:0/3449049632 shutdown_connections 2024-09-11T01:16:52.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.337+0000 7f5086c00640 1 -- 172.21.15.103:0/3449049632 wait complete. 2024-09-11T01:16:52.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.338+0000 7f5086c00640 1 Processor -- start 2024-09-11T01:16:52.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.339+0000 7f5086c00640 1 -- start start 2024-09-11T01:16:52.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.339+0000 7f5086c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5080075540 0x7f508019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:52.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.339+0000 7f5086c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5080075e60 0x7f508019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:52.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.339+0000 7f5086c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5080113b00 0x7f50801a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:52.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.339+0000 7f5086c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50801193b0 con 0x7f5080075e60 2024-09-11T01:16:52.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.339+0000 7f5086c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5080119230 con 0x7f5080113b00 2024-09-11T01:16:52.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.339+0000 7f5086c00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5080119530 con 0x7f5080075540 2024-09-11T01:16:52.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.339+0000 7f5084c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5080113b00 0x7f50801a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:52.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.339+0000 7f507fe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5080075540 0x7f508019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:52.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.339+0000 7f5084c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5080113b00 0x7f50801a5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38904/0 (socket says 172.21.15.103:38904) 2024-09-11T01:16:52.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.339+0000 7f5084c00640 1 -- 172.21.15.103:0/3887861336 learned_addr learned my addr 172.21.15.103:0/3887861336 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:52.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.339+0000 7f507f400640 1 --2- 172.21.15.103:0/3887861336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5080075e60 0x7f508019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:52.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.340+0000 7f5084c00640 1 -- 172.21.15.103:0/3887861336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5080075540 msgr2=0x7f508019f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:52.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.340+0000 7f5084c00640 1 --2- 172.21.15.103:0/3887861336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5080075540 0x7f508019f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:52.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.340+0000 7f5084c00640 1 -- 172.21.15.103:0/3887861336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5080075e60 msgr2=0x7f508019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:52.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.340+0000 7f5084c00640 1 --2- 172.21.15.103:0/3887861336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5080075e60 0x7f508019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:52.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.340+0000 7f5084c00640 1 -- 172.21.15.103:0/3887861336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50801a5910 con 0x7f5080113b00 2024-09-11T01:16:52.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.340+0000 7f5084c00640 1 --2- 172.21.15.103:0/3887861336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5080113b00 0x7f50801a5140 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f507802a930 tx=0x7f5078003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:52.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.341+0000 7f507cc00640 1 -- 172.21.15.103:0/3887861336 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507803f070 con 0x7f5080113b00 2024-09-11T01:16:52.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.341+0000 7f5086c00640 1 -- 172.21.15.103:0/3887861336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50801a5ba0 con 0x7f5080113b00 2024-09-11T01:16:52.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.341+0000 7f507cc00640 1 -- 172.21.15.103:0/3887861336 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5078031b50 con 0x7f5080113b00 2024-09-11T01:16:52.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.341+0000 7f507cc00640 1 -- 172.21.15.103:0/3887861336 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5078035030 con 0x7f5080113b00 2024-09-11T01:16:52.344 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.341+0000 7f5086c00640 1 -- 172.21.15.103:0/3887861336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50801ac2c0 con 0x7f5080113b00 2024-09-11T01:16:52.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.342+0000 7f5086c00640 1 -- 172.21.15.103:0/3887861336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5080075920 con 0x7f5080113b00 2024-09-11T01:16:52.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.344+0000 7f507cc00640 1 -- 172.21.15.103:0/3887861336 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f50780316a0 con 0x7f5080113b00 2024-09-11T01:16:52.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.346+0000 7f507cc00640 1 --2- 172.21.15.103:0/3887861336 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f50640b52e0 0x7f50640b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:52.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.346+0000 7f507cc00640 1 -- 172.21.15.103:0/3887861336 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5078106c80 con 0x7f5080113b00 2024-09-11T01:16:52.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.346+0000 7f507fe00640 1 --2- 172.21.15.103:0/3887861336 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f50640b52e0 0x7f50640b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:52.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.347+0000 7f507fe00640 1 --2- 172.21.15.103:0/3887861336 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f50640b52e0 0x7f50640b77a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f50700099a0 tx=0x7f5070009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:52.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.347+0000 7f507cc00640 1 -- 172.21.15.103:0/3887861336 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f50780cd0e0 con 0x7f5080113b00 2024-09-11T01:16:52.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.572+0000 7f5086c00640 1 -- 172.21.15.103:0/3887861336 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50801a0990 con 0x7f5080113b00 2024-09-11T01:16:52.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.574+0000 7f507cc00640 1 -- 172.21.15.103:0/3887861336 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11930 (secure 0 0 0) 0x7f50780d1b10 con 0x7f5080113b00 2024-09-11T01:16:52.577 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:16:52.577 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":31,"btime":"2024-09-11T01:12:40:372256+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:12:39.857673+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24619,24629,24665]},"id":1}]} 2024-09-11T01:16:52.577 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 31 2024-09-11T01:16:52.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.576+0000 7f5086c00640 1 -- 172.21.15.103:0/3887861336 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f50640b52e0 msgr2=0x7f50640b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:52.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.576+0000 7f5086c00640 1 --2- 172.21.15.103:0/3887861336 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f50640b52e0 0x7f50640b77a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f50700099a0 tx=0x7f5070009500 comp rx=0 tx=0).stop 2024-09-11T01:16:52.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.576+0000 7f5086c00640 1 -- 172.21.15.103:0/3887861336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5080113b00 msgr2=0x7f50801a5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:52.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.576+0000 7f5086c00640 1 --2- 172.21.15.103:0/3887861336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5080113b00 0x7f50801a5140 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f507802a930 tx=0x7f5078003b90 comp rx=0 tx=0).stop 2024-09-11T01:16:52.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.576+0000 7f5086c00640 1 -- 172.21.15.103:0/3887861336 shutdown_connections 2024-09-11T01:16:52.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.576+0000 7f5086c00640 1 --2- 172.21.15.103:0/3887861336 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f50640b52e0 0x7f50640b77a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:52.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.576+0000 7f5086c00640 1 --2- 172.21.15.103:0/3887861336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5080113b00 0x7f50801a5140 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:52.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.576+0000 7f5086c00640 1 --2- 172.21.15.103:0/3887861336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5080075e60 0x7f508019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:52.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.576+0000 7f5086c00640 1 --2- 172.21.15.103:0/3887861336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5080075540 0x7f508019f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:52.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.576+0000 7f5086c00640 1 -- 172.21.15.103:0/3887861336 >> 172.21.15.103:0/3887861336 conn(0x7f50800fe810 msgr2=0x7f50800ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:52.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.576+0000 7f5086c00640 1 -- 172.21.15.103:0/3887861336 shutdown_connections 2024-09-11T01:16:52.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:52.577+0000 7f5086c00640 1 -- 172.21.15.103:0/3887861336 wait complete. 2024-09-11T01:16:52.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:52 smithi183 ceph-mon[34992]: pgmap v656: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 MiB/s wr, 2.18k op/s 2024-09-11T01:16:52.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:52 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3887861336' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:16:52.976 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:52 smithi103 ceph-mon[30562]: pgmap v656: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 MiB/s wr, 2.18k op/s 2024-09-11T01:16:52.976 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:52 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3887861336' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:16:53.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:52 smithi117 ceph-mon[35358]: pgmap v656: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 11 MiB/s wr, 2.18k op/s 2024-09-11T01:16:53.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:52 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3887861336' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:16:53.594 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 2 (i) to a remote file /var/run/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ops-286870a3-1-mds.i.json 2024-09-11T01:16:53.595 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell mds.1:2 ops --flags=locks --path=/var/run/ceph/ops-286870a3-1-mds.i.json 2024-09-11T01:16:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.702+0000 7f17ea800640 1 -- 172.21.15.103:0/3836467152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17e41066b0 msgr2=0x7f17e410d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.702+0000 7f17ea800640 1 --2- 172.21.15.103:0/3836467152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17e41066b0 0x7f17e410d030 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009cd0 tx=0x7f17dc02a8e0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.705 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.702+0000 7f17ea800640 1 -- 172.21.15.103:0/3836467152 shutdown_connections 2024-09-11T01:16:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.702+0000 7f17ea800640 1 --2- 172.21.15.103:0/3836467152 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17e41066b0 0x7f17e410d030 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.702+0000 7f17ea800640 1 --2- 172.21.15.103:0/3836467152 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e4105cf0 0x7f17e4106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.702+0000 7f17ea800640 1 --2- 172.21.15.103:0/3836467152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17e4104ba0 0x7f17e4104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.702+0000 7f17ea800640 1 -- 172.21.15.103:0/3836467152 >> 172.21.15.103:0/3836467152 conn(0x7f17e4100460 msgr2=0x7f17e4102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.702+0000 7f17ea800640 1 -- 172.21.15.103:0/3836467152 shutdown_connections 2024-09-11T01:16:53.706 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.702+0000 7f17ea800640 1 -- 172.21.15.103:0/3836467152 wait complete. 2024-09-11T01:16:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.703+0000 7f17ea800640 1 Processor -- start 2024-09-11T01:16:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.703+0000 7f17ea800640 1 -- start start 2024-09-11T01:16:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.704+0000 7f17ea800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17e4104ba0 0x7f17e419af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.704+0000 7f17ea800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17e4105cf0 0x7f17e419b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.704+0000 7f17ea800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e41066b0 0x7f17e419c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.708 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.704+0000 7f17ea800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17e4110860 con 0x7f17e41066b0 2024-09-11T01:16:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.704+0000 7f17ea800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f17e41106e0 con 0x7f17e4104ba0 2024-09-11T01:16:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.704+0000 7f17ea800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f17e41109e0 con 0x7f17e4105cf0 2024-09-11T01:16:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.704+0000 7f17e3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e41066b0 0x7f17e419c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.704+0000 7f17e3400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17e4104ba0 0x7f17e419af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.704+0000 7f17e3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e41066b0 0x7f17e419c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57610/0 (socket says 172.21.15.103:57610) 2024-09-11T01:16:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.704+0000 7f17e3400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17e4104ba0 0x7f17e419af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38932/0 (socket says 172.21.15.103:38932) 2024-09-11T01:16:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.704+0000 7f17e2a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17e4105cf0 0x7f17e419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.704+0000 7f17e3e00640 1 -- 172.21.15.103:0/977535053 learned_addr learned my addr 172.21.15.103:0/977535053 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.705+0000 7f17e3400640 1 -- 172.21.15.103:0/977535053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17e4105cf0 msgr2=0x7f17e419b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.705+0000 7f17e3400640 1 --2- 172.21.15.103:0/977535053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17e4105cf0 0x7f17e419b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.705+0000 7f17e3400640 1 -- 172.21.15.103:0/977535053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e41066b0 msgr2=0x7f17e419c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.705+0000 7f17e3400640 1 --2- 172.21.15.103:0/977535053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e41066b0 0x7f17e419c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.709 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.705+0000 7f17e3400640 1 -- 172.21.15.103:0/977535053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e419ca70 con 0x7f17e4104ba0 2024-09-11T01:16:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.705+0000 7f17e3e00640 1 --2- 172.21.15.103:0/977535053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e41066b0 0x7f17e419c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:16:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.705+0000 7f17e3400640 1 --2- 172.21.15.103:0/977535053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17e4104ba0 0x7f17e419af30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f17d400e9f0 tx=0x7f17d400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.705+0000 7f17dbe00640 1 -- 172.21.15.103:0/977535053 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d400ccc0 con 0x7f17e4104ba0 2024-09-11T01:16:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.705+0000 7f17dbe00640 1 -- 172.21.15.103:0/977535053 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17d4005020 con 0x7f17e4104ba0 2024-09-11T01:16:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.705+0000 7f17dbe00640 1 -- 172.21.15.103:0/977535053 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d4004a00 con 0x7f17e4104ba0 2024-09-11T01:16:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.705+0000 7f17ea800640 1 -- 172.21.15.103:0/977535053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e419cd60 con 0x7f17e4104ba0 2024-09-11T01:16:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.705+0000 7f17ea800640 1 -- 172.21.15.103:0/977535053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e41a3430 con 0x7f17e4104ba0 2024-09-11T01:16:53.710 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.708+0000 7f17ed7fd740 1 Processor -- start 2024-09-11T01:16:53.711 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.708+0000 7f17ed7fd740 1 -- start start 2024-09-11T01:16:53.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.708+0000 7f17ed7fd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf384feb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17ed7fd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf384ff0c0 0x55cf385014b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17ed7fd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf38501b00 0x55cf38503fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17ed7fd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cf3846f6b0 con 0x55cf38501b00 2024-09-11T01:16:53.712 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17ed7fd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cf3845eae0 con 0x55cf384ff0c0 2024-09-11T01:16:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17ed7fd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cf384628f0 con 0x55cf384fc790 2024-09-11T01:16:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17dbe00640 1 -- 172.21.15.103:0/977535053 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f17d4004ba0 con 0x7f17e4104ba0 2024-09-11T01:16:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17e2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf38501b00 0x55cf38503fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17e2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf38501b00 0x55cf38503fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57622/0 (socket says 172.21.15.103:57622) 2024-09-11T01:16:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17e2a00640 1 -- 172.21.15.103:0/3839608236 learned_addr learned my addr 172.21.15.103:0/3839608236 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17e3e00640 1 --2- 172.21.15.103:0/3839608236 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf384feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17e3400640 1 --2- 172.21.15.103:0/3839608236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf384ff0c0 0x55cf385014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17e3e00640 1 -- 172.21.15.103:0/3839608236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf384ff0c0 msgr2=0x55cf385014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17e3e00640 1 --2- 172.21.15.103:0/3839608236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf384ff0c0 0x55cf385014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17e3e00640 1 -- 172.21.15.103:0/3839608236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf38501b00 msgr2=0x55cf38503fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17e3e00640 1 --2- 172.21.15.103:0/3839608236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf38501b00 0x55cf38503fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17e3e00640 1 -- 172.21.15.103:0/3839608236 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf3842b780 con 0x55cf384fc790 2024-09-11T01:16:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.709+0000 7f17e2a00640 1 --2- 172.21.15.103:0/3839608236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf38501b00 0x55cf38503fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:16:53.713 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.710+0000 7f17e3e00640 1 --2- 172.21.15.103:0/3839608236 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf384feb80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f17dc005e30 tx=0x7f17dc005f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53008ad1c532f271 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.710+0000 7f17d8c00640 1 -- 172.21.15.103:0/3839608236 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc048070 con 0x55cf384fc790 2024-09-11T01:16:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.710+0000 7f17d8c00640 1 -- 172.21.15.103:0/3839608236 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17dc036070 con 0x55cf384fc790 2024-09-11T01:16:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.710+0000 7f17d8c00640 1 -- 172.21.15.103:0/3839608236 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17dc004790 con 0x55cf384fc790 2024-09-11T01:16:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.711+0000 7f17dbe00640 1 --2- 172.21.15.103:0/977535053 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f17c80b5360 0x7f17c80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.711+0000 7f17ed7fd740 1 -- 172.21.15.103:0/3839608236 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 msgr2=0x55cf384feb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.711+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/3839608236 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf384feb80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f17dc005e30 tx=0x7f17dc005f80 comp rx=0 tx=0).stop 2024-09-11T01:16:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.711+0000 7f17e3400640 1 --2- 172.21.15.103:0/977535053 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f17c80b5360 0x7f17c80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.715 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.711+0000 7f17dbe00640 1 -- 172.21.15.103:0/977535053 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f17d40e5f10 con 0x7f17e4104ba0 2024-09-11T01:16:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.712+0000 7f17ed7fd740 1 -- 172.21.15.103:0/3839608236 shutdown_connections 2024-09-11T01:16:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.712+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/3839608236 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf38501b00 0x55cf38503fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.712+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/3839608236 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf384ff0c0 0x55cf385014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.712+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/3839608236 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf384feb80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.712+0000 7f17ed7fd740 1 -- 172.21.15.103:0/3839608236 >> 172.21.15.103:0/3839608236 conn(0x55cf384f78e0 msgr2=0x55cf384f8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.712+0000 7f17e3400640 1 --2- 172.21.15.103:0/977535053 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f17c80b5360 0x7f17c80b7820 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f17d400e9c0 tx=0x7f17d4005460 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.712+0000 7f17ed7fd740 1 -- 172.21.15.103:0/3839608236 shutdown_connections 2024-09-11T01:16:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.712+0000 7f17ed7fd740 1 -- 172.21.15.103:0/3839608236 wait complete. 2024-09-11T01:16:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.712+0000 7f17ed7fd740 1 -- start start 2024-09-11T01:16:53.716 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.712+0000 7f17ed7fd740 1 Processor -- start 2024-09-11T01:16:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.713+0000 7f17ed7fd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384fc790 0x55cf38505e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.713+0000 7f17ed7fd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384ff0c0 0x55cf38506500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.713+0000 7f17ed7fd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 0x55cf385070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.713+0000 7f17ed7fd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55cf38396ab0 con 0x55cf384fc790 2024-09-11T01:16:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.713+0000 7f17ed7fd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55cf38405570 con 0x55cf38501b00 2024-09-11T01:16:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.713+0000 7f17ed7fd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55cf38504a80 con 0x55cf384ff0c0 2024-09-11T01:16:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.713+0000 7f17ed7fd740 10 client.0 _ll_register_callbacks cb 0x55cf38414100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:16:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.714+0000 7f17e3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 0x55cf385070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.714+0000 7f17e3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 0x55cf385070d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38950/0 (socket says 172.21.15.103:38950) 2024-09-11T01:16:53.718 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.714+0000 7f17e3e00640 1 -- 172.21.15.103:0/1475339878 learned_addr learned my addr 172.21.15.103:0/1475339878 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.714+0000 7f17e3e00640 1 --2- 172.21.15.103:0/1475339878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384fc790 0x55cf38505e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.714+0000 7f17e2a00640 1 --2- 172.21.15.103:0/1475339878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384ff0c0 0x55cf38506500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.714+0000 7f17e2a00640 1 -- 172.21.15.103:0/1475339878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 msgr2=0x55cf385070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.714+0000 7f17e2a00640 1 --2- 172.21.15.103:0/1475339878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 0x55cf385070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.714+0000 7f17e2a00640 1 -- 172.21.15.103:0/1475339878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384fc790 msgr2=0x55cf38505e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.714+0000 7f17e2a00640 1 --2- 172.21.15.103:0/1475339878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384fc790 0x55cf38505e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.714+0000 7f17e2a00640 1 -- 172.21.15.103:0/1475339878 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf381c0790 con 0x55cf384ff0c0 2024-09-11T01:16:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.714+0000 7f17e3e00640 1 --2- 172.21.15.103:0/1475339878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 0x55cf385070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:16:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.715+0000 7f17e2a00640 1 --2- 172.21.15.103:0/1475339878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384ff0c0 0x55cf38506500 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f17d00126f0 tx=0x7f17d0012bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a446d672bc394a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.715+0000 7f17cd600640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:16:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.715+0000 7f17cd600640 1 -- 172.21.15.103:0/1475339878 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d0004030 con 0x55cf384ff0c0 2024-09-11T01:16:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.715+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1475339878 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17dc036070 con 0x55cf384ff0c0 2024-09-11T01:16:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.715+0000 7f17cd600640 1 -- 172.21.15.103:0/1475339878 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f17d0012e00 con 0x55cf384ff0c0 2024-09-11T01:16:53.719 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.715+0000 7f17cd600640 1 -- 172.21.15.103:0/1475339878 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f17d00041d0 con 0x55cf384ff0c0 2024-09-11T01:16:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.715+0000 7f17ed7fd740 10 client.25894 fetch_fsmap learned FSMap version 31 2024-09-11T01:16:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.715+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1475339878 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cf38239620 con 0x55cf384ff0c0 2024-09-11T01:16:53.720 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.715+0000 7f17cd600640 1 -- 172.21.15.103:0/1475339878 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17dc036070 con 0x55cf384ff0c0 2024-09-11T01:16:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.716+0000 7f17cd600640 1 -- 172.21.15.103:0/1475339878 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f17d00038e0 con 0x55cf384ff0c0 2024-09-11T01:16:53.721 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.716+0000 7f17ed7fd740 10 client.25894 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:16:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.716+0000 7f17ed7fd740 10 client.25894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:16:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.716+0000 7f17ed7fd740 20 client.25894 populate_metadata read hostname 'smithi103' 2024-09-11T01:16:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.716+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1475339878 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cf3851a080 0x55cf3851c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.716+0000 7f17ed7fd740 4 client.25894 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:16:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.716+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1475339878 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cf38471600 con 0x55cf3851a080 2024-09-11T01:16:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.716+0000 7f17e3e00640 1 --2- 172.21.15.103:0/1475339878 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cf3851a080 0x55cf3851c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.717+0000 7f17e3e00640 1 --2- 172.21.15.103:0/1475339878 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cf3851a080 0x55cf3851c4a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ccd2a0e8fd49701 server_cookie=1396ec33647ef722 in_seq=0 out_seq=0 2024-09-11T01:16:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.717+0000 7f17cd600640 10 client.25894 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:16:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.717+0000 7f17cd600640 1 -- 172.21.15.103:0/1475339878 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55cf38471600 con 0x55cf3851a080 2024-09-11T01:16:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.717+0000 7f17cd600640 10 client.25894 handle_command_reply: tid=0 2024-09-11T01:16:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.718+0000 7f17ed7fd740 1 client.25894 shutdown 2024-09-11T01:16:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.718+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1475339878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384ff0c0 msgr2=0x55cf38506500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.718+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1475339878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384ff0c0 0x55cf38506500 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f17d00126f0 tx=0x7f17d0012bb0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.722 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.718+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1475339878 shutdown_connections 2024-09-11T01:16:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.718+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1475339878 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 0x55cf385070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.718+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1475339878 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cf3851a080 0x55cf3851c4a0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.718+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1475339878 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384ff0c0 0x55cf38506500 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.718+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1475339878 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384fc790 0x55cf38505e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.718+0000 7f17cd600640 0 client.25894 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:16:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.718+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1475339878 >> 172.21.15.103:0/1475339878 conn(0x55cf384f78e0 msgr2=0x55cf384f6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.718+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1475339878 shutdown_connections 2024-09-11T01:16:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.718+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1475339878 wait complete. 2024-09-11T01:16:53.723 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.718+0000 7f17ed7fd740 20 client.25894 trim_cache size 0 max 16384 2024-09-11T01:16:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.733+0000 7f17ed7fd740 1 Processor -- start 2024-09-11T01:16:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17ed7fd740 1 -- start start 2024-09-11T01:16:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17ed7fd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf38520d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17ed7fd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384ff0c0 0x55cf385212a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17ed7fd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 0x55cf385217e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17ed7fd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17e41abc20 con 0x55cf384ff0c0 2024-09-11T01:16:53.737 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17ed7fd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f17e41a94f0 con 0x55cf38501b00 2024-09-11T01:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17ed7fd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f17e41a7340 con 0x55cf384fc790 2024-09-11T01:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17e2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384ff0c0 0x55cf385212a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17e3e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf38520d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17e3e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf38520d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:33296/0 (socket says 172.21.15.103:33296) 2024-09-11T01:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17e3e00640 1 -- 172.21.15.103:0/1102302367 learned_addr learned my addr 172.21.15.103:0/1102302367 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17e3e00640 1 --2- 172.21.15.103:0/1102302367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 0x55cf385217e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17e2a00640 1 -- 172.21.15.103:0/1102302367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 msgr2=0x55cf38520d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17e2a00640 1 --2- 172.21.15.103:0/1102302367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf38520d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17e2a00640 1 -- 172.21.15.103:0/1102302367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 msgr2=0x55cf385217e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.734+0000 7f17e2a00640 1 --2- 172.21.15.103:0/1102302367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 0x55cf385217e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.735+0000 7f17e2a00640 1 -- 172.21.15.103:0/1102302367 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf38505960 con 0x55cf384ff0c0 2024-09-11T01:16:53.738 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.735+0000 7f17e3e00640 1 --2- 172.21.15.103:0/1102302367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf38520d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:16:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.735+0000 7f17e2a00640 1 --2- 172.21.15.103:0/1102302367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384ff0c0 0x55cf385212a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f17d0003ef0 tx=0x7f17d0005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9258ffb558962ca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.735+0000 7f17cfe00640 1 -- 172.21.15.103:0/1102302367 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d002d070 con 0x55cf384ff0c0 2024-09-11T01:16:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.735+0000 7f17cfe00640 1 -- 172.21.15.103:0/1102302367 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17d0003aa0 con 0x55cf384ff0c0 2024-09-11T01:16:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.735+0000 7f17cfe00640 1 -- 172.21.15.103:0/1102302367 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d000fb80 con 0x55cf384ff0c0 2024-09-11T01:16:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.736+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1102302367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384ff0c0 msgr2=0x55cf385212a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:53.741 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.736+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1102302367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384ff0c0 0x55cf385212a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f17d0003ef0 tx=0x7f17d0005850 comp rx=0 tx=0).stop 2024-09-11T01:16:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.736+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1102302367 shutdown_connections 2024-09-11T01:16:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.736+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1102302367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 0x55cf385217e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.736+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1102302367 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384ff0c0 0x55cf385212a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.736+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1102302367 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf38520d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.736+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1102302367 >> 172.21.15.103:0/1102302367 conn(0x55cf384f78e0 msgr2=0x55cf384fa930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.736+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1102302367 shutdown_connections 2024-09-11T01:16:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.736+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1102302367 wait complete. 2024-09-11T01:16:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.736+0000 7f17ed7fd740 1 -- start start 2024-09-11T01:16:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.737+0000 7f17ed7fd740 1 Processor -- start 2024-09-11T01:16:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.737+0000 7f17ed7fd740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf3850ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.737+0000 7f17ed7fd740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384ff0c0 0x55cf3850d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.737+0000 7f17ed7fd740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 0x55cf3850b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.737+0000 7f17ed7fd740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f17e41a79b0 con 0x55cf384ff0c0 2024-09-11T01:16:53.742 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.737+0000 7f17ed7fd740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f17e41a8e20 con 0x55cf38501b00 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.737+0000 7f17ed7fd740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f17e41a8080 con 0x55cf384fc790 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.737+0000 7f17ed7fd740 10 client.0 _ll_register_callbacks cb 0x7f17d0009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.737+0000 7f17e2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384ff0c0 0x55cf3850d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.737+0000 7f17e2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384ff0c0 0x55cf3850d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57648/0 (socket says 172.21.15.103:57648) 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.737+0000 7f17e2a00640 1 -- 172.21.15.103:0/1898688019 learned_addr learned my addr 172.21.15.103:0/1898688019 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.737+0000 7f17e3e00640 1 --2- 172.21.15.103:0/1898688019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf3850ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.738+0000 7f17e3e00640 1 --2- 172.21.15.103:0/1898688019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 0x55cf3850b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.738+0000 7f17e2a00640 1 -- 172.21.15.103:0/1898688019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 msgr2=0x55cf3850ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.738+0000 7f17e2a00640 1 --2- 172.21.15.103:0/1898688019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf3850ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.738+0000 7f17e2a00640 1 -- 172.21.15.103:0/1898688019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 msgr2=0x55cf3850b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.738+0000 7f17e2a00640 1 --2- 172.21.15.103:0/1898688019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 0x55cf3850b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.738+0000 7f17e2a00640 1 -- 172.21.15.103:0/1898688019 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf3850be10 con 0x55cf384ff0c0 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.738+0000 7f17e2a00640 1 --2- 172.21.15.103:0/1898688019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384ff0c0 0x55cf3850d230 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f17d0003d80 tx=0x7f17d000f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79aca0c5822d4ea4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.738+0000 7f17cd600640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:16:53.743 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.738+0000 7f17cd600640 1 -- 172.21.15.103:0/1898688019 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d002d070 con 0x55cf384ff0c0 2024-09-11T01:16:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.738+0000 7f17cd600640 1 -- 172.21.15.103:0/1898688019 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f17d000fb30 con 0x55cf384ff0c0 2024-09-11T01:16:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.738+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1898688019 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17d0003aa0 con 0x55cf384ff0c0 2024-09-11T01:16:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.738+0000 7f17cd600640 1 -- 172.21.15.103:0/1898688019 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f17d000fd30 con 0x55cf384ff0c0 2024-09-11T01:16:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.739+0000 7f17ed7fd740 10 client.15867 fetch_fsmap learned FSMap version 31 2024-09-11T01:16:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.739+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1898688019 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cf385876e0 con 0x55cf384ff0c0 2024-09-11T01:16:53.744 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.739+0000 7f17cd600640 1 -- 172.21.15.103:0/1898688019 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f17d0003aa0 con 0x55cf384ff0c0 2024-09-11T01:16:53.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.739+0000 7f17cd600640 1 -- 172.21.15.103:0/1898688019 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f17d0010430 con 0x55cf384ff0c0 2024-09-11T01:16:53.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.739+0000 7f17ed7fd740 10 client.15867 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:16:53.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.739+0000 7f17ed7fd740 10 client.15867 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:16:53.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.739+0000 7f17ed7fd740 20 client.15867 populate_metadata read hostname 'smithi103' 2024-09-11T01:16:53.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.739+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1898688019 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cf38587f70 0x55cf3858a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:53.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.739+0000 7f17ed7fd740 4 client.15867 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:16:53.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.739+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1898688019 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cf3846d0b0 con 0x55cf38587f70 2024-09-11T01:16:53.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.739+0000 7f17e3e00640 1 --2- 172.21.15.103:0/1898688019 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cf38587f70 0x55cf3858a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:53.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.740+0000 7f17e3e00640 1 --2- 172.21.15.103:0/1898688019 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cf38587f70 0x55cf3858a390 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30f4f0fcfe1fd5a6 server_cookie=699a757190c0bbe0 in_seq=0 out_seq=0 2024-09-11T01:16:53.745 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.740+0000 7f17cd600640 10 client.15867 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:16:53.751 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17cd600640 1 -- 172.21.15.103:0/1898688019 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cf3846d0b0 con 0x55cf38587f70 2024-09-11T01:16:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17cd600640 10 client.15867 handle_command_reply: tid=0 2024-09-11T01:16:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17ed7fd740 1 client.15867 shutdown 2024-09-11T01:16:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1898688019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384ff0c0 msgr2=0x55cf3850d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1898688019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384ff0c0 0x55cf3850d230 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f17d0003d80 tx=0x7f17d000f810 comp rx=0 tx=0).stop 2024-09-11T01:16:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1898688019 shutdown_connections 2024-09-11T01:16:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1898688019 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55cf38501b00 0x55cf3850b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1898688019 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55cf384ff0c0 0x55cf3850d230 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1898688019 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55cf38587f70 0x55cf3858a390 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17ed7fd740 1 --2- 172.21.15.103:0/1898688019 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55cf384fc790 0x55cf3850ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17cd600640 0 client.15867 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:16:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1898688019 >> 172.21.15.103:0/1898688019 conn(0x55cf384f78e0 msgr2=0x55cf384f6240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1898688019 shutdown_connections 2024-09-11T01:16:53.752 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17ed7fd740 1 -- 172.21.15.103:0/1898688019 wait complete. 2024-09-11T01:16:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.749+0000 7f17ed7fd740 20 client.15867 trim_cache size 0 max 16384 2024-09-11T01:16:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:16:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:16:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:16:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:16:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.750+0000 7f17ea800640 1 -- 172.21.15.103:0/977535053 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f17c80b5360 msgr2=0x7f17c80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.750+0000 7f17ea800640 1 --2- 172.21.15.103:0/977535053 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f17c80b5360 0x7f17c80b7820 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f17d400e9c0 tx=0x7f17d4005460 comp rx=0 tx=0).stop 2024-09-11T01:16:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.750+0000 7f17ea800640 1 -- 172.21.15.103:0/977535053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17e4104ba0 msgr2=0x7f17e419af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.750+0000 7f17ea800640 1 --2- 172.21.15.103:0/977535053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17e4104ba0 0x7f17e419af30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f17d400e9f0 tx=0x7f17d400eeb0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.750+0000 7f17ea800640 1 -- 172.21.15.103:0/977535053 shutdown_connections 2024-09-11T01:16:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.750+0000 7f17ea800640 1 --2- 172.21.15.103:0/977535053 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f17c80b5360 0x7f17c80b7820 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.750+0000 7f17ea800640 1 --2- 172.21.15.103:0/977535053 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f17e41066b0 0x7f17e419c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.750+0000 7f17ea800640 1 --2- 172.21.15.103:0/977535053 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f17e4105cf0 0x7f17e419b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.750+0000 7f17ea800640 1 --2- 172.21.15.103:0/977535053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17e4104ba0 0x7f17e419af30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.750+0000 7f17ea800640 1 -- 172.21.15.103:0/977535053 >> 172.21.15.103:0/977535053 conn(0x7f17e4100460 msgr2=0x7f17e4108ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.750+0000 7f17ea800640 1 -- 172.21.15.103:0/977535053 shutdown_connections 2024-09-11T01:16:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:16:53.750+0000 7f17ea800640 1 -- 172.21.15.103:0/977535053 wait complete. 2024-09-11T01:16:53.986 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:16:54.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:54 smithi183 ceph-mon[34992]: pgmap v657: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 2.19k op/s 2024-09-11T01:16:55.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:54 smithi103 ceph-mon[30562]: pgmap v657: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 2.19k op/s 2024-09-11T01:16:55.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:54 smithi117 ceph-mon[35358]: pgmap v657: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 2.19k op/s 2024-09-11T01:16:56.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:56 smithi183 ceph-mon[34992]: pgmap v658: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 2.19k op/s 2024-09-11T01:16:57.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:56 smithi103 ceph-mon[30562]: pgmap v658: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 2.19k op/s 2024-09-11T01:16:57.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:56 smithi117 ceph-mon[35358]: pgmap v658: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 11 MiB/s wr, 2.19k op/s 2024-09-11T01:16:58.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:58 smithi183 ceph-mon[34992]: pgmap v659: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 11 MiB/s wr, 2.12k op/s 2024-09-11T01:16:58.925 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:58 smithi117 ceph-mon[35358]: pgmap v659: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 11 MiB/s wr, 2.12k op/s 2024-09-11T01:16:58.946 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:58 smithi103 ceph-mon[30562]: pgmap v659: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 11 MiB/s wr, 2.12k op/s 2024-09-11T01:16:59.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.215+0000 7f2acf200640 1 -- 172.21.15.103:0/2828252639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ad010a820 msgr2=0x7f2ad010ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.215+0000 7f2acf200640 1 --2- 172.21.15.103:0/2828252639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ad010a820 0x7f2ad010ac60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009900 tx=0x7f2ab802a400 comp rx=0 tx=0).stop 2024-09-11T01:16:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.215+0000 7f2acf200640 1 -- 172.21.15.103:0/2828252639 shutdown_connections 2024-09-11T01:16:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.215+0000 7f2acf200640 1 --2- 172.21.15.103:0/2828252639 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ad010b1a0 0x7f2ad01119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.215+0000 7f2acf200640 1 --2- 172.21.15.103:0/2828252639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ad010a820 0x7f2ad010ac60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.215+0000 7f2acf200640 1 --2- 172.21.15.103:0/2828252639 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ad0104e10 0x7f2ad01051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.215+0000 7f2acf200640 1 -- 172.21.15.103:0/2828252639 >> 172.21.15.103:0/2828252639 conn(0x7f2ad0100840 msgr2=0x7f2ad0102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.215+0000 7f2acf200640 1 -- 172.21.15.103:0/2828252639 shutdown_connections 2024-09-11T01:16:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.215+0000 7f2acf200640 1 -- 172.21.15.103:0/2828252639 wait complete. 2024-09-11T01:16:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.216+0000 7f2acf200640 1 Processor -- start 2024-09-11T01:16:59.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.216+0000 7f2acf200640 1 -- start start 2024-09-11T01:16:59.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.216+0000 7f2acf200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ad0104e10 0x7f2ad019b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.216+0000 7f2acf200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ad010a820 0x7f2ad019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.216+0000 7f2acf200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ad010b1a0 0x7f2ad01a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.216+0000 7f2acf200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0114e20 con 0x7f2ad010b1a0 2024-09-11T01:16:59.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.216+0000 7f2acf200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0114ca0 con 0x7f2ad0104e10 2024-09-11T01:16:59.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.216+0000 7f2acf200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0114fa0 con 0x7f2ad010a820 2024-09-11T01:16:59.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.217+0000 7f2acde00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ad0104e10 0x7f2ad019b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.217+0000 7f2acd400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ad010a820 0x7f2ad019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.217+0000 7f2ace800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ad010b1a0 0x7f2ad01a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.217+0000 7f2acde00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ad0104e10 0x7f2ad019b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38994/0 (socket says 172.21.15.103:38994) 2024-09-11T01:16:59.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.217+0000 7f2acde00640 1 -- 172.21.15.103:0/412743282 learned_addr learned my addr 172.21.15.103:0/412743282 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.217+0000 7f2acde00640 1 -- 172.21.15.103:0/412743282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ad010a820 msgr2=0x7f2ad019b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.217+0000 7f2acde00640 1 --2- 172.21.15.103:0/412743282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ad010a820 0x7f2ad019b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.217+0000 7f2acde00640 1 -- 172.21.15.103:0/412743282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ad010b1a0 msgr2=0x7f2ad01a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.217+0000 7f2acde00640 1 --2- 172.21.15.103:0/412743282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ad010b1a0 0x7f2ad01a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.217+0000 7f2acde00640 1 -- 172.21.15.103:0/412743282 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad01a1380 con 0x7f2ad0104e10 2024-09-11T01:16:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.218+0000 7f2acde00640 1 --2- 172.21.15.103:0/412743282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ad0104e10 0x7f2ad019b2d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000eb90 tx=0x7f2ac000c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.218+0000 7f2ac6a00640 1 -- 172.21.15.103:0/412743282 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0004d20 con 0x7f2ad0104e10 2024-09-11T01:16:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.218+0000 7f2acf200640 1 -- 172.21.15.103:0/412743282 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad01a1670 con 0x7f2ad0104e10 2024-09-11T01:16:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.218+0000 7f2ac6a00640 1 -- 172.21.15.103:0/412743282 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ac000ee90 con 0x7f2ad0104e10 2024-09-11T01:16:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.218+0000 7f2ac6a00640 1 -- 172.21.15.103:0/412743282 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac0010670 con 0x7f2ad0104e10 2024-09-11T01:16:59.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.218+0000 7f2acf200640 1 -- 172.21.15.103:0/412743282 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad01a7d30 con 0x7f2ad0104e10 2024-09-11T01:16:59.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.221+0000 7f2ac6a00640 1 -- 172.21.15.103:0/412743282 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f2ac0005020 con 0x7f2ad0104e10 2024-09-11T01:16:59.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.223+0000 7f2ac6a00640 1 --2- 172.21.15.103:0/412743282 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ab40b5390 0x7f2ab40b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.223+0000 7f2ac6a00640 1 -- 172.21.15.103:0/412743282 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f2ac00e6620 con 0x7f2ad0104e10 2024-09-11T01:16:59.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.223+0000 7f2acd400640 1 --2- 172.21.15.103:0/412743282 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ab40b5390 0x7f2ab40b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.224+0000 7f2acd400640 1 --2- 172.21.15.103:0/412743282 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ab40b5390 0x7f2ab40b7850 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8031440 tx=0x7f2ab8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:59.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.231+0000 7f2ad7613740 1 Processor -- start 2024-09-11T01:16:59.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.231+0000 7f2ad7613740 1 -- start start 2024-09-11T01:16:59.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.231+0000 7f2ad7613740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce98f40 0x559c4ce99320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.231+0000 7f2ad7613740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4ce99860 0x559c4cea52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.231+0000 7f2ad7613740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4cea57f0 0x559c4cea7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.231+0000 7f2ad7613740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559c4ce10450 con 0x559c4cea57f0 2024-09-11T01:16:59.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.231+0000 7f2ad7613740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559c4cdff880 con 0x559c4ce99860 2024-09-11T01:16:59.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.231+0000 7f2ad7613740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x559c4ce03690 con 0x559c4ce98f40 2024-09-11T01:16:59.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.231+0000 7f2ace800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4cea57f0 0x559c4cea7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.231+0000 7f2ace800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4cea57f0 0x559c4cea7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57686/0 (socket says 172.21.15.103:57686) 2024-09-11T01:16:59.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.231+0000 7f2ace800640 1 -- 172.21.15.103:0/2521166052 learned_addr learned my addr 172.21.15.103:0/2521166052 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:59.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.231+0000 7f2acd400640 1 --2- 172.21.15.103:0/2521166052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4ce99860 0x559c4cea52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.231+0000 7f2acde00640 1 --2- 172.21.15.103:0/2521166052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce98f40 0x559c4ce99320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.232+0000 7f2ace800640 1 -- 172.21.15.103:0/2521166052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce98f40 msgr2=0x559c4ce99320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:59.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.232+0000 7f2ace800640 1 --2- 172.21.15.103:0/2521166052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce98f40 0x559c4ce99320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.232+0000 7f2ace800640 1 -- 172.21.15.103:0/2521166052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4ce99860 msgr2=0x559c4cea52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:59.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.232+0000 7f2ace800640 1 --2- 172.21.15.103:0/2521166052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4ce99860 0x559c4cea52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.232+0000 7f2ace800640 1 -- 172.21.15.103:0/2521166052 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c4cdb1b00 con 0x559c4cea57f0 2024-09-11T01:16:59.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.232+0000 7f2acde00640 1 --2- 172.21.15.103:0/2521166052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce98f40 0x559c4ce99320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:16:59.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.232+0000 7f2ace800640 1 --2- 172.21.15.103:0/2521166052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4cea57f0 0x559c4cea7be0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009c50 tx=0x7f2ac8011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7a9dbcd82bbec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:59.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.232+0000 7f2abf000640 1 -- 172.21.15.103:0/2521166052 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac801e070 con 0x559c4cea57f0 2024-09-11T01:16:59.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.232+0000 7f2abf000640 1 -- 172.21.15.103:0/2521166052 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ac8019ae0 con 0x559c4cea57f0 2024-09-11T01:16:59.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.232+0000 7f2abf000640 1 -- 172.21.15.103:0/2521166052 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac800e9f0 con 0x559c4cea57f0 2024-09-11T01:16:59.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.233+0000 7f2ad7613740 1 -- 172.21.15.103:0/2521166052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4cea57f0 msgr2=0x559c4cea7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:59.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.233+0000 7f2ad7613740 1 --2- 172.21.15.103:0/2521166052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4cea57f0 0x559c4cea7be0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009c50 tx=0x7f2ac8011810 comp rx=0 tx=0).stop 2024-09-11T01:16:59.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.233+0000 7f2ad7613740 1 -- 172.21.15.103:0/2521166052 shutdown_connections 2024-09-11T01:16:59.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.233+0000 7f2ad7613740 1 --2- 172.21.15.103:0/2521166052 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4cea57f0 0x559c4cea7be0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.233+0000 7f2ad7613740 1 --2- 172.21.15.103:0/2521166052 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4ce99860 0x559c4cea52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.233+0000 7f2ad7613740 1 --2- 172.21.15.103:0/2521166052 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce98f40 0x559c4ce99320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.233+0000 7f2ad7613740 1 -- 172.21.15.103:0/2521166052 >> 172.21.15.103:0/2521166052 conn(0x559c4ce96d70 msgr2=0x559c4ce97f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:59.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.233+0000 7f2ad7613740 1 -- 172.21.15.103:0/2521166052 shutdown_connections 2024-09-11T01:16:59.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.233+0000 7f2ad7613740 1 -- 172.21.15.103:0/2521166052 wait complete. 2024-09-11T01:16:59.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.234+0000 7f2ad7613740 1 -- start start 2024-09-11T01:16:59.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.234+0000 7f2ad7613740 1 Processor -- start 2024-09-11T01:16:59.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.234+0000 7f2ad7613740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4ce98f40 0x559c4cea4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.234+0000 7f2ad7613740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce99860 0x559c4cea2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.234+0000 7f2ad7613740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4cea57f0 0x559c4cea2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.234+0000 7f2ad7613740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559c4cc61380 con 0x559c4ce99860 2024-09-11T01:16:59.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.234+0000 7f2ad7613740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x559c4cda5260 con 0x559c4ce98f40 2024-09-11T01:16:59.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.234+0000 7f2ad7613740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x559c4cea84a0 con 0x559c4cea57f0 2024-09-11T01:16:59.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.235+0000 7f2ad7613740 10 client.0 _ll_register_callbacks cb 0x559c4cdf97a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:16:59.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.235+0000 7f2acde00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4ce98f40 0x559c4cea4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.235+0000 7f2acde00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4ce98f40 0x559c4cea4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:39010/0 (socket says 172.21.15.103:39010) 2024-09-11T01:16:59.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.235+0000 7f2acd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce99860 0x559c4cea2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.235+0000 7f2acde00640 1 -- 172.21.15.103:0/1491556377 learned_addr learned my addr 172.21.15.103:0/1491556377 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:59.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.235+0000 7f2ace800640 1 --2- 172.21.15.103:0/1491556377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4cea57f0 0x559c4cea2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.235+0000 7f2acde00640 1 -- 172.21.15.103:0/1491556377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4cea57f0 msgr2=0x559c4cea2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:59.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.235+0000 7f2acde00640 1 --2- 172.21.15.103:0/1491556377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4cea57f0 0x559c4cea2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.235+0000 7f2acde00640 1 -- 172.21.15.103:0/1491556377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce99860 msgr2=0x559c4cea2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:59.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.235+0000 7f2acde00640 1 --2- 172.21.15.103:0/1491556377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce99860 0x559c4cea2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.235+0000 7f2acde00640 1 -- 172.21.15.103:0/1491556377 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c4cbd0490 con 0x559c4ce98f40 2024-09-11T01:16:59.241 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.235+0000 7f2acde00640 1 --2- 172.21.15.103:0/1491556377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4ce98f40 0x559c4cea4de0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00049d0 tx=0x7f2ac00a8140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13665729fa3005b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:59.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.235+0000 7f2ab3400640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:16:59.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.236+0000 7f2ab3400640 1 -- 172.21.15.103:0/1491556377 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00ac9d0 con 0x559c4ce98f40 2024-09-11T01:16:59.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.236+0000 7f2ab3400640 1 -- 172.21.15.103:0/1491556377 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f2ac00e6250 con 0x559c4ce98f40 2024-09-11T01:16:59.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.236+0000 7f2ad7613740 1 -- 172.21.15.103:0/1491556377 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ac8019ae0 con 0x559c4ce98f40 2024-09-11T01:16:59.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.236+0000 7f2ab3400640 1 -- 172.21.15.103:0/1491556377 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2ac00c7050 con 0x559c4ce98f40 2024-09-11T01:16:59.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.236+0000 7f2ad7613740 10 client.25961 fetch_fsmap learned FSMap version 31 2024-09-11T01:16:59.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.236+0000 7f2ad7613740 1 -- 172.21.15.103:0/1491556377 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559c4ceb3ae0 con 0x559c4ce98f40 2024-09-11T01:16:59.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.236+0000 7f2ab3400640 1 -- 172.21.15.103:0/1491556377 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ac8019ae0 con 0x559c4ce98f40 2024-09-11T01:16:59.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.236+0000 7f2ab3400640 1 -- 172.21.15.103:0/1491556377 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f2ac0005340 con 0x559c4ce98f40 2024-09-11T01:16:59.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.236+0000 7f2ad7613740 10 client.25961 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:16:59.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.236+0000 7f2ad7613740 10 client.25961 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-11T01:16:59.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.236+0000 7f2ad7613740 20 client.25961 populate_metadata read hostname 'smithi103' 2024-09-11T01:16:59.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.236+0000 7f2ad7613740 1 --2- 172.21.15.103:0/1491556377 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x559c4ceb4fa0 0x559c4ceb7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.236+0000 7f2ad7613740 4 client.25961 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:16:59.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.236+0000 7f2ad7613740 1 -- 172.21.15.103:0/1491556377 --> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c4ce123a0 con 0x559c4ceb4fa0 2024-09-11T01:16:59.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.237+0000 7f2acd400640 1 --2- 172.21.15.103:0/1491556377 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x559c4ceb4fa0 0x559c4ceb7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.238+0000 7f2acd400640 1 --2- 172.21.15.103:0/1491556377 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x559c4ceb4fa0 0x559c4ceb7420 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=737185aff63b7389 server_cookie=e8083a614844432e in_seq=0 out_seq=0 2024-09-11T01:16:59.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.238+0000 7f2ab3400640 10 client.25961 ms_handle_connect on v2:172.21.15.183:6838/1006805616 2024-09-11T01:16:59.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ab3400640 1 -- 172.21.15.103:0/1491556377 <== mds.2 v2:172.21.15.183:6838/1006805616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559c4ce123a0 con 0x559c4ceb4fa0 2024-09-11T01:16:59.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ab3400640 10 client.25961 handle_command_reply: tid=0 2024-09-11T01:16:59.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ad7613740 1 client.25961 shutdown 2024-09-11T01:16:59.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ad7613740 1 -- 172.21.15.103:0/1491556377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4ce98f40 msgr2=0x559c4cea4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:59.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ad7613740 1 --2- 172.21.15.103:0/1491556377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4ce98f40 0x559c4cea4de0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00049d0 tx=0x7f2ac00a8140 comp rx=0 tx=0).stop 2024-09-11T01:16:59.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ad7613740 1 -- 172.21.15.103:0/1491556377 shutdown_connections 2024-09-11T01:16:59.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ad7613740 1 --2- 172.21.15.103:0/1491556377 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x559c4ceb4fa0 0x559c4ceb7420 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ad7613740 1 --2- 172.21.15.103:0/1491556377 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4cea57f0 0x559c4cea2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ad7613740 1 --2- 172.21.15.103:0/1491556377 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce99860 0x559c4cea2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ad7613740 1 --2- 172.21.15.103:0/1491556377 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4ce98f40 0x559c4cea4de0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ad7613740 1 -- 172.21.15.103:0/1491556377 >> 172.21.15.103:0/1491556377 conn(0x559c4ce96d70 msgr2=0x559c4ce9c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:59.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ab3400640 0 client.25961 ms_handle_reset on v2:172.21.15.183:6838/1006805616 2024-09-11T01:16:59.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ad7613740 1 -- 172.21.15.103:0/1491556377 shutdown_connections 2024-09-11T01:16:59.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ad7613740 1 -- 172.21.15.103:0/1491556377 wait complete. 2024-09-11T01:16:59.245 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.239+0000 7f2ad7613740 20 client.25961 trim_cache size 0 max 16384 2024-09-11T01:16:59.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.255+0000 7f2ad7613740 1 Processor -- start 2024-09-11T01:16:59.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.255+0000 7f2ad7613740 1 -- start start 2024-09-11T01:16:59.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2ad7613740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce98f40 0x559c4cea1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2ad7613740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce99860 0x559c4cea3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2ad7613740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4cea57f0 0x559c4cea6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2ad7613740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01b44b0 con 0x559c4ce98f40 2024-09-11T01:16:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2ad7613740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01b1d80 con 0x559c4cea57f0 2024-09-11T01:16:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2ad7613740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01afbd0 con 0x559c4ce99860 2024-09-11T01:16:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2acde00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce98f40 0x559c4cea1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2acde00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce98f40 0x559c4cea1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57716/0 (socket says 172.21.15.103:57716) 2024-09-11T01:16:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2acde00640 1 -- 172.21.15.103:0/127852861 learned_addr learned my addr 172.21.15.103:0/127852861 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2ace800640 1 --2- 172.21.15.103:0/127852861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4cea57f0 0x559c4cea6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2acd400640 1 --2- 172.21.15.103:0/127852861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce99860 0x559c4cea3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2acde00640 1 -- 172.21.15.103:0/127852861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce99860 msgr2=0x559c4cea3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2acde00640 1 --2- 172.21.15.103:0/127852861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce99860 0x559c4cea3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2acde00640 1 -- 172.21.15.103:0/127852861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4cea57f0 msgr2=0x559c4cea6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2acde00640 1 --2- 172.21.15.103:0/127852861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4cea57f0 0x559c4cea6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2acde00640 1 -- 172.21.15.103:0/127852861 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c4ce92630 con 0x559c4ce98f40 2024-09-11T01:16:59.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.256+0000 7f2acd400640 1 --2- 172.21.15.103:0/127852861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce99860 0x559c4cea3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:16:59.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.257+0000 7f2acde00640 1 --2- 172.21.15.103:0/127852861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce98f40 0x559c4cea1120 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00a8f50 tx=0x7f2ac00a8270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65caf3d44771a7f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:59.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.257+0000 7f2abe600640 1 -- 172.21.15.103:0/127852861 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00cb020 con 0x559c4ce98f40 2024-09-11T01:16:59.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.257+0000 7f2abe600640 1 -- 172.21.15.103:0/127852861 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ac00b1070 con 0x559c4ce98f40 2024-09-11T01:16:59.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.257+0000 7f2abe600640 1 -- 172.21.15.103:0/127852861 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac00e63f0 con 0x559c4ce98f40 2024-09-11T01:16:59.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.257+0000 7f2ad7613740 1 -- 172.21.15.103:0/127852861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce98f40 msgr2=0x559c4cea1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:59.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.257+0000 7f2ad7613740 1 --2- 172.21.15.103:0/127852861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce98f40 0x559c4cea1120 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00a8f50 tx=0x7f2ac00a8270 comp rx=0 tx=0).stop 2024-09-11T01:16:59.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.258+0000 7f2ad7613740 1 -- 172.21.15.103:0/127852861 shutdown_connections 2024-09-11T01:16:59.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.258+0000 7f2ad7613740 1 --2- 172.21.15.103:0/127852861 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4cea57f0 0x559c4cea6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.258+0000 7f2ad7613740 1 --2- 172.21.15.103:0/127852861 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce99860 0x559c4cea3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.258+0000 7f2ad7613740 1 --2- 172.21.15.103:0/127852861 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce98f40 0x559c4cea1120 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.258+0000 7f2ad7613740 1 -- 172.21.15.103:0/127852861 >> 172.21.15.103:0/127852861 conn(0x559c4ce96d70 msgr2=0x559c4cea3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:59.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.258+0000 7f2ad7613740 1 -- 172.21.15.103:0/127852861 shutdown_connections 2024-09-11T01:16:59.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.258+0000 7f2ad7613740 1 -- 172.21.15.103:0/127852861 wait complete. 2024-09-11T01:16:59.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.258+0000 7f2ad7613740 1 -- start start 2024-09-11T01:16:59.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.258+0000 7f2ad7613740 1 Processor -- start 2024-09-11T01:16:59.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.259+0000 7f2ad7613740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce98f40 0x559c4cea8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.259+0000 7f2ad7613740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce99860 0x559c4cea9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.259+0000 7f2ad7613740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4cea57f0 0x559c4cf21ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.259+0000 7f2ad7613740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01b0240 con 0x559c4ce99860 2024-09-11T01:16:59.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.259+0000 7f2ad7613740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01b16b0 con 0x559c4cea57f0 2024-09-11T01:16:59.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.259+0000 7f2ad7613740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad01b0910 con 0x559c4ce98f40 2024-09-11T01:16:59.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.259+0000 7f2ad7613740 10 client.0 _ll_register_callbacks cb 0x7f2ac00a8900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:16:59.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.259+0000 7f2acd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce99860 0x559c4cea9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.259+0000 7f2ace800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4cea57f0 0x559c4cf21ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.259+0000 7f2ace800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4cea57f0 0x559c4cf21ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:39034/0 (socket says 172.21.15.103:39034) 2024-09-11T01:16:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.259+0000 7f2ace800640 1 -- 172.21.15.103:0/3116933331 learned_addr learned my addr 172.21.15.103:0/3116933331 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:16:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.259+0000 7f2acde00640 1 --2- 172.21.15.103:0/3116933331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce98f40 0x559c4cea8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.260+0000 7f2acd400640 1 -- 172.21.15.103:0/3116933331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce98f40 msgr2=0x559c4cea8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.260+0000 7f2acd400640 1 --2- 172.21.15.103:0/3116933331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce98f40 0x559c4cea8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.260+0000 7f2acd400640 1 -- 172.21.15.103:0/3116933331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4cea57f0 msgr2=0x559c4cf21ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:16:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.260+0000 7f2acd400640 1 --2- 172.21.15.103:0/3116933331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4cea57f0 0x559c4cf21ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.260+0000 7f2acd400640 1 -- 172.21.15.103:0/3116933331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c4cf22430 con 0x559c4ce99860 2024-09-11T01:16:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.260+0000 7f2acd400640 1 --2- 172.21.15.103:0/3116933331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce99860 0x559c4cea9060 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009230 tx=0x7f2ab802a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e00785669b76cee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:16:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.260+0000 7f2ab3400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:16:59.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.260+0000 7f2ab3400640 1 -- 172.21.15.103:0/3116933331 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab8035040 con 0x559c4ce99860 2024-09-11T01:16:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.260+0000 7f2ab3400640 1 -- 172.21.15.103:0/3116933331 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f2ab8005040 con 0x559c4ce99860 2024-09-11T01:16:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.260+0000 7f2ad7613740 1 -- 172.21.15.103:0/3116933331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ac00b1070 con 0x559c4ce99860 2024-09-11T01:16:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.260+0000 7f2ab3400640 1 -- 172.21.15.103:0/3116933331 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2ab8005240 con 0x559c4ce99860 2024-09-11T01:16:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.261+0000 7f2ad7613740 10 client.15885 fetch_fsmap learned FSMap version 31 2024-09-11T01:16:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.261+0000 7f2ad7613740 1 -- 172.21.15.103:0/3116933331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559c4cf23610 con 0x559c4ce99860 2024-09-11T01:16:59.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.261+0000 7f2ab3400640 1 -- 172.21.15.103:0/3116933331 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ac00b1070 con 0x559c4ce99860 2024-09-11T01:16:59.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.261+0000 7f2ab3400640 1 -- 172.21.15.103:0/3116933331 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f2ab80035f0 con 0x559c4ce99860 2024-09-11T01:16:59.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.261+0000 7f2ad7613740 10 client.15885 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:16:59.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.261+0000 7f2ad7613740 10 client.15885 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-11T01:16:59.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.261+0000 7f2ad7613740 20 client.15885 populate_metadata read hostname 'smithi103' 2024-09-11T01:16:59.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.261+0000 7f2ad7613740 1 --2- 172.21.15.103:0/3116933331 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x559c4cf23de0 0x559c4cf26200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:16:59.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.261+0000 7f2ad7613740 4 client.15885 mds_command: new command op to 24619 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-286870a3-1-mds.i.json"}] 2024-09-11T01:16:59.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.261+0000 7f2ad7613740 1 -- 172.21.15.103:0/3116933331 --> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-286870a3-1-mds.i.json"}) -- 0x559c4ce0de50 con 0x559c4cf23de0 2024-09-11T01:16:59.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.261+0000 7f2acde00640 1 --2- 172.21.15.103:0/3116933331 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x559c4cf23de0 0x559c4cf26200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:16:59.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.262+0000 7f2acde00640 1 --2- 172.21.15.103:0/3116933331 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x559c4cf23de0 0x559c4cf26200 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9d84016614e2483f server_cookie=94ceffc3f0b99ed7 in_seq=0 out_seq=0 2024-09-11T01:16:59.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.262+0000 7f2ab3400640 10 client.15885 ms_handle_connect on v2:172.21.15.183:6838/1006805616 2024-09-11T01:16:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ab3400640 1 -- 172.21.15.103:0/3116933331 <== mds.2 v2:172.21.15.183:6838/1006805616 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x559c4ce0de50 con 0x559c4cf23de0 2024-09-11T01:16:59.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ab3400640 10 client.15885 handle_command_reply: tid=0 2024-09-11T01:16:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ad7613740 1 client.15885 shutdown 2024-09-11T01:16:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ad7613740 1 -- 172.21.15.103:0/3116933331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce99860 msgr2=0x559c4cea9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ad7613740 1 --2- 172.21.15.103:0/3116933331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce99860 0x559c4cea9060 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8009230 tx=0x7f2ab802a400 comp rx=0 tx=0).stop 2024-09-11T01:16:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ad7613740 1 -- 172.21.15.103:0/3116933331 shutdown_connections 2024-09-11T01:16:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ad7613740 1 --2- 172.21.15.103:0/3116933331 >> [v2:172.21.15.183:6838/1006805616,v1:172.21.15.183:6839/1006805616] conn(0x559c4cf23de0 0x559c4cf26200 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ad7613740 1 --2- 172.21.15.103:0/3116933331 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x559c4cea57f0 0x559c4cf21ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ad7613740 1 --2- 172.21.15.103:0/3116933331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559c4ce99860 0x559c4cea9060 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ad7613740 1 --2- 172.21.15.103:0/3116933331 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x559c4ce98f40 0x559c4cea8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ad7613740 1 -- 172.21.15.103:0/3116933331 >> 172.21.15.103:0/3116933331 conn(0x559c4ce96d70 msgr2=0x559c4cea4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ab3400640 0 client.15885 ms_handle_reset on v2:172.21.15.183:6838/1006805616 2024-09-11T01:16:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ad7613740 1 -- 172.21.15.103:0/3116933331 shutdown_connections 2024-09-11T01:16:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ad7613740 1 -- 172.21.15.103:0/3116933331 wait complete. 2024-09-11T01:16:59.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2ad7613740 20 client.15885 trim_cache size 0 max 16384 2024-09-11T01:16:59.276 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:16:59.276 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/var/run/ceph/ops-286870a3-1-mds.i.json" 2024-09-11T01:16:59.276 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:16:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2acf200640 1 -- 172.21.15.103:0/412743282 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ab40b5390 msgr2=0x7f2ab40b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2acf200640 1 --2- 172.21.15.103:0/412743282 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ab40b5390 0x7f2ab40b7850 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f2ab8031440 tx=0x7f2ab8005b50 comp rx=0 tx=0).stop 2024-09-11T01:16:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2acf200640 1 -- 172.21.15.103:0/412743282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ad0104e10 msgr2=0x7f2ad019b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:16:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.272+0000 7f2acf200640 1 --2- 172.21.15.103:0/412743282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ad0104e10 0x7f2ad019b2d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2ac000eb90 tx=0x7f2ac000c6a0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.273+0000 7f2acf200640 1 -- 172.21.15.103:0/412743282 shutdown_connections 2024-09-11T01:16:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.273+0000 7f2acf200640 1 --2- 172.21.15.103:0/412743282 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ab40b5390 0x7f2ab40b7850 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.273+0000 7f2acf200640 1 --2- 172.21.15.103:0/412743282 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ad010b1a0 0x7f2ad01a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.273+0000 7f2acf200640 1 --2- 172.21.15.103:0/412743282 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ad010a820 0x7f2ad019b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.273+0000 7f2acf200640 1 --2- 172.21.15.103:0/412743282 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ad0104e10 0x7f2ad019b2d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:16:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.273+0000 7f2acf200640 1 -- 172.21.15.103:0/412743282 >> 172.21.15.103:0/412743282 conn(0x7f2ad0100840 msgr2=0x7f2ad0102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:16:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.273+0000 7f2acf200640 1 -- 172.21.15.103:0/412743282 shutdown_connections 2024-09-11T01:16:59.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:16:59.273+0000 7f2acf200640 1 -- 172.21.15.103:0/412743282 wait complete. 2024-09-11T01:16:59.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:16:59 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:17:00.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:16:59 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:17:00.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:16:59 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:17:00.174 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 1 (h) to a remote file /var/run/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ops-286870a3-1-mds.h.json 2024-09-11T01:17:00.174 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell mds.1:1 ops --flags=locks --path=/var/run/ceph/ops-286870a3-1-mds.h.json 2024-09-11T01:17:00.544 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:17:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:00 smithi183 ceph-mon[34992]: pgmap v660: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.4 MiB/s wr, 1.64k op/s 2024-09-11T01:17:00.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:00 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:17:00.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:00 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:17:00.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:00 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:17:00.987 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:00 smithi103 ceph-mon[30562]: pgmap v660: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.4 MiB/s wr, 1.64k op/s 2024-09-11T01:17:00.987 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:00 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:17:00.987 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:00 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:17:00.987 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:00 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:17:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.097+0000 7fc5f1200640 1 -- 172.21.15.103:0/981429691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5ec103bb0 msgr2=0x7fc5ec103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.097+0000 7fc5f1200640 1 --2- 172.21.15.103:0/981429691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5ec103bb0 0x7fc5ec103f90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc009860 tx=0x7fc5dc02a340 comp rx=0 tx=0).stop 2024-09-11T01:17:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.097+0000 7fc5f1200640 1 -- 172.21.15.103:0/981429691 shutdown_connections 2024-09-11T01:17:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.097+0000 7fc5f1200640 1 --2- 172.21.15.103:0/981429691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5ec10d160 0x7fc5ec10f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.097+0000 7fc5f1200640 1 --2- 172.21.15.103:0/981429691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5ec1045b0 0x7fc5ec10cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.097+0000 7fc5f1200640 1 --2- 172.21.15.103:0/981429691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5ec103bb0 0x7fc5ec103f90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.097+0000 7fc5f1200640 1 -- 172.21.15.103:0/981429691 >> 172.21.15.103:0/981429691 conn(0x7fc5ec0fd700 msgr2=0x7fc5ec0ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.097+0000 7fc5f1200640 1 -- 172.21.15.103:0/981429691 shutdown_connections 2024-09-11T01:17:01.099 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.097+0000 7fc5f1200640 1 -- 172.21.15.103:0/981429691 wait complete. 2024-09-11T01:17:01.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.098+0000 7fc5f1200640 1 Processor -- start 2024-09-11T01:17:01.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.098+0000 7fc5f1200640 1 -- start start 2024-09-11T01:17:01.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5f1200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5ec103bb0 0x7fc5ec1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5f1200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5ec1045b0 0x7fc5ec1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5f1200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5ec10d160 0x7fc5ec19eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5f1200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec112d80 con 0x7fc5ec10d160 2024-09-11T01:17:01.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5f1200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec112c00 con 0x7fc5ec103bb0 2024-09-11T01:17:01.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5f1200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec112f00 con 0x7fc5ec1045b0 2024-09-11T01:17:01.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5e9e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5ec103bb0 0x7fc5ec1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5e9e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5ec103bb0 0x7fc5ec1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:44694/0 (socket says 172.21.15.103:44694) 2024-09-11T01:17:01.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5e9e00640 1 -- 172.21.15.103:0/1220132264 learned_addr learned my addr 172.21.15.103:0/1220132264 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:01.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5ea800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5ec10d160 0x7fc5ec19eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5e3e00640 1 --2- 172.21.15.103:0/1220132264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5ec1045b0 0x7fc5ec1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5e9e00640 1 -- 172.21.15.103:0/1220132264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5ec1045b0 msgr2=0x7fc5ec1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:01.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5e9e00640 1 --2- 172.21.15.103:0/1220132264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5ec1045b0 0x7fc5ec1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5e9e00640 1 -- 172.21.15.103:0/1220132264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5ec10d160 msgr2=0x7fc5ec19eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:01.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5e9e00640 1 --2- 172.21.15.103:0/1220132264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5ec10d160 0x7fc5ec19eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5e9e00640 1 -- 172.21.15.103:0/1220132264 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5ec19f360 con 0x7fc5ec103bb0 2024-09-11T01:17:01.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.099+0000 7fc5e3e00640 1 --2- 172.21.15.103:0/1220132264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5ec1045b0 0x7fc5ec1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:17:01.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.100+0000 7fc5e9e00640 1 --2- 172.21.15.103:0/1220132264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5ec103bb0 0x7fc5ec1992b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0303f0 tx=0x7fc5dc032eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:01.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.100+0000 7fc5e2a00640 1 -- 172.21.15.103:0/1220132264 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc040020 con 0x7fc5ec103bb0 2024-09-11T01:17:01.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.100+0000 7fc5e2a00640 1 -- 172.21.15.103:0/1220132264 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5dc030450 con 0x7fc5ec103bb0 2024-09-11T01:17:01.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.100+0000 7fc5e2a00640 1 -- 172.21.15.103:0/1220132264 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc037040 con 0x7fc5ec103bb0 2024-09-11T01:17:01.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.100+0000 7fc5f1200640 1 -- 172.21.15.103:0/1220132264 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5ec19f5f0 con 0x7fc5ec103bb0 2024-09-11T01:17:01.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.100+0000 7fc5f1200640 1 -- 172.21.15.103:0/1220132264 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5ec1a5d10 con 0x7fc5ec103bb0 2024-09-11T01:17:01.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.103+0000 7fc5f3e39740 1 Processor -- start 2024-09-11T01:17:01.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.103+0000 7fc5f3e39740 1 -- start start 2024-09-11T01:17:01.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.104+0000 7fc5f3e39740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48ad80 0x55a88b48b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.104+0000 7fc5f3e39740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48b6a0 0x55a88b4970f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.104+0000 7fc5f3e39740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b499a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.104+0000 7fc5f3e39740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a88b402450 con 0x55a88b48b6a0 2024-09-11T01:17:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.104+0000 7fc5f3e39740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a88b3f1880 con 0x55a88b497630 2024-09-11T01:17:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.104+0000 7fc5f3e39740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a88b3f5690 con 0x55a88b48ad80 2024-09-11T01:17:01.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.104+0000 7fc5e2a00640 1 -- 172.21.15.103:0/1220132264 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7fc5dc04d060 con 0x7fc5ec103bb0 2024-09-11T01:17:01.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.104+0000 7fc5e3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b499a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.104+0000 7fc5e9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48b6a0 0x55a88b4970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.104+0000 7fc5ea800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48ad80 0x55a88b48b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.104+0000 7fc5e3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b499a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:44710/0 (socket says 172.21.15.103:44710) 2024-09-11T01:17:01.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.104+0000 7fc5e3e00640 1 -- 172.21.15.103:0/1669657204 learned_addr learned my addr 172.21.15.103:0/1669657204 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:01.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.105+0000 7fc5e3e00640 1 -- 172.21.15.103:0/1669657204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48ad80 msgr2=0x55a88b48b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:01.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.105+0000 7fc5e3e00640 1 --2- 172.21.15.103:0/1669657204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48ad80 0x55a88b48b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.105+0000 7fc5e3e00640 1 -- 172.21.15.103:0/1669657204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48b6a0 msgr2=0x55a88b4970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:01.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.105+0000 7fc5e3e00640 1 --2- 172.21.15.103:0/1669657204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48b6a0 0x55a88b4970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.105+0000 7fc5e3e00640 1 -- 172.21.15.103:0/1669657204 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88b3a3b00 con 0x55a88b497630 2024-09-11T01:17:01.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.105+0000 7fc5e3e00640 1 --2- 172.21.15.103:0/1669657204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b499a20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400bd30 tx=0x7fc5d400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa9c043fa748750c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:01.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.105+0000 7fc5db400640 1 -- 172.21.15.103:0/1669657204 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4005220 con 0x55a88b497630 2024-09-11T01:17:01.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.105+0000 7fc5db400640 1 -- 172.21.15.103:0/1669657204 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5d400be20 con 0x55a88b497630 2024-09-11T01:17:01.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.105+0000 7fc5db400640 1 -- 172.21.15.103:0/1669657204 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40116a0 con 0x55a88b497630 2024-09-11T01:17:01.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.106+0000 7fc5f3e39740 1 -- 172.21.15.103:0/1669657204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 msgr2=0x55a88b499a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:01.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.106+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/1669657204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b499a20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400bd30 tx=0x7fc5d400f730 comp rx=0 tx=0).stop 2024-09-11T01:17:01.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.106+0000 7fc5f3e39740 1 -- 172.21.15.103:0/1669657204 shutdown_connections 2024-09-11T01:17:01.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.106+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/1669657204 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b499a20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.106+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/1669657204 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48b6a0 0x55a88b4970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.106+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/1669657204 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48ad80 0x55a88b48b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.106+0000 7fc5f3e39740 1 -- 172.21.15.103:0/1669657204 >> 172.21.15.103:0/1669657204 conn(0x55a88b488bb0 msgr2=0x55a88b489d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.106+0000 7fc5e2a00640 1 --2- 172.21.15.103:0/1220132264 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc5d00b5360 0x7fc5d00b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.106+0000 7fc5f3e39740 1 -- 172.21.15.103:0/1669657204 shutdown_connections 2024-09-11T01:17:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.106+0000 7fc5f3e39740 1 -- 172.21.15.103:0/1669657204 wait complete. 2024-09-11T01:17:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.106+0000 7fc5e2a00640 1 -- 172.21.15.103:0/1220132264 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fc5dc105cf0 con 0x7fc5ec103bb0 2024-09-11T01:17:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.106+0000 7fc5ea800640 1 --2- 172.21.15.103:0/1220132264 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc5d00b5360 0x7fc5d00b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.107+0000 7fc5f3e39740 1 -- start start 2024-09-11T01:17:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.107+0000 7fc5f3e39740 1 Processor -- start 2024-09-11T01:17:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.107+0000 7fc5ea800640 1 --2- 172.21.15.103:0/1220132264 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc5d00b5360 0x7fc5d00b7820 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec06c570 tx=0x7fc5e4010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.107+0000 7fc5f3e39740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48ad80 0x55a88b496b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.107+0000 7fc5f3e39740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48b6a0 0x55a88b493fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5f3e39740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b494520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5f3e39740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a88b253380 con 0x55a88b48b6a0 2024-09-11T01:17:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5f3e39740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55a88b397260 con 0x55a88b497630 2024-09-11T01:17:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5f3e39740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55a88b49a2e0 con 0x55a88b48ad80 2024-09-11T01:17:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5f3e39740 10 client.0 _ll_register_callbacks cb 0x55a88b3eb7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5ea800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b494520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5e3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48b6a0 0x55a88b493fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5ea800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b494520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:44722/0 (socket says 172.21.15.103:44722) 2024-09-11T01:17:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5ea800640 1 -- 172.21.15.103:0/2254957460 learned_addr learned my addr 172.21.15.103:0/2254957460 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5e9e00640 1 --2- 172.21.15.103:0/2254957460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48ad80 0x55a88b496b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5ea800640 1 -- 172.21.15.103:0/2254957460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48ad80 msgr2=0x55a88b496b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5ea800640 1 --2- 172.21.15.103:0/2254957460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48ad80 0x55a88b496b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5ea800640 1 -- 172.21.15.103:0/2254957460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48b6a0 msgr2=0x55a88b493fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5ea800640 1 --2- 172.21.15.103:0/2254957460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48b6a0 0x55a88b493fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.108+0000 7fc5ea800640 1 -- 172.21.15.103:0/2254957460 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88b1c2490 con 0x55a88b497630 2024-09-11T01:17:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.109+0000 7fc5ea800640 1 --2- 172.21.15.103:0/2254957460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b494520 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40045c0 tx=0x7fc5e4004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77b1e0061f0f96c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.109+0000 7fc5cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:17:01.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.109+0000 7fc5cfe00640 1 -- 172.21.15.103:0/2254957460 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4020040 con 0x55a88b497630 2024-09-11T01:17:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.109+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2254957460 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5d400be20 con 0x55a88b497630 2024-09-11T01:17:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.109+0000 7fc5cfe00640 1 -- 172.21.15.103:0/2254957460 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fc5e400dc20 con 0x55a88b497630 2024-09-11T01:17:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.109+0000 7fc5cfe00640 1 -- 172.21.15.103:0/2254957460 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc5e4032050 con 0x55a88b497630 2024-09-11T01:17:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.109+0000 7fc5f3e39740 10 client.25979 fetch_fsmap learned FSMap version 31 2024-09-11T01:17:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.109+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2254957460 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a88b4a5920 con 0x55a88b497630 2024-09-11T01:17:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.110+0000 7fc5cfe00640 1 -- 172.21.15.103:0/2254957460 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5d400be20 con 0x55a88b497630 2024-09-11T01:17:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.110+0000 7fc5cfe00640 1 -- 172.21.15.103:0/2254957460 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fc5e400b040 con 0x55a88b497630 2024-09-11T01:17:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.110+0000 7fc5f3e39740 10 client.25979 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:17:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.110+0000 7fc5f3e39740 10 client.25979 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-11T01:17:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.110+0000 7fc5f3e39740 20 client.25979 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.110+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/2254957460 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55a88b4a6df0 0x55a88b4a9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.110+0000 7fc5f3e39740 4 client.25979 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:17:01.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.110+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2254957460 --> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a88b4043a0 con 0x55a88b4a6df0 2024-09-11T01:17:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.110+0000 7fc5e9e00640 1 --2- 172.21.15.103:0/2254957460 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55a88b4a6df0 0x55a88b4a9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.111+0000 7fc5e9e00640 1 --2- 172.21.15.103:0/2254957460 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55a88b4a6df0 0x55a88b4a9250 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c10bfcde6fe008ad server_cookie=44c52541c30e9692 in_seq=0 out_seq=0 2024-09-11T01:17:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.111+0000 7fc5cfe00640 10 client.25979 ms_handle_connect on v2:172.21.15.117:6836/294794871 2024-09-11T01:17:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.111+0000 7fc5cfe00640 1 -- 172.21.15.103:0/2254957460 <== mds.1 v2:172.21.15.117:6836/294794871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a88b4043a0 con 0x55a88b4a6df0 2024-09-11T01:17:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.111+0000 7fc5cfe00640 10 client.25979 handle_command_reply: tid=0 2024-09-11T01:17:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.112+0000 7fc5f3e39740 1 client.25979 shutdown 2024-09-11T01:17:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.112+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2254957460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 msgr2=0x55a88b494520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.112+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/2254957460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b494520 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40045c0 tx=0x7fc5e4004ab0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.112+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2254957460 shutdown_connections 2024-09-11T01:17:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.112+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/2254957460 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55a88b4a6df0 0x55a88b4a9250 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.112+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/2254957460 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b494520 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.112+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/2254957460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48b6a0 0x55a88b493fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.112+0000 7fc5cfe00640 0 client.25979 ms_handle_reset on v2:172.21.15.117:6836/294794871 2024-09-11T01:17:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.112+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/2254957460 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48ad80 0x55a88b496b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.112+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2254957460 >> 172.21.15.103:0/2254957460 conn(0x55a88b488bb0 msgr2=0x55a88b48e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.112+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2254957460 shutdown_connections 2024-09-11T01:17:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.112+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2254957460 wait complete. 2024-09-11T01:17:01.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.112+0000 7fc5f3e39740 20 client.25979 trim_cache size 0 max 16384 2024-09-11T01:17:01.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:00 smithi117 ceph-mon[35358]: pgmap v660: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.4 MiB/s wr, 1.64k op/s 2024-09-11T01:17:01.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:00 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:17:01.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:00 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:17:01.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:00 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:17:01.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.128+0000 7fc5f3e39740 1 Processor -- start 2024-09-11T01:17:01.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.128+0000 7fc5f3e39740 1 -- start start 2024-09-11T01:17:01.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5f3e39740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48ad80 0x55a88b48f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5f3e39740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b48b6a0 0x55a88b4aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5f3e39740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b497630 0x55a88b4af060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5f3e39740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec1b0230 con 0x55a88b48ad80 2024-09-11T01:17:01.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5f3e39740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec1adb00 con 0x55a88b48b6a0 2024-09-11T01:17:01.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5f3e39740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec1ab950 con 0x55a88b497630 2024-09-11T01:17:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5e9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48ad80 0x55a88b48f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5e9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48ad80 0x55a88b48f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43846/0 (socket says 172.21.15.103:43846) 2024-09-11T01:17:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5e9e00640 1 -- 172.21.15.103:0/3266149207 learned_addr learned my addr 172.21.15.103:0/3266149207 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5ea800640 1 --2- 172.21.15.103:0/3266149207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b497630 0x55a88b4af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5e3e00640 1 --2- 172.21.15.103:0/3266149207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b48b6a0 0x55a88b4aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5e9e00640 1 -- 172.21.15.103:0/3266149207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b497630 msgr2=0x55a88b4af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5e9e00640 1 --2- 172.21.15.103:0/3266149207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b497630 0x55a88b4af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5e9e00640 1 -- 172.21.15.103:0/3266149207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b48b6a0 msgr2=0x55a88b4aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5e9e00640 1 --2- 172.21.15.103:0/3266149207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b48b6a0 0x55a88b4aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5e9e00640 1 -- 172.21.15.103:0/3266149207 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a88b499d90 con 0x55a88b48ad80 2024-09-11T01:17:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5ea800640 1 --2- 172.21.15.103:0/3266149207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b497630 0x55a88b4af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:01.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.129+0000 7fc5e3e00640 1 --2- 172.21.15.103:0/3266149207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b48b6a0 0x55a88b4aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:01.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.130+0000 7fc5e9e00640 1 --2- 172.21.15.103:0/3266149207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48ad80 0x55a88b48f650 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0c8670 tx=0x7fc5dc0d5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e560a44cc3da20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.130+0000 7fc5daa00640 1 -- 172.21.15.103:0/3266149207 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0c86f0 con 0x55a88b48ad80 2024-09-11T01:17:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.130+0000 7fc5daa00640 1 -- 172.21.15.103:0/3266149207 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5dc0ef110 con 0x55a88b48ad80 2024-09-11T01:17:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.130+0000 7fc5daa00640 1 -- 172.21.15.103:0/3266149207 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0cb810 con 0x55a88b48ad80 2024-09-11T01:17:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.130+0000 7fc5f3e39740 1 -- 172.21.15.103:0/3266149207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48ad80 msgr2=0x55a88b48f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.130+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/3266149207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48ad80 0x55a88b48f650 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0c8670 tx=0x7fc5dc0d5040 comp rx=0 tx=0).stop 2024-09-11T01:17:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.131+0000 7fc5f3e39740 1 -- 172.21.15.103:0/3266149207 shutdown_connections 2024-09-11T01:17:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.131+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/3266149207 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b497630 0x55a88b4af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.131+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/3266149207 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b48b6a0 0x55a88b4aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.131+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/3266149207 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b48ad80 0x55a88b48f650 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.131+0000 7fc5f3e39740 1 -- 172.21.15.103:0/3266149207 >> 172.21.15.103:0/3266149207 conn(0x55a88b488bb0 msgr2=0x55a88b48df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.131+0000 7fc5f3e39740 1 -- 172.21.15.103:0/3266149207 shutdown_connections 2024-09-11T01:17:01.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.131+0000 7fc5f3e39740 1 -- 172.21.15.103:0/3266149207 wait complete. 2024-09-11T01:17:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.131+0000 7fc5f3e39740 1 -- start start 2024-09-11T01:17:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.131+0000 7fc5f3e39740 1 Processor -- start 2024-09-11T01:17:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.132+0000 7fc5f3e39740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48b6a0 0x55a88b49ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.132+0000 7fc5f3e39740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b49f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.132+0000 7fc5f3e39740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b511d30 0x55a88b514120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.132+0000 7fc5f3e39740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec1abfc0 con 0x55a88b511d30 2024-09-11T01:17:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.132+0000 7fc5f3e39740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec1ad430 con 0x55a88b497630 2024-09-11T01:17:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.132+0000 7fc5f3e39740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fc5ec1ac690 con 0x55a88b48b6a0 2024-09-11T01:17:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.132+0000 7fc5f3e39740 10 client.0 _ll_register_callbacks cb 0x7fc5e401d040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.132+0000 7fc5e9e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48b6a0 0x55a88b49ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.132+0000 7fc5e9e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48b6a0 0x55a88b49ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:33142/0 (socket says 172.21.15.103:33142) 2024-09-11T01:17:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.132+0000 7fc5ea800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b511d30 0x55a88b514120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.132+0000 7fc5e9e00640 1 -- 172.21.15.103:0/2424289185 learned_addr learned my addr 172.21.15.103:0/2424289185 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:01.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.132+0000 7fc5e3e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b49f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.132+0000 7fc5e9e00640 1 -- 172.21.15.103:0/2424289185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 msgr2=0x55a88b49f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.132+0000 7fc5e9e00640 1 --2- 172.21.15.103:0/2424289185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b49f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.133+0000 7fc5e9e00640 1 -- 172.21.15.103:0/2424289185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b511d30 msgr2=0x55a88b514120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.133+0000 7fc5e9e00640 1 --2- 172.21.15.103:0/2424289185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b511d30 0x55a88b514120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.133+0000 7fc5e9e00640 1 -- 172.21.15.103:0/2424289185 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a88b514810 con 0x55a88b48b6a0 2024-09-11T01:17:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.133+0000 7fc5e9e00640 1 --2- 172.21.15.103:0/2424289185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48b6a0 0x55a88b49ed20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0c9310 tx=0x7fc5dc004580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb0aede68922eca server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.133+0000 7fc5cfe00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:17:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.133+0000 7fc5cfe00640 1 -- 172.21.15.103:0/2424289185 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc0cb9f0 con 0x55a88b48b6a0 2024-09-11T01:17:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.133+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2424289185 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a88b494ea0 con 0x55a88b48b6a0 2024-09-11T01:17:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.133+0000 7fc5cfe00640 1 -- 172.21.15.103:0/2424289185 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fc5dc0d51a0 con 0x55a88b48b6a0 2024-09-11T01:17:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.133+0000 7fc5cfe00640 1 -- 172.21.15.103:0/2424289185 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc5dc0cbe70 con 0x55a88b48b6a0 2024-09-11T01:17:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.133+0000 7fc5f3e39740 10 client.25936 fetch_fsmap learned FSMap version 31 2024-09-11T01:17:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.133+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2424289185 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a88b515af0 con 0x55a88b48b6a0 2024-09-11T01:17:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.134+0000 7fc5cfe00640 1 -- 172.21.15.103:0/2424289185 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55a88b494ea0 con 0x55a88b48b6a0 2024-09-11T01:17:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.134+0000 7fc5cfe00640 1 -- 172.21.15.103:0/2424289185 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fc5dc10d040 con 0x55a88b48b6a0 2024-09-11T01:17:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.134+0000 7fc5f3e39740 10 client.25936 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:17:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.134+0000 7fc5f3e39740 10 client.25936 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-11T01:17:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.134+0000 7fc5f3e39740 20 client.25936 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:01.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.134+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/2424289185 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55a88b516200 0x55a88b518620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:01.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.134+0000 7fc5f3e39740 4 client.25936 mds_command: new command op to 24629 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-286870a3-1-mds.h.json"}] 2024-09-11T01:17:01.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.134+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2424289185 --> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-286870a3-1-mds.h.json"}) -- 0x55a88b3ffe50 con 0x55a88b516200 2024-09-11T01:17:01.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.134+0000 7fc5e3e00640 1 --2- 172.21.15.103:0/2424289185 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55a88b516200 0x55a88b518620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:01.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.135+0000 7fc5e3e00640 1 --2- 172.21.15.103:0/2424289185 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55a88b516200 0x55a88b518620 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c51c60fa7fd79296 server_cookie=675cfadff542d705 in_seq=0 out_seq=0 2024-09-11T01:17:01.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.135+0000 7fc5cfe00640 10 client.25936 ms_handle_connect on v2:172.21.15.117:6836/294794871 2024-09-11T01:17:01.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.143+0000 7fc5cfe00640 1 -- 172.21.15.103:0/2424289185 <== mds.1 v2:172.21.15.117:6836/294794871 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x55a88b3ffe50 con 0x55a88b516200 2024-09-11T01:17:01.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.143+0000 7fc5cfe00640 10 client.25936 handle_command_reply: tid=0 2024-09-11T01:17:01.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.143+0000 7fc5f3e39740 1 client.25936 shutdown 2024-09-11T01:17:01.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.143+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2424289185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48b6a0 msgr2=0x55a88b49ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.143+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/2424289185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48b6a0 0x55a88b49ed20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0c9310 tx=0x7fc5dc004580 comp rx=0 tx=0).stop 2024-09-11T01:17:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.143+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2424289185 shutdown_connections 2024-09-11T01:17:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.143+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/2424289185 >> [v2:172.21.15.117:6836/294794871,v1:172.21.15.117:6837/294794871] conn(0x55a88b516200 0x55a88b518620 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.143+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/2424289185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a88b511d30 0x55a88b514120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.143+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/2424289185 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55a88b497630 0x55a88b49f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.143+0000 7fc5cfe00640 0 client.25936 ms_handle_reset on v2:172.21.15.117:6836/294794871 2024-09-11T01:17:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.143+0000 7fc5f3e39740 1 --2- 172.21.15.103:0/2424289185 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55a88b48b6a0 0x55a88b49ed20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.143+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2424289185 >> 172.21.15.103:0/2424289185 conn(0x55a88b488bb0 msgr2=0x55a88b48e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.143+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2424289185 shutdown_connections 2024-09-11T01:17:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.144+0000 7fc5f3e39740 1 -- 172.21.15.103:0/2424289185 wait complete. 2024-09-11T01:17:01.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.144+0000 7fc5f3e39740 20 client.25936 trim_cache size 0 max 16384 2024-09-11T01:17:01.147 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:17:01.147 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/var/run/ceph/ops-286870a3-1-mds.h.json" 2024-09-11T01:17:01.147 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:17:01.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.144+0000 7fc5f1200640 1 -- 172.21.15.103:0/1220132264 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc5d00b5360 msgr2=0x7fc5d00b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:01.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.144+0000 7fc5f1200640 1 --2- 172.21.15.103:0/1220132264 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc5d00b5360 0x7fc5d00b7820 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec06c570 tx=0x7fc5e4010040 comp rx=0 tx=0).stop 2024-09-11T01:17:01.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.144+0000 7fc5f1200640 1 -- 172.21.15.103:0/1220132264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5ec103bb0 msgr2=0x7fc5ec1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:01.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.144+0000 7fc5f1200640 1 --2- 172.21.15.103:0/1220132264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5ec103bb0 0x7fc5ec1992b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0303f0 tx=0x7fc5dc032eb0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.144+0000 7fc5f1200640 1 -- 172.21.15.103:0/1220132264 shutdown_connections 2024-09-11T01:17:01.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.144+0000 7fc5f1200640 1 --2- 172.21.15.103:0/1220132264 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fc5d00b5360 0x7fc5d00b7820 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.144+0000 7fc5f1200640 1 --2- 172.21.15.103:0/1220132264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc5ec10d160 0x7fc5ec19eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.144+0000 7fc5f1200640 1 --2- 172.21.15.103:0/1220132264 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fc5ec1045b0 0x7fc5ec1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.144+0000 7fc5f1200640 1 --2- 172.21.15.103:0/1220132264 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5ec103bb0 0x7fc5ec1992b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:01.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.144+0000 7fc5f1200640 1 -- 172.21.15.103:0/1220132264 >> 172.21.15.103:0/1220132264 conn(0x7fc5ec0fd700 msgr2=0x7fc5ec0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:01.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.144+0000 7fc5f1200640 1 -- 172.21.15.103:0/1220132264 shutdown_connections 2024-09-11T01:17:01.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:01.145+0000 7fc5f1200640 1 -- 172.21.15.103:0/1220132264 wait complete. 2024-09-11T01:17:01.921 DEBUG:tasks.quiescer.fs.[cephfs]:Dumping ops on rank 0 (b) to a remote file /var/run/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ops-286870a3-1-mds.b.json 2024-09-11T01:17:01.922 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph tell mds.1:0 ops --flags=locks --path=/var/run/ceph/ops-286870a3-1-mds.b.json 2024-09-11T01:17:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:17:02.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.858+0000 7efc37200640 1 -- 172.21.15.103:0/3164847876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc30104fc0 msgr2=0x7efc301053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:02.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.858+0000 7efc37200640 1 --2- 172.21.15.103:0/3164847876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc30104fc0 0x7efc301053a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efc20009900 tx=0x7efc2002a3f0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.858+0000 7efc37200640 1 -- 172.21.15.103:0/3164847876 shutdown_connections 2024-09-11T01:17:02.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.858+0000 7efc37200640 1 --2- 172.21.15.103:0/3164847876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc3010b350 0x7efc30111b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.858+0000 7efc37200640 1 --2- 172.21.15.103:0/3164847876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc3010a9d0 0x7efc3010ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.858+0000 7efc37200640 1 --2- 172.21.15.103:0/3164847876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc30104fc0 0x7efc301053a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.858+0000 7efc37200640 1 -- 172.21.15.103:0/3164847876 >> 172.21.15.103:0/3164847876 conn(0x7efc301009f0 msgr2=0x7efc30102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:02.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.858+0000 7efc37200640 1 -- 172.21.15.103:0/3164847876 shutdown_connections 2024-09-11T01:17:02.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.858+0000 7efc37200640 1 -- 172.21.15.103:0/3164847876 wait complete. 2024-09-11T01:17:02.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.859+0000 7efc37200640 1 Processor -- start 2024-09-11T01:17:02.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.859+0000 7efc37200640 1 -- start start 2024-09-11T01:17:02.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc37200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc30104fc0 0x7efc3019b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc37200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc3010a9d0 0x7efc3019b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc37200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc3010b350 0x7efc301a0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc37200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efc30114f80 con 0x7efc3010a9d0 2024-09-11T01:17:02.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc37200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efc30114e00 con 0x7efc30104fc0 2024-09-11T01:17:02.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc37200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efc30115100 con 0x7efc3010b350 2024-09-11T01:17:02.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc2f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc3010a9d0 0x7efc3019b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc2fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc30104fc0 0x7efc3019b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.863 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc2f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc3010a9d0 0x7efc3019b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43868/0 (socket says 172.21.15.103:43868) 2024-09-11T01:17:02.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc2f400640 1 -- 172.21.15.103:0/3670407615 learned_addr learned my addr 172.21.15.103:0/3670407615 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:02.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc35200640 1 --2- 172.21.15.103:0/3670407615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc3010b350 0x7efc301a0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc2f400640 1 -- 172.21.15.103:0/3670407615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc3010b350 msgr2=0x7efc301a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:02.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc2f400640 1 --2- 172.21.15.103:0/3670407615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc3010b350 0x7efc301a0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc2f400640 1 -- 172.21.15.103:0/3670407615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc30104fc0 msgr2=0x7efc3019b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:02.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc2f400640 1 --2- 172.21.15.103:0/3670407615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc30104fc0 0x7efc3019b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.860+0000 7efc2f400640 1 -- 172.21.15.103:0/3670407615 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc301a1500 con 0x7efc3010a9d0 2024-09-11T01:17:02.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.861+0000 7efc2f400640 1 --2- 172.21.15.103:0/3670407615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc3010a9d0 0x7efc3019b990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7efc1800ea60 tx=0x7efc1800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:02.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.861+0000 7efc2cc00640 1 -- 172.21.15.103:0/3670407615 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1800cde0 con 0x7efc3010a9d0 2024-09-11T01:17:02.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.861+0000 7efc2cc00640 1 -- 172.21.15.103:0/3670407615 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc180035f0 con 0x7efc3010a9d0 2024-09-11T01:17:02.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.861+0000 7efc37200640 1 -- 172.21.15.103:0/3670407615 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc301a17f0 con 0x7efc3010a9d0 2024-09-11T01:17:02.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.861+0000 7efc2cc00640 1 -- 172.21.15.103:0/3670407615 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18010690 con 0x7efc3010a9d0 2024-09-11T01:17:02.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.861+0000 7efc37200640 1 -- 172.21.15.103:0/3670407615 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc301a7eb0 con 0x7efc3010a9d0 2024-09-11T01:17:02.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.865+0000 7efc39ccf740 1 Processor -- start 2024-09-11T01:17:02.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.866+0000 7efc39ccf740 1 -- start start 2024-09-11T01:17:02.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.866+0000 7efc39ccf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad0331160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.866+0000 7efc39ccf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad03316a0 0x55fad033d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.866+0000 7efc39ccf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad033d630 0x55fad033fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.866+0000 7efc39ccf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fad02a8450 con 0x55fad0330d80 2024-09-11T01:17:02.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.866+0000 7efc39ccf740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fad0297880 con 0x55fad03316a0 2024-09-11T01:17:02.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.866+0000 7efc39ccf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fad029b690 con 0x55fad033d630 2024-09-11T01:17:02.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.866+0000 7efc2cc00640 1 -- 172.21.15.103:0/3670407615 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7efc18004000 con 0x7efc3010a9d0 2024-09-11T01:17:02.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.866+0000 7efc2fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad03316a0 0x55fad033d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.866+0000 7efc35200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad0331160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.866+0000 7efc2fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad03316a0 0x55fad033d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:44762/0 (socket says 172.21.15.103:44762) 2024-09-11T01:17:02.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.866+0000 7efc2fe00640 1 -- 172.21.15.103:0/2097901667 learned_addr learned my addr 172.21.15.103:0/2097901667 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:02.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.867+0000 7efc2fe00640 1 -- 172.21.15.103:0/2097901667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad033d630 msgr2=0x55fad033fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:02.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.867+0000 7efc2f400640 1 --2- 172.21.15.103:0/2097901667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad033d630 0x55fad033fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.867+0000 7efc2fe00640 1 --2- 172.21.15.103:0/2097901667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad033d630 0x55fad033fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.867+0000 7efc2fe00640 1 -- 172.21.15.103:0/2097901667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 msgr2=0x55fad0331160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:02.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.867+0000 7efc2fe00640 1 --2- 172.21.15.103:0/2097901667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad0331160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.867+0000 7efc2fe00640 1 -- 172.21.15.103:0/2097901667 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fad0249b00 con 0x55fad03316a0 2024-09-11T01:17:02.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.867+0000 7efc35200640 1 --2- 172.21.15.103:0/2097901667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad0331160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:02.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.867+0000 7efc2f400640 1 --2- 172.21.15.103:0/2097901667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad033d630 0x55fad033fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-11T01:17:02.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.867+0000 7efc2fe00640 1 --2- 172.21.15.103:0/2097901667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad03316a0 0x55fad033d0f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efc20009900 tx=0x7efc20032b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ff073c566c03c10 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:02.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.867+0000 7efc25600640 1 -- 172.21.15.103:0/2097901667 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20040070 con 0x55fad03316a0 2024-09-11T01:17:02.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.868+0000 7efc25600640 1 -- 172.21.15.103:0/2097901667 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc20004030 con 0x55fad03316a0 2024-09-11T01:17:02.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.868+0000 7efc25600640 1 -- 172.21.15.103:0/2097901667 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20035040 con 0x55fad03316a0 2024-09-11T01:17:02.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.868+0000 7efc2cc00640 1 --2- 172.21.15.103:0/3670407615 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7efc140b52e0 0x7efc140b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.868+0000 7efc2cc00640 1 -- 172.21.15.103:0/3670407615 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7efc180e6330 con 0x7efc3010a9d0 2024-09-11T01:17:02.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.868+0000 7efc35200640 1 --2- 172.21.15.103:0/3670407615 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7efc140b52e0 0x7efc140b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.868+0000 7efc39ccf740 1 -- 172.21.15.103:0/2097901667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad03316a0 msgr2=0x55fad033d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:02.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.868+0000 7efc39ccf740 1 --2- 172.21.15.103:0/2097901667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad03316a0 0x55fad033d0f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efc20009900 tx=0x7efc20032b20 comp rx=0 tx=0).stop 2024-09-11T01:17:02.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.869+0000 7efc39ccf740 1 -- 172.21.15.103:0/2097901667 shutdown_connections 2024-09-11T01:17:02.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.869+0000 7efc39ccf740 1 --2- 172.21.15.103:0/2097901667 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad033d630 0x55fad033fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.869+0000 7efc39ccf740 1 --2- 172.21.15.103:0/2097901667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad03316a0 0x55fad033d0f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.869+0000 7efc39ccf740 1 --2- 172.21.15.103:0/2097901667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad0331160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.869+0000 7efc39ccf740 1 -- 172.21.15.103:0/2097901667 >> 172.21.15.103:0/2097901667 conn(0x55fad032ebb0 msgr2=0x55fad032fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:02.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.869+0000 7efc39ccf740 1 -- 172.21.15.103:0/2097901667 shutdown_connections 2024-09-11T01:17:02.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.869+0000 7efc39ccf740 1 -- 172.21.15.103:0/2097901667 wait complete. 2024-09-11T01:17:02.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.869+0000 7efc35200640 1 --2- 172.21.15.103:0/3670407615 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7efc140b52e0 0x7efc140b77a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efc28009fd0 tx=0x7efc28009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:02.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.869+0000 7efc39ccf740 1 -- start start 2024-09-11T01:17:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.870+0000 7efc39ccf740 1 Processor -- start 2024-09-11T01:17:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.870+0000 7efc39ccf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad033cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.870+0000 7efc39ccf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 0x55fad033a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.870+0000 7efc39ccf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad033d630 0x55fad033a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.870+0000 7efc39ccf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fad00f9380 con 0x55fad0330d80 2024-09-11T01:17:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.870+0000 7efc39ccf740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55fad023d260 con 0x55fad033d630 2024-09-11T01:17:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.870+0000 7efc39ccf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55fad0340280 con 0x55fad03316a0 2024-09-11T01:17:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.870+0000 7efc39ccf740 10 client.0 _ll_register_callbacks cb 0x55fad02917a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.870+0000 7efc2fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad033cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.870+0000 7efc2fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad033cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43888/0 (socket says 172.21.15.103:43888) 2024-09-11T01:17:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.870+0000 7efc2f400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 0x55fad033a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.870+0000 7efc2fe00640 1 -- 172.21.15.103:0/963270540 learned_addr learned my addr 172.21.15.103:0/963270540 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.870+0000 7efc35200640 1 --2- 172.21.15.103:0/963270540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad033d630 0x55fad033a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.871+0000 7efc2fe00640 1 -- 172.21.15.103:0/963270540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 msgr2=0x55fad033a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.871+0000 7efc2fe00640 1 --2- 172.21.15.103:0/963270540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 0x55fad033a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.871+0000 7efc2fe00640 1 -- 172.21.15.103:0/963270540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad033d630 msgr2=0x55fad033a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.871+0000 7efc2fe00640 1 --2- 172.21.15.103:0/963270540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad033d630 0x55fad033a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.871+0000 7efc2fe00640 1 -- 172.21.15.103:0/963270540 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fad0068490 con 0x55fad0330d80 2024-09-11T01:17:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.871+0000 7efc35200640 1 --2- 172.21.15.103:0/963270540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad033d630 0x55fad033a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:17:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.871+0000 7efc2fe00640 1 --2- 172.21.15.103:0/963270540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad033cc30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7efc200095f0 tx=0x7efc2002a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9ae603d47ca13a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.871+0000 7efc1e000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:17:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.871+0000 7efc1e000640 1 -- 172.21.15.103:0/963270540 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2004d060 con 0x55fad0330d80 2024-09-11T01:17:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.871+0000 7efc39ccf740 1 -- 172.21.15.103:0/963270540 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc20004030 con 0x55fad0330d80 2024-09-11T01:17:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.871+0000 7efc1e000640 1 -- 172.21.15.103:0/963270540 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7efc20005460 con 0x55fad0330d80 2024-09-11T01:17:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.872+0000 7efc1e000640 1 -- 172.21.15.103:0/963270540 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7efc20054050 con 0x55fad0330d80 2024-09-11T01:17:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.872+0000 7efc39ccf740 10 client.15915 fetch_fsmap learned FSMap version 31 2024-09-11T01:17:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.872+0000 7efc39ccf740 1 -- 172.21.15.103:0/963270540 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55fad034b860 con 0x55fad0330d80 2024-09-11T01:17:02.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.872+0000 7efc1e000640 1 -- 172.21.15.103:0/963270540 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc20004030 con 0x55fad0330d80 2024-09-11T01:17:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.872+0000 7efc1e000640 1 -- 172.21.15.103:0/963270540 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7efc20004cb0 con 0x55fad0330d80 2024-09-11T01:17:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.872+0000 7efc39ccf740 10 client.15915 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:17:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.872+0000 7efc39ccf740 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T01:17:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.872+0000 7efc39ccf740 20 client.15915 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.872+0000 7efc39ccf740 1 --2- 172.21.15.103:0/963270540 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fad034cbb0 0x55fad034efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.872+0000 7efc39ccf740 4 client.15915 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:17:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.872+0000 7efc39ccf740 1 -- 172.21.15.103:0/963270540 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fad02aa3a0 con 0x55fad034cbb0 2024-09-11T01:17:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.873+0000 7efc2f400640 1 --2- 172.21.15.103:0/963270540 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fad034cbb0 0x55fad034efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.873+0000 7efc1e000640 10 client.15915 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.873+0000 7efc2f400640 1 --2- 172.21.15.103:0/963270540 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fad034cbb0 0x55fad034efa0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c7c3bd6ae8a6b26 server_cookie=908ee0d5665c9e0a in_seq=0 out_seq=0 2024-09-11T01:17:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.874+0000 7efc1e000640 1 -- 172.21.15.103:0/963270540 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fad02aa3a0 con 0x55fad034cbb0 2024-09-11T01:17:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.874+0000 7efc1e000640 10 client.15915 handle_command_reply: tid=0 2024-09-11T01:17:02.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.874+0000 7efc39ccf740 1 client.15915 shutdown 2024-09-11T01:17:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.874+0000 7efc39ccf740 1 -- 172.21.15.103:0/963270540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 msgr2=0x55fad033cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.874+0000 7efc39ccf740 1 --2- 172.21.15.103:0/963270540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad033cc30 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7efc200095f0 tx=0x7efc2002a3f0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.874+0000 7efc39ccf740 1 -- 172.21.15.103:0/963270540 shutdown_connections 2024-09-11T01:17:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.874+0000 7efc39ccf740 1 --2- 172.21.15.103:0/963270540 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad033d630 0x55fad033a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.874+0000 7efc39ccf740 1 --2- 172.21.15.103:0/963270540 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fad034cbb0 0x55fad034efa0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.874+0000 7efc39ccf740 1 --2- 172.21.15.103:0/963270540 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 0x55fad033a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.874+0000 7efc39ccf740 1 --2- 172.21.15.103:0/963270540 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad033cc30 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.874+0000 7efc1e000640 0 client.15915 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.874+0000 7efc39ccf740 1 -- 172.21.15.103:0/963270540 >> 172.21.15.103:0/963270540 conn(0x55fad032ebb0 msgr2=0x55fad0334750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.874+0000 7efc39ccf740 1 -- 172.21.15.103:0/963270540 shutdown_connections 2024-09-11T01:17:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.875+0000 7efc39ccf740 1 -- 172.21.15.103:0/963270540 wait complete. 2024-09-11T01:17:02.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.875+0000 7efc39ccf740 20 client.15915 trim_cache size 0 max 16384 2024-09-11T01:17:02.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.891+0000 7efc39ccf740 1 Processor -- start 2024-09-11T01:17:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.891+0000 7efc39ccf740 1 -- start start 2024-09-11T01:17:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.891+0000 7efc39ccf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad0330d80 0x55fad033ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.891+0000 7efc39ccf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 0x55fad033ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.891+0000 7efc39ccf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad033d630 0x55fad032dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.891+0000 7efc39ccf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efc301b45f0 con 0x55fad033d630 2024-09-11T01:17:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.891+0000 7efc39ccf740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efc301b1ec0 con 0x55fad0330d80 2024-09-11T01:17:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.891+0000 7efc39ccf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efc301afd10 con 0x55fad03316a0 2024-09-11T01:17:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.891+0000 7efc35200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad033d630 0x55fad032dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.891+0000 7efc35200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad033d630 0x55fad032dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43890/0 (socket says 172.21.15.103:43890) 2024-09-11T01:17:02.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.891+0000 7efc35200640 1 -- 172.21.15.103:0/3610829072 learned_addr learned my addr 172.21.15.103:0/3610829072 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.891+0000 7efc2f400640 1 --2- 172.21.15.103:0/3610829072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 0x55fad033ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.892+0000 7efc2fe00640 1 --2- 172.21.15.103:0/3610829072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad0330d80 0x55fad033ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.892+0000 7efc35200640 1 -- 172.21.15.103:0/3610829072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 msgr2=0x55fad033ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.892+0000 7efc35200640 1 --2- 172.21.15.103:0/3610829072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 0x55fad033ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.892+0000 7efc35200640 1 -- 172.21.15.103:0/3610829072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad0330d80 msgr2=0x55fad033ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.892+0000 7efc35200640 1 --2- 172.21.15.103:0/3610829072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad0330d80 0x55fad033ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.892+0000 7efc35200640 1 -- 172.21.15.103:0/3610829072 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fad032f630 con 0x55fad033d630 2024-09-11T01:17:02.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.892+0000 7efc35200640 1 --2- 172.21.15.103:0/3610829072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad033d630 0x55fad032dc70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efc2801f430 tx=0x7efc28016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f662984bac72b8d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:02.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.892+0000 7efc24c00640 1 -- 172.21.15.103:0/3610829072 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28004b20 con 0x55fad033d630 2024-09-11T01:17:02.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.892+0000 7efc24c00640 1 -- 172.21.15.103:0/3610829072 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc28003e20 con 0x55fad033d630 2024-09-11T01:17:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.892+0000 7efc24c00640 1 -- 172.21.15.103:0/3610829072 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc280046f0 con 0x55fad033d630 2024-09-11T01:17:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.893+0000 7efc39ccf740 1 -- 172.21.15.103:0/3610829072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad033d630 msgr2=0x55fad032dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.893+0000 7efc39ccf740 1 --2- 172.21.15.103:0/3610829072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad033d630 0x55fad032dc70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7efc2801f430 tx=0x7efc28016000 comp rx=0 tx=0).stop 2024-09-11T01:17:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.893+0000 7efc39ccf740 1 -- 172.21.15.103:0/3610829072 shutdown_connections 2024-09-11T01:17:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.893+0000 7efc39ccf740 1 --2- 172.21.15.103:0/3610829072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad033d630 0x55fad032dc70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.893+0000 7efc39ccf740 1 --2- 172.21.15.103:0/3610829072 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 0x55fad033ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.893+0000 7efc39ccf740 1 --2- 172.21.15.103:0/3610829072 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad0330d80 0x55fad033ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.893+0000 7efc39ccf740 1 -- 172.21.15.103:0/3610829072 >> 172.21.15.103:0/3610829072 conn(0x55fad032ebb0 msgr2=0x55fad033bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.893+0000 7efc39ccf740 1 -- 172.21.15.103:0/3610829072 shutdown_connections 2024-09-11T01:17:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.893+0000 7efc39ccf740 1 -- 172.21.15.103:0/3610829072 wait complete. 2024-09-11T01:17:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.894+0000 7efc39ccf740 1 -- start start 2024-09-11T01:17:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.894+0000 7efc39ccf740 1 Processor -- start 2024-09-11T01:17:02.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.894+0000 7efc39ccf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad0344010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.894+0000 7efc39ccf740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 0x55fad0344590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.894+0000 7efc39ccf740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad033d630 0x55fad03b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.894+0000 7efc39ccf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7efc301b0380 con 0x55fad0330d80 2024-09-11T01:17:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.894+0000 7efc39ccf740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7efc301b17f0 con 0x55fad033d630 2024-09-11T01:17:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.895+0000 7efc39ccf740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7efc301b0a50 con 0x55fad03316a0 2024-09-11T01:17:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.895+0000 7efc39ccf740 10 client.0 _ll_register_callbacks cb 0x7efc28009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.895+0000 7efc2fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad0344010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.895+0000 7efc2fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad0344010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43894/0 (socket says 172.21.15.103:43894) 2024-09-11T01:17:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.895+0000 7efc2fe00640 1 -- 172.21.15.103:0/633314948 learned_addr learned my addr 172.21.15.103:0/633314948 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.895+0000 7efc35200640 1 --2- 172.21.15.103:0/633314948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad033d630 0x55fad03b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.895+0000 7efc2f400640 1 --2- 172.21.15.103:0/633314948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 0x55fad0344590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.895+0000 7efc2fe00640 1 -- 172.21.15.103:0/633314948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 msgr2=0x55fad0344590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.895+0000 7efc2fe00640 1 --2- 172.21.15.103:0/633314948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 0x55fad0344590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.895+0000 7efc2fe00640 1 -- 172.21.15.103:0/633314948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad033d630 msgr2=0x55fad03b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:02.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.895+0000 7efc2fe00640 1 --2- 172.21.15.103:0/633314948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad033d630 0x55fad03b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.895+0000 7efc2fe00640 1 -- 172.21.15.103:0/633314948 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fad03b1e90 con 0x55fad0330d80 2024-09-11T01:17:02.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.895+0000 7efc2f400640 1 --2- 172.21.15.103:0/633314948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 0x55fad0344590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:17:02.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.895+0000 7efc2fe00640 1 --2- 172.21.15.103:0/633314948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad0344010 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efc20009900 tx=0x7efc200054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9a58f02c222a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:02.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.896+0000 7efc1e000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:17:02.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.896+0000 7efc1e000640 1 -- 172.21.15.103:0/633314948 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc20040070 con 0x55fad0330d80 2024-09-11T01:17:02.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.896+0000 7efc39ccf740 1 -- 172.21.15.103:0/633314948 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc28003e20 con 0x55fad0330d80 2024-09-11T01:17:02.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.896+0000 7efc1e000640 1 -- 172.21.15.103:0/633314948 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7efc200314a0 con 0x55fad0330d80 2024-09-11T01:17:02.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.896+0000 7efc1e000640 1 -- 172.21.15.103:0/633314948 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7efc20065050 con 0x55fad0330d80 2024-09-11T01:17:02.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.896+0000 7efc39ccf740 10 client.15921 fetch_fsmap learned FSMap version 31 2024-09-11T01:17:02.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.896+0000 7efc39ccf740 1 -- 172.21.15.103:0/633314948 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55fad03ba3f0 con 0x55fad0330d80 2024-09-11T01:17:02.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.896+0000 7efc1e000640 1 -- 172.21.15.103:0/633314948 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc28003e20 con 0x55fad0330d80 2024-09-11T01:17:02.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.897+0000 7efc1e000640 1 -- 172.21.15.103:0/633314948 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7efc20060030 con 0x55fad0330d80 2024-09-11T01:17:02.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.897+0000 7efc39ccf740 10 client.15921 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:17:02.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.897+0000 7efc39ccf740 10 client.15921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-11T01:17:02.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.897+0000 7efc39ccf740 20 client.15921 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:02.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.897+0000 7efc39ccf740 1 --2- 172.21.15.103:0/633314948 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fad03bac90 0x55fad03bd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:02.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.897+0000 7efc39ccf740 4 client.15921 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-286870a3-1-mds.b.json"}] 2024-09-11T01:17:02.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.897+0000 7efc39ccf740 1 -- 172.21.15.103:0/633314948 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "ops", "flags": ["locks"], "path": "/var/run/ceph/ops-286870a3-1-mds.b.json"}) -- 0x55fad02a5e50 con 0x55fad03bac90 2024-09-11T01:17:02.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.897+0000 7efc2f400640 1 --2- 172.21.15.103:0/633314948 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fad03bac90 0x55fad03bd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:02.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.897+0000 7efc2f400640 1 --2- 172.21.15.103:0/633314948 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fad03bac90 0x55fad03bd0b0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69e51956d8324b5e server_cookie=5087fc0c5d4a9a51 in_seq=0 out_seq=0 2024-09-11T01:17:02.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.897+0000 7efc1e000640 10 client.15921 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:02.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.910+0000 7efc1e000640 1 -- 172.21.15.103:0/633314948 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+58 (crc 0 0 0) 0x55fad02a5e50 con 0x55fad03bac90 2024-09-11T01:17:02.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.910+0000 7efc1e000640 10 client.15921 handle_command_reply: tid=0 2024-09-11T01:17:02.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.910+0000 7efc39ccf740 1 client.15921 shutdown 2024-09-11T01:17:02.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.911+0000 7efc39ccf740 1 -- 172.21.15.103:0/633314948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 msgr2=0x55fad0344010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:02.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.911+0000 7efc39ccf740 1 --2- 172.21.15.103:0/633314948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad0344010 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efc20009900 tx=0x7efc200054a0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.911+0000 7efc39ccf740 1 -- 172.21.15.103:0/633314948 shutdown_connections 2024-09-11T01:17:02.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.911+0000 7efc39ccf740 1 --2- 172.21.15.103:0/633314948 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55fad033d630 0x55fad03b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.911+0000 7efc39ccf740 1 --2- 172.21.15.103:0/633314948 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55fad03bac90 0x55fad03bd0b0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.911+0000 7efc39ccf740 1 --2- 172.21.15.103:0/633314948 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55fad03316a0 0x55fad0344590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.911+0000 7efc39ccf740 1 --2- 172.21.15.103:0/633314948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fad0330d80 0x55fad0344010 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.911+0000 7efc39ccf740 1 -- 172.21.15.103:0/633314948 >> 172.21.15.103:0/633314948 conn(0x55fad032ebb0 msgr2=0x55fad032dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:02.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.911+0000 7efc1e000640 0 client.15921 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:02.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.911+0000 7efc39ccf740 1 -- 172.21.15.103:0/633314948 shutdown_connections 2024-09-11T01:17:02.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.911+0000 7efc39ccf740 1 -- 172.21.15.103:0/633314948 wait complete. 2024-09-11T01:17:02.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.911+0000 7efc39ccf740 20 client.15921 trim_cache size 0 max 16384 2024-09-11T01:17:02.914 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:17:02.914 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/var/run/ceph/ops-286870a3-1-mds.b.json" 2024-09-11T01:17:02.914 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:17:02.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.912+0000 7efc37200640 1 -- 172.21.15.103:0/3670407615 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7efc140b52e0 msgr2=0x7efc140b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:02.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.912+0000 7efc37200640 1 --2- 172.21.15.103:0/3670407615 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7efc140b52e0 0x7efc140b77a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efc28009fd0 tx=0x7efc28009500 comp rx=0 tx=0).stop 2024-09-11T01:17:02.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.912+0000 7efc37200640 1 -- 172.21.15.103:0/3670407615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc3010a9d0 msgr2=0x7efc3019b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:02.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.912+0000 7efc37200640 1 --2- 172.21.15.103:0/3670407615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc3010a9d0 0x7efc3019b990 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7efc1800ea60 tx=0x7efc1800ef20 comp rx=0 tx=0).stop 2024-09-11T01:17:02.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.912+0000 7efc37200640 1 -- 172.21.15.103:0/3670407615 shutdown_connections 2024-09-11T01:17:02.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.912+0000 7efc37200640 1 --2- 172.21.15.103:0/3670407615 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7efc140b52e0 0x7efc140b77a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.912+0000 7efc37200640 1 --2- 172.21.15.103:0/3670407615 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7efc3010b350 0x7efc301a0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.912+0000 7efc37200640 1 --2- 172.21.15.103:0/3670407615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7efc3010a9d0 0x7efc3019b990 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.912+0000 7efc37200640 1 --2- 172.21.15.103:0/3670407615 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc30104fc0 0x7efc3019b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:02.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.912+0000 7efc37200640 1 -- 172.21.15.103:0/3670407615 >> 172.21.15.103:0/3670407615 conn(0x7efc301009f0 msgr2=0x7efc30101250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:02.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.912+0000 7efc37200640 1 -- 172.21.15.103:0/3670407615 shutdown_connections 2024-09-11T01:17:02.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:02.912+0000 7efc37200640 1 -- 172.21.15.103:0/3670407615 wait complete. 2024-09-11T01:17:02.927 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:02 smithi103 ceph-mon[30562]: pgmap v661: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.5 MiB/s wr, 1.09k op/s 2024-09-11T01:17:03.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:02 smithi117 ceph-mon[35358]: pgmap v661: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.5 MiB/s wr, 1.09k op/s 2024-09-11T01:17:03.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:02 smithi183 ceph-mon[34992]: pgmap v661: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.5 MiB/s wr, 1.09k op/s 2024-09-11T01:17:03.808 DEBUG:teuthology.orchestra.run.smithi183:> mktemp 2024-09-11T01:17:03.848 INFO:teuthology.orchestra.run.smithi183.stdout:/tmp/tmp.93BWMKTBWd 2024-09-11T01:17:03.848 DEBUG:teuthology.orchestra.run.smithi183:> sudo cp /var/run/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ops-286870a3-1-mds.i.json /tmp/tmp.93BWMKTBWd 2024-09-11T01:17:03.998 DEBUG:teuthology.orchestra.run.smithi183:> sudo chmod 0666 /tmp/tmp.93BWMKTBWd 2024-09-11T01:17:04.111 DEBUG:teuthology.orchestra.remote:smithi183:/tmp/tmp.93BWMKTBWd is 390KB 2024-09-11T01:17:04.208 DEBUG:teuthology.orchestra.run.smithi183:> rm -fr /tmp/tmp.93BWMKTBWd 2024-09-11T01:17:04.226 DEBUG:tasks.quiescer.fs.[cephfs]:read 399540B of ops from '/var/run/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ops-286870a3-1-mds.i.json' on mds.2 (i) 2024-09-11T01:17:04.271 INFO:tasks.quiescer.fs.[cephfs]:Pulled 148 ops from rank 2 (i) into home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865/ops-286870a3-1-mds.i.json 2024-09-11T01:17:04.271 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -- /var/run/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ops-286870a3-1-mds.i.json 2024-09-11T01:17:04.299 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-09-11T01:17:04.325 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.yquOyZYQSm 2024-09-11T01:17:04.326 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /var/run/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ops-286870a3-1-mds.h.json /tmp/tmp.yquOyZYQSm 2024-09-11T01:17:04.466 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.yquOyZYQSm 2024-09-11T01:17:04.559 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.yquOyZYQSm is 339KB 2024-09-11T01:17:04.653 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.yquOyZYQSm 2024-09-11T01:17:04.670 DEBUG:tasks.quiescer.fs.[cephfs]:read 346938B of ops from '/var/run/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ops-286870a3-1-mds.h.json' on mds.1 (h) 2024-09-11T01:17:04.708 INFO:tasks.quiescer.fs.[cephfs]:Pulled 125 ops from rank 1 (h) into home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865/ops-286870a3-1-mds.h.json 2024-09-11T01:17:04.708 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -- /var/run/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ops-286870a3-1-mds.h.json 2024-09-11T01:17:04.732 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:04 smithi117 ceph-mon[35358]: pgmap v662: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 909 KiB/s wr, 187 op/s 2024-09-11T01:17:04.736 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-09-11T01:17:04.792 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.eLlSANgsfX 2024-09-11T01:17:04.793 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /var/run/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ops-286870a3-1-mds.b.json /tmp/tmp.eLlSANgsfX 2024-09-11T01:17:04.858 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.eLlSANgsfX 2024-09-11T01:17:04.982 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.eLlSANgsfX is 569KB 2024-09-11T01:17:05.081 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.eLlSANgsfX 2024-09-11T01:17:05.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:04 smithi103 ceph-mon[30562]: pgmap v662: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 909 KiB/s wr, 187 op/s 2024-09-11T01:17:05.096 DEBUG:tasks.quiescer.fs.[cephfs]:read 582337B of ops from '/var/run/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ops-286870a3-1-mds.b.json' on mds.0 (b) 2024-09-11T01:17:05.159 INFO:tasks.quiescer.fs.[cephfs]:Pulled 220 ops from rank 0 (b) into home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865/ops-286870a3-1-mds.b.json 2024-09-11T01:17:05.160 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -- /var/run/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ops-286870a3-1-mds.b.json 2024-09-11T01:17:05.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:04 smithi183 ceph-mon[34992]: pgmap v662: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 909 KiB/s wr, 187 op/s 2024-09-11T01:17:05.185 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:17:05.567 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:17:06.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.162+0000 7fe7fbc00640 1 -- 172.21.15.103:0/1729333679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7f4102da0 msgr2=0x7fe7f4103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:06.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.162+0000 7fe7fbc00640 1 --2- 172.21.15.103:0/1729333679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7f4102da0 0x7fe7f4103180 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4009ca0 tx=0x7fe7e402a8c0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.162+0000 7fe7fbc00640 1 -- 172.21.15.103:0/1729333679 shutdown_connections 2024-09-11T01:17:06.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.162+0000 7fe7fbc00640 1 --2- 172.21.15.103:0/1729333679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7f4109130 0x7fe7f410f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.164 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.162+0000 7fe7fbc00640 1 --2- 172.21.15.103:0/1729333679 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7f41087b0 0x7fe7f4108bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.162+0000 7fe7fbc00640 1 --2- 172.21.15.103:0/1729333679 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7f4102da0 0x7fe7f4103180 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.162+0000 7fe7fbc00640 1 -- 172.21.15.103:0/1729333679 >> 172.21.15.103:0/1729333679 conn(0x7fe7f40fe810 msgr2=0x7fe7f4100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.162+0000 7fe7fbc00640 1 -- 172.21.15.103:0/1729333679 shutdown_connections 2024-09-11T01:17:06.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.162+0000 7fe7fbc00640 1 -- 172.21.15.103:0/1729333679 wait complete. 2024-09-11T01:17:06.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.163+0000 7fe7fbc00640 1 Processor -- start 2024-09-11T01:17:06.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.163+0000 7fe7fbc00640 1 -- start start 2024-09-11T01:17:06.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.163+0000 7fe7fbc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7f4102da0 0x7fe7f419b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7fbc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7f41087b0 0x7fe7f419b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7fbc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7f4109130 0x7fe7f41a0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7fbc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f4112e40 con 0x7fe7f4102da0 2024-09-11T01:17:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7fbc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f4112cc0 con 0x7fe7f41087b0 2024-09-11T01:17:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7fbc00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f4112fc0 con 0x7fe7f4109130 2024-09-11T01:17:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7f9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7f4102da0 0x7fe7f419b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7f9200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7f4102da0 0x7fe7f419b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43908/0 (socket says 172.21.15.103:43908) 2024-09-11T01:17:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7f9200640 1 -- 172.21.15.103:0/841509996 learned_addr learned my addr 172.21.15.103:0/841509996 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7f3e00640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7f41087b0 0x7fe7f419b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7f9c00640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7f4109130 0x7fe7f41a0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7f3e00640 1 -- 172.21.15.103:0/841509996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7f4109130 msgr2=0x7fe7f41a0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7f3e00640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7f4109130 0x7fe7f41a0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7f3e00640 1 -- 172.21.15.103:0/841509996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7f4102da0 msgr2=0x7fe7f419b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:06.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7f3e00640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7f4102da0 0x7fe7f419b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7f3e00640 1 -- 172.21.15.103:0/841509996 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f41a1550 con 0x7fe7f41087b0 2024-09-11T01:17:06.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.164+0000 7fe7f9200640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7f4102da0 0x7fe7f419b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:06.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.165+0000 7fe7f3e00640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7f41087b0 0x7fe7f419b9e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe7e000e9f0 tx=0x7fe7e000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:06.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.165+0000 7fe7f1600640 1 -- 172.21.15.103:0/841509996 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e000ccc0 con 0x7fe7f41087b0 2024-09-11T01:17:06.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.165+0000 7fe7f1600640 1 -- 172.21.15.103:0/841509996 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7e0005020 con 0x7fe7f41087b0 2024-09-11T01:17:06.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.165+0000 7fe7fbc00640 1 -- 172.21.15.103:0/841509996 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f41a1840 con 0x7fe7f41087b0 2024-09-11T01:17:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.165+0000 7fe7f1600640 1 -- 172.21.15.103:0/841509996 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e000ce60 con 0x7fe7f41087b0 2024-09-11T01:17:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.165+0000 7fe7fbc00640 1 -- 172.21.15.103:0/841509996 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f41a7f00 con 0x7fe7f41087b0 2024-09-11T01:17:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.166+0000 7fe7fbc00640 1 -- 172.21.15.103:0/841509996 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f4103180 con 0x7fe7f41087b0 2024-09-11T01:17:06.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.169+0000 7fe7f1600640 1 -- 172.21.15.103:0/841509996 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7fe7e0004a20 con 0x7fe7f41087b0 2024-09-11T01:17:06.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.170+0000 7fe7f1600640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe7d80b52e0 0x7fe7d80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.170+0000 7fe7f1600640 1 -- 172.21.15.103:0/841509996 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fe7e00e5fe0 con 0x7fe7f41087b0 2024-09-11T01:17:06.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.170+0000 7fe7f9200640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe7d80b52e0 0x7fe7d80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.171+0000 7fe7f9200640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe7d80b52e0 0x7fe7d80b77a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4000f80 tx=0x7fe7e4005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:06.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.171+0000 7fe7f1600640 1 -- 172.21.15.103:0/841509996 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fe7e00acb20 con 0x7fe7f41087b0 2024-09-11T01:17:06.391 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.390+0000 7fe7fbc00640 1 -- 172.21.15.103:0/841509996 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7f419c5d0 con 0x7fe7f41087b0 2024-09-11T01:17:06.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.391+0000 7fe7f1600640 1 -- 172.21.15.103:0/841509996 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11930 (secure 0 0 0) 0x7fe7e00ac420 con 0x7fe7f41087b0 2024-09-11T01:17:06.393 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:17:06.393 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":31,"btime":"2024-09-11T01:12:40:372256+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:12:39.857673+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24619,24629,24665]},"id":1}]} 2024-09-11T01:17:06.393 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 31 2024-09-11T01:17:06.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.393+0000 7fe7fbc00640 1 -- 172.21.15.103:0/841509996 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe7d80b52e0 msgr2=0x7fe7d80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:06.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.393+0000 7fe7fbc00640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe7d80b52e0 0x7fe7d80b77a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4000f80 tx=0x7fe7e4005d80 comp rx=0 tx=0).stop 2024-09-11T01:17:06.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.393+0000 7fe7fbc00640 1 -- 172.21.15.103:0/841509996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7f41087b0 msgr2=0x7fe7f419b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:06.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.393+0000 7fe7fbc00640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7f41087b0 0x7fe7f419b9e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe7e000e9f0 tx=0x7fe7e000edf0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.393+0000 7fe7fbc00640 1 -- 172.21.15.103:0/841509996 shutdown_connections 2024-09-11T01:17:06.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.393+0000 7fe7fbc00640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fe7d80b52e0 0x7fe7d80b77a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.393+0000 7fe7fbc00640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fe7f4109130 0x7fe7f41a0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.393+0000 7fe7fbc00640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe7f41087b0 0x7fe7f419b9e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.393+0000 7fe7fbc00640 1 --2- 172.21.15.103:0/841509996 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7f4102da0 0x7fe7f419b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.393+0000 7fe7fbc00640 1 -- 172.21.15.103:0/841509996 >> 172.21.15.103:0/841509996 conn(0x7fe7f40fe810 msgr2=0x7fe7f4075ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.394+0000 7fe7fbc00640 1 -- 172.21.15.103:0/841509996 shutdown_connections 2024-09-11T01:17:06.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:06.394+0000 7fe7fbc00640 1 -- 172.21.15.103:0/841509996 wait complete. 2024-09-11T01:17:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.866+0000 7fac94000640 1 -- 172.21.15.103:0/1469225386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac8c075ac0 msgr2=0x7fac8c075f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.866+0000 7fac94000640 1 --2- 172.21.15.103:0/1469225386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac8c075ac0 0x7fac8c075f40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fac78009900 tx=0x7fac7802a410 comp rx=0 tx=0).stop 2024-09-11T01:17:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.866+0000 7fac94000640 1 -- 172.21.15.103:0/1469225386 shutdown_connections 2024-09-11T01:17:06.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.866+0000 7fac94000640 1 --2- 172.21.15.103:0/1469225386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac8c10a910 0x7fac8c10cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.866+0000 7fac94000640 1 --2- 172.21.15.103:0/1469225386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac8c075ac0 0x7fac8c075f40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.866+0000 7fac94000640 1 --2- 172.21.15.103:0/1469225386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac8c076f30 0x7fac8c075580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.866+0000 7fac94000640 1 -- 172.21.15.103:0/1469225386 >> 172.21.15.103:0/1469225386 conn(0x7fac8c0fe250 msgr2=0x7fac8c100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.866+0000 7fac94000640 1 -- 172.21.15.103:0/1469225386 shutdown_connections 2024-09-11T01:17:06.869 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.866+0000 7fac94000640 1 -- 172.21.15.103:0/1469225386 wait complete. 2024-09-11T01:17:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.867+0000 7fac94000640 1 Processor -- start 2024-09-11T01:17:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.867+0000 7fac94000640 1 -- start start 2024-09-11T01:17:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac94000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac8c075ac0 0x7fac8c19afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac94000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac8c076f30 0x7fac8c19b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac94000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac8c10a910 0x7fac8c19c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac94000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c110850 con 0x7fac8c075ac0 2024-09-11T01:17:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac94000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c1106d0 con 0x7fac8c10a910 2024-09-11T01:17:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac94000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c1109d0 con 0x7fac8c076f30 2024-09-11T01:17:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac91600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac8c075ac0 0x7fac8c19afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.871 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac91600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac8c075ac0 0x7fac8c19afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43926/0 (socket says 172.21.15.103:43926) 2024-09-11T01:17:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac91600640 1 -- 172.21.15.103:0/1405402246 learned_addr learned my addr 172.21.15.103:0/1405402246 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac92000640 1 --2- 172.21.15.103:0/1405402246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac8c10a910 0x7fac8c19c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac90c00640 1 --2- 172.21.15.103:0/1405402246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac8c076f30 0x7fac8c19b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac91600640 1 -- 172.21.15.103:0/1405402246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac8c076f30 msgr2=0x7fac8c19b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac91600640 1 --2- 172.21.15.103:0/1405402246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac8c076f30 0x7fac8c19b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac91600640 1 -- 172.21.15.103:0/1405402246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac8c10a910 msgr2=0x7fac8c19c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac91600640 1 --2- 172.21.15.103:0/1405402246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac8c10a910 0x7fac8c19c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.868+0000 7fac91600640 1 -- 172.21.15.103:0/1405402246 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c19cae0 con 0x7fac8c075ac0 2024-09-11T01:17:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.869+0000 7fac91600640 1 --2- 172.21.15.103:0/1405402246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac8c075ac0 0x7fac8c19afa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fac8000eb90 tx=0x7fac8000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.869+0000 7fac8a000640 1 -- 172.21.15.103:0/1405402246 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80004d20 con 0x7fac8c075ac0 2024-09-11T01:17:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.869+0000 7fac94000640 1 -- 172.21.15.103:0/1405402246 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8c19cdd0 con 0x7fac8c075ac0 2024-09-11T01:17:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.869+0000 7fac8a000640 1 -- 172.21.15.103:0/1405402246 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac8000ee90 con 0x7fac8c075ac0 2024-09-11T01:17:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.869+0000 7fac8a000640 1 -- 172.21.15.103:0/1405402246 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80010670 con 0x7fac8c075ac0 2024-09-11T01:17:06.872 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.869+0000 7fac94000640 1 -- 172.21.15.103:0/1405402246 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac8c1a34a0 con 0x7fac8c075ac0 2024-09-11T01:17:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.872+0000 7fac96df2740 1 Processor -- start 2024-09-11T01:17:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.872+0000 7fac96df2740 1 -- start start 2024-09-11T01:17:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.872+0000 7fac96df2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 0x55bcd98e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.872+0000 7fac96df2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.872+0000 7fac96df2740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e4b00 0x55bcd98e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.872+0000 7fac96df2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bcd98526b0 con 0x55bcd98e20c0 2024-09-11T01:17:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.872+0000 7fac96df2740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bcd9841ae0 con 0x55bcd98e4b00 2024-09-11T01:17:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.872+0000 7fac96df2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bcd98458f0 con 0x55bcd98df790 2024-09-11T01:17:06.874 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.872+0000 7fac8a000640 1 -- 172.21.15.103:0/1405402246 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7fac80005020 con 0x7fac8c075ac0 2024-09-11T01:17:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.873+0000 7fac90c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e4b00 0x55bcd98e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.873+0000 7fac91600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.873+0000 7fac92000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 0x55bcd98e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.873+0000 7fac90c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e4b00 0x55bcd98e6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:44832/0 (socket says 172.21.15.103:44832) 2024-09-11T01:17:06.875 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.873+0000 7fac90c00640 1 -- 172.21.15.103:0/3398574814 learned_addr learned my addr 172.21.15.103:0/3398574814 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:06.876 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.873+0000 7fac92000640 1 -- 172.21.15.103:0/3398574814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e4b00 msgr2=0x55bcd98e6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.873+0000 7fac92000640 1 --2- 172.21.15.103:0/3398574814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e4b00 0x55bcd98e6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.873+0000 7fac92000640 1 -- 172.21.15.103:0/3398574814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 msgr2=0x55bcd98e44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.873+0000 7fac92000640 1 --2- 172.21.15.103:0/3398574814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98e44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.873+0000 7fac92000640 1 -- 172.21.15.103:0/3398574814 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcd980e780 con 0x55bcd98df790 2024-09-11T01:17:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.873+0000 7fac92000640 1 --2- 172.21.15.103:0/3398574814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 0x55bcd98e1b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fac84009b50 tx=0x7fac84011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=210c2ae2c776f22b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.874+0000 7fac7e600640 1 -- 172.21.15.103:0/3398574814 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84004030 con 0x55bcd98df790 2024-09-11T01:17:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.874+0000 7fac7e600640 1 -- 172.21.15.103:0/3398574814 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac84005020 con 0x55bcd98df790 2024-09-11T01:17:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.874+0000 7fac7e600640 1 -- 172.21.15.103:0/3398574814 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84004b90 con 0x55bcd98df790 2024-09-11T01:17:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.874+0000 7fac8a000640 1 --2- 172.21.15.103:0/1405402246 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fac740b52e0 0x7fac740b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.874+0000 7fac96df2740 1 -- 172.21.15.103:0/3398574814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 msgr2=0x55bcd98e1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.874+0000 7fac96df2740 1 --2- 172.21.15.103:0/3398574814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 0x55bcd98e1b80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fac84009b50 tx=0x7fac84011810 comp rx=0 tx=0).stop 2024-09-11T01:17:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.874+0000 7fac8a000640 1 -- 172.21.15.103:0/1405402246 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fac800e66b0 con 0x7fac8c075ac0 2024-09-11T01:17:06.877 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.874+0000 7fac91600640 1 --2- 172.21.15.103:0/1405402246 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fac740b52e0 0x7fac740b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.874+0000 7fac96df2740 1 -- 172.21.15.103:0/3398574814 shutdown_connections 2024-09-11T01:17:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.874+0000 7fac96df2740 1 --2- 172.21.15.103:0/3398574814 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e4b00 0x55bcd98e6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.874+0000 7fac96df2740 1 --2- 172.21.15.103:0/3398574814 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98e44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.874+0000 7fac96df2740 1 --2- 172.21.15.103:0/3398574814 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 0x55bcd98e1b80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.874+0000 7fac96df2740 1 -- 172.21.15.103:0/3398574814 >> 172.21.15.103:0/3398574814 conn(0x55bcd98da8e0 msgr2=0x55bcd98db670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.874+0000 7fac96df2740 1 -- 172.21.15.103:0/3398574814 shutdown_connections 2024-09-11T01:17:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.875+0000 7fac96df2740 1 -- 172.21.15.103:0/3398574814 wait complete. 2024-09-11T01:17:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.875+0000 7fac91600640 1 --2- 172.21.15.103:0/1405402246 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fac740b52e0 0x7fac740b77a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fac800049d0 tx=0x7fac800ec530 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.875+0000 7fac96df2740 1 -- start start 2024-09-11T01:17:06.878 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.875+0000 7fac96df2740 1 Processor -- start 2024-09-11T01:17:06.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac96df2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 0x55bcd98e8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac96df2740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e20c0 0x55bcd98e95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac96df2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e4b00 0x55bcd98ea120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac96df2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bcd9779ab0 con 0x55bcd98e4b00 2024-09-11T01:17:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac96df2740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55bcd97e8570 con 0x55bcd98e20c0 2024-09-11T01:17:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac96df2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55bcd98e7ae0 con 0x55bcd98df790 2024-09-11T01:17:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac96df2740 10 client.0 _ll_register_callbacks cb 0x55bcd97f7100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac90c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e20c0 0x55bcd98e95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac92000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e4b00 0x55bcd98ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac90c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e20c0 0x55bcd98e95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:44842/0 (socket says 172.21.15.103:44842) 2024-09-11T01:17:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac90c00640 1 -- 172.21.15.103:0/529805629 learned_addr learned my addr 172.21.15.103:0/529805629 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac92000640 1 --2- 172.21.15.103:0/529805629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 0x55bcd98e8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac90c00640 1 -- 172.21.15.103:0/529805629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 msgr2=0x55bcd98e8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac90c00640 1 --2- 172.21.15.103:0/529805629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 0x55bcd98e8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac90c00640 1 -- 172.21.15.103:0/529805629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e4b00 msgr2=0x55bcd98ea120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac90c00640 1 --2- 172.21.15.103:0/529805629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e4b00 0x55bcd98ea120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.876+0000 7fac90c00640 1 -- 172.21.15.103:0/529805629 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcd95a3790 con 0x55bcd98e20c0 2024-09-11T01:17:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.877+0000 7fac90c00640 1 --2- 172.21.15.103:0/529805629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e20c0 0x55bcd98e95c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fac7802a930 tx=0x7fac78005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7fe5c3498b8f2b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.877+0000 7fac72a00640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:17:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.877+0000 7fac72a00640 1 -- 172.21.15.103:0/529805629 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78035040 con 0x55bcd98e20c0 2024-09-11T01:17:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.877+0000 7fac96df2740 1 -- 172.21.15.103:0/529805629 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac84005020 con 0x55bcd98e20c0 2024-09-11T01:17:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.877+0000 7fac72a00640 1 -- 172.21.15.103:0/529805629 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fac780048c0 con 0x55bcd98e20c0 2024-09-11T01:17:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.877+0000 7fac72a00640 1 -- 172.21.15.103:0/529805629 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fac7804e050 con 0x55bcd98e20c0 2024-09-11T01:17:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.877+0000 7fac96df2740 10 client.26021 fetch_fsmap learned FSMap version 31 2024-09-11T01:17:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.877+0000 7fac96df2740 1 -- 172.21.15.103:0/529805629 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55bcd961c620 con 0x55bcd98e20c0 2024-09-11T01:17:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.877+0000 7fac72a00640 1 -- 172.21.15.103:0/529805629 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac84005020 con 0x55bcd98e20c0 2024-09-11T01:17:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.877+0000 7fac72a00640 1 -- 172.21.15.103:0/529805629 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fac78003cb0 con 0x55bcd98e20c0 2024-09-11T01:17:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.878+0000 7fac96df2740 10 client.26021 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:17:06.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.878+0000 7fac96df2740 10 client.26021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:17:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.878+0000 7fac96df2740 20 client.26021 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.878+0000 7fac96df2740 1 --2- 172.21.15.103:0/529805629 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bcd98f47b0 0x55bcd98f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.878+0000 7fac96df2740 4 client.26021 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:17:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.878+0000 7fac96df2740 1 -- 172.21.15.103:0/529805629 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bcd9854600 con 0x55bcd98f47b0 2024-09-11T01:17:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.878+0000 7fac92000640 1 --2- 172.21.15.103:0/529805629 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bcd98f47b0 0x55bcd98f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.878+0000 7fac92000640 1 --2- 172.21.15.103:0/529805629 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bcd98f47b0 0x55bcd98f6ba0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58855c6054d376cb server_cookie=3bd5727e054a5318 in_seq=0 out_seq=0 2024-09-11T01:17:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.878+0000 7fac72a00640 10 client.26021 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.879+0000 7fac72a00640 1 -- 172.21.15.103:0/529805629 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55bcd9854600 con 0x55bcd98f47b0 2024-09-11T01:17:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.879+0000 7fac72a00640 10 client.26021 handle_command_reply: tid=0 2024-09-11T01:17:06.884 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.879+0000 7fac96df2740 1 client.26021 shutdown 2024-09-11T01:17:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.879+0000 7fac96df2740 1 -- 172.21.15.103:0/529805629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e20c0 msgr2=0x55bcd98e95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.879+0000 7fac96df2740 1 --2- 172.21.15.103:0/529805629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e20c0 0x55bcd98e95c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fac7802a930 tx=0x7fac78005270 comp rx=0 tx=0).stop 2024-09-11T01:17:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.879+0000 7fac96df2740 1 -- 172.21.15.103:0/529805629 shutdown_connections 2024-09-11T01:17:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.879+0000 7fac96df2740 1 --2- 172.21.15.103:0/529805629 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e4b00 0x55bcd98ea120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.879+0000 7fac96df2740 1 --2- 172.21.15.103:0/529805629 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e20c0 0x55bcd98e95c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.879+0000 7fac96df2740 1 --2- 172.21.15.103:0/529805629 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bcd98f47b0 0x55bcd98f6ba0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.885 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.879+0000 7fac96df2740 1 --2- 172.21.15.103:0/529805629 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 0x55bcd98e8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.880+0000 7fac96df2740 1 -- 172.21.15.103:0/529805629 >> 172.21.15.103:0/529805629 conn(0x55bcd98da8e0 msgr2=0x55bcd98d9a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.880+0000 7fac72a00640 0 client.26021 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.880+0000 7fac96df2740 1 -- 172.21.15.103:0/529805629 shutdown_connections 2024-09-11T01:17:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.880+0000 7fac96df2740 1 -- 172.21.15.103:0/529805629 wait complete. 2024-09-11T01:17:06.886 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.880+0000 7fac96df2740 20 client.26021 trim_cache size 0 max 16384 2024-09-11T01:17:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.895+0000 7fac96df2740 1 Processor -- start 2024-09-11T01:17:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.895+0000 7fac96df2740 1 -- start start 2024-09-11T01:17:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac96df2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 0x55bcd98e9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac96df2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98e7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac96df2740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e4b00 0x55bcd98e8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac96df2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c1b01b0 con 0x55bcd98e20c0 2024-09-11T01:17:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac96df2740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c1ada80 con 0x55bcd98e4b00 2024-09-11T01:17:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac96df2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c1ab8d0 con 0x55bcd98df790 2024-09-11T01:17:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac90c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98e7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac90c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98e7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43956/0 (socket says 172.21.15.103:43956) 2024-09-11T01:17:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac90c00640 1 -- 172.21.15.103:0/956132781 learned_addr learned my addr 172.21.15.103:0/956132781 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac92000640 1 --2- 172.21.15.103:0/956132781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e4b00 0x55bcd98e8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac92000640 1 --2- 172.21.15.103:0/956132781 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 0x55bcd98e9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac90c00640 1 -- 172.21.15.103:0/956132781 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 msgr2=0x55bcd98e9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac90c00640 1 --2- 172.21.15.103:0/956132781 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 0x55bcd98e9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac90c00640 1 -- 172.21.15.103:0/956132781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e4b00 msgr2=0x55bcd98e8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac90c00640 1 --2- 172.21.15.103:0/956132781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e4b00 0x55bcd98e8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac90c00640 1 -- 172.21.15.103:0/956132781 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bcd98f6f10 con 0x55bcd98e20c0 2024-09-11T01:17:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.896+0000 7fac92000640 1 --2- 172.21.15.103:0/956132781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e4b00 0x55bcd98e8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.897+0000 7fac90c00640 1 --2- 172.21.15.103:0/956132781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98e7ee0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fac78000c00 tx=0x7fac780319a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe5392e1c8820de server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.897+0000 7fac7dc00640 1 -- 172.21.15.103:0/956132781 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78057070 con 0x55bcd98e20c0 2024-09-11T01:17:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.897+0000 7fac7dc00640 1 -- 172.21.15.103:0/956132781 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac78040070 con 0x55bcd98e20c0 2024-09-11T01:17:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.897+0000 7fac7dc00640 1 -- 172.21.15.103:0/956132781 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78035070 con 0x55bcd98e20c0 2024-09-11T01:17:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.897+0000 7fac96df2740 1 -- 172.21.15.103:0/956132781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 msgr2=0x55bcd98e7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.897+0000 7fac96df2740 1 --2- 172.21.15.103:0/956132781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98e7ee0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fac78000c00 tx=0x7fac780319a0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.898+0000 7fac96df2740 1 -- 172.21.15.103:0/956132781 shutdown_connections 2024-09-11T01:17:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.898+0000 7fac96df2740 1 --2- 172.21.15.103:0/956132781 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98e4b00 0x55bcd98e8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.898+0000 7fac96df2740 1 --2- 172.21.15.103:0/956132781 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98e7ee0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.898+0000 7fac96df2740 1 --2- 172.21.15.103:0/956132781 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98df790 0x55bcd98e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.898+0000 7fac96df2740 1 -- 172.21.15.103:0/956132781 >> 172.21.15.103:0/956132781 conn(0x55bcd98da8e0 msgr2=0x55bcd98e8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.898+0000 7fac96df2740 1 -- 172.21.15.103:0/956132781 shutdown_connections 2024-09-11T01:17:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.898+0000 7fac96df2740 1 -- 172.21.15.103:0/956132781 wait complete. 2024-09-11T01:17:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.898+0000 7fac96df2740 1 -- start start 2024-09-11T01:17:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.898+0000 7fac96df2740 1 Processor -- start 2024-09-11T01:17:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac96df2740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98df790 0x55bcd98f0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac96df2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98f0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac96df2740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98e4b00 0x55bcd98eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac96df2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c1abf40 con 0x55bcd98e20c0 2024-09-11T01:17:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac96df2740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c1ad3b0 con 0x55bcd98df790 2024-09-11T01:17:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac96df2740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c1ac610 con 0x55bcd98e4b00 2024-09-11T01:17:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac96df2740 10 client.0 _ll_register_callbacks cb 0x7fac800093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac90c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac90c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98f0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43968/0 (socket says 172.21.15.103:43968) 2024-09-11T01:17:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac90c00640 1 -- 172.21.15.103:0/533199252 learned_addr learned my addr 172.21.15.103:0/533199252 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac92000640 1 --2- 172.21.15.103:0/533199252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98e4b00 0x55bcd98eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac92000640 1 --2- 172.21.15.103:0/533199252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98df790 0x55bcd98f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac90c00640 1 -- 172.21.15.103:0/533199252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98e4b00 msgr2=0x55bcd98eeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac90c00640 1 --2- 172.21.15.103:0/533199252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98e4b00 0x55bcd98eeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac90c00640 1 -- 172.21.15.103:0/533199252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98df790 msgr2=0x55bcd98f0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac90c00640 1 --2- 172.21.15.103:0/533199252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98df790 0x55bcd98f0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.899+0000 7fac90c00640 1 -- 172.21.15.103:0/533199252 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bcd98ea490 con 0x55bcd98e20c0 2024-09-11T01:17:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.900+0000 7fac90c00640 1 --2- 172.21.15.103:0/533199252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98f0810 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fac7802a930 tx=0x7fac78004540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ce4dd7977c666 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.900+0000 7fac72a00640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:17:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.900+0000 7fac72a00640 1 -- 172.21.15.103:0/533199252 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac78057040 con 0x55bcd98e20c0 2024-09-11T01:17:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.900+0000 7fac96df2740 1 -- 172.21.15.103:0/533199252 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac78040070 con 0x55bcd98e20c0 2024-09-11T01:17:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.900+0000 7fac72a00640 1 -- 172.21.15.103:0/533199252 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fac780046c0 con 0x55bcd98e20c0 2024-09-11T01:17:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.900+0000 7fac72a00640 1 -- 172.21.15.103:0/533199252 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fac78064050 con 0x55bcd98e20c0 2024-09-11T01:17:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.900+0000 7fac96df2740 10 client.15945 fetch_fsmap learned FSMap version 31 2024-09-11T01:17:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.900+0000 7fac96df2740 1 -- 172.21.15.103:0/533199252 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55bcd9961ed0 con 0x55bcd98e20c0 2024-09-11T01:17:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.900+0000 7fac72a00640 1 -- 172.21.15.103:0/533199252 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fac78040070 con 0x55bcd98e20c0 2024-09-11T01:17:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.900+0000 7fac72a00640 1 -- 172.21.15.103:0/533199252 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fac7805a030 con 0x55bcd98e20c0 2024-09-11T01:17:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.900+0000 7fac96df2740 10 client.15945 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:17:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.900+0000 7fac96df2740 10 client.15945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:17:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.900+0000 7fac96df2740 20 client.15945 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.901+0000 7fac96df2740 1 --2- 172.21.15.103:0/533199252 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bcd9962760 0x55bcd9964b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.901+0000 7fac96df2740 4 client.15945 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:17:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.901+0000 7fac96df2740 1 -- 172.21.15.103:0/533199252 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bcd98500b0 con 0x55bcd9962760 2024-09-11T01:17:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.901+0000 7fac92000640 1 --2- 172.21.15.103:0/533199252 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bcd9962760 0x55bcd9964b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.901+0000 7fac92000640 1 --2- 172.21.15.103:0/533199252 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bcd9962760 0x55bcd9964b50 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eba63e1a2ffa1a1 server_cookie=86da537833d4de8e in_seq=0 out_seq=0 2024-09-11T01:17:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.901+0000 7fac72a00640 10 client.15945 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:06.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.910+0000 7fac72a00640 1 -- 172.21.15.103:0/533199252 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bcd98500b0 con 0x55bcd9962760 2024-09-11T01:17:06.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.910+0000 7fac72a00640 10 client.15945 handle_command_reply: tid=0 2024-09-11T01:17:06.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.910+0000 7fac96df2740 1 client.15945 shutdown 2024-09-11T01:17:06.912 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.910+0000 7fac96df2740 1 -- 172.21.15.103:0/533199252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 msgr2=0x55bcd98f0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.910+0000 7fac96df2740 1 --2- 172.21.15.103:0/533199252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98f0810 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fac7802a930 tx=0x7fac78004540 comp rx=0 tx=0).stop 2024-09-11T01:17:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.910+0000 7fac96df2740 1 -- 172.21.15.103:0/533199252 shutdown_connections 2024-09-11T01:17:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.910+0000 7fac96df2740 1 --2- 172.21.15.103:0/533199252 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55bcd9962760 0x55bcd9964b50 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.910+0000 7fac96df2740 1 --2- 172.21.15.103:0/533199252 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55bcd98e4b00 0x55bcd98eeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.910+0000 7fac96df2740 1 --2- 172.21.15.103:0/533199252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bcd98e20c0 0x55bcd98f0810 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.910+0000 7fac72a00640 0 client.15945 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.910+0000 7fac96df2740 1 --2- 172.21.15.103:0/533199252 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55bcd98df790 0x55bcd98f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.910+0000 7fac96df2740 1 -- 172.21.15.103:0/533199252 >> 172.21.15.103:0/533199252 conn(0x55bcd98da8e0 msgr2=0x55bcd98e4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.911+0000 7fac96df2740 1 -- 172.21.15.103:0/533199252 shutdown_connections 2024-09-11T01:17:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.911+0000 7fac96df2740 1 -- 172.21.15.103:0/533199252 wait complete. 2024-09-11T01:17:06.913 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.911+0000 7fac96df2740 20 client.15945 trim_cache size 0 max 16384 2024-09-11T01:17:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:17:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:17:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:17:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:17:06.914 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.911+0000 7fac94000640 1 -- 172.21.15.103:0/1405402246 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fac740b52e0 msgr2=0x7fac740b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.911+0000 7fac94000640 1 --2- 172.21.15.103:0/1405402246 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fac740b52e0 0x7fac740b77a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fac800049d0 tx=0x7fac800ec530 comp rx=0 tx=0).stop 2024-09-11T01:17:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.911+0000 7fac94000640 1 -- 172.21.15.103:0/1405402246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac8c075ac0 msgr2=0x7fac8c19afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.911+0000 7fac94000640 1 --2- 172.21.15.103:0/1405402246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac8c075ac0 0x7fac8c19afa0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fac8000eb90 tx=0x7fac8000c6a0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.911+0000 7fac94000640 1 -- 172.21.15.103:0/1405402246 shutdown_connections 2024-09-11T01:17:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.911+0000 7fac94000640 1 --2- 172.21.15.103:0/1405402246 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fac740b52e0 0x7fac740b77a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.911+0000 7fac94000640 1 --2- 172.21.15.103:0/1405402246 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac8c10a910 0x7fac8c19c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.911+0000 7fac94000640 1 --2- 172.21.15.103:0/1405402246 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fac8c076f30 0x7fac8c19b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.911+0000 7fac94000640 1 --2- 172.21.15.103:0/1405402246 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fac8c075ac0 0x7fac8c19afa0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.911+0000 7fac94000640 1 -- 172.21.15.103:0/1405402246 >> 172.21.15.103:0/1405402246 conn(0x7fac8c0fe250 msgr2=0x7fac8c0fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.912+0000 7fac94000640 1 -- 172.21.15.103:0/1405402246 shutdown_connections 2024-09-11T01:17:06.915 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:06.912+0000 7fac94000640 1 -- 172.21.15.103:0/1405402246 wait complete. 2024-09-11T01:17:07.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:06 smithi103 ceph-mon[30562]: pgmap v663: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-11T01:17:07.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:06 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/841509996' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:17:07.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:06 smithi117 ceph-mon[35358]: pgmap v663: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-11T01:17:07.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:06 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/841509996' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:17:07.149 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24665 quiesce db --set-id 286870a3 --await-for 45.0' 2024-09-11T01:17:07.149 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24665 quiesce db --set-id 286870a3 --await-for 45.0 2024-09-11T01:17:07.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:06 smithi183 ceph-mon[34992]: pgmap v663: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.6 KiB/s wr, 8 op/s 2024-09-11T01:17:07.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:06 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/841509996' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:17:07.517 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:17:08.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.169+0000 7f8288a00640 1 -- 172.21.15.103:0/2798247504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8284104fc0 msgr2=0x7f82841053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:08.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.169+0000 7f8288a00640 1 --2- 172.21.15.103:0/2798247504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8284104fc0 0x7f82841053a0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8274009900 tx=0x7f827402a410 comp rx=0 tx=0).stop 2024-09-11T01:17:08.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.169+0000 7f8288a00640 1 -- 172.21.15.103:0/2798247504 shutdown_connections 2024-09-11T01:17:08.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.169+0000 7f8288a00640 1 --2- 172.21.15.103:0/2798247504 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f828410b350 0x7f8284111b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.169+0000 7f8288a00640 1 --2- 172.21.15.103:0/2798247504 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828410a9d0 0x7f828410ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.169+0000 7f8288a00640 1 --2- 172.21.15.103:0/2798247504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8284104fc0 0x7f82841053a0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.169+0000 7f8288a00640 1 -- 172.21.15.103:0/2798247504 >> 172.21.15.103:0/2798247504 conn(0x7f82841009f0 msgr2=0x7f8284102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:08.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.169+0000 7f8288a00640 1 -- 172.21.15.103:0/2798247504 shutdown_connections 2024-09-11T01:17:08.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.169+0000 7f8288a00640 1 -- 172.21.15.103:0/2798247504 wait complete. 2024-09-11T01:17:08.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.170+0000 7f8288a00640 1 Processor -- start 2024-09-11T01:17:08.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.171+0000 7f8288a00640 1 -- start start 2024-09-11T01:17:08.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.171+0000 7f8288a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8284104fc0 0x7f828419b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.171+0000 7f8288a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828410a9d0 0x7f828419b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.171+0000 7f8288a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f828410b350 0x7f82841a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.171+0000 7f8288a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8284114fd0 con 0x7f8284104fc0 2024-09-11T01:17:08.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.171+0000 7f8288a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8284114e50 con 0x7f828410b350 2024-09-11T01:17:08.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.171+0000 7f8288a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8284115150 con 0x7f828410a9d0 2024-09-11T01:17:08.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.171+0000 7f8281e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8284104fc0 0x7f828419b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.172+0000 7f8281e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8284104fc0 0x7f828419b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43978/0 (socket says 172.21.15.103:43978) 2024-09-11T01:17:08.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.172+0000 7f8281e00640 1 -- 172.21.15.103:0/660857165 learned_addr learned my addr 172.21.15.103:0/660857165 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:08.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.172+0000 7f8281400640 1 --2- 172.21.15.103:0/660857165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828410a9d0 0x7f828419b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.172+0000 7f8282800640 1 --2- 172.21.15.103:0/660857165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f828410b350 0x7f82841a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.172+0000 7f8281e00640 1 -- 172.21.15.103:0/660857165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828410a9d0 msgr2=0x7f828419b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:08.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.172+0000 7f8281e00640 1 --2- 172.21.15.103:0/660857165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828410a9d0 0x7f828419b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.172+0000 7f8281e00640 1 -- 172.21.15.103:0/660857165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f828410b350 msgr2=0x7f82841a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:08.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.172+0000 7f8281e00640 1 --2- 172.21.15.103:0/660857165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f828410b350 0x7f82841a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.172+0000 7f8281e00640 1 -- 172.21.15.103:0/660857165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82841a1530 con 0x7f8284104fc0 2024-09-11T01:17:08.175 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.172+0000 7f8281e00640 1 --2- 172.21.15.103:0/660857165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8284104fc0 0x7f828419b480 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8274005ab0 tx=0x7f8274003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:08.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.173+0000 7f827aa00640 1 -- 172.21.15.103:0/660857165 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827403f070 con 0x7f8284104fc0 2024-09-11T01:17:08.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.173+0000 7f827aa00640 1 -- 172.21.15.103:0/660857165 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8274031b60 con 0x7f8284104fc0 2024-09-11T01:17:08.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.173+0000 7f827aa00640 1 -- 172.21.15.103:0/660857165 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8274035030 con 0x7f8284104fc0 2024-09-11T01:17:08.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.173+0000 7f8288a00640 1 -- 172.21.15.103:0/660857165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82841a17c0 con 0x7f8284104fc0 2024-09-11T01:17:08.176 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.173+0000 7f8288a00640 1 -- 172.21.15.103:0/660857165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82841a7ee0 con 0x7f8284104fc0 2024-09-11T01:17:08.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.176+0000 7f827aa00640 1 -- 172.21.15.103:0/660857165 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f827403b460 con 0x7f8284104fc0 2024-09-11T01:17:08.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.176+0000 7f828b5ee740 1 Processor -- start 2024-09-11T01:17:08.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.176+0000 7f828b5ee740 1 -- start start 2024-09-11T01:17:08.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.177+0000 7f828b5ee740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef39490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.177+0000 7f828b5ee740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef399d0 0x55662ef45420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.177+0000 7f828b5ee740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef45960 0x55662ef47d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.177+0000 7f828b5ee740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55662eedc8d0 con 0x55662ef390b0 2024-09-11T01:17:08.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.177+0000 7f828b5ee740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55662eeb10c0 con 0x55662ef399d0 2024-09-11T01:17:08.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.177+0000 7f828b5ee740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55662eea04f0 con 0x55662ef45960 2024-09-11T01:17:08.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.177+0000 7f8282800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef39490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.177+0000 7f8281e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef399d0 0x55662ef45420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.177+0000 7f8281400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef45960 0x55662ef47d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.177+0000 7f8282800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef39490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43986/0 (socket says 172.21.15.103:43986) 2024-09-11T01:17:08.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.177+0000 7f8281400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef45960 0x55662ef47d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:33300/0 (socket says 172.21.15.103:33300) 2024-09-11T01:17:08.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.177+0000 7f8282800640 1 -- 172.21.15.103:0/152969228 learned_addr learned my addr 172.21.15.103:0/152969228 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:08.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.178+0000 7f8281e00640 1 -- 172.21.15.103:0/152969228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef45960 msgr2=0x55662ef47d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:08.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.178+0000 7f8281e00640 1 --2- 172.21.15.103:0/152969228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef45960 0x55662ef47d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.178+0000 7f8281e00640 1 -- 172.21.15.103:0/152969228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 msgr2=0x55662ef39490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:08.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.178+0000 7f8281e00640 1 --2- 172.21.15.103:0/152969228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef39490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.178+0000 7f8281e00640 1 -- 172.21.15.103:0/152969228 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662ebfeb00 con 0x55662ef399d0 2024-09-11T01:17:08.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.178+0000 7f8281e00640 1 --2- 172.21.15.103:0/152969228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef399d0 0x55662ef45420 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8274104000 tx=0x7f827410ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5acc4f6d4bb561e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:08.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.178+0000 7f827aa00640 1 --2- 172.21.15.103:0/660857165 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f82680b52e0 0x7f82680b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.178+0000 7f826f000640 1 -- 172.21.15.103:0/152969228 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8274110650 con 0x55662ef399d0 2024-09-11T01:17:08.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.178+0000 7f826f000640 1 -- 172.21.15.103:0/152969228 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8274116020 con 0x55662ef399d0 2024-09-11T01:17:08.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.178+0000 7f826f000640 1 -- 172.21.15.103:0/152969228 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827404c6f0 con 0x55662ef399d0 2024-09-11T01:17:08.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.179+0000 7f8282800640 1 --2- 172.21.15.103:0/660857165 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f82680b52e0 0x7f82680b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.179+0000 7f827aa00640 1 -- 172.21.15.103:0/660857165 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f8274106970 con 0x7f8284104fc0 2024-09-11T01:17:08.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.179+0000 7f828b5ee740 1 -- 172.21.15.103:0/152969228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef399d0 msgr2=0x55662ef45420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:08.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.179+0000 7f828b5ee740 1 --2- 172.21.15.103:0/152969228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef399d0 0x55662ef45420 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8274104000 tx=0x7f827410ccb0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.179+0000 7f8282800640 1 --2- 172.21.15.103:0/660857165 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f82680b52e0 0x7f82680b77a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f827c012640 tx=0x7f827c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:08.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.179+0000 7f828b5ee740 1 -- 172.21.15.103:0/152969228 shutdown_connections 2024-09-11T01:17:08.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.179+0000 7f828b5ee740 1 --2- 172.21.15.103:0/152969228 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef45960 0x55662ef47d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.179+0000 7f828b5ee740 1 --2- 172.21.15.103:0/152969228 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef399d0 0x55662ef45420 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.179+0000 7f828b5ee740 1 --2- 172.21.15.103:0/152969228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef39490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.179+0000 7f828b5ee740 1 -- 172.21.15.103:0/152969228 >> 172.21.15.103:0/152969228 conn(0x55662ef36ee0 msgr2=0x55662ef38080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:08.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.180+0000 7f828b5ee740 1 -- 172.21.15.103:0/152969228 shutdown_connections 2024-09-11T01:17:08.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.180+0000 7f828b5ee740 1 -- 172.21.15.103:0/152969228 wait complete. 2024-09-11T01:17:08.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.180+0000 7f828b5ee740 1 -- start start 2024-09-11T01:17:08.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.180+0000 7f828b5ee740 1 Processor -- start 2024-09-11T01:17:08.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.181+0000 7f828b5ee740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef453d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.181+0000 7f828b5ee740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 0x55662ef42820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.181+0000 7f828b5ee740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef45960 0x55662ef42fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.181+0000 7f828b5ee740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55662ee3b500 con 0x55662ef390b0 2024-09-11T01:17:08.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.181+0000 7f828b5ee740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55662eea4300 con 0x55662ef45960 2024-09-11T01:17:08.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.181+0000 7f828b5ee740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55662ed01bb0 con 0x55662ef399d0 2024-09-11T01:17:08.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.181+0000 7f828b5ee740 10 client.0 _ll_register_callbacks cb 0x55662ebaad70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:08.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.181+0000 7f8281e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.181+0000 7f8282800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef45960 0x55662ef42fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.181+0000 7f8281400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 0x55662ef42820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.181+0000 7f8282800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef45960 0x55662ef42fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:44896/0 (socket says 172.21.15.103:44896) 2024-09-11T01:17:08.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.181+0000 7f8282800640 1 -- 172.21.15.103:0/2738543234 learned_addr learned my addr 172.21.15.103:0/2738543234 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:08.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.182+0000 7f8282800640 1 -- 172.21.15.103:0/2738543234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 msgr2=0x55662ef42820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:08.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.182+0000 7f8282800640 1 --2- 172.21.15.103:0/2738543234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 0x55662ef42820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.182+0000 7f8282800640 1 -- 172.21.15.103:0/2738543234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 msgr2=0x55662ef453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:08.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.182+0000 7f8282800640 1 --2- 172.21.15.103:0/2738543234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.182+0000 7f8282800640 1 -- 172.21.15.103:0/2738543234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55662ef51540 con 0x55662ef45960 2024-09-11T01:17:08.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.182+0000 7f8282800640 1 --2- 172.21.15.103:0/2738543234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef45960 0x55662ef42fb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f827c009e60 tx=0x7f827c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8b923cea2da1182 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:08.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.182+0000 7f8263400640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:17:08.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.182+0000 7f8263400640 1 -- 172.21.15.103:0/2738543234 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c03f060 con 0x55662ef45960 2024-09-11T01:17:08.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.182+0000 7f828b5ee740 1 -- 172.21.15.103:0/2738543234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8274116020 con 0x55662ef45960 2024-09-11T01:17:08.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.182+0000 7f8263400640 1 -- 172.21.15.103:0/2738543234 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f827c01e5a0 con 0x55662ef45960 2024-09-11T01:17:08.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.183+0000 7f8263400640 1 -- 172.21.15.103:0/2738543234 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f827c046050 con 0x55662ef45960 2024-09-11T01:17:08.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.183+0000 7f828b5ee740 10 client.26039 fetch_fsmap learned FSMap version 31 2024-09-11T01:17:08.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.183+0000 7f828b5ee740 1 -- 172.21.15.103:0/2738543234 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55662ef53f50 con 0x55662ef45960 2024-09-11T01:17:08.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.183+0000 7f8263400640 1 -- 172.21.15.103:0/2738543234 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8274116020 con 0x55662ef45960 2024-09-11T01:17:08.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.183+0000 7f8263400640 1 -- 172.21.15.103:0/2738543234 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f827c03a8c0 con 0x55662ef45960 2024-09-11T01:17:08.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.184+0000 7f828b5ee740 10 client.26039 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:17:08.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.184+0000 7f828b5ee740 10 client.26039 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:17:08.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.184+0000 7f828b5ee740 20 client.26039 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:08.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.184+0000 7f828b5ee740 1 --2- 172.21.15.103:0/2738543234 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55662ef55400 0x55662ef57830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.184+0000 7f828b5ee740 4 client.26039 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:17:08.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.184+0000 7f828b5ee740 1 -- 172.21.15.103:0/2738543234 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55662eeb3010 con 0x55662ef55400 2024-09-11T01:17:08.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.184+0000 7f8281e00640 1 --2- 172.21.15.103:0/2738543234 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55662ef55400 0x55662ef57830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.184+0000 7f8281e00640 1 --2- 172.21.15.103:0/2738543234 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55662ef55400 0x55662ef57830 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdc1903b86c5873e server_cookie=9d078a75400a9315 in_seq=0 out_seq=0 2024-09-11T01:17:08.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.184+0000 7f8263400640 10 client.26039 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:08.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.185+0000 7f8263400640 1 -- 172.21.15.103:0/2738543234 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55662eeb3010 con 0x55662ef55400 2024-09-11T01:17:08.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.185+0000 7f8263400640 10 client.26039 handle_command_reply: tid=0 2024-09-11T01:17:08.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.185+0000 7f828b5ee740 1 client.26039 shutdown 2024-09-11T01:17:08.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.186+0000 7f828b5ee740 1 -- 172.21.15.103:0/2738543234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef45960 msgr2=0x55662ef42fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:08.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.186+0000 7f828b5ee740 1 --2- 172.21.15.103:0/2738543234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef45960 0x55662ef42fb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f827c009e60 tx=0x7f827c004ab0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.186+0000 7f828b5ee740 1 -- 172.21.15.103:0/2738543234 shutdown_connections 2024-09-11T01:17:08.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.186+0000 7f828b5ee740 1 --2- 172.21.15.103:0/2738543234 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef45960 0x55662ef42fb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.186+0000 7f828b5ee740 1 --2- 172.21.15.103:0/2738543234 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55662ef55400 0x55662ef57830 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.186+0000 7f828b5ee740 1 --2- 172.21.15.103:0/2738543234 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 0x55662ef42820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.186+0000 7f828b5ee740 1 --2- 172.21.15.103:0/2738543234 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.186+0000 7f828b5ee740 1 -- 172.21.15.103:0/2738543234 >> 172.21.15.103:0/2738543234 conn(0x55662ef36ee0 msgr2=0x55662ef361e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:08.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.186+0000 7f8263400640 0 client.26039 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:08.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.186+0000 7f828b5ee740 1 -- 172.21.15.103:0/2738543234 shutdown_connections 2024-09-11T01:17:08.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.186+0000 7f828b5ee740 1 -- 172.21.15.103:0/2738543234 wait complete. 2024-09-11T01:17:08.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.186+0000 7f828b5ee740 20 client.26039 trim_cache size 0 max 16384 2024-09-11T01:17:08.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.204+0000 7f828b5ee740 1 Processor -- start 2024-09-11T01:17:08.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.204+0000 7f828b5ee740 1 -- start start 2024-09-11T01:17:08.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.204+0000 7f828b5ee740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef3fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.204+0000 7f828b5ee740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 0x55662ef3ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.204+0000 7f828b5ee740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef45960 0x55662ef5d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.204+0000 7f828b5ee740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f82841b0280 con 0x55662ef390b0 2024-09-11T01:17:08.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.204+0000 7f828b5ee740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f82841adb50 con 0x55662ef45960 2024-09-11T01:17:08.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.204+0000 7f828b5ee740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f82841ab9a0 con 0x55662ef399d0 2024-09-11T01:17:08.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.205+0000 7f8281e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef3fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.205+0000 7f8281e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef3fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44000/0 (socket says 172.21.15.103:44000) 2024-09-11T01:17:08.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.205+0000 7f8281e00640 1 -- 172.21.15.103:0/2968597691 learned_addr learned my addr 172.21.15.103:0/2968597691 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:08.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.205+0000 7f8281400640 1 --2- 172.21.15.103:0/2968597691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 0x55662ef3ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.205+0000 7f8282800640 1 --2- 172.21.15.103:0/2968597691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef45960 0x55662ef5d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.205+0000 7f8281e00640 1 -- 172.21.15.103:0/2968597691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 msgr2=0x55662ef3ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:08.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.205+0000 7f8281e00640 1 --2- 172.21.15.103:0/2968597691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 0x55662ef3ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.205+0000 7f8281e00640 1 -- 172.21.15.103:0/2968597691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef45960 msgr2=0x55662ef5d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:08.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.205+0000 7f8281e00640 1 --2- 172.21.15.103:0/2968597691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef45960 0x55662ef5d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.205+0000 7f8281e00640 1 -- 172.21.15.103:0/2968597691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55662ef32c30 con 0x55662ef390b0 2024-09-11T01:17:08.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.205+0000 7f8282800640 1 --2- 172.21.15.103:0/2968597691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef45960 0x55662ef5d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:08.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.205+0000 7f8281e00640 1 --2- 172.21.15.103:0/2968597691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef3fa30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8274005ec0 tx=0x7f82740cc540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309ffbb2ec0c0feb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.206+0000 7f826e600640 1 -- 172.21.15.103:0/2968597691 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827403aca0 con 0x55662ef390b0 2024-09-11T01:17:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.206+0000 7f826e600640 1 -- 172.21.15.103:0/2968597691 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82740cc8e0 con 0x55662ef390b0 2024-09-11T01:17:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.206+0000 7f826e600640 1 -- 172.21.15.103:0/2968597691 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827403ae90 con 0x55662ef390b0 2024-09-11T01:17:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.206+0000 7f828b5ee740 1 -- 172.21.15.103:0/2968597691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 msgr2=0x55662ef3fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.206+0000 7f828b5ee740 1 --2- 172.21.15.103:0/2968597691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef3fa30 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f8274005ec0 tx=0x7f82740cc540 comp rx=0 tx=0).stop 2024-09-11T01:17:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.207+0000 7f828b5ee740 1 -- 172.21.15.103:0/2968597691 shutdown_connections 2024-09-11T01:17:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.207+0000 7f828b5ee740 1 --2- 172.21.15.103:0/2968597691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef45960 0x55662ef5d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.207+0000 7f828b5ee740 1 --2- 172.21.15.103:0/2968597691 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 0x55662ef3ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.207+0000 7f828b5ee740 1 --2- 172.21.15.103:0/2968597691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef390b0 0x55662ef3fa30 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.207+0000 7f828b5ee740 1 -- 172.21.15.103:0/2968597691 >> 172.21.15.103:0/2968597691 conn(0x55662ef36ee0 msgr2=0x55662ef44670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.207+0000 7f828b5ee740 1 -- 172.21.15.103:0/2968597691 shutdown_connections 2024-09-11T01:17:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.207+0000 7f828b5ee740 1 -- 172.21.15.103:0/2968597691 wait complete. 2024-09-11T01:17:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.207+0000 7f828b5ee740 1 -- start start 2024-09-11T01:17:08.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.207+0000 7f828b5ee740 1 Processor -- start 2024-09-11T01:17:08.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.208+0000 7f828b5ee740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef390b0 0x55662ef48890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.208+0000 7f828b5ee740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 0x55662ef48dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.208+0000 7f828b5ee740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef45960 0x55662ef49330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.208+0000 7f828b5ee740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f82841ac010 con 0x55662ef45960 2024-09-11T01:17:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.208+0000 7f828b5ee740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f82841ad480 con 0x55662ef390b0 2024-09-11T01:17:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.208+0000 7f828b5ee740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f82841ac6e0 con 0x55662ef399d0 2024-09-11T01:17:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.208+0000 7f828b5ee740 10 client.0 _ll_register_callbacks cb 0x7f827c009db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.208+0000 7f8281400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 0x55662ef48dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.208+0000 7f8281e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef390b0 0x55662ef48890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.208+0000 7f8281400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 0x55662ef48dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:33320/0 (socket says 172.21.15.103:33320) 2024-09-11T01:17:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.208+0000 7f8281400640 1 -- 172.21.15.103:0/3668380591 learned_addr learned my addr 172.21.15.103:0/3668380591 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.208+0000 7f8282800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef45960 0x55662ef49330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.209+0000 7f8282800640 1 -- 172.21.15.103:0/3668380591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 msgr2=0x55662ef48dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.209+0000 7f8282800640 1 --2- 172.21.15.103:0/3668380591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 0x55662ef48dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.209+0000 7f8282800640 1 -- 172.21.15.103:0/3668380591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef390b0 msgr2=0x55662ef48890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.209+0000 7f8282800640 1 --2- 172.21.15.103:0/3668380591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef390b0 0x55662ef48890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.209+0000 7f8282800640 1 -- 172.21.15.103:0/3668380591 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55662efc2610 con 0x55662ef45960 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.209+0000 7f8281e00640 1 --2- 172.21.15.103:0/3668380591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef390b0 0x55662ef48890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.209+0000 7f8282800640 1 --2- 172.21.15.103:0/3668380591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef45960 0x55662ef49330 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f827c03ad10 tx=0x7f827c00ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92c0901cf5a0fd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.209+0000 7f8263400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.209+0000 7f8263400640 1 -- 172.21.15.103:0/3668380591 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c04e020 con 0x55662ef45960 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.209+0000 7f8263400640 1 -- 172.21.15.103:0/3668380591 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f827c03a430 con 0x55662ef45960 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.209+0000 7f828b5ee740 1 -- 172.21.15.103:0/3668380591 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82740cc8e0 con 0x55662ef45960 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.210+0000 7f8263400640 1 -- 172.21.15.103:0/3668380591 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f827c059050 con 0x55662ef45960 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.210+0000 7f828b5ee740 10 client.15963 fetch_fsmap learned FSMap version 31 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.210+0000 7f828b5ee740 1 -- 172.21.15.103:0/3668380591 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55662efc3940 con 0x55662ef45960 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.210+0000 7f8263400640 1 -- 172.21.15.103:0/3668380591 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f82740cc8e0 con 0x55662ef45960 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.210+0000 7f8263400640 1 -- 172.21.15.103:0/3668380591 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f827c01eb40 con 0x55662ef45960 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.210+0000 7f828b5ee740 10 client.15963 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.210+0000 7f828b5ee740 10 client.15963 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.210+0000 7f828b5ee740 20 client.15963 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:08.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.210+0000 7f828b5ee740 1 --2- 172.21.15.103:0/3668380591 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55662efc40e0 0x55662efc6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:08.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.210+0000 7f828b5ee740 4 client.15963 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "286870a3", "await_for": 45.0}] 2024-09-11T01:17:08.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.210+0000 7f828b5ee740 1 -- 172.21.15.103:0/3668380591 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "quiesce db", "set_id": "286870a3", "await_for": 45.0}) -- 0x55662ef38ad0 con 0x55662efc40e0 2024-09-11T01:17:08.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.211+0000 7f8281e00640 1 --2- 172.21.15.103:0/3668380591 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55662efc40e0 0x55662efc6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:08.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.211+0000 7f8281e00640 1 --2- 172.21.15.103:0/3668380591 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55662efc40e0 0x55662efc6500 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df9b8fb23d8356f4 server_cookie=ff93a939704b2f6a in_seq=0 out_seq=0 2024-09-11T01:17:08.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.211+0000 7f8263400640 10 client.15963 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:08.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f8263400640 1 -- 172.21.15.103:0/3668380591 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+592 (crc 0 0 0) 0x55662ef38ad0 con 0x55662efc40e0 2024-09-11T01:17:08.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f8263400640 10 client.15963 handle_command_reply: tid=0 2024-09-11T01:17:08.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f828b5ee740 1 client.15963 shutdown 2024-09-11T01:17:08.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f828b5ee740 1 -- 172.21.15.103:0/3668380591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef45960 msgr2=0x55662ef49330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:08.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f828b5ee740 1 --2- 172.21.15.103:0/3668380591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef45960 0x55662ef49330 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f827c03ad10 tx=0x7f827c00ff30 comp rx=0 tx=0).stop 2024-09-11T01:17:08.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f828b5ee740 1 -- 172.21.15.103:0/3668380591 shutdown_connections 2024-09-11T01:17:08.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f828b5ee740 1 --2- 172.21.15.103:0/3668380591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55662ef45960 0x55662ef49330 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f828b5ee740 1 --2- 172.21.15.103:0/3668380591 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55662efc40e0 0x55662efc6500 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f828b5ee740 1 --2- 172.21.15.103:0/3668380591 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55662ef399d0 0x55662ef48dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f828b5ee740 1 --2- 172.21.15.103:0/3668380591 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55662ef390b0 0x55662ef48890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f828b5ee740 1 -- 172.21.15.103:0/3668380591 >> 172.21.15.103:0/3668380591 conn(0x55662ef36ee0 msgr2=0x55662ef3c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:08.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f8263400640 0 client.15963 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:08.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f828b5ee740 1 -- 172.21.15.103:0/3668380591 shutdown_connections 2024-09-11T01:17:08.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f828b5ee740 1 -- 172.21.15.103:0/3668380591 wait complete. 2024-09-11T01:17:08.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.212+0000 7f828b5ee740 20 client.15963 trim_cache size 0 max 16384 2024-09-11T01:17:08.217 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:17:08.217 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 31, 2024-09-11T01:17:08.217 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24665, 2024-09-11T01:17:08.217 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 15, 2024-09-11T01:17:08.218 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-09-11T01:17:08.218 INFO:teuthology.orchestra.run.smithi103.stdout: "286870a3": { 2024-09-11T01:17:08.218 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 15, 2024-09-11T01:17:08.218 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-09-11T01:17:08.218 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:17:08.218 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCED", 2024-09-11T01:17:08.218 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:17:08.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:17:08.218 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-09-11T01:17:08.218 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 150.0, 2024-09-11T01:17:08.218 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-09-11T01:17:08.218 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-09-11T01:17:08.218 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-09-11T01:17:08.218 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:17:08.219 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCED", 2024-09-11T01:17:08.219 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 34.8 2024-09-11T01:17:08.219 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:08.219 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:08.219 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:08.219 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:08.219 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:08.219 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:17:08.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.213+0000 7f8288a00640 1 -- 172.21.15.103:0/660857165 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f82680b52e0 msgr2=0x7f82680b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:08.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.213+0000 7f8288a00640 1 --2- 172.21.15.103:0/660857165 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f82680b52e0 0x7f82680b77a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f827c012640 tx=0x7f827c009500 comp rx=0 tx=0).stop 2024-09-11T01:17:08.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.213+0000 7f8288a00640 1 -- 172.21.15.103:0/660857165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8284104fc0 msgr2=0x7f828419b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:08.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.213+0000 7f8288a00640 1 --2- 172.21.15.103:0/660857165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8284104fc0 0x7f828419b480 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8274005ab0 tx=0x7f8274003c10 comp rx=0 tx=0).stop 2024-09-11T01:17:08.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.213+0000 7f8288a00640 1 -- 172.21.15.103:0/660857165 shutdown_connections 2024-09-11T01:17:08.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.213+0000 7f8288a00640 1 --2- 172.21.15.103:0/660857165 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f82680b52e0 0x7f82680b77a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.213+0000 7f8288a00640 1 --2- 172.21.15.103:0/660857165 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f828410b350 0x7f82841a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.213+0000 7f8288a00640 1 --2- 172.21.15.103:0/660857165 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f828410a9d0 0x7f828419b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.213+0000 7f8288a00640 1 --2- 172.21.15.103:0/660857165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8284104fc0 0x7f828419b480 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:08.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.213+0000 7f8288a00640 1 -- 172.21.15.103:0/660857165 >> 172.21.15.103:0/660857165 conn(0x7f82841009f0 msgr2=0x7f8284102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:08.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.213+0000 7f8288a00640 1 -- 172.21.15.103:0/660857165 shutdown_connections 2024-09-11T01:17:08.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:08.213+0000 7f8288a00640 1 -- 172.21.15.103:0/660857165 wait complete. 2024-09-11T01:17:09.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:08 smithi103 ceph-mon[30562]: pgmap v664: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-11T01:17:09.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:08 smithi117 ceph-mon[35358]: pgmap v664: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-11T01:17:09.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:08 smithi183 ceph-mon[34992]: pgmap v664: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2024-09-11T01:17:09.233 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '286870a3', quiesce took 289.9 seconds. Will release after: -259.9 2024-09-11T01:17:09.234 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:17:09.610 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:17:10.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.286+0000 7f6713e00640 1 -- 172.21.15.103:0/358915336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f670c1093d0 msgr2=0x7f670c1097b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:10.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.286+0000 7f6713e00640 1 --2- 172.21.15.103:0/358915336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f670c1093d0 0x7f670c1097b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6700009900 tx=0x7f670002a3f0 comp rx=0 tx=0).stop 2024-09-11T01:17:10.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.286+0000 7f6713e00640 1 -- 172.21.15.103:0/358915336 shutdown_connections 2024-09-11T01:17:10.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.286+0000 7f6713e00640 1 --2- 172.21.15.103:0/358915336 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f670c10f760 0x7f670c115f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:10.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.286+0000 7f6713e00640 1 --2- 172.21.15.103:0/358915336 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670c10ede0 0x7f670c10f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:10.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.286+0000 7f6713e00640 1 --2- 172.21.15.103:0/358915336 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f670c1093d0 0x7f670c1097b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:10.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.286+0000 7f6713e00640 1 -- 172.21.15.103:0/358915336 >> 172.21.15.103:0/358915336 conn(0x7f670c078a40 msgr2=0x7f670c07ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:10.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.287+0000 7f6713e00640 1 -- 172.21.15.103:0/358915336 shutdown_connections 2024-09-11T01:17:10.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.287+0000 7f6713e00640 1 -- 172.21.15.103:0/358915336 wait complete. 2024-09-11T01:17:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.288+0000 7f6713e00640 1 Processor -- start 2024-09-11T01:17:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.288+0000 7f6713e00640 1 -- start start 2024-09-11T01:17:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.288+0000 7f6713e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670c1093d0 0x7f670c19f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.288+0000 7f6713e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f670c10ede0 0x7f670c19fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.288+0000 7f6713e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f670c10f760 0x7f670c1a51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.288+0000 7f6713e00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f670c1193e0 con 0x7f670c10f760 2024-09-11T01:17:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.288+0000 7f6713e00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f670c119260 con 0x7f670c1093d0 2024-09-11T01:17:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.288+0000 7f6713e00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f670c119560 con 0x7f670c10ede0 2024-09-11T01:17:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.289+0000 7f6711e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f670c10f760 0x7f670c1a51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.289+0000 7f6711400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670c1093d0 0x7f670c19f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:10.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.289+0000 7f6711e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f670c10f760 0x7f670c1a51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48476/0 (socket says 172.21.15.103:48476) 2024-09-11T01:17:10.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.289+0000 7f6711e00640 1 -- 172.21.15.103:0/3838326512 learned_addr learned my addr 172.21.15.103:0/3838326512 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:10.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.289+0000 7f6710a00640 1 --2- 172.21.15.103:0/3838326512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f670c10ede0 0x7f670c19fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:10.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.289+0000 7f6711400640 1 -- 172.21.15.103:0/3838326512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f670c10ede0 msgr2=0x7f670c19fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:10.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.289+0000 7f6711400640 1 --2- 172.21.15.103:0/3838326512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f670c10ede0 0x7f670c19fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:10.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.289+0000 7f6711400640 1 -- 172.21.15.103:0/3838326512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f670c10f760 msgr2=0x7f670c1a51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:10.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.289+0000 7f6711400640 1 --2- 172.21.15.103:0/3838326512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f670c10f760 0x7f670c1a51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:10.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.289+0000 7f6711400640 1 -- 172.21.15.103:0/3838326512 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670c1a59c0 con 0x7f670c1093d0 2024-09-11T01:17:10.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.289+0000 7f6710a00640 1 --2- 172.21.15.103:0/3838326512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f670c10ede0 0x7f670c19fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:10.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.290+0000 7f6711400640 1 --2- 172.21.15.103:0/3838326512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670c1093d0 0x7f670c19f910 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f670002a9e0 tx=0x7f6700003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:10.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.290+0000 7f670a000640 1 -- 172.21.15.103:0/3838326512 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670003f070 con 0x7f670c1093d0 2024-09-11T01:17:10.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.290+0000 7f6713e00640 1 -- 172.21.15.103:0/3838326512 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f670c1a5c50 con 0x7f670c1093d0 2024-09-11T01:17:10.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.290+0000 7f670a000640 1 -- 172.21.15.103:0/3838326512 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6700031b50 con 0x7f670c1093d0 2024-09-11T01:17:10.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.290+0000 7f670a000640 1 -- 172.21.15.103:0/3838326512 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6700035030 con 0x7f670c1093d0 2024-09-11T01:17:10.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.290+0000 7f6713e00640 1 -- 172.21.15.103:0/3838326512 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f670c1ac370 con 0x7f670c1093d0 2024-09-11T01:17:10.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.291+0000 7f6713e00640 1 -- 172.21.15.103:0/3838326512 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f670c1097b0 con 0x7f670c1093d0 2024-09-11T01:17:10.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.294+0000 7f670a000640 1 -- 172.21.15.103:0/3838326512 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f67000316a0 con 0x7f670c1093d0 2024-09-11T01:17:10.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.295+0000 7f670a000640 1 --2- 172.21.15.103:0/3838326512 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f66f40b52e0 0x7f66f40b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:10.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.295+0000 7f670a000640 1 -- 172.21.15.103:0/3838326512 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f6700106a70 con 0x7f670c1093d0 2024-09-11T01:17:10.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.295+0000 7f6710a00640 1 --2- 172.21.15.103:0/3838326512 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f66f40b52e0 0x7f66f40b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:10.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.296+0000 7f6710a00640 1 --2- 172.21.15.103:0/3838326512 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f66f40b52e0 0x7f66f40b77a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f66f80095f0 tx=0x7f66f8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:10.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.297+0000 7f670a000640 1 -- 172.21.15.103:0/3838326512 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f6700031d00 con 0x7f670c1093d0 2024-09-11T01:17:10.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.527+0000 7f6713e00640 1 -- 172.21.15.103:0/3838326512 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f670c1a0a40 con 0x7f670c1093d0 2024-09-11T01:17:10.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.528+0000 7f670a000640 1 -- 172.21.15.103:0/3838326512 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11930 (secure 0 0 0) 0x7f67000cced0 con 0x7f670c1093d0 2024-09-11T01:17:10.530 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:17:10.530 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":31,"btime":"2024-09-11T01:12:40:372256+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:12:39.857673+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24619,24629,24665]},"id":1}]} 2024-09-11T01:17:10.530 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 31 2024-09-11T01:17:10.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.530+0000 7f6713e00640 1 -- 172.21.15.103:0/3838326512 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f66f40b52e0 msgr2=0x7f66f40b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:10.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.530+0000 7f6713e00640 1 --2- 172.21.15.103:0/3838326512 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f66f40b52e0 0x7f66f40b77a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f66f80095f0 tx=0x7f66f8005f90 comp rx=0 tx=0).stop 2024-09-11T01:17:10.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.530+0000 7f6713e00640 1 -- 172.21.15.103:0/3838326512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670c1093d0 msgr2=0x7f670c19f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:10.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.530+0000 7f6713e00640 1 --2- 172.21.15.103:0/3838326512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670c1093d0 0x7f670c19f910 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f670002a9e0 tx=0x7f6700003b90 comp rx=0 tx=0).stop 2024-09-11T01:17:10.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.530+0000 7f6713e00640 1 -- 172.21.15.103:0/3838326512 shutdown_connections 2024-09-11T01:17:10.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.530+0000 7f6713e00640 1 --2- 172.21.15.103:0/3838326512 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f66f40b52e0 0x7f66f40b77a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:10.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.530+0000 7f6713e00640 1 --2- 172.21.15.103:0/3838326512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f670c10f760 0x7f670c1a51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:10.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.530+0000 7f6713e00640 1 --2- 172.21.15.103:0/3838326512 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f670c10ede0 0x7f670c19fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:10.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.530+0000 7f6713e00640 1 --2- 172.21.15.103:0/3838326512 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f670c1093d0 0x7f670c19f910 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:10.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.530+0000 7f6713e00640 1 -- 172.21.15.103:0/3838326512 >> 172.21.15.103:0/3838326512 conn(0x7f670c078a40 msgr2=0x7f670c079280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:10.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.531+0000 7f6713e00640 1 -- 172.21.15.103:0/3838326512 shutdown_connections 2024-09-11T01:17:10.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:10.531+0000 7f6713e00640 1 -- 172.21.15.103:0/3838326512 wait complete. 2024-09-11T01:17:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:10 smithi103 ceph-mon[30562]: pgmap v665: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-11T01:17:10.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:10 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3838326512' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:17:11.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:10 smithi117 ceph-mon[35358]: pgmap v665: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-11T01:17:11.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:10 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3838326512' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:17:11.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:10 smithi183 ceph-mon[34992]: pgmap v665: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-09-11T01:17:11.169 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:10 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3838326512' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:17:11.411 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24665 quiesce db --set-id 286870a3 --release --await' 2024-09-11T01:17:11.412 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24665 quiesce db --set-id 286870a3 --release --await 2024-09-11T01:17:11.787 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:17:12.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.416+0000 7f3584c00640 1 -- 172.21.15.103:0/496212995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35801087d0 msgr2=0x7f3580108c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:12.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.416+0000 7f3584c00640 1 --2- 172.21.15.103:0/496212995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35801087d0 0x7f3580108c10 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f356c009900 tx=0x7f356c02a3f0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.416+0000 7f3584c00640 1 -- 172.21.15.103:0/496212995 shutdown_connections 2024-09-11T01:17:12.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.416+0000 7f3584c00640 1 --2- 172.21.15.103:0/496212995 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3580109150 0x7f358010f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.416+0000 7f3584c00640 1 --2- 172.21.15.103:0/496212995 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35801087d0 0x7f3580108c10 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.416+0000 7f3584c00640 1 --2- 172.21.15.103:0/496212995 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3580102dc0 0x7f35801031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.416+0000 7f3584c00640 1 -- 172.21.15.103:0/496212995 >> 172.21.15.103:0/496212995 conn(0x7f35800fe830 msgr2=0x7f3580100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:12.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.416+0000 7f3584c00640 1 -- 172.21.15.103:0/496212995 shutdown_connections 2024-09-11T01:17:12.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.416+0000 7f3584c00640 1 -- 172.21.15.103:0/496212995 wait complete. 2024-09-11T01:17:12.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.417+0000 7f3584c00640 1 Processor -- start 2024-09-11T01:17:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.418+0000 7f3584c00640 1 -- start start 2024-09-11T01:17:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.418+0000 7f3584c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3580102dc0 0x7f3580199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.418+0000 7f3584c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35801087d0 0x7f35801997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.418+0000 7f3584c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3580109150 0x7f358019eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.418+0000 7f3584c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3580112e60 con 0x7f3580102dc0 2024-09-11T01:17:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.418+0000 7f3584c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f3580112ce0 con 0x7f35801087d0 2024-09-11T01:17:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.418+0000 7f3584c00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f3580112fe0 con 0x7f3580109150 2024-09-11T01:17:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.418+0000 7f357de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3580102dc0 0x7f3580199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.418+0000 7f357de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3580102dc0 0x7f3580199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48498/0 (socket says 172.21.15.103:48498) 2024-09-11T01:17:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.418+0000 7f357de00640 1 -- 172.21.15.103:0/2547583055 learned_addr learned my addr 172.21.15.103:0/2547583055 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.418+0000 7f357d400640 1 --2- 172.21.15.103:0/2547583055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35801087d0 0x7f35801997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.418+0000 7f357e800640 1 --2- 172.21.15.103:0/2547583055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3580109150 0x7f358019eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.419+0000 7f357de00640 1 -- 172.21.15.103:0/2547583055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3580109150 msgr2=0x7f358019eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:12.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.419+0000 7f357de00640 1 --2- 172.21.15.103:0/2547583055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3580109150 0x7f358019eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.419+0000 7f357de00640 1 -- 172.21.15.103:0/2547583055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35801087d0 msgr2=0x7f35801997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.419+0000 7f357de00640 1 --2- 172.21.15.103:0/2547583055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35801087d0 0x7f35801997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.419+0000 7f357de00640 1 -- 172.21.15.103:0/2547583055 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358019f340 con 0x7f3580102dc0 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.419+0000 7f357de00640 1 --2- 172.21.15.103:0/2547583055 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3580102dc0 0x7f3580199290 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f357000d950 tx=0x7f357000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.419+0000 7f3576a00640 1 -- 172.21.15.103:0/2547583055 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3570017070 con 0x7f3580102dc0 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.419+0000 7f3576a00640 1 -- 172.21.15.103:0/2547583055 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3570009c30 con 0x7f3580102dc0 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.419+0000 7f3584c00640 1 -- 172.21.15.103:0/2547583055 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f358019f630 con 0x7f3580102dc0 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.419+0000 7f3576a00640 1 -- 172.21.15.103:0/2547583055 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357000f620 con 0x7f3580102dc0 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.419+0000 7f3584c00640 1 -- 172.21.15.103:0/2547583055 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35801a5cf0 con 0x7f3580102dc0 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.423+0000 7f3587821740 1 Processor -- start 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.424+0000 7f3587821740 1 -- start start 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.424+0000 7f3587821740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce34ff0 0x55703ce353d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.424+0000 7f3587821740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 0x55703ce45770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.424+0000 7f3587821740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce45cb0 0x55703ce480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.424+0000 7f3587821740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55703cdac290 con 0x55703ce45cb0 2024-09-11T01:17:12.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.424+0000 7f3587821740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55703cd9b6c0 con 0x55703ce35910 2024-09-11T01:17:12.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.424+0000 7f3587821740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55703cd9f4d0 con 0x55703ce34ff0 2024-09-11T01:17:12.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.424+0000 7f3576a00640 1 -- 172.21.15.103:0/2547583055 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f3570010460 con 0x7f3580102dc0 2024-09-11T01:17:12.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.424+0000 7f357d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce45cb0 0x55703ce480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.424+0000 7f357d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce45cb0 0x55703ce480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48506/0 (socket says 172.21.15.103:48506) 2024-09-11T01:17:12.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.424+0000 7f357d400640 1 -- 172.21.15.103:0/807743783 learned_addr learned my addr 172.21.15.103:0/807743783 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:12.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.424+0000 7f357e800640 1 --2- 172.21.15.103:0/807743783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce34ff0 0x55703ce353d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.425+0000 7f357de00640 1 --2- 172.21.15.103:0/807743783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 0x55703ce45770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.425+0000 7f357d400640 1 -- 172.21.15.103:0/807743783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce34ff0 msgr2=0x55703ce353d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:12.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.425+0000 7f357d400640 1 --2- 172.21.15.103:0/807743783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce34ff0 0x55703ce353d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.425+0000 7f357d400640 1 -- 172.21.15.103:0/807743783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 msgr2=0x55703ce45770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:12.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.425+0000 7f357d400640 1 --2- 172.21.15.103:0/807743783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 0x55703ce45770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.425+0000 7f357d400640 1 -- 172.21.15.103:0/807743783 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55703cd28460 con 0x55703ce45cb0 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.425+0000 7f357d400640 1 --2- 172.21.15.103:0/807743783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce45cb0 0x55703ce480a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f356c000c00 tx=0x7f356c004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8a0d4d50b8eaf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.425+0000 7f356b000640 1 -- 172.21.15.103:0/807743783 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356c035040 con 0x55703ce45cb0 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.425+0000 7f356b000640 1 -- 172.21.15.103:0/807743783 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f356c0054f0 con 0x55703ce45cb0 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.425+0000 7f356b000640 1 -- 172.21.15.103:0/807743783 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356c003850 con 0x55703ce45cb0 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.426+0000 7f3576a00640 1 --2- 172.21.15.103:0/2547583055 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f35640b52e0 0x7f35640b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.426+0000 7f3576a00640 1 -- 172.21.15.103:0/2547583055 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f35700e5b80 con 0x7f3580102dc0 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.426+0000 7f3587821740 1 -- 172.21.15.103:0/807743783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce45cb0 msgr2=0x55703ce480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.426+0000 7f3587821740 1 --2- 172.21.15.103:0/807743783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce45cb0 0x55703ce480a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f356c000c00 tx=0x7f356c004180 comp rx=0 tx=0).stop 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.426+0000 7f357e800640 1 --2- 172.21.15.103:0/2547583055 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f35640b52e0 0x7f35640b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.426+0000 7f3587821740 1 -- 172.21.15.103:0/807743783 shutdown_connections 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.426+0000 7f3587821740 1 --2- 172.21.15.103:0/807743783 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce45cb0 0x55703ce480a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.426+0000 7f3587821740 1 --2- 172.21.15.103:0/807743783 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 0x55703ce45770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.426+0000 7f3587821740 1 --2- 172.21.15.103:0/807743783 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce34ff0 0x55703ce353d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.426+0000 7f3587821740 1 -- 172.21.15.103:0/807743783 >> 172.21.15.103:0/807743783 conn(0x55703ce32e20 msgr2=0x55703ce33fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:12.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.426+0000 7f3587821740 1 -- 172.21.15.103:0/807743783 shutdown_connections 2024-09-11T01:17:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.426+0000 7f3587821740 1 -- 172.21.15.103:0/807743783 wait complete. 2024-09-11T01:17:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.427+0000 7f357e800640 1 --2- 172.21.15.103:0/2547583055 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f35640b52e0 0x7f35640b77a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3578005fd0 tx=0x7f3578009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.427+0000 7f3587821740 1 -- start start 2024-09-11T01:17:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.427+0000 7f3587821740 1 Processor -- start 2024-09-11T01:17:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f3587821740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce34ff0 0x55703ce42c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f3587821740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 0x55703ce43140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f3587821740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce45cb0 0x55703ce43680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f3587821740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55703cbfcbb0 con 0x55703ce34ff0 2024-09-11T01:17:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f3587821740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55703cd366c0 con 0x55703ce35910 2024-09-11T01:17:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f3587821740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55703ce48900 con 0x55703ce45cb0 2024-09-11T01:17:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f3587821740 10 client.0 _ll_register_callbacks cb 0x55703cd51490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f357de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce34ff0 0x55703ce42c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f357de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce34ff0 0x55703ce42c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48518/0 (socket says 172.21.15.103:48518) 2024-09-11T01:17:12.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f357de00640 1 -- 172.21.15.103:0/3397063187 learned_addr learned my addr 172.21.15.103:0/3397063187 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f357d400640 1 --2- 172.21.15.103:0/3397063187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 0x55703ce43140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f357e800640 1 --2- 172.21.15.103:0/3397063187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce45cb0 0x55703ce43680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f357de00640 1 -- 172.21.15.103:0/3397063187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce45cb0 msgr2=0x55703ce43680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f357de00640 1 --2- 172.21.15.103:0/3397063187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce45cb0 0x55703ce43680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f357de00640 1 -- 172.21.15.103:0/3397063187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 msgr2=0x55703ce43140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f357de00640 1 --2- 172.21.15.103:0/3397063187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 0x55703ce43140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.428+0000 7f357de00640 1 -- 172.21.15.103:0/3397063187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55703caf9b00 con 0x55703ce34ff0 2024-09-11T01:17:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.429+0000 7f357de00640 1 --2- 172.21.15.103:0/3397063187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce34ff0 0x55703ce42c00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f35700abce0 tx=0x7f35700a84d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12e2535dc6158832 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.429+0000 7f355f400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:17:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.429+0000 7f355f400640 1 -- 172.21.15.103:0/3397063187 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3570020070 con 0x55703ce34ff0 2024-09-11T01:17:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.429+0000 7f355f400640 1 -- 172.21.15.103:0/3397063187 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f35700ab450 con 0x55703ce34ff0 2024-09-11T01:17:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.429+0000 7f3587821740 1 -- 172.21.15.103:0/3397063187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f356c0054f0 con 0x55703ce34ff0 2024-09-11T01:17:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.429+0000 7f355f400640 1 -- 172.21.15.103:0/3397063187 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f35700ab750 con 0x55703ce34ff0 2024-09-11T01:17:12.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.429+0000 7f3587821740 10 client.15981 fetch_fsmap learned FSMap version 31 2024-09-11T01:17:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.429+0000 7f3587821740 1 -- 172.21.15.103:0/3397063187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55703cb70960 con 0x55703ce34ff0 2024-09-11T01:17:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.429+0000 7f355f400640 1 -- 172.21.15.103:0/3397063187 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f356c0054f0 con 0x55703ce34ff0 2024-09-11T01:17:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.430+0000 7f355f400640 1 -- 172.21.15.103:0/3397063187 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f35700971a0 con 0x55703ce34ff0 2024-09-11T01:17:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.430+0000 7f3587821740 10 client.15981 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:17:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.430+0000 7f3587821740 10 client.15981 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:17:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.430+0000 7f3587821740 20 client.15981 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.430+0000 7f3587821740 1 --2- 172.21.15.103:0/3397063187 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55703ce557d0 0x55703ce57c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.430+0000 7f3587821740 4 client.15981 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:17:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.430+0000 7f3587821740 1 -- 172.21.15.103:0/3397063187 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55703cdae1e0 con 0x55703ce557d0 2024-09-11T01:17:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.430+0000 7f357d400640 1 --2- 172.21.15.103:0/3397063187 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55703ce557d0 0x55703ce57c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.431+0000 7f357d400640 1 --2- 172.21.15.103:0/3397063187 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55703ce557d0 0x55703ce57c00 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18eddace6bb9466a server_cookie=b707478e21bb21fa in_seq=0 out_seq=0 2024-09-11T01:17:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.431+0000 7f355f400640 10 client.15981 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f355f400640 1 -- 172.21.15.103:0/3397063187 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55703cdae1e0 con 0x55703ce557d0 2024-09-11T01:17:12.444 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f355f400640 10 client.15981 handle_command_reply: tid=0 2024-09-11T01:17:12.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f3587821740 1 client.15981 shutdown 2024-09-11T01:17:12.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f3587821740 1 -- 172.21.15.103:0/3397063187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce34ff0 msgr2=0x55703ce42c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:12.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f3587821740 1 --2- 172.21.15.103:0/3397063187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce34ff0 0x55703ce42c00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f35700abce0 tx=0x7f35700a84d0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f3587821740 1 -- 172.21.15.103:0/3397063187 shutdown_connections 2024-09-11T01:17:12.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f3587821740 1 --2- 172.21.15.103:0/3397063187 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55703ce557d0 0x55703ce57c00 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f3587821740 1 --2- 172.21.15.103:0/3397063187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce45cb0 0x55703ce43680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f3587821740 1 --2- 172.21.15.103:0/3397063187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 0x55703ce43140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f3587821740 1 --2- 172.21.15.103:0/3397063187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce34ff0 0x55703ce42c00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f3587821740 1 -- 172.21.15.103:0/3397063187 >> 172.21.15.103:0/3397063187 conn(0x55703ce32e20 msgr2=0x55703ce38950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:12.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f355f400640 0 client.15981 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:12.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f3587821740 1 -- 172.21.15.103:0/3397063187 shutdown_connections 2024-09-11T01:17:12.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f3587821740 1 -- 172.21.15.103:0/3397063187 wait complete. 2024-09-11T01:17:12.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.432+0000 7f3587821740 20 client.15981 trim_cache size 0 max 16384 2024-09-11T01:17:12.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.450+0000 7f3587821740 1 Processor -- start 2024-09-11T01:17:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.450+0000 7f3587821740 1 -- start start 2024-09-11T01:17:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f3587821740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce34ff0 0x55703ce46f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f3587821740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce35910 0x55703ce34250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f3587821740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce45cb0 0x55703ce325a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f3587821740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35801b0190 con 0x55703ce35910 2024-09-11T01:17:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f3587821740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f35801ada60 con 0x55703ce45cb0 2024-09-11T01:17:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f3587821740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f35801ab8b0 con 0x55703ce34ff0 2024-09-11T01:17:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f357d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce35910 0x55703ce34250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f357d400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce35910 0x55703ce34250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48520/0 (socket says 172.21.15.103:48520) 2024-09-11T01:17:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f357de00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce34ff0 0x55703ce46f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f357d400640 1 -- 172.21.15.103:0/1376073505 learned_addr learned my addr 172.21.15.103:0/1376073505 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f357e800640 1 --2- 172.21.15.103:0/1376073505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce45cb0 0x55703ce325a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f357de00640 1 -- 172.21.15.103:0/1376073505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce45cb0 msgr2=0x55703ce325a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f357de00640 1 --2- 172.21.15.103:0/1376073505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce45cb0 0x55703ce325a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f357de00640 1 -- 172.21.15.103:0/1376073505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce35910 msgr2=0x55703ce34250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f357de00640 1 --2- 172.21.15.103:0/1376073505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce35910 0x55703ce34250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f357de00640 1 -- 172.21.15.103:0/1376073505 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55703ce41100 con 0x55703ce34ff0 2024-09-11T01:17:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.451+0000 7f357d400640 1 --2- 172.21.15.103:0/1376073505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce35910 0x55703ce34250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.452+0000 7f357de00640 1 --2- 172.21.15.103:0/1376073505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce34ff0 0x55703ce46f30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f35700a9250 tx=0x7f35700e5e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50d764a696c5a526 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.452+0000 7f356a600640 1 -- 172.21.15.103:0/1376073505 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3570020040 con 0x55703ce34ff0 2024-09-11T01:17:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.452+0000 7f356a600640 1 -- 172.21.15.103:0/1376073505 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35700ed040 con 0x55703ce34ff0 2024-09-11T01:17:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.452+0000 7f356a600640 1 -- 172.21.15.103:0/1376073505 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35700e91f0 con 0x55703ce34ff0 2024-09-11T01:17:12.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.453+0000 7f3587821740 1 -- 172.21.15.103:0/1376073505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce34ff0 msgr2=0x55703ce46f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.453+0000 7f3587821740 1 --2- 172.21.15.103:0/1376073505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce34ff0 0x55703ce46f30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f35700a9250 tx=0x7f35700e5e00 comp rx=0 tx=0).stop 2024-09-11T01:17:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.453+0000 7f3587821740 1 -- 172.21.15.103:0/1376073505 shutdown_connections 2024-09-11T01:17:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.453+0000 7f3587821740 1 --2- 172.21.15.103:0/1376073505 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce45cb0 0x55703ce325a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.453+0000 7f3587821740 1 --2- 172.21.15.103:0/1376073505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce35910 0x55703ce34250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.453+0000 7f3587821740 1 --2- 172.21.15.103:0/1376073505 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce34ff0 0x55703ce46f30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.453+0000 7f3587821740 1 -- 172.21.15.103:0/1376073505 >> 172.21.15.103:0/1376073505 conn(0x55703ce32e20 msgr2=0x55703ce44a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.453+0000 7f3587821740 1 -- 172.21.15.103:0/1376073505 shutdown_connections 2024-09-11T01:17:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.453+0000 7f3587821740 1 -- 172.21.15.103:0/1376073505 wait complete. 2024-09-11T01:17:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.453+0000 7f3587821740 1 -- start start 2024-09-11T01:17:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.453+0000 7f3587821740 1 Processor -- start 2024-09-11T01:17:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f3587821740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce34ff0 0x55703ce5da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f3587821740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 0x55703ce5c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f3587821740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce45cb0 0x55703ce5ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f3587821740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f35801abf20 con 0x55703ce34ff0 2024-09-11T01:17:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f3587821740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f35801ad390 con 0x55703ce35910 2024-09-11T01:17:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f3587821740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f35801ac5f0 con 0x55703ce45cb0 2024-09-11T01:17:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f3587821740 10 client.0 _ll_register_callbacks cb 0x7f357000df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f357de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce34ff0 0x55703ce5da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f357d400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 0x55703ce5c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f357d400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 0x55703ce5c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:53870/0 (socket says 172.21.15.103:53870) 2024-09-11T01:17:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f357d400640 1 -- 172.21.15.103:0/1713509683 learned_addr learned my addr 172.21.15.103:0/1713509683 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f357e800640 1 --2- 172.21.15.103:0/1713509683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce45cb0 0x55703ce5ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f357d400640 1 -- 172.21.15.103:0/1713509683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce45cb0 msgr2=0x55703ce5ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f357d400640 1 --2- 172.21.15.103:0/1713509683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce45cb0 0x55703ce5ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f357d400640 1 -- 172.21.15.103:0/1713509683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce34ff0 msgr2=0x55703ce5da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f357d400640 1 --2- 172.21.15.103:0/1713509683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce34ff0 0x55703ce5da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.454+0000 7f357d400640 1 -- 172.21.15.103:0/1713509683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55703ce5cff0 con 0x55703ce35910 2024-09-11T01:17:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.455+0000 7f357d400640 1 --2- 172.21.15.103:0/1713509683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 0x55703ce5c4c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f356c02a910 tx=0x7f356c02a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e36050ce033480ea server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.455+0000 7f355f400640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:17:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.455+0000 7f355f400640 1 -- 172.21.15.103:0/1713509683 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f356c05b060 con 0x55703ce35910 2024-09-11T01:17:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.455+0000 7f3587821740 1 -- 172.21.15.103:0/1713509683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35700ed040 con 0x55703ce35910 2024-09-11T01:17:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.455+0000 7f355f400640 1 -- 172.21.15.103:0/1713509683 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f356c004af0 con 0x55703ce35910 2024-09-11T01:17:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.455+0000 7f355f400640 1 -- 172.21.15.103:0/1713509683 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f356c035040 con 0x55703ce35910 2024-09-11T01:17:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.455+0000 7f3587821740 10 client.26069 fetch_fsmap learned FSMap version 31 2024-09-11T01:17:12.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.455+0000 7f3587821740 1 -- 172.21.15.103:0/1713509683 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55703ce4dad0 con 0x55703ce35910 2024-09-11T01:17:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.456+0000 7f355f400640 1 -- 172.21.15.103:0/1713509683 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f35700ed040 con 0x55703ce35910 2024-09-11T01:17:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.456+0000 7f355f400640 1 -- 172.21.15.103:0/1713509683 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f356c005000 con 0x55703ce35910 2024-09-11T01:17:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.456+0000 7f3587821740 10 client.26069 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:17:12.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.456+0000 7f3587821740 10 client.26069 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:17:12.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.456+0000 7f3587821740 20 client.26069 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:12.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.456+0000 7f3587821740 1 --2- 172.21.15.103:0/1713509683 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55703ce4de90 0x55703ce4e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:12.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.456+0000 7f3587821740 4 client.26069 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "286870a3", "release": true, "await": true}] 2024-09-11T01:17:12.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.456+0000 7f3587821740 1 -- 172.21.15.103:0/1713509683 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "quiesce db", "set_id": "286870a3", "release": true, "await": true}) -- 0x55703cda9c90 con 0x55703ce4de90 2024-09-11T01:17:12.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.456+0000 7f357de00640 1 --2- 172.21.15.103:0/1713509683 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55703ce4de90 0x55703ce4e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:12.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.457+0000 7f357de00640 1 --2- 172.21.15.103:0/1713509683 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55703ce4de90 0x55703ce4e2a0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4dbaaf50ffd801d server_cookie=3cebdbff4dc21825 in_seq=0 out_seq=0 2024-09-11T01:17:12.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.457+0000 7f355f400640 10 client.26069 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.468+0000 7f355f400640 1 -- 172.21.15.103:0/1713509683 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55703cda9c90 con 0x55703ce4de90 2024-09-11T01:17:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.468+0000 7f355f400640 10 client.26069 handle_command_reply: tid=0 2024-09-11T01:17:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.470+0000 7f3587821740 1 client.26069 shutdown 2024-09-11T01:17:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.473+0000 7f3587821740 1 -- 172.21.15.103:0/1713509683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 msgr2=0x55703ce5c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.473+0000 7f3587821740 1 --2- 172.21.15.103:0/1713509683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 0x55703ce5c4c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f356c02a910 tx=0x7f356c02a3f0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.473+0000 7f3587821740 1 -- 172.21.15.103:0/1713509683 shutdown_connections 2024-09-11T01:17:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.473+0000 7f3587821740 1 --2- 172.21.15.103:0/1713509683 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55703ce4de90 0x55703ce4e2a0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.473+0000 7f3587821740 1 --2- 172.21.15.103:0/1713509683 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55703ce45cb0 0x55703ce5ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.473+0000 7f3587821740 1 --2- 172.21.15.103:0/1713509683 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55703ce35910 0x55703ce5c4c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.473+0000 7f3587821740 1 --2- 172.21.15.103:0/1713509683 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55703ce34ff0 0x55703ce5da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.473+0000 7f3587821740 1 -- 172.21.15.103:0/1713509683 >> 172.21.15.103:0/1713509683 conn(0x55703ce32e20 msgr2=0x55703ce44230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:12.483 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:17:12.484 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 31, 2024-09-11T01:17:12.484 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24665, 2024-09-11T01:17:12.484 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 17, 2024-09-11T01:17:12.484 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-09-11T01:17:12.484 INFO:teuthology.orchestra.run.smithi103.stdout: "286870a3": { 2024-09-11T01:17:12.484 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 17, 2024-09-11T01:17:12.484 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-09-11T01:17:12.484 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:17:12.484 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RELEASED", 2024-09-11T01:17:12.484 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:17:12.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:17:12.484 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-09-11T01:17:12.484 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 150.0, 2024-09-11T01:17:12.485 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-09-11T01:17:12.485 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-09-11T01:17:12.485 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-09-11T01:17:12.485 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:17:12.485 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RELEASED", 2024-09-11T01:17:12.485 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:17:12.485 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:12.485 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:12.485 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:12.485 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:12.485 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:12.485 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:17:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.474+0000 7f355f400640 0 client.26069 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.475+0000 7f3587821740 1 -- 172.21.15.103:0/1713509683 shutdown_connections 2024-09-11T01:17:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.475+0000 7f3587821740 1 -- 172.21.15.103:0/1713509683 wait complete. 2024-09-11T01:17:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.479+0000 7f3587821740 20 client.26069 trim_cache size 0 max 16384 2024-09-11T01:17:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.480+0000 7f3584c00640 1 -- 172.21.15.103:0/2547583055 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f35640b52e0 msgr2=0x7f35640b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.480+0000 7f3584c00640 1 --2- 172.21.15.103:0/2547583055 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f35640b52e0 0x7f35640b77a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3578005fd0 tx=0x7f3578009600 comp rx=0 tx=0).stop 2024-09-11T01:17:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.480+0000 7f3584c00640 1 -- 172.21.15.103:0/2547583055 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3580102dc0 msgr2=0x7f3580199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.480+0000 7f3584c00640 1 --2- 172.21.15.103:0/2547583055 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3580102dc0 0x7f3580199290 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f357000d950 tx=0x7f357000de10 comp rx=0 tx=0).stop 2024-09-11T01:17:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.480+0000 7f3584c00640 1 -- 172.21.15.103:0/2547583055 shutdown_connections 2024-09-11T01:17:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.480+0000 7f3584c00640 1 --2- 172.21.15.103:0/2547583055 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f35640b52e0 0x7f35640b77a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.480+0000 7f3584c00640 1 --2- 172.21.15.103:0/2547583055 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f3580109150 0x7f358019eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.480+0000 7f3584c00640 1 --2- 172.21.15.103:0/2547583055 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35801087d0 0x7f35801997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.480+0000 7f3584c00640 1 --2- 172.21.15.103:0/2547583055 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3580102dc0 0x7f3580199290 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:12.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.480+0000 7f3584c00640 1 -- 172.21.15.103:0/2547583055 >> 172.21.15.103:0/2547583055 conn(0x7f35800fe830 msgr2=0x7f3580100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:12.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.480+0000 7f3584c00640 1 -- 172.21.15.103:0/2547583055 shutdown_connections 2024-09-11T01:17:12.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:12.480+0000 7f3584c00640 1 -- 172.21.15.103:0/2547583055 wait complete. 2024-09-11T01:17:13.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:12 smithi103 ceph-mon[30562]: pgmap v666: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.4 KiB/s wr, 8 op/s 2024-09-11T01:17:13.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:12 smithi117 ceph-mon[35358]: pgmap v666: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.4 KiB/s wr, 8 op/s 2024-09-11T01:17:13.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:12 smithi183 ceph-mon[34992]: pgmap v666: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.4 KiB/s wr, 8 op/s 2024-09-11T01:17:15.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:14 smithi103 ceph-mon[30562]: pgmap v667: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 70 KiB/s wr, 23 op/s 2024-09-11T01:17:15.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:14 smithi117 ceph-mon[35358]: pgmap v667: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 70 KiB/s wr, 23 op/s 2024-09-11T01:17:15.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:14 smithi183 ceph-mon[34992]: pgmap v667: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 70 KiB/s wr, 23 op/s 2024-09-11T01:17:15.350 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '286870a3', total seconds elapsed: 296.0 2024-09-11T01:17:15.350 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-11T01:17:15.350 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:17:16.114 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:17:16.906 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:16 smithi103 ceph-mon[30562]: pgmap v668: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.1 MiB/s wr, 503 op/s 2024-09-11T01:17:17.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.102+0000 7f2ee7e00640 1 -- 172.21.15.103:0/1697031723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ee0075540 msgr2=0x7f2ee0075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:17.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.103+0000 7f2ee7e00640 1 --2- 172.21.15.103:0/1697031723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ee0075540 0x7f2ee0075920 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8009900 tx=0x7f2ed802a400 comp rx=0 tx=0).stop 2024-09-11T01:17:17.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.105+0000 7f2ee7e00640 1 -- 172.21.15.103:0/1697031723 shutdown_connections 2024-09-11T01:17:17.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.105+0000 7f2ee7e00640 1 --2- 172.21.15.103:0/1697031723 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ee0113b20 0x7f2ee0115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:17.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.105+0000 7f2ee7e00640 1 --2- 172.21.15.103:0/1697031723 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0075e60 0x7f2ee01135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:17.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.105+0000 7f2ee7e00640 1 --2- 172.21.15.103:0/1697031723 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ee0075540 0x7f2ee0075920 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:17.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.105+0000 7f2ee7e00640 1 -- 172.21.15.103:0/1697031723 >> 172.21.15.103:0/1697031723 conn(0x7f2ee00fe830 msgr2=0x7f2ee0100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:17.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.105+0000 7f2ee7e00640 1 -- 172.21.15.103:0/1697031723 shutdown_connections 2024-09-11T01:17:17.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.105+0000 7f2ee7e00640 1 -- 172.21.15.103:0/1697031723 wait complete. 2024-09-11T01:17:17.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.109+0000 7f2ee7e00640 1 Processor -- start 2024-09-11T01:17:17.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.109+0000 7f2ee7e00640 1 -- start start 2024-09-11T01:17:17.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.110+0000 7f2ee7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0075540 0x7f2ee0074780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:17.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.111+0000 7f2ee7e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ee0075e60 0x7f2ee0074cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:17.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.111+0000 7f2ee7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ee0113b20 0x7f2ee006dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:17.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.111+0000 7f2ee5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0075540 0x7f2ee0074780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:17.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.112+0000 7f2ee5400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0075540 0x7f2ee0074780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48554/0 (socket says 172.21.15.103:48554) 2024-09-11T01:17:17.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.112+0000 7f2ee5400640 1 -- 172.21.15.103:0/2837677892 learned_addr learned my addr 172.21.15.103:0/2837677892 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:17.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.112+0000 7f2ee7e00640 1 -- 172.21.15.103:0/2837677892 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee01193f0 con 0x7f2ee0075540 2024-09-11T01:17:17.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.113+0000 7f2ee5e00640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ee0113b20 0x7f2ee006dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:17.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.113+0000 7f2ee7e00640 1 -- 172.21.15.103:0/2837677892 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee0119270 con 0x7f2ee0113b20 2024-09-11T01:17:17.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.114+0000 7f2ee7e00640 1 -- 172.21.15.103:0/2837677892 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee0119570 con 0x7f2ee0075e60 2024-09-11T01:17:17.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.114+0000 7f2ee4a00640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ee0075e60 0x7f2ee0074cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:17.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.115+0000 7f2ee4a00640 1 -- 172.21.15.103:0/2837677892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ee0113b20 msgr2=0x7f2ee006dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:17.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.115+0000 7f2ee4a00640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ee0113b20 0x7f2ee006dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:17.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.115+0000 7f2ee4a00640 1 -- 172.21.15.103:0/2837677892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0075540 msgr2=0x7f2ee0074780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:17.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.116+0000 7f2ee4a00640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0075540 0x7f2ee0074780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:17.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.116+0000 7f2ee4a00640 1 -- 172.21.15.103:0/2837677892 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee006e3a0 con 0x7f2ee0075e60 2024-09-11T01:17:17.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.116+0000 7f2ee5400640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0075540 0x7f2ee0074780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:17.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.116+0000 7f2ee4a00640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ee0075e60 0x7f2ee0074cc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000c970 tx=0x7f2ed000ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:17.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.118+0000 7f2ede000640 1 -- 172.21.15.103:0/2837677892 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0007bb0 con 0x7f2ee0075e60 2024-09-11T01:17:17.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.118+0000 7f2ede000640 1 -- 172.21.15.103:0/2837677892 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ed0007d50 con 0x7f2ee0075e60 2024-09-11T01:17:17.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.118+0000 7f2ede000640 1 -- 172.21.15.103:0/2837677892 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0004df0 con 0x7f2ee0075e60 2024-09-11T01:17:17.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.118+0000 7f2ee7e00640 1 -- 172.21.15.103:0/2837677892 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee006e690 con 0x7f2ee0075e60 2024-09-11T01:17:17.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.118+0000 7f2ee7e00640 1 -- 172.21.15.103:0/2837677892 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee00735c0 con 0x7f2ee0075e60 2024-09-11T01:17:17.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:16 smithi117 ceph-mon[35358]: pgmap v668: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.1 MiB/s wr, 503 op/s 2024-09-11T01:17:17.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.122+0000 7f2ee7e00640 1 -- 172.21.15.103:0/2837677892 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec40052c0 con 0x7f2ee0075e60 2024-09-11T01:17:17.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.126+0000 7f2ede000640 1 -- 172.21.15.103:0/2837677892 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f2ed0046aa0 con 0x7f2ee0075e60 2024-09-11T01:17:17.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.128+0000 7f2ede000640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ec80b54b0 0x7f2ec80b7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:17.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.128+0000 7f2ede000640 1 -- 172.21.15.103:0/2837677892 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f2ed00e5f20 con 0x7f2ee0075e60 2024-09-11T01:17:17.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.129+0000 7f2ee5400640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ec80b54b0 0x7f2ec80b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:17.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.129+0000 7f2ede000640 1 -- 172.21.15.103:0/2837677892 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f2ed001d020 con 0x7f2ee0075e60 2024-09-11T01:17:17.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.130+0000 7f2ee5400640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ec80b54b0 0x7f2ec80b7970 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80096c0 tx=0x7f2ed8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:17.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:16 smithi183 ceph-mon[34992]: pgmap v668: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.1 MiB/s wr, 503 op/s 2024-09-11T01:17:17.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.578+0000 7f2ee7e00640 1 -- 172.21.15.103:0/2837677892 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ec40055b0 con 0x7f2ee0075e60 2024-09-11T01:17:17.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.579+0000 7f2ede000640 1 -- 172.21.15.103:0/2837677892 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11930 (secure 0 0 0) 0x7f2ed0014030 con 0x7f2ee0075e60 2024-09-11T01:17:17.581 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:17:17.582 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":31,"btime":"2024-09-11T01:12:40:372256+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:12:39.857673+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24619,24629,24665]},"id":1}]} 2024-09-11T01:17:17.582 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 31 2024-09-11T01:17:17.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.582+0000 7f2ee7e00640 1 -- 172.21.15.103:0/2837677892 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ec80b54b0 msgr2=0x7f2ec80b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:17.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.582+0000 7f2ee7e00640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ec80b54b0 0x7f2ec80b7970 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2ed80096c0 tx=0x7f2ed8005a20 comp rx=0 tx=0).stop 2024-09-11T01:17:17.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.582+0000 7f2ee7e00640 1 -- 172.21.15.103:0/2837677892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ee0075e60 msgr2=0x7f2ee0074cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:17.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.582+0000 7f2ee7e00640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ee0075e60 0x7f2ee0074cc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000c970 tx=0x7f2ed000ce30 comp rx=0 tx=0).stop 2024-09-11T01:17:17.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.583+0000 7f2ee7e00640 1 -- 172.21.15.103:0/2837677892 shutdown_connections 2024-09-11T01:17:17.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.583+0000 7f2ee7e00640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2ec80b54b0 0x7f2ec80b7970 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:17.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.583+0000 7f2ee7e00640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2ee0113b20 0x7f2ee006dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:17.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.583+0000 7f2ee7e00640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2ee0075e60 0x7f2ee0074cc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:17.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.583+0000 7f2ee7e00640 1 --2- 172.21.15.103:0/2837677892 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2ee0075540 0x7f2ee0074780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:17.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.583+0000 7f2ee7e00640 1 -- 172.21.15.103:0/2837677892 >> 172.21.15.103:0/2837677892 conn(0x7f2ee00fe830 msgr2=0x7f2ee00ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:17.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.586+0000 7f2ee7e00640 1 -- 172.21.15.103:0/2837677892 shutdown_connections 2024-09-11T01:17:17.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:17.586+0000 7f2ee7e00640 1 -- 172.21.15.103:0/2837677892 wait complete. 2024-09-11T01:17:17.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:17 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2837677892' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:17:18.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:17 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2837677892' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:17:18.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:17 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2837677892' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:17:19.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:18 smithi103 ceph-mon[30562]: pgmap v669: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.6 MiB/s wr, 1.08k op/s 2024-09-11T01:17:19.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:18 smithi117 ceph-mon[35358]: pgmap v669: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.6 MiB/s wr, 1.08k op/s 2024-09-11T01:17:19.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:18 smithi183 ceph-mon[34992]: pgmap v669: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.6 MiB/s wr, 1.08k op/s 2024-09-11T01:17:19.501 INFO:tasks.workunit.client.0.smithi103.stdout:Syncing()...6 sec 2024-09-11T01:17:19.501 INFO:tasks.workunit.client.0.smithi103.stdout:FFSB benchmark finished at: Wed Sep 11 01:17:19 2024 2024-09-11T01:17:19.501 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:17:19.501 INFO:tasks.workunit.client.0.smithi103.stdout:Results: 2024-09-11T01:17:19.501 INFO:tasks.workunit.client.0.smithi103.stdout:Benchmark took 359.38 sec 2024-09-11T01:17:19.501 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:17:19.502 INFO:tasks.workunit.client.0.smithi103.stdout:Total Results 2024-09-11T01:17:19.502 INFO:tasks.workunit.client.0.smithi103.stdout:=============== 2024-09-11T01:17:19.502 INFO:tasks.workunit.client.0.smithi103.stdout: Op Name Transactions Trans/sec % Trans % Op Weight Throughput 2024-09-11T01:17:19.502 INFO:tasks.workunit.client.0.smithi103.stdout: ======= ============ ========= ======= =========== ========== 2024-09-11T01:17:19.502 INFO:tasks.workunit.client.0.smithi103.stdout: write : 6183680 17206.71 100.000% 100.000% 67.2MB/sec 2024-09-11T01:17:19.502 INFO:tasks.workunit.client.0.smithi103.stdout:- 2024-09-11T01:17:19.502 INFO:tasks.workunit.client.0.smithi103.stdout:17206.71 Transactions per Second 2024-09-11T01:17:19.502 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:17:19.502 INFO:tasks.workunit.client.0.smithi103.stdout:Throughput Results 2024-09-11T01:17:19.502 INFO:tasks.workunit.client.0.smithi103.stdout:=================== 2024-09-11T01:17:19.502 INFO:tasks.workunit.client.0.smithi103.stdout:Write Throughput: 67.2MB/sec 2024-09-11T01:17:19.554 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:17:19.554 INFO:tasks.workunit.client.0.smithi103.stdout:System Call Latency statistics in millisecs 2024-09-11T01:17:19.554 INFO:tasks.workunit.client.0.smithi103.stdout:===== 2024-09-11T01:17:19.554 INFO:tasks.workunit.client.0.smithi103.stdout: Min Avg Max Total Calls 2024-09-11T01:17:19.554 INFO:tasks.workunit.client.0.smithi103.stdout: ======== ======== ======== ============ 2024-09-11T01:17:19.555 INFO:tasks.workunit.client.0.smithi103.stdout:[ open] 0.018000 0.285565 39.955002 4831 2024-09-11T01:17:19.555 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-11T01:17:19.555 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-11T01:17:19.555 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-11T01:17:19.555 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-11T01:17:19.555 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-11T01:17:19.555 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-11T01:17:19.555 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-11T01:17:19.555 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[7] 20.000000 - 50.000000 : 11 2024-09-11T01:17:19.555 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[8] 10.000000 - 20.000000 : 27 2024-09-11T01:17:19.555 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[9] 5.000000 - 10.000000 : 34 2024-09-11T01:17:19.555 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[10] 2.000000 - 5.000000 : 47 2024-09-11T01:17:19.555 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[11] 1.000000 - 2.000000 : 42 2024-09-11T01:17:19.555 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[12] 0.500000 - 1.000000 : 15 2024-09-11T01:17:19.556 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[13] 0.200000 - 0.500000 : 33 2024-09-11T01:17:19.556 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[14] 0.100000 - 0.200000 : 192 2024-09-11T01:17:19.556 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[15] 0.050000 - 0.100000 : 365 2024-09-11T01:17:19.556 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[16] 0.020000 - 0.050000 : 4038 2024-09-11T01:17:19.556 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[17] 0.010000 - 0.020000 : 27 2024-09-11T01:17:19.556 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[18] 0.000000 - 0.010000 : 0 2024-09-11T01:17:19.556 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:17:19.556 INFO:tasks.workunit.client.0.smithi103.stdout:[ write] 0.003000 1.820621 105892.804688 6183680 2024-09-11T01:17:19.556 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[0] 5000.000000 - 10000.000000 : 313 2024-09-11T01:17:19.556 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[1] 2000.000000 - 5000.000000 : 227 2024-09-11T01:17:19.556 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[2] 1000.000000 - 2000.000000 : 151 2024-09-11T01:17:19.556 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[3] 500.000000 - 1000.000000 : 189 2024-09-11T01:17:19.556 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[4] 200.000000 - 500.000000 : 1263 2024-09-11T01:17:19.556 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[5] 100.000000 - 200.000000 : 2947 2024-09-11T01:17:19.557 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[6] 50.000000 - 100.000000 : 7723 2024-09-11T01:17:19.557 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[7] 20.000000 - 50.000000 : 1327 2024-09-11T01:17:19.557 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[8] 10.000000 - 20.000000 : 2491 2024-09-11T01:17:19.557 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[9] 5.000000 - 10.000000 : 2762 2024-09-11T01:17:19.557 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[10] 2.000000 - 5.000000 : 4043 2024-09-11T01:17:19.557 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[11] 1.000000 - 2.000000 : 2462 2024-09-11T01:17:19.557 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[12] 0.500000 - 1.000000 : 2026 2024-09-11T01:17:19.557 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[13] 0.200000 - 0.500000 : 4355 2024-09-11T01:17:19.557 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[14] 0.100000 - 0.200000 : 8397 2024-09-11T01:17:19.557 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[15] 0.050000 - 0.100000 : 21845 2024-09-11T01:17:19.557 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[16] 0.020000 - 0.050000 : 184788 2024-09-11T01:17:19.557 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[17] 0.010000 - 0.020000 : 2449440 2024-09-11T01:17:19.557 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[18] 0.000000 - 0.010000 : 3486665 2024-09-11T01:17:19.557 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:17:19.558 INFO:tasks.workunit.client.0.smithi103.stdout:[ lseek] 0.000000 0.002264 55.040001 6183680 2024-09-11T01:17:19.558 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-11T01:17:19.558 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-11T01:17:19.558 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-11T01:17:19.558 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-11T01:17:19.558 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-11T01:17:19.558 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-11T01:17:19.558 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[6] 50.000000 - 100.000000 : 2 2024-09-11T01:17:19.558 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[7] 20.000000 - 50.000000 : 44 2024-09-11T01:17:19.558 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[8] 10.000000 - 20.000000 : 216 2024-09-11T01:17:19.558 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[9] 5.000000 - 10.000000 : 238 2024-09-11T01:17:19.558 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[10] 2.000000 - 5.000000 : 288 2024-09-11T01:17:19.558 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[11] 1.000000 - 2.000000 : 153 2024-09-11T01:17:19.558 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[12] 0.500000 - 1.000000 : 156 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[13] 0.200000 - 0.500000 : 254 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[14] 0.100000 - 0.200000 : 391 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[15] 0.050000 - 0.100000 : 970 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[16] 0.020000 - 0.050000 : 3858 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[17] 0.010000 - 0.020000 : 2953 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[18] 0.000000 - 0.010000 : 6174157 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout:[ close] 0.003000 0.022746 33.028999 4831 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[0] 5000.000000 - 10000.000000 : 0 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[1] 2000.000000 - 5000.000000 : 0 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[2] 1000.000000 - 2000.000000 : 0 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[3] 500.000000 - 1000.000000 : 0 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[4] 200.000000 - 500.000000 : 0 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[5] 100.000000 - 200.000000 : 0 2024-09-11T01:17:19.559 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[6] 50.000000 - 100.000000 : 0 2024-09-11T01:17:19.560 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[7] 20.000000 - 50.000000 : 1 2024-09-11T01:17:19.560 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[8] 10.000000 - 20.000000 : 2 2024-09-11T01:17:19.560 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[9] 5.000000 - 10.000000 : 0 2024-09-11T01:17:19.560 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[10] 2.000000 - 5.000000 : 1 2024-09-11T01:17:19.560 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[11] 1.000000 - 2.000000 : 3 2024-09-11T01:17:19.560 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[12] 0.500000 - 1.000000 : 1 2024-09-11T01:17:19.560 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[13] 0.200000 - 0.500000 : 2 2024-09-11T01:17:19.560 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[14] 0.100000 - 0.200000 : 2 2024-09-11T01:17:19.560 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[15] 0.050000 - 0.100000 : 10 2024-09-11T01:17:19.560 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[16] 0.020000 - 0.050000 : 37 2024-09-11T01:17:19.560 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[17] 0.010000 - 0.020000 : 2536 2024-09-11T01:17:19.560 INFO:tasks.workunit.client.0.smithi103.stdout: msec_range[18] 0.000000 - 0.010000 : 2236 2024-09-11T01:17:19.560 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:17:19.561 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:17:19.561 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:17:19.561 INFO:tasks.workunit.client.0.smithi103.stdout: 2024-09-11T01:17:19.561 INFO:tasks.workunit.client.0.smithi103.stdout:1.1% User Time 2024-09-11T01:17:19.561 INFO:tasks.workunit.client.0.smithi103.stdout:19.8% System Time 2024-09-11T01:17:19.561 INFO:tasks.workunit.client.0.smithi103.stdout:20.8% CPU Utilization 2024-09-11T01:17:19.568 INFO:tasks.workunit.client.0.smithi103.stderr:+ cd .. 2024-09-11T01:17:19.572 INFO:tasks.workunit.client.0.smithi103.stderr:+ rm -r tmp ffsb 2024-09-11T01:17:19.819 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24665 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-11T01:17:19.819 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24665 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-11T01:17:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.032+0000 7fb888c00640 1 -- 172.21.15.103:0/3201587581 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb884104b90 msgr2=0x7fb884104f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.032+0000 7fb888c00640 1 --2- 172.21.15.103:0/3201587581 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb884104b90 0x7fb884104f90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb874009930 tx=0x7fb87402a420 comp rx=0 tx=0).stop 2024-09-11T01:17:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.032+0000 7fb888c00640 1 -- 172.21.15.103:0/3201587581 shutdown_connections 2024-09-11T01:17:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.032+0000 7fb888c00640 1 --2- 172.21.15.103:0/3201587581 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8841066a0 0x7fb88410d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.032+0000 7fb888c00640 1 --2- 172.21.15.103:0/3201587581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb884105ce0 0x7fb884106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.032+0000 7fb888c00640 1 --2- 172.21.15.103:0/3201587581 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb884104b90 0x7fb884104f90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.032+0000 7fb888c00640 1 -- 172.21.15.103:0/3201587581 >> 172.21.15.103:0/3201587581 conn(0x7fb884100470 msgr2=0x7fb884102890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.033+0000 7fb888c00640 1 -- 172.21.15.103:0/3201587581 shutdown_connections 2024-09-11T01:17:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.033+0000 7fb888c00640 1 -- 172.21.15.103:0/3201587581 wait complete. 2024-09-11T01:17:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.034+0000 7fb888c00640 1 Processor -- start 2024-09-11T01:17:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.034+0000 7fb888c00640 1 -- start start 2024-09-11T01:17:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.034+0000 7fb888c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb884104b90 0x7fb88419afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.034+0000 7fb888c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb884105ce0 0x7fb88419b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.034+0000 7fb888c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8841066a0 0x7fb88419c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.034+0000 7fb888c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841107e0 con 0x7fb884105ce0 2024-09-11T01:17:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.034+0000 7fb888c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb884110660 con 0x7fb884104b90 2024-09-11T01:17:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.034+0000 7fb888c00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb884110960 con 0x7fb8841066a0 2024-09-11T01:17:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.034+0000 7fb881e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb884104b90 0x7fb88419afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.034+0000 7fb881e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb884104b90 0x7fb88419afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38218/0 (socket says 172.21.15.103:38218) 2024-09-11T01:17:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.034+0000 7fb881e00640 1 -- 172.21.15.103:0/211843962 learned_addr learned my addr 172.21.15.103:0/211843962 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.034+0000 7fb881400640 1 --2- 172.21.15.103:0/211843962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb884105ce0 0x7fb88419b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.034+0000 7fb882800640 1 --2- 172.21.15.103:0/211843962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8841066a0 0x7fb88419c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.035+0000 7fb881e00640 1 -- 172.21.15.103:0/211843962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8841066a0 msgr2=0x7fb88419c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.035+0000 7fb881e00640 1 --2- 172.21.15.103:0/211843962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8841066a0 0x7fb88419c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.035+0000 7fb881e00640 1 -- 172.21.15.103:0/211843962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb884105ce0 msgr2=0x7fb88419b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.035+0000 7fb881e00640 1 --2- 172.21.15.103:0/211843962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb884105ce0 0x7fb88419b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.035+0000 7fb881e00640 1 -- 172.21.15.103:0/211843962 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88419cb00 con 0x7fb884104b90 2024-09-11T01:17:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.035+0000 7fb881e00640 1 --2- 172.21.15.103:0/211843962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb884104b90 0x7fb88419afc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb874009a50 tx=0x7fb8740042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.035+0000 7fb87aa00640 1 -- 172.21.15.103:0/211843962 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87403f030 con 0x7fb884104b90 2024-09-11T01:17:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.035+0000 7fb888c00640 1 -- 172.21.15.103:0/211843962 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88419cd90 con 0x7fb884104b90 2024-09-11T01:17:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.035+0000 7fb87aa00640 1 -- 172.21.15.103:0/211843962 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb874031910 con 0x7fb884104b90 2024-09-11T01:17:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.036+0000 7fb87aa00640 1 -- 172.21.15.103:0/211843962 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb874035070 con 0x7fb884104b90 2024-09-11T01:17:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.036+0000 7fb888c00640 1 -- 172.21.15.103:0/211843962 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8841a34c0 con 0x7fb884104b90 2024-09-11T01:17:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb88b9db740 1 Processor -- start 2024-09-11T01:17:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb88b9db740 1 -- start start 2024-09-11T01:17:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb88b9db740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621a7790 0x5562621a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb88b9db740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621aa0c0 0x5562621ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb88b9db740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621acb00 0x5562621aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb87aa00640 1 -- 172.21.15.103:0/211843962 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7fb87403ba60 con 0x7fb884104b90 2024-09-11T01:17:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb88b9db740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55626211a6b0 con 0x5562621aa0c0 2024-09-11T01:17:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb88b9db740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x556262109ae0 con 0x5562621a7790 2024-09-11T01:17:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb88b9db740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55626210d8f0 con 0x5562621acb00 2024-09-11T01:17:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb882800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621a7790 0x5562621a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb881400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621acb00 0x5562621aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb882800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621a7790 0x5562621a9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38226/0 (socket says 172.21.15.103:38226) 2024-09-11T01:17:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb881400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621acb00 0x5562621aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:52478/0 (socket says 172.21.15.103:52478) 2024-09-11T01:17:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb882800640 1 -- 172.21.15.103:0/1645808707 learned_addr learned my addr 172.21.15.103:0/1645808707 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.039+0000 7fb881e00640 1 --2- 172.21.15.103:0/1645808707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621aa0c0 0x5562621ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.040+0000 7fb882800640 1 -- 172.21.15.103:0/1645808707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621acb00 msgr2=0x5562621aefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.040+0000 7fb882800640 1 --2- 172.21.15.103:0/1645808707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621acb00 0x5562621aefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.040+0000 7fb882800640 1 -- 172.21.15.103:0/1645808707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621aa0c0 msgr2=0x5562621ac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.040+0000 7fb882800640 1 --2- 172.21.15.103:0/1645808707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621aa0c0 0x5562621ac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.040+0000 7fb882800640 1 -- 172.21.15.103:0/1645808707 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562620d6780 con 0x5562621a7790 2024-09-11T01:17:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.040+0000 7fb881400640 1 --2- 172.21.15.103:0/1645808707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621acb00 0x5562621aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.040+0000 7fb882800640 1 --2- 172.21.15.103:0/1645808707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621a7790 0x5562621a9b80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009f90 tx=0x7fb87c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c1b7466ac82c672 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.040+0000 7fb86f000640 1 -- 172.21.15.103:0/1645808707 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c004b20 con 0x5562621a7790 2024-09-11T01:17:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.040+0000 7fb86f000640 1 -- 172.21.15.103:0/1645808707 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb87c004cc0 con 0x5562621a7790 2024-09-11T01:17:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.040+0000 7fb86f000640 1 -- 172.21.15.103:0/1645808707 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c005020 con 0x5562621a7790 2024-09-11T01:17:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.041+0000 7fb87aa00640 1 --2- 172.21.15.103:0/211843962 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8680b52e0 0x7fb8680b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.041+0000 7fb88b9db740 1 -- 172.21.15.103:0/1645808707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621a7790 msgr2=0x5562621a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:20.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.041+0000 7fb88b9db740 1 --2- 172.21.15.103:0/1645808707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621a7790 0x5562621a9b80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009f90 tx=0x7fb87c0118d0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.041+0000 7fb88b9db740 1 -- 172.21.15.103:0/1645808707 shutdown_connections 2024-09-11T01:17:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.041+0000 7fb88b9db740 1 --2- 172.21.15.103:0/1645808707 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621acb00 0x5562621aefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.041+0000 7fb88b9db740 1 --2- 172.21.15.103:0/1645808707 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621aa0c0 0x5562621ac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.041+0000 7fb88b9db740 1 --2- 172.21.15.103:0/1645808707 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621a7790 0x5562621a9b80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.041+0000 7fb88b9db740 1 -- 172.21.15.103:0/1645808707 >> 172.21.15.103:0/1645808707 conn(0x5562621a28e0 msgr2=0x5562621a3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:20.047 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.041+0000 7fb87aa00640 1 -- 172.21.15.103:0/211843962 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fb8741067f0 con 0x7fb884104b90 2024-09-11T01:17:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.042+0000 7fb881e00640 1 --2- 172.21.15.103:0/211843962 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8680b52e0 0x7fb8680b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.042+0000 7fb88b9db740 1 -- 172.21.15.103:0/1645808707 shutdown_connections 2024-09-11T01:17:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.042+0000 7fb88b9db740 1 -- 172.21.15.103:0/1645808707 wait complete. 2024-09-11T01:17:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.042+0000 7fb88b9db740 1 -- start start 2024-09-11T01:17:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.042+0000 7fb881e00640 1 --2- 172.21.15.103:0/211843962 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8680b52e0 0x7fb8680b77a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb874103ee0 tx=0x7fb87402a420 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.042+0000 7fb88b9db740 1 Processor -- start 2024-09-11T01:17:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb88b9db740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621a7790 0x5562621b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb88b9db740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621aa0c0 0x5562621b1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb88b9db740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621acb00 0x5562621b2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb88b9db740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556262041ab0 con 0x5562621a7790 2024-09-11T01:17:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb88b9db740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5562620b0570 con 0x5562621aa0c0 2024-09-11T01:17:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb88b9db740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5562621afae0 con 0x5562621acb00 2024-09-11T01:17:20.048 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb88b9db740 10 client.0 _ll_register_callbacks cb 0x5562620bf100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb881400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621aa0c0 0x5562621b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb881400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621aa0c0 0x5562621b1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38232/0 (socket says 172.21.15.103:38232) 2024-09-11T01:17:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb881400640 1 -- 172.21.15.103:0/2020096698 learned_addr learned my addr 172.21.15.103:0/2020096698 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb882800640 1 --2- 172.21.15.103:0/2020096698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621a7790 0x5562621b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb882800640 1 --2- 172.21.15.103:0/2020096698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621acb00 0x5562621b2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb881400640 1 -- 172.21.15.103:0/2020096698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621acb00 msgr2=0x5562621b2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb881400640 1 --2- 172.21.15.103:0/2020096698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621acb00 0x5562621b2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb881400640 1 -- 172.21.15.103:0/2020096698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621a7790 msgr2=0x5562621b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb881400640 1 --2- 172.21.15.103:0/2020096698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621a7790 0x5562621b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.043+0000 7fb881400640 1 -- 172.21.15.103:0/2020096698 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556261e6b790 con 0x5562621aa0c0 2024-09-11T01:17:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.044+0000 7fb882800640 1 --2- 172.21.15.103:0/2020096698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621a7790 0x5562621b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:17:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.044+0000 7fb881400640 1 --2- 172.21.15.103:0/2020096698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621aa0c0 0x5562621b1560 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb870012760 tx=0x7fb870012c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=282f4521ce0accb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:20.049 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.044+0000 7fb863400640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:17:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.044+0000 7fb863400640 1 -- 172.21.15.103:0/2020096698 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87000f920 con 0x5562621aa0c0 2024-09-11T01:17:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.044+0000 7fb88b9db740 1 -- 172.21.15.103:0/2020096698 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb87c004cc0 con 0x5562621aa0c0 2024-09-11T01:17:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.044+0000 7fb863400640 1 -- 172.21.15.103:0/2020096698 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fb87000fac0 con 0x5562621aa0c0 2024-09-11T01:17:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.044+0000 7fb863400640 1 -- 172.21.15.103:0/2020096698 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb87000fcc0 con 0x5562621aa0c0 2024-09-11T01:17:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.044+0000 7fb88b9db740 10 client.26087 fetch_fsmap learned FSMap version 31 2024-09-11T01:17:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.044+0000 7fb88b9db740 1 -- 172.21.15.103:0/2020096698 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556261ee4620 con 0x5562621aa0c0 2024-09-11T01:17:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.044+0000 7fb863400640 1 -- 172.21.15.103:0/2020096698 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb87c004cc0 con 0x5562621aa0c0 2024-09-11T01:17:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.045+0000 7fb863400640 1 -- 172.21.15.103:0/2020096698 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fb87001c420 con 0x5562621aa0c0 2024-09-11T01:17:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.045+0000 7fb88b9db740 10 client.26087 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:17:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.045+0000 7fb88b9db740 10 client.26087 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:17:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.045+0000 7fb88b9db740 20 client.26087 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.045+0000 7fb88b9db740 1 --2- 172.21.15.103:0/2020096698 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5562621bc820 0x5562621bec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.045+0000 7fb88b9db740 4 client.26087 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:17:20.050 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.045+0000 7fb88b9db740 1 -- 172.21.15.103:0/2020096698 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55626211c600 con 0x5562621bc820 2024-09-11T01:17:20.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.045+0000 7fb882800640 1 --2- 172.21.15.103:0/2020096698 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5562621bc820 0x5562621bec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.046+0000 7fb863400640 10 client.26087 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:20.051 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.046+0000 7fb882800640 1 --2- 172.21.15.103:0/2020096698 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5562621bc820 0x5562621bec10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bb6f7ba03aa249f server_cookie=3e21a2e42c14c695 in_seq=0 out_seq=0 2024-09-11T01:17:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.047+0000 7fb863400640 1 -- 172.21.15.103:0/2020096698 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55626211c600 con 0x5562621bc820 2024-09-11T01:17:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.047+0000 7fb863400640 10 client.26087 handle_command_reply: tid=0 2024-09-11T01:17:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.047+0000 7fb88b9db740 1 client.26087 shutdown 2024-09-11T01:17:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.047+0000 7fb88b9db740 1 -- 172.21.15.103:0/2020096698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621aa0c0 msgr2=0x5562621b1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.047+0000 7fb88b9db740 1 --2- 172.21.15.103:0/2020096698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621aa0c0 0x5562621b1560 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb870012760 tx=0x7fb870012c20 comp rx=0 tx=0).stop 2024-09-11T01:17:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.047+0000 7fb88b9db740 1 -- 172.21.15.103:0/2020096698 shutdown_connections 2024-09-11T01:17:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.047+0000 7fb88b9db740 1 --2- 172.21.15.103:0/2020096698 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5562621bc820 0x5562621bec10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.047+0000 7fb88b9db740 1 --2- 172.21.15.103:0/2020096698 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621acb00 0x5562621b2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.047+0000 7fb88b9db740 1 --2- 172.21.15.103:0/2020096698 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621aa0c0 0x5562621b1560 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.047+0000 7fb88b9db740 1 --2- 172.21.15.103:0/2020096698 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621a7790 0x5562621b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.047+0000 7fb863400640 0 client.26087 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.047+0000 7fb88b9db740 1 -- 172.21.15.103:0/2020096698 >> 172.21.15.103:0/2020096698 conn(0x5562621a28e0 msgr2=0x5562621a1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.047+0000 7fb88b9db740 1 -- 172.21.15.103:0/2020096698 shutdown_connections 2024-09-11T01:17:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.048+0000 7fb88b9db740 1 -- 172.21.15.103:0/2020096698 wait complete. 2024-09-11T01:17:20.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.048+0000 7fb88b9db740 20 client.26087 trim_cache size 0 max 16384 2024-09-11T01:17:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.063+0000 7fb88b9db740 1 Processor -- start 2024-09-11T01:17:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.063+0000 7fb88b9db740 1 -- start start 2024-09-11T01:17:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.063+0000 7fb88b9db740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621a7790 0x55626219d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.063+0000 7fb88b9db740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621aa0c0 0x5562621b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.063+0000 7fb88b9db740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621acb00 0x5562621b1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.063+0000 7fb88b9db740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841b0180 con 0x5562621acb00 2024-09-11T01:17:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.063+0000 7fb88b9db740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841ada50 con 0x5562621a7790 2024-09-11T01:17:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.063+0000 7fb88b9db740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841ab8a0 con 0x5562621aa0c0 2024-09-11T01:17:20.065 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.063+0000 7fb882800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621a7790 0x55626219d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.063+0000 7fb882800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621a7790 0x55626219d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38240/0 (socket says 172.21.15.103:38240) 2024-09-11T01:17:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.063+0000 7fb882800640 1 -- 172.21.15.103:0/3916539453 learned_addr learned my addr 172.21.15.103:0/3916539453 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.063+0000 7fb882800640 1 --2- 172.21.15.103:0/3916539453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621acb00 0x5562621b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.066 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.063+0000 7fb881400640 1 --2- 172.21.15.103:0/3916539453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621aa0c0 0x5562621b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.064+0000 7fb882800640 1 -- 172.21.15.103:0/3916539453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621aa0c0 msgr2=0x5562621b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.064+0000 7fb882800640 1 --2- 172.21.15.103:0/3916539453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621aa0c0 0x5562621b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.064+0000 7fb882800640 1 -- 172.21.15.103:0/3916539453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621acb00 msgr2=0x5562621b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.064+0000 7fb882800640 1 --2- 172.21.15.103:0/3916539453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621acb00 0x5562621b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.067 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.064+0000 7fb882800640 1 -- 172.21.15.103:0/3916539453 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562621a3b40 con 0x5562621a7790 2024-09-11T01:17:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.064+0000 7fb882800640 1 --2- 172.21.15.103:0/3916539453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621a7790 0x55626219d960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009270 tx=0x7fb87c013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd195155ddf3f824 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.064+0000 7fb86e600640 1 -- 172.21.15.103:0/3916539453 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c00f8a0 con 0x5562621a7790 2024-09-11T01:17:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.064+0000 7fb86e600640 1 -- 172.21.15.103:0/3916539453 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb87c026460 con 0x5562621a7790 2024-09-11T01:17:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.064+0000 7fb86e600640 1 -- 172.21.15.103:0/3916539453 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c0286b0 con 0x5562621a7790 2024-09-11T01:17:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.065+0000 7fb88b9db740 1 -- 172.21.15.103:0/3916539453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621a7790 msgr2=0x55626219d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.065+0000 7fb88b9db740 1 --2- 172.21.15.103:0/3916539453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621a7790 0x55626219d960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009270 tx=0x7fb87c013040 comp rx=0 tx=0).stop 2024-09-11T01:17:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.065+0000 7fb88b9db740 1 -- 172.21.15.103:0/3916539453 shutdown_connections 2024-09-11T01:17:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.065+0000 7fb88b9db740 1 --2- 172.21.15.103:0/3916539453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621acb00 0x5562621b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.065+0000 7fb88b9db740 1 --2- 172.21.15.103:0/3916539453 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621aa0c0 0x5562621b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.065+0000 7fb88b9db740 1 --2- 172.21.15.103:0/3916539453 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621a7790 0x55626219d960 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.065+0000 7fb88b9db740 1 -- 172.21.15.103:0/3916539453 >> 172.21.15.103:0/3916539453 conn(0x5562621a28e0 msgr2=0x5562621a5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.065+0000 7fb88b9db740 1 -- 172.21.15.103:0/3916539453 shutdown_connections 2024-09-11T01:17:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.065+0000 7fb88b9db740 1 -- 172.21.15.103:0/3916539453 wait complete. 2024-09-11T01:17:20.068 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.066+0000 7fb88b9db740 1 -- start start 2024-09-11T01:17:20.069 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.066+0000 7fb88b9db740 1 Processor -- start 2024-09-11T01:17:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.066+0000 7fb88b9db740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621a7790 0x5562621b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.066+0000 7fb88b9db740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621aa0c0 0x5562621b8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.066+0000 7fb88b9db740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621acb00 0x5562621b8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.066+0000 7fb88b9db740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841abf10 con 0x5562621acb00 2024-09-11T01:17:20.071 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.066+0000 7fb88b9db740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841ad380 con 0x5562621aa0c0 2024-09-11T01:17:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.066+0000 7fb88b9db740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb8841ac5e0 con 0x5562621a7790 2024-09-11T01:17:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.066+0000 7fb88b9db740 10 client.0 _ll_register_callbacks cb 0x7fb870009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.066+0000 7fb881400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621aa0c0 0x5562621b8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.066+0000 7fb882800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621a7790 0x5562621b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.066+0000 7fb881400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621aa0c0 0x5562621b8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38256/0 (socket says 172.21.15.103:38256) 2024-09-11T01:17:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.066+0000 7fb881400640 1 -- 172.21.15.103:0/4261438514 learned_addr learned my addr 172.21.15.103:0/4261438514 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.067+0000 7fb882800640 1 --2- 172.21.15.103:0/4261438514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621acb00 0x5562621b8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.067+0000 7fb881400640 1 -- 172.21.15.103:0/4261438514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621a7790 msgr2=0x5562621b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.067+0000 7fb881400640 1 --2- 172.21.15.103:0/4261438514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621a7790 0x5562621b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.067+0000 7fb881400640 1 -- 172.21.15.103:0/4261438514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621acb00 msgr2=0x5562621b8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.067+0000 7fb881400640 1 --2- 172.21.15.103:0/4261438514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621acb00 0x5562621b8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.072 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.067+0000 7fb881400640 1 -- 172.21.15.103:0/4261438514 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562621a9ef0 con 0x5562621aa0c0 2024-09-11T01:17:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.067+0000 7fb882800640 1 --2- 172.21.15.103:0/4261438514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621acb00 0x5562621b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:17:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.067+0000 7fb881400640 1 --2- 172.21.15.103:0/4261438514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621aa0c0 0x5562621b8000 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb87001ca80 tx=0x7fb87001cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=441c088c087b68ee server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.067+0000 7fb863400640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:17:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.067+0000 7fb863400640 1 -- 172.21.15.103:0/4261438514 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87002f060 con 0x5562621aa0c0 2024-09-11T01:17:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.067+0000 7fb88b9db740 1 -- 172.21.15.103:0/4261438514 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb87c026460 con 0x5562621aa0c0 2024-09-11T01:17:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.067+0000 7fb863400640 1 -- 172.21.15.103:0/4261438514 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fb87001c630 con 0x5562621aa0c0 2024-09-11T01:17:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.067+0000 7fb863400640 1 -- 172.21.15.103:0/4261438514 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb87000fe60 con 0x5562621aa0c0 2024-09-11T01:17:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.068+0000 7fb88b9db740 10 client.26093 fetch_fsmap learned FSMap version 31 2024-09-11T01:17:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.068+0000 7fb88b9db740 1 -- 172.21.15.103:0/4261438514 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556262229af0 con 0x5562621aa0c0 2024-09-11T01:17:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.068+0000 7fb863400640 1 -- 172.21.15.103:0/4261438514 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb87c026460 con 0x5562621aa0c0 2024-09-11T01:17:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.068+0000 7fb863400640 1 -- 172.21.15.103:0/4261438514 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fb870003960 con 0x5562621aa0c0 2024-09-11T01:17:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.068+0000 7fb88b9db740 10 client.26093 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:17:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.068+0000 7fb88b9db740 10 client.26093 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:17:20.073 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.068+0000 7fb88b9db740 20 client.26093 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.068+0000 7fb88b9db740 1 --2- 172.21.15.103:0/4261438514 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55626222a4d0 0x55626222c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.068+0000 7fb88b9db740 4 client.26093 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:17:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.068+0000 7fb88b9db740 1 -- 172.21.15.103:0/4261438514 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5562621180b0 con 0x55626222a4d0 2024-09-11T01:17:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.068+0000 7fb882800640 1 --2- 172.21.15.103:0/4261438514 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55626222a4d0 0x55626222c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.069+0000 7fb882800640 1 --2- 172.21.15.103:0/4261438514 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55626222a4d0 0x55626222c8f0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=579a6df9d8ec18b9 server_cookie=f4f628abc5fb9320 in_seq=0 out_seq=0 2024-09-11T01:17:20.074 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.069+0000 7fb863400640 10 client.26093 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.138+0000 7fb863400640 1 -- 172.21.15.103:0/4261438514 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5562621180b0 con 0x55626222a4d0 2024-09-11T01:17:20.140 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.138+0000 7fb863400640 10 client.26093 handle_command_reply: tid=0 2024-09-11T01:17:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.138+0000 7fb88b9db740 1 client.26093 shutdown 2024-09-11T01:17:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.138+0000 7fb88b9db740 1 -- 172.21.15.103:0/4261438514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621aa0c0 msgr2=0x5562621b8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.138+0000 7fb88b9db740 1 --2- 172.21.15.103:0/4261438514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621aa0c0 0x5562621b8000 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb87001ca80 tx=0x7fb87001cd30 comp rx=0 tx=0).stop 2024-09-11T01:17:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.138+0000 7fb88b9db740 1 -- 172.21.15.103:0/4261438514 shutdown_connections 2024-09-11T01:17:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.138+0000 7fb88b9db740 1 --2- 172.21.15.103:0/4261438514 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5562621acb00 0x5562621b8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.138+0000 7fb88b9db740 1 --2- 172.21.15.103:0/4261438514 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5562621aa0c0 0x5562621b8000 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.138+0000 7fb88b9db740 1 --2- 172.21.15.103:0/4261438514 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55626222a4d0 0x55626222c8f0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.139+0000 7fb88b9db740 1 --2- 172.21.15.103:0/4261438514 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5562621a7790 0x5562621b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.139+0000 7fb863400640 0 client.26093 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.139+0000 7fb88b9db740 1 -- 172.21.15.103:0/4261438514 >> 172.21.15.103:0/4261438514 conn(0x5562621a28e0 msgr2=0x5562621a6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.139+0000 7fb88b9db740 1 -- 172.21.15.103:0/4261438514 shutdown_connections 2024-09-11T01:17:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.139+0000 7fb88b9db740 1 -- 172.21.15.103:0/4261438514 wait complete. 2024-09-11T01:17:20.141 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.139+0000 7fb88b9db740 20 client.26093 trim_cache size 0 max 16384 2024-09-11T01:17:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:17:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:17:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:17:20.142 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:17:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.140+0000 7fb888c00640 1 -- 172.21.15.103:0/211843962 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8680b52e0 msgr2=0x7fb8680b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.140+0000 7fb888c00640 1 --2- 172.21.15.103:0/211843962 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8680b52e0 0x7fb8680b77a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb874103ee0 tx=0x7fb87402a420 comp rx=0 tx=0).stop 2024-09-11T01:17:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.140+0000 7fb888c00640 1 -- 172.21.15.103:0/211843962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb884104b90 msgr2=0x7fb88419afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.140+0000 7fb888c00640 1 --2- 172.21.15.103:0/211843962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb884104b90 0x7fb88419afc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb874009a50 tx=0x7fb8740042f0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.140+0000 7fb888c00640 1 -- 172.21.15.103:0/211843962 shutdown_connections 2024-09-11T01:17:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.140+0000 7fb888c00640 1 --2- 172.21.15.103:0/211843962 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8680b52e0 0x7fb8680b77a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.140+0000 7fb888c00640 1 --2- 172.21.15.103:0/211843962 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8841066a0 0x7fb88419c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.140+0000 7fb888c00640 1 --2- 172.21.15.103:0/211843962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb884105ce0 0x7fb88419b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.140+0000 7fb888c00640 1 --2- 172.21.15.103:0/211843962 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb884104b90 0x7fb88419afc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:20.143 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.140+0000 7fb888c00640 1 -- 172.21.15.103:0/211843962 >> 172.21.15.103:0/211843962 conn(0x7fb884100470 msgr2=0x7fb884109120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.140+0000 7fb888c00640 1 -- 172.21.15.103:0/211843962 shutdown_connections 2024-09-11T01:17:20.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:20.140+0000 7fb888c00640 1 -- 172.21.15.103:0/211843962 wait complete. 2024-09-11T01:17:20.250 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:17:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.049+0000 7f83b0a00640 1 -- 172.21.15.103:0/144165937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83ac10f220 msgr2=0x7f83ac111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.049+0000 7f83b0a00640 1 --2- 172.21.15.103:0/144165937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83ac10f220 0x7f83ac111610 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009be0 tx=0x7f83a402a6c0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.049+0000 7f83b0a00640 1 -- 172.21.15.103:0/144165937 shutdown_connections 2024-09-11T01:17:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.049+0000 7f83b0a00640 1 --2- 172.21.15.103:0/144165937 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83ac10f220 0x7f83ac111610 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.049+0000 7f83b0a00640 1 --2- 172.21.15.103:0/144165937 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83ac075de0 0x7f83ac10ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.049+0000 7f83b0a00640 1 --2- 172.21.15.103:0/144165937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83ac0754c0 0x7f83ac0758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.049+0000 7f83b0a00640 1 -- 172.21.15.103:0/144165937 >> 172.21.15.103:0/144165937 conn(0x7f83ac0fe660 msgr2=0x7f83ac100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:21.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.049+0000 7f83b0a00640 1 -- 172.21.15.103:0/144165937 shutdown_connections 2024-09-11T01:17:21.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.049+0000 7f83b0a00640 1 -- 172.21.15.103:0/144165937 wait complete. 2024-09-11T01:17:21.052 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:20 smithi103 ceph-mon[30562]: pgmap v670: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 9.0 MiB/s wr, 2.10k op/s 2024-09-11T01:17:21.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.050+0000 7f83b0a00640 1 Processor -- start 2024-09-11T01:17:21.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.050+0000 7f83b0a00640 1 -- start start 2024-09-11T01:17:21.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83b0a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83ac0754c0 0x7f83ac19b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83b0a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83ac075de0 0x7f83ac19b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83b0a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83ac10f220 0x7f83ac1a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83b0a00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac114e00 con 0x7f83ac075de0 2024-09-11T01:17:21.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83b0a00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac114c80 con 0x7f83ac10f220 2024-09-11T01:17:21.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83b0a00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac114f80 con 0x7f83ac0754c0 2024-09-11T01:17:21.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83ab400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83ac0754c0 0x7f83ac19b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83ab400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83ac0754c0 0x7f83ac19b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:52498/0 (socket says 172.21.15.103:52498) 2024-09-11T01:17:21.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83ab400640 1 -- 172.21.15.103:0/1022172077 learned_addr learned my addr 172.21.15.103:0/1022172077 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:21.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83a2a00640 1 --2- 172.21.15.103:0/1022172077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83ac075de0 0x7f83ac19b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83abe00640 1 --2- 172.21.15.103:0/1022172077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83ac10f220 0x7f83ac1a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83ab400640 1 -- 172.21.15.103:0/1022172077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83ac10f220 msgr2=0x7f83ac1a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:21.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83ab400640 1 --2- 172.21.15.103:0/1022172077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83ac10f220 0x7f83ac1a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83ab400640 1 -- 172.21.15.103:0/1022172077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83ac075de0 msgr2=0x7f83ac19b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:21.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83ab400640 1 --2- 172.21.15.103:0/1022172077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83ac075de0 0x7f83ac19b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.051+0000 7f83ab400640 1 -- 172.21.15.103:0/1022172077 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac1a1330 con 0x7f83ac0754c0 2024-09-11T01:17:21.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.052+0000 7f83ab400640 1 --2- 172.21.15.103:0/1022172077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83ac0754c0 0x7f83ac19b280 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f839c00e9c0 tx=0x7f839c00ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:21.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.052+0000 7f83a8c00640 1 -- 172.21.15.103:0/1022172077 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c00ccc0 con 0x7f83ac0754c0 2024-09-11T01:17:21.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.052+0000 7f83a8c00640 1 -- 172.21.15.103:0/1022172077 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f839c0054d0 con 0x7f83ac0754c0 2024-09-11T01:17:21.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.052+0000 7f83b0a00640 1 -- 172.21.15.103:0/1022172077 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ac1a1620 con 0x7f83ac0754c0 2024-09-11T01:17:21.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.052+0000 7f83a8c00640 1 -- 172.21.15.103:0/1022172077 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c010430 con 0x7f83ac0754c0 2024-09-11T01:17:21.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.052+0000 7f83b0a00640 1 -- 172.21.15.103:0/1022172077 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ac1a7ce0 con 0x7f83ac0754c0 2024-09-11T01:17:21.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.056+0000 7f83a8c00640 1 -- 172.21.15.103:0/1022172077 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f839c004f80 con 0x7f83ac0754c0 2024-09-11T01:17:21.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.057+0000 7f83a8c00640 1 --2- 172.21.15.103:0/1022172077 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f83900b5390 0x7f83900b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.057+0000 7f83a8c00640 1 -- 172.21.15.103:0/1022172077 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f839c0e6500 con 0x7f83ac0754c0 2024-09-11T01:17:21.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.057+0000 7f83a2a00640 1 --2- 172.21.15.103:0/1022172077 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f83900b5390 0x7f83900b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.058+0000 7f83a2a00640 1 --2- 172.21.15.103:0/1022172077 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f83900b5390 0x7f83900b7850 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f83ac100ed0 tx=0x7f8394005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:21.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.079+0000 7f83b4a4e740 1 Processor -- start 2024-09-11T01:17:21.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.079+0000 7f83b4a4e740 1 -- start start 2024-09-11T01:17:21.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.079+0000 7f83b4a4e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c5152f0 0x555a6c5156d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.079+0000 7f83b4a4e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c515c10 0x555a6c521660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.079+0000 7f83b4a4e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c521ba0 0x555a6c523f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.079+0000 7f83b4a4e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555a6c48aca0 con 0x555a6c5152f0 2024-09-11T01:17:21.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.079+0000 7f83b4a4e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555a6c47a0d0 con 0x555a6c515c10 2024-09-11T01:17:21.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.079+0000 7f83b4a4e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555a6c47dee0 con 0x555a6c521ba0 2024-09-11T01:17:21.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.080+0000 7f83ab400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c5152f0 0x555a6c5156d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.080+0000 7f83abe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c521ba0 0x555a6c523f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.080+0000 7f83a2a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c515c10 0x555a6c521660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.080+0000 7f83abe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c521ba0 0x555a6c523f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:52510/0 (socket says 172.21.15.103:52510) 2024-09-11T01:17:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.080+0000 7f83abe00640 1 -- 172.21.15.103:0/3266339651 learned_addr learned my addr 172.21.15.103:0/3266339651 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.080+0000 7f83abe00640 1 -- 172.21.15.103:0/3266339651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c515c10 msgr2=0x555a6c521660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.080+0000 7f83abe00640 1 --2- 172.21.15.103:0/3266339651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c515c10 0x555a6c521660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.080+0000 7f83abe00640 1 -- 172.21.15.103:0/3266339651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c5152f0 msgr2=0x555a6c5156d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.080+0000 7f83abe00640 1 --2- 172.21.15.103:0/3266339651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c5152f0 0x555a6c5156d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.080+0000 7f83abe00640 1 -- 172.21.15.103:0/3266339651 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a6c42c400 con 0x555a6c521ba0 2024-09-11T01:17:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.080+0000 7f83ab400640 1 --2- 172.21.15.103:0/3266339651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c5152f0 0x555a6c5156d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.080+0000 7f83abe00640 1 --2- 172.21.15.103:0/3266339651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c521ba0 0x555a6c523f90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f83a4006010 tx=0x7f83a4030430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1df07be636eb247e server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.080+0000 7f839be00640 1 -- 172.21.15.103:0/3266339651 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4040030 con 0x555a6c521ba0 2024-09-11T01:17:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.081+0000 7f839be00640 1 -- 172.21.15.103:0/3266339651 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a4003e20 con 0x555a6c521ba0 2024-09-11T01:17:21.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.081+0000 7f839be00640 1 -- 172.21.15.103:0/3266339651 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4036040 con 0x555a6c521ba0 2024-09-11T01:17:21.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.081+0000 7f83b4a4e740 1 -- 172.21.15.103:0/3266339651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c521ba0 msgr2=0x555a6c523f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:21.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.081+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/3266339651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c521ba0 0x555a6c523f90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f83a4006010 tx=0x7f83a4030430 comp rx=0 tx=0).stop 2024-09-11T01:17:21.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.081+0000 7f83b4a4e740 1 -- 172.21.15.103:0/3266339651 shutdown_connections 2024-09-11T01:17:21.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.081+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/3266339651 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c521ba0 0x555a6c523f90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.081+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/3266339651 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c515c10 0x555a6c521660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.081+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/3266339651 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c5152f0 0x555a6c5156d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.085 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.081+0000 7f83b4a4e740 1 -- 172.21.15.103:0/3266339651 >> 172.21.15.103:0/3266339651 conn(0x555a6c513120 msgr2=0x555a6c5142c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.082+0000 7f83b4a4e740 1 -- 172.21.15.103:0/3266339651 shutdown_connections 2024-09-11T01:17:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.082+0000 7f83b4a4e740 1 -- 172.21.15.103:0/3266339651 wait complete. 2024-09-11T01:17:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.082+0000 7f83b4a4e740 1 -- start start 2024-09-11T01:17:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.082+0000 7f83b4a4e740 1 Processor -- start 2024-09-11T01:17:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83b4a4e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c5152f0 0x555a6c521470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83b4a4e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c515c10 0x555a6c51e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83b4a4e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c521ba0 0x555a6c51eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83b4a4e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555a6c2db7a0 con 0x555a6c515c10 2024-09-11T01:17:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83b4a4e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x555a6c41fa10 con 0x555a6c521ba0 2024-09-11T01:17:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83b4a4e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x555a6c5247c0 con 0x555a6c5152f0 2024-09-11T01:17:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83b4a4e740 10 client.0 _ll_register_callbacks cb 0x555a6c42fbe0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83abe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c521ba0 0x555a6c51eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83ab400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c5152f0 0x555a6c521470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.086 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83a2a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c515c10 0x555a6c51e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83abe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c521ba0 0x555a6c51eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38288/0 (socket says 172.21.15.103:38288) 2024-09-11T01:17:21.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83abe00640 1 -- 172.21.15.103:0/2272440471 learned_addr learned my addr 172.21.15.103:0/2272440471 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:21.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83ab400640 1 -- 172.21.15.103:0/2272440471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c521ba0 msgr2=0x555a6c51eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:21.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83ab400640 1 --2- 172.21.15.103:0/2272440471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c521ba0 0x555a6c51eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83ab400640 1 -- 172.21.15.103:0/2272440471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c515c10 msgr2=0x555a6c51e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:21.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83ab400640 1 --2- 172.21.15.103:0/2272440471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c515c10 0x555a6c51e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83ab400640 1 -- 172.21.15.103:0/2272440471 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a6c1e7b90 con 0x555a6c5152f0 2024-09-11T01:17:21.087 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.083+0000 7f83abe00640 1 --2- 172.21.15.103:0/2272440471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c521ba0 0x555a6c51eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.084+0000 7f83ab400640 1 --2- 172.21.15.103:0/2272440471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c5152f0 0x555a6c521470 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f839c000c00 tx=0x7f839c0ac2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c7d650a26f55c7a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.084+0000 7f8398c00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:17:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.084+0000 7f8398c00640 1 -- 172.21.15.103:0/2272440471 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c0acfb0 con 0x555a6c5152f0 2024-09-11T01:17:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.084+0000 7f83b4a4e740 1 -- 172.21.15.103:0/2272440471 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83a4003e20 con 0x555a6c5152f0 2024-09-11T01:17:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.084+0000 7f8398c00640 1 -- 172.21.15.103:0/2272440471 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f839c0e61d0 con 0x555a6c5152f0 2024-09-11T01:17:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.084+0000 7f8398c00640 1 -- 172.21.15.103:0/2272440471 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f839c0ac8b0 con 0x555a6c5152f0 2024-09-11T01:17:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.084+0000 7f83b4a4e740 10 client.26053 fetch_fsmap learned FSMap version 31 2024-09-11T01:17:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.084+0000 7f83b4a4e740 1 -- 172.21.15.103:0/2272440471 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555a6c530120 con 0x555a6c5152f0 2024-09-11T01:17:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.085+0000 7f8398c00640 1 -- 172.21.15.103:0/2272440471 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a4003e20 con 0x555a6c5152f0 2024-09-11T01:17:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.085+0000 7f8398c00640 1 -- 172.21.15.103:0/2272440471 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f839c0a8200 con 0x555a6c5152f0 2024-09-11T01:17:21.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.085+0000 7f83b4a4e740 10 client.26053 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:17:21.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.085+0000 7f83b4a4e740 10 client.26053 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:17:21.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.085+0000 7f83b4a4e740 20 client.26053 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:21.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.085+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/2272440471 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555a6c5315a0 0x555a6c5339f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.085+0000 7f83b4a4e740 4 client.26053 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:17:21.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.085+0000 7f83b4a4e740 1 -- 172.21.15.103:0/2272440471 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a6c48cbf0 con 0x555a6c5315a0 2024-09-11T01:17:21.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.085+0000 7f83a2a00640 1 --2- 172.21.15.103:0/2272440471 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555a6c5315a0 0x555a6c5339f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.086+0000 7f83a2a00640 1 --2- 172.21.15.103:0/2272440471 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555a6c5315a0 0x555a6c5339f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4289237d68fb22d server_cookie=a7fa61af2e5f8314 in_seq=0 out_seq=0 2024-09-11T01:17:21.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.086+0000 7f8398c00640 10 client.26053 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:21.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.087+0000 7f8398c00640 1 -- 172.21.15.103:0/2272440471 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555a6c48cbf0 con 0x555a6c5315a0 2024-09-11T01:17:21.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.087+0000 7f8398c00640 10 client.26053 handle_command_reply: tid=0 2024-09-11T01:17:21.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.087+0000 7f83b4a4e740 1 client.26053 shutdown 2024-09-11T01:17:21.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.087+0000 7f83b4a4e740 1 -- 172.21.15.103:0/2272440471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c5152f0 msgr2=0x555a6c521470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:21.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.087+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/2272440471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c5152f0 0x555a6c521470 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f839c000c00 tx=0x7f839c0ac2f0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.087+0000 7f83b4a4e740 1 -- 172.21.15.103:0/2272440471 shutdown_connections 2024-09-11T01:17:21.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.087+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/2272440471 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c521ba0 0x555a6c51eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.087+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/2272440471 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c515c10 0x555a6c51e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.087+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/2272440471 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555a6c5315a0 0x555a6c5339f0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.087+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/2272440471 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c5152f0 0x555a6c521470 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.087+0000 7f8398c00640 0 client.26053 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:21.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.087+0000 7f83b4a4e740 1 -- 172.21.15.103:0/2272440471 >> 172.21.15.103:0/2272440471 conn(0x555a6c513120 msgr2=0x555a6c518cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:21.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.088+0000 7f83b4a4e740 1 -- 172.21.15.103:0/2272440471 shutdown_connections 2024-09-11T01:17:21.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.088+0000 7f83b4a4e740 1 -- 172.21.15.103:0/2272440471 wait complete. 2024-09-11T01:17:21.092 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.088+0000 7f83b4a4e740 20 client.26053 trim_cache size 0 max 16384 2024-09-11T01:17:21.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.106+0000 7f83b4a4e740 1 Processor -- start 2024-09-11T01:17:21.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.106+0000 7f83b4a4e740 1 -- start start 2024-09-11T01:17:21.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.106+0000 7f83b4a4e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c5152f0 0x555a6c51e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.106+0000 7f83b4a4e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c515c10 0x555a6c522f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.106+0000 7f83b4a4e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c521ba0 0x555a6c5234d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.106+0000 7f83b4a4e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1b44e0 con 0x555a6c521ba0 2024-09-11T01:17:21.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.106+0000 7f83b4a4e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1b1db0 con 0x555a6c515c10 2024-09-11T01:17:21.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.106+0000 7f83b4a4e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1afc00 con 0x555a6c5152f0 2024-09-11T01:17:21.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.106+0000 7f83a2a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c515c10 0x555a6c522f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.106+0000 7f83abe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c521ba0 0x555a6c5234d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.106+0000 7f83a2a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c515c10 0x555a6c522f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38298/0 (socket says 172.21.15.103:38298) 2024-09-11T01:17:21.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.106+0000 7f83a2a00640 1 -- 172.21.15.103:0/2082523998 learned_addr learned my addr 172.21.15.103:0/2082523998 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:21.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.106+0000 7f83ab400640 1 --2- 172.21.15.103:0/2082523998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c5152f0 0x555a6c51e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.107+0000 7f83a2a00640 1 -- 172.21.15.103:0/2082523998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c5152f0 msgr2=0x555a6c51e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:21.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.107+0000 7f83a2a00640 1 --2- 172.21.15.103:0/2082523998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c5152f0 0x555a6c51e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.107+0000 7f83a2a00640 1 -- 172.21.15.103:0/2082523998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c521ba0 msgr2=0x555a6c5234d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:21.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.107+0000 7f83a2a00640 1 --2- 172.21.15.103:0/2082523998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c521ba0 0x555a6c5234d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.107+0000 7f83a2a00640 1 -- 172.21.15.103:0/2082523998 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a6c515a40 con 0x555a6c515c10 2024-09-11T01:17:21.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.107+0000 7f83ab400640 1 --2- 172.21.15.103:0/2082523998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c5152f0 0x555a6c51e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:21.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.107+0000 7f83a2a00640 1 --2- 172.21.15.103:0/2082523998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c515c10 0x555a6c522f90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8394009a20 tx=0x7f8394014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3113dcb159ad5573 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:21.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.107+0000 7f839b400640 1 -- 172.21.15.103:0/2082523998 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394012540 con 0x555a6c515c10 2024-09-11T01:17:21.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.108+0000 7f839b400640 1 -- 172.21.15.103:0/2082523998 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8394012b90 con 0x555a6c515c10 2024-09-11T01:17:21.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.108+0000 7f839b400640 1 -- 172.21.15.103:0/2082523998 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839402bac0 con 0x555a6c515c10 2024-09-11T01:17:21.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.108+0000 7f83b4a4e740 1 -- 172.21.15.103:0/2082523998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c515c10 msgr2=0x555a6c522f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:21.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.108+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/2082523998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c515c10 0x555a6c522f90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8394009a20 tx=0x7f8394014000 comp rx=0 tx=0).stop 2024-09-11T01:17:21.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.108+0000 7f83b4a4e740 1 -- 172.21.15.103:0/2082523998 shutdown_connections 2024-09-11T01:17:21.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.108+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/2082523998 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c521ba0 0x555a6c5234d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.108+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/2082523998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c515c10 0x555a6c522f90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.108+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/2082523998 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c5152f0 0x555a6c51e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.108+0000 7f83b4a4e740 1 -- 172.21.15.103:0/2082523998 >> 172.21.15.103:0/2082523998 conn(0x555a6c513120 msgr2=0x555a6c520710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:21.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.108+0000 7f83b4a4e740 1 -- 172.21.15.103:0/2082523998 shutdown_connections 2024-09-11T01:17:21.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.108+0000 7f83b4a4e740 1 -- 172.21.15.103:0/2082523998 wait complete. 2024-09-11T01:17:21.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.109+0000 7f83b4a4e740 1 -- start start 2024-09-11T01:17:21.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.109+0000 7f83b4a4e740 1 Processor -- start 2024-09-11T01:17:21.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.109+0000 7f83b4a4e740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c5152f0 0x555a6c52a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.109+0000 7f83b4a4e740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c515c10 0x555a6c524a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.109+0000 7f83b4a4e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c521ba0 0x555a6c524f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.109+0000 7f83b4a4e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1b0270 con 0x555a6c521ba0 2024-09-11T01:17:21.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.109+0000 7f83b4a4e740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1b16e0 con 0x555a6c5152f0 2024-09-11T01:17:21.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.109+0000 7f83b4a4e740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac1b0940 con 0x555a6c515c10 2024-09-11T01:17:21.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83b4a4e740 10 client.0 _ll_register_callbacks cb 0x7f839c0a8ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:21.114 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-11T01:17:21.114 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-11T01:17:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83ab400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c5152f0 0x555a6c52a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83a2a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c515c10 0x555a6c524a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83ab400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c5152f0 0x555a6c52a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:38310/0 (socket says 172.21.15.103:38310) 2024-09-11T01:17:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83ab400640 1 -- 172.21.15.103:0/4244432901 learned_addr learned my addr 172.21.15.103:0/4244432901 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83a2a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c515c10 0x555a6c524a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:52552/0 (socket says 172.21.15.103:52552) 2024-09-11T01:17:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83abe00640 1 --2- 172.21.15.103:0/4244432901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c521ba0 0x555a6c524f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83a2a00640 1 -- 172.21.15.103:0/4244432901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c5152f0 msgr2=0x555a6c52a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83a2a00640 1 --2- 172.21.15.103:0/4244432901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c5152f0 0x555a6c52a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83a2a00640 1 -- 172.21.15.103:0/4244432901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c521ba0 msgr2=0x555a6c524f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83a2a00640 1 --2- 172.21.15.103:0/4244432901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c521ba0 0x555a6c524f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83a2a00640 1 -- 172.21.15.103:0/4244432901 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a6c5257c0 con 0x555a6c515c10 2024-09-11T01:17:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83abe00640 1 --2- 172.21.15.103:0/4244432901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c521ba0 0x555a6c524f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:17:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83ab400640 1 --2- 172.21.15.103:0/4244432901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c5152f0 0x555a6c52a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f83a2a00640 1 --2- 172.21.15.103:0/4244432901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c515c10 0x555a6c524a10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8394009a20 tx=0x7f8394011d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be6265866267fcdb server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.110+0000 7f8398c00640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:17:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.111+0000 7f8398c00640 1 -- 172.21.15.103:0/4244432901 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8394040060 con 0x555a6c515c10 2024-09-11T01:17:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.111+0000 7f8398c00640 1 -- 172.21.15.103:0/4244432901 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f8394012d40 con 0x555a6c515c10 2024-09-11T01:17:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.111+0000 7f83b4a4e740 1 -- 172.21.15.103:0/4244432901 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8394012b90 con 0x555a6c515c10 2024-09-11T01:17:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.111+0000 7f8398c00640 1 -- 172.21.15.103:0/4244432901 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8394047050 con 0x555a6c515c10 2024-09-11T01:17:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.111+0000 7f83b4a4e740 10 client.26059 fetch_fsmap learned FSMap version 31 2024-09-11T01:17:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.111+0000 7f83b4a4e740 1 -- 172.21.15.103:0/4244432901 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555a6c59f590 con 0x555a6c515c10 2024-09-11T01:17:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.111+0000 7f8398c00640 1 -- 172.21.15.103:0/4244432901 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8394012b90 con 0x555a6c515c10 2024-09-11T01:17:21.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.112+0000 7f8398c00640 1 -- 172.21.15.103:0/4244432901 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f839402bc10 con 0x555a6c515c10 2024-09-11T01:17:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.112+0000 7f83b4a4e740 10 client.26059 fetch_fsmap finished waiting for FSMap version 31 2024-09-11T01:17:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.112+0000 7f83b4a4e740 10 client.26059 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:17:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.112+0000 7f83b4a4e740 20 client.26059 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.112+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/4244432901 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555a6c59fcf0 0x555a6c5a2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.112+0000 7f83b4a4e740 4 client.26059 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-11T01:17:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.112+0000 7f83b4a4e740 1 -- 172.21.15.103:0/4244432901 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x555a6c4886a0 con 0x555a6c59fcf0 2024-09-11T01:17:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.112+0000 7f83ab400640 1 --2- 172.21.15.103:0/4244432901 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555a6c59fcf0 0x555a6c5a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.112+0000 7f83ab400640 1 --2- 172.21.15.103:0/4244432901 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555a6c59fcf0 0x555a6c5a2110 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba4fb257a34f61bd server_cookie=52c2e8cca9794c1a in_seq=0 out_seq=0 2024-09-11T01:17:21.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.112+0000 7f8398c00640 10 client.26059 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:21.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:20 smithi117 ceph-mon[35358]: pgmap v670: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 9.0 MiB/s wr, 2.10k op/s 2024-09-11T01:17:21.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:20 smithi183 ceph-mon[34992]: pgmap v670: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 9.0 MiB/s wr, 2.10k op/s 2024-09-11T01:17:21.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f8398c00640 1 -- 172.21.15.103:0/4244432901 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555a6c4886a0 con 0x555a6c59fcf0 2024-09-11T01:17:21.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f8398c00640 10 client.26059 handle_command_reply: tid=0 2024-09-11T01:17:21.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f83b4a4e740 1 client.26059 shutdown 2024-09-11T01:17:21.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f83b4a4e740 1 -- 172.21.15.103:0/4244432901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c515c10 msgr2=0x555a6c524a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:21.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/4244432901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c515c10 0x555a6c524a10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8394009a20 tx=0x7f8394011d00 comp rx=0 tx=0).stop 2024-09-11T01:17:21.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f83b4a4e740 1 -- 172.21.15.103:0/4244432901 shutdown_connections 2024-09-11T01:17:21.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/4244432901 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555a6c521ba0 0x555a6c524f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/4244432901 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x555a6c59fcf0 0x555a6c5a2110 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/4244432901 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x555a6c515c10 0x555a6c524a10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f83b4a4e740 1 --2- 172.21.15.103:0/4244432901 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x555a6c5152f0 0x555a6c52a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f8398c00640 0 client.26059 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:21.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f83b4a4e740 1 -- 172.21.15.103:0/4244432901 >> 172.21.15.103:0/4244432901 conn(0x555a6c513120 msgr2=0x555a6c511ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:21.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f83b4a4e740 1 -- 172.21.15.103:0/4244432901 shutdown_connections 2024-09-11T01:17:21.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f83b4a4e740 1 -- 172.21.15.103:0/4244432901 wait complete. 2024-09-11T01:17:21.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.179+0000 7f83b4a4e740 20 client.26059 trim_cache size 0 max 16384 2024-09-11T01:17:21.182 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:17:21.182 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 31, 2024-09-11T01:17:21.182 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24665, 2024-09-11T01:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 19, 2024-09-11T01:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-09-11T01:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: "6b411aaa": { 2024-09-11T01:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 19, 2024-09-11T01:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-09-11T01:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCED", 2024-09-11T01:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-09-11T01:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 150.0, 2024-09-11T01:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-09-11T01:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-09-11T01:17:21.183 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-09-11T01:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCED", 2024-09-11T01:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:21.184 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:17:21.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.180+0000 7f83b0a00640 1 -- 172.21.15.103:0/1022172077 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f83900b5390 msgr2=0x7f83900b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:21.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.180+0000 7f83b0a00640 1 --2- 172.21.15.103:0/1022172077 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f83900b5390 0x7f83900b7850 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f83ac100ed0 tx=0x7f8394005f90 comp rx=0 tx=0).stop 2024-09-11T01:17:21.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.180+0000 7f83b0a00640 1 -- 172.21.15.103:0/1022172077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83ac0754c0 msgr2=0x7f83ac19b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:21.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.180+0000 7f83b0a00640 1 --2- 172.21.15.103:0/1022172077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83ac0754c0 0x7f83ac19b280 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f839c00e9c0 tx=0x7f839c00ee80 comp rx=0 tx=0).stop 2024-09-11T01:17:21.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.180+0000 7f83b0a00640 1 -- 172.21.15.103:0/1022172077 shutdown_connections 2024-09-11T01:17:21.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.180+0000 7f83b0a00640 1 --2- 172.21.15.103:0/1022172077 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f83900b5390 0x7f83900b7850 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.180+0000 7f83b0a00640 1 --2- 172.21.15.103:0/1022172077 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f83ac10f220 0x7f83ac1a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.180+0000 7f83b0a00640 1 --2- 172.21.15.103:0/1022172077 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f83ac075de0 0x7f83ac19b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.180+0000 7f83b0a00640 1 --2- 172.21.15.103:0/1022172077 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f83ac0754c0 0x7f83ac19b280 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:21.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.180+0000 7f83b0a00640 1 -- 172.21.15.103:0/1022172077 >> 172.21.15.103:0/1022172077 conn(0x7f83ac0fe660 msgr2=0x7f83ac111410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:21.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.180+0000 7f83b0a00640 1 -- 172.21.15.103:0/1022172077 shutdown_connections 2024-09-11T01:17:21.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:21.180+0000 7f83b0a00640 1 -- 172.21.15.103:0/1022172077 wait complete. 2024-09-11T01:17:21.994 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6b411aaa', quiesce took 6.6 seconds. Will release after: 23.4 2024-09-11T01:17:23.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:22 smithi103 ceph-mon[30562]: pgmap v671: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 12 MiB/s wr, 2.71k op/s 2024-09-11T01:17:23.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:22 smithi117 ceph-mon[35358]: pgmap v671: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 12 MiB/s wr, 2.71k op/s 2024-09-11T01:17:23.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:22 smithi183 ceph-mon[34992]: pgmap v671: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 12 MiB/s wr, 2.71k op/s 2024-09-11T01:17:24.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:23 smithi103 ceph-mon[30562]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:17:24.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:23 smithi117 ceph-mon[35358]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:17:24.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:23 smithi183 ceph-mon[34992]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:17:25.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:24 smithi103 ceph-mon[30562]: pgmap v672: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 12 MiB/s wr, 2.89k op/s 2024-09-11T01:17:25.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:24 smithi117 ceph-mon[35358]: pgmap v672: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 12 MiB/s wr, 2.89k op/s 2024-09-11T01:17:25.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:24 smithi183 ceph-mon[34992]: pgmap v672: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 12 MiB/s wr, 2.89k op/s 2024-09-11T01:17:27.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:26 smithi103 ceph-mon[30562]: pgmap v673: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 12 MiB/s wr, 2.91k op/s 2024-09-11T01:17:27.083 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:26 smithi103 ceph-mon[30562]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:17:27.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:26 smithi117 ceph-mon[35358]: pgmap v673: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 12 MiB/s wr, 2.91k op/s 2024-09-11T01:17:27.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:26 smithi117 ceph-mon[35358]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:17:27.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:26 smithi183 ceph-mon[34992]: pgmap v673: 129 pgs: 129 active+clean; 13 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 12 MiB/s wr, 2.91k op/s 2024-09-11T01:17:27.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:26 smithi183 ceph-mon[34992]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-11T01:17:29.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:28 smithi103 ceph-mon[30562]: pgmap v674: 129 pgs: 129 active+clean; 12 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 10 MiB/s wr, 2.45k op/s 2024-09-11T01:17:29.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:28 smithi117 ceph-mon[35358]: pgmap v674: 129 pgs: 129 active+clean; 12 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 10 MiB/s wr, 2.45k op/s 2024-09-11T01:17:29.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:28 smithi183 ceph-mon[34992]: pgmap v674: 129 pgs: 129 active+clean; 12 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 10 MiB/s wr, 2.45k op/s 2024-09-11T01:17:31.085 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:30 smithi103 ceph-mon[30562]: pgmap v675: 129 pgs: 129 active+clean; 9.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 7.9 MiB/s wr, 1.93k op/s 2024-09-11T01:17:31.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:30 smithi117 ceph-mon[35358]: pgmap v675: 129 pgs: 129 active+clean; 9.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 7.9 MiB/s wr, 1.93k op/s 2024-09-11T01:17:31.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:30 smithi183 ceph-mon[34992]: pgmap v675: 129 pgs: 129 active+clean; 9.8 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 7.9 MiB/s wr, 1.93k op/s 2024-09-11T01:17:33.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:32 smithi103 ceph-mon[30562]: pgmap v676: 129 pgs: 129 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 3.5 MiB/s wr, 978 op/s 2024-09-11T01:17:33.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:32 smithi117 ceph-mon[35358]: pgmap v676: 129 pgs: 129 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 3.5 MiB/s wr, 978 op/s 2024-09-11T01:17:33.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:32 smithi183 ceph-mon[34992]: pgmap v676: 129 pgs: 129 active+clean; 6.8 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 3.5 MiB/s wr, 978 op/s 2024-09-11T01:17:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.824+0000 7f2fcb600640 1 -- 172.21.15.103:0/443873083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fc4105cf0 msgr2=0x7f2fc4106170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.824+0000 7f2fcb600640 1 --2- 172.21.15.103:0/443873083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fc4105cf0 0x7f2fc4106170 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2fac009930 tx=0x7f2fac02a440 comp rx=0 tx=0).stop 2024-09-11T01:17:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.824+0000 7f2fcb600640 1 -- 172.21.15.103:0/443873083 shutdown_connections 2024-09-11T01:17:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.824+0000 7f2fcb600640 1 --2- 172.21.15.103:0/443873083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fc41066b0 0x7f2fc410d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.824+0000 7f2fcb600640 1 --2- 172.21.15.103:0/443873083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fc4105cf0 0x7f2fc4106170 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.827 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.824+0000 7f2fcb600640 1 --2- 172.21.15.103:0/443873083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fc4104ba0 0x7f2fc4104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.824+0000 7f2fcb600640 1 -- 172.21.15.103:0/443873083 >> 172.21.15.103:0/443873083 conn(0x7f2fc4100460 msgr2=0x7f2fc4102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:34.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.824+0000 7f2fcb600640 1 -- 172.21.15.103:0/443873083 shutdown_connections 2024-09-11T01:17:34.828 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.824+0000 7f2fcb600640 1 -- 172.21.15.103:0/443873083 wait complete. 2024-09-11T01:17:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.825+0000 7f2fcb600640 1 Processor -- start 2024-09-11T01:17:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.825+0000 7f2fcb600640 1 -- start start 2024-09-11T01:17:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fcb600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fc4104ba0 0x7f2fc419af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fcb600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fc4105cf0 0x7f2fc419b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fcb600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fc41066b0 0x7f2fc419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.829 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fcb600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc4110860 con 0x7f2fc4105cf0 2024-09-11T01:17:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fcb600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc41106e0 con 0x7f2fc4104ba0 2024-09-11T01:17:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fcb600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc41109e0 con 0x7f2fc41066b0 2024-09-11T01:17:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fc8c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fc4104ba0 0x7f2fc419af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fbbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fc4105cf0 0x7f2fc419b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fc8c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fc4104ba0 0x7f2fc419af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:52236/0 (socket says 172.21.15.103:52236) 2024-09-11T01:17:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fc8c00640 1 -- 172.21.15.103:0/821857205 learned_addr learned my addr 172.21.15.103:0/821857205 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fc9600640 1 --2- 172.21.15.103:0/821857205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fc41066b0 0x7f2fc419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fc8c00640 1 -- 172.21.15.103:0/821857205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fc41066b0 msgr2=0x7f2fc419c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fc8c00640 1 --2- 172.21.15.103:0/821857205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fc41066b0 0x7f2fc419c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fc8c00640 1 -- 172.21.15.103:0/821857205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fc4105cf0 msgr2=0x7f2fc419b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fc8c00640 1 --2- 172.21.15.103:0/821857205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fc4105cf0 0x7f2fc419b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.826+0000 7f2fc8c00640 1 -- 172.21.15.103:0/821857205 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc419cac0 con 0x7f2fc4104ba0 2024-09-11T01:17:34.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.827+0000 7f2fc8c00640 1 --2- 172.21.15.103:0/821857205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fc4104ba0 0x7f2fc419af80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400ea60 tx=0x7f2fb400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.827+0000 7f2fc2000640 1 -- 172.21.15.103:0/821857205 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb400cde0 con 0x7f2fc4104ba0 2024-09-11T01:17:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.827+0000 7f2fc2000640 1 -- 172.21.15.103:0/821857205 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fb40035f0 con 0x7f2fc4104ba0 2024-09-11T01:17:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.827+0000 7f2fcb600640 1 -- 172.21.15.103:0/821857205 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc419cdb0 con 0x7f2fc4104ba0 2024-09-11T01:17:34.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.827+0000 7f2fc2000640 1 -- 172.21.15.103:0/821857205 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4010690 con 0x7f2fc4104ba0 2024-09-11T01:17:34.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.827+0000 7f2fcb600640 1 -- 172.21.15.103:0/821857205 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc41a3480 con 0x7f2fc4104ba0 2024-09-11T01:17:34.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.831+0000 7f2fce64f740 1 Processor -- start 2024-09-11T01:17:34.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.831+0000 7f2fc2000640 1 -- 172.21.15.103:0/821857205 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f2fb4004000 con 0x7f2fc4104ba0 2024-09-11T01:17:34.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.831+0000 7f2fce64f740 1 -- start start 2024-09-11T01:17:34.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.831+0000 7f2fce64f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556865686790 0x556865688b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.831+0000 7f2fce64f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5568656890c0 0x55686568b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.831+0000 7f2fce64f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55686568bb00 0x55686568dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.831+0000 7f2fce64f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5568655f96b0 con 0x5568656890c0 2024-09-11T01:17:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.831+0000 7f2fce64f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5568655e8ae0 con 0x55686568bb00 2024-09-11T01:17:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.831+0000 7f2fce64f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5568655ec8f0 con 0x556865686790 2024-09-11T01:17:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.832+0000 7f2fc9600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556865686790 0x556865688b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.832+0000 7f2fc8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5568656890c0 0x55686568b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.832+0000 7f2fc9600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556865686790 0x556865688b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:51360/0 (socket says 172.21.15.103:51360) 2024-09-11T01:17:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.832+0000 7f2fbbe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55686568bb00 0x55686568dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.832+0000 7f2fc9600640 1 -- 172.21.15.103:0/16842137 learned_addr learned my addr 172.21.15.103:0/16842137 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.832+0000 7f2fc9600640 1 -- 172.21.15.103:0/16842137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55686568bb00 msgr2=0x55686568dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.832+0000 7f2fc9600640 1 --2- 172.21.15.103:0/16842137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55686568bb00 0x55686568dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.835 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.832+0000 7f2fc9600640 1 -- 172.21.15.103:0/16842137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5568656890c0 msgr2=0x55686568b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.832+0000 7f2fc9600640 1 --2- 172.21.15.103:0/16842137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5568656890c0 0x55686568b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.836 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.832+0000 7f2fc9600640 1 -- 172.21.15.103:0/16842137 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568655b5780 con 0x556865686790 2024-09-11T01:17:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.832+0000 7f2fc9600640 1 --2- 172.21.15.103:0/16842137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556865686790 0x556865688b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009f90 tx=0x7f2fbc0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fad39328c596cf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.833+0000 7f2fb9c00640 1 -- 172.21.15.103:0/16842137 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc004d20 con 0x556865686790 2024-09-11T01:17:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.833+0000 7f2fb9c00640 1 -- 172.21.15.103:0/16842137 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fbc004050 con 0x556865686790 2024-09-11T01:17:34.837 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.833+0000 7f2fb9c00640 1 -- 172.21.15.103:0/16842137 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc005280 con 0x556865686790 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.833+0000 7f2fc2000640 1 --2- 172.21.15.103:0/821857205 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2fa80b5360 0x7f2fa80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.833+0000 7f2fc8c00640 1 --2- 172.21.15.103:0/821857205 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2fa80b5360 0x7f2fa80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.833+0000 7f2fc2000640 1 -- 172.21.15.103:0/821857205 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f2fb40e61c0 con 0x7f2fc4104ba0 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.833+0000 7f2fce64f740 1 -- 172.21.15.103:0/16842137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556865686790 msgr2=0x556865688b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.834+0000 7f2fce64f740 1 --2- 172.21.15.103:0/16842137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556865686790 0x556865688b80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009f90 tx=0x7f2fbc0118d0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.834+0000 7f2fce64f740 1 -- 172.21.15.103:0/16842137 shutdown_connections 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.834+0000 7f2fce64f740 1 --2- 172.21.15.103:0/16842137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55686568bb00 0x55686568dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.834+0000 7f2fce64f740 1 --2- 172.21.15.103:0/16842137 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5568656890c0 0x55686568b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.834+0000 7f2fce64f740 1 --2- 172.21.15.103:0/16842137 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556865686790 0x556865688b80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.834+0000 7f2fce64f740 1 -- 172.21.15.103:0/16842137 >> 172.21.15.103:0/16842137 conn(0x5568656818e0 msgr2=0x556865682670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.834+0000 7f2fce64f740 1 -- 172.21.15.103:0/16842137 shutdown_connections 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.834+0000 7f2fce64f740 1 -- 172.21.15.103:0/16842137 wait complete. 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.834+0000 7f2fc8c00640 1 --2- 172.21.15.103:0/821857205 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2fa80b5360 0x7f2fa80b7820 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40ac560 tx=0x7f2fb40e9ca0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.834+0000 7f2fce64f740 1 -- start start 2024-09-11T01:17:34.838 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.835+0000 7f2fce64f740 1 Processor -- start 2024-09-11T01:17:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.835+0000 7f2fce64f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556865686790 0x55686568ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.835+0000 7f2fce64f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5568656890c0 0x5568656905c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.835+0000 7f2fce64f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55686568bb00 0x556865691120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.835+0000 7f2fce64f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556865520ab0 con 0x55686568bb00 2024-09-11T01:17:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.835+0000 7f2fce64f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x55686558f570 con 0x5568656890c0 2024-09-11T01:17:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.835+0000 7f2fce64f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x55686568eae0 con 0x556865686790 2024-09-11T01:17:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.835+0000 7f2fce64f740 10 client.0 _ll_register_callbacks cb 0x55686559e100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.835+0000 7f2fc9600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556865686790 0x55686568ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.836+0000 7f2fc9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55686568bb00 0x556865691120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.836+0000 7f2fbbe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5568656890c0 0x5568656905c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.836+0000 7f2fbbe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5568656890c0 0x5568656905c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:52248/0 (socket says 172.21.15.103:52248) 2024-09-11T01:17:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.836+0000 7f2fbbe00640 1 -- 172.21.15.103:0/3813637578 learned_addr learned my addr 172.21.15.103:0/3813637578 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.836+0000 7f2fbbe00640 1 -- 172.21.15.103:0/3813637578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556865686790 msgr2=0x55686568ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.836+0000 7f2fbbe00640 1 --2- 172.21.15.103:0/3813637578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556865686790 0x55686568ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.836+0000 7f2fbbe00640 1 -- 172.21.15.103:0/3813637578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55686568bb00 msgr2=0x556865691120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:34.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.836+0000 7f2fbbe00640 1 --2- 172.21.15.103:0/3813637578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55686568bb00 0x556865691120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.836+0000 7f2fbbe00640 1 -- 172.21.15.103:0/3813637578 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55686534a790 con 0x5568656890c0 2024-09-11T01:17:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.836+0000 7f2fbbe00640 1 --2- 172.21.15.103:0/3813637578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5568656890c0 0x5568656905c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2fac000c00 tx=0x7f2fac0043b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f27dfca490dae6c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.836+0000 7f2fb2000640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:17:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.837+0000 7f2fb2000640 1 -- 172.21.15.103:0/3813637578 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac035040 con 0x5568656890c0 2024-09-11T01:17:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.837+0000 7f2fce64f740 1 -- 172.21.15.103:0/3813637578 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fbc004050 con 0x5568656890c0 2024-09-11T01:17:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.837+0000 7f2fb2000640 1 -- 172.21.15.103:0/3813637578 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f2fac003a00 con 0x5568656890c0 2024-09-11T01:17:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.837+0000 7f2fb2000640 1 -- 172.21.15.103:0/3813637578 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2fac04e050 con 0x5568656890c0 2024-09-11T01:17:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.837+0000 7f2fce64f740 10 client.26123 fetch_fsmap learned FSMap version 33 2024-09-11T01:17:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.837+0000 7f2fce64f740 1 -- 172.21.15.103:0/3813637578 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5568653c3620 con 0x5568656890c0 2024-09-11T01:17:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.837+0000 7f2fb2000640 1 -- 172.21.15.103:0/3813637578 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fbc004050 con 0x5568656890c0 2024-09-11T01:17:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.837+0000 7f2fb2000640 1 -- 172.21.15.103:0/3813637578 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f2fac03c440 con 0x5568656890c0 2024-09-11T01:17:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.838+0000 7f2fce64f740 10 client.26123 fetch_fsmap finished waiting for FSMap version 33 2024-09-11T01:17:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.838+0000 7f2fce64f740 10 client.26123 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:17:34.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.838+0000 7f2fce64f740 20 client.26123 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.838+0000 7f2fce64f740 1 --2- 172.21.15.103:0/3813637578 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55686569b7d0 0x55686569dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.838+0000 7f2fce64f740 4 client.26123 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:17:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.838+0000 7f2fce64f740 1 -- 172.21.15.103:0/3813637578 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568655fb600 con 0x55686569b7d0 2024-09-11T01:17:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.838+0000 7f2fc9600640 1 --2- 172.21.15.103:0/3813637578 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55686569b7d0 0x55686569dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.839+0000 7f2fc9600640 1 --2- 172.21.15.103:0/3813637578 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55686569b7d0 0x55686569dbc0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=155a3fef5ace6149 server_cookie=b5c8860ba891697a in_seq=0 out_seq=0 2024-09-11T01:17:34.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.839+0000 7f2fb2000640 10 client.26123 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fb2000640 1 -- 172.21.15.103:0/3813637578 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5568655fb600 con 0x55686569b7d0 2024-09-11T01:17:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fb2000640 10 client.26123 handle_command_reply: tid=0 2024-09-11T01:17:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fce64f740 1 client.26123 shutdown 2024-09-11T01:17:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fce64f740 1 -- 172.21.15.103:0/3813637578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5568656890c0 msgr2=0x5568656905c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fce64f740 1 --2- 172.21.15.103:0/3813637578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5568656890c0 0x5568656905c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2fac000c00 tx=0x7f2fac0043b0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fce64f740 1 -- 172.21.15.103:0/3813637578 shutdown_connections 2024-09-11T01:17:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fce64f740 1 --2- 172.21.15.103:0/3813637578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55686568bb00 0x556865691120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.845 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fce64f740 1 --2- 172.21.15.103:0/3813637578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5568656890c0 0x5568656905c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fce64f740 1 --2- 172.21.15.103:0/3813637578 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x55686569b7d0 0x55686569dbc0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fce64f740 1 --2- 172.21.15.103:0/3813637578 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x556865686790 0x55686568ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fce64f740 1 -- 172.21.15.103:0/3813637578 >> 172.21.15.103:0/3813637578 conn(0x5568656818e0 msgr2=0x556865680a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fb2000640 0 client.26123 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fce64f740 1 -- 172.21.15.103:0/3813637578 shutdown_connections 2024-09-11T01:17:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fce64f740 1 -- 172.21.15.103:0/3813637578 wait complete. 2024-09-11T01:17:34.846 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.840+0000 7f2fce64f740 20 client.26123 trim_cache size 0 max 16384 2024-09-11T01:17:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.856+0000 7f2fce64f740 1 Processor -- start 2024-09-11T01:17:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.856+0000 7f2fce64f740 1 -- start start 2024-09-11T01:17:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.856+0000 7f2fce64f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556865686790 0x55686568c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.856+0000 7f2fce64f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5568656890c0 0x55686568ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.856+0000 7f2fce64f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55686568bb00 0x556865690460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.856+0000 7f2fce64f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc41b01e0 con 0x5568656890c0 2024-09-11T01:17:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.856+0000 7f2fce64f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc41ada20 con 0x556865686790 2024-09-11T01:17:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.856+0000 7f2fce64f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc41ab870 con 0x55686568bb00 2024-09-11T01:17:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.857+0000 7f2fbbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5568656890c0 0x55686568ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.860 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.857+0000 7f2fbbe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5568656890c0 0x55686568ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51192/0 (socket says 172.21.15.103:51192) 2024-09-11T01:17:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.857+0000 7f2fbbe00640 1 -- 172.21.15.103:0/132835627 learned_addr learned my addr 172.21.15.103:0/132835627 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.857+0000 7f2fc9600640 1 --2- 172.21.15.103:0/132835627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556865686790 0x55686568c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.857+0000 7f2fc9600640 1 --2- 172.21.15.103:0/132835627 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55686568bb00 0x556865690460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.857+0000 7f2fbbe00640 1 -- 172.21.15.103:0/132835627 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55686568bb00 msgr2=0x556865690460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.857+0000 7f2fbbe00640 1 --2- 172.21.15.103:0/132835627 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55686568bb00 0x556865690460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.857+0000 7f2fbbe00640 1 -- 172.21.15.103:0/132835627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556865686790 msgr2=0x55686568c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.857+0000 7f2fbbe00640 1 --2- 172.21.15.103:0/132835627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556865686790 0x55686568c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.861 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.857+0000 7f2fbbe00640 1 -- 172.21.15.103:0/132835627 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556865688ef0 con 0x5568656890c0 2024-09-11T01:17:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.858+0000 7f2fbbe00640 1 --2- 172.21.15.103:0/132835627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5568656890c0 0x55686568ff20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2fac03c7b0 tx=0x7f2fac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e8a86ffb73bd76 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.858+0000 7f2fb9200640 1 -- 172.21.15.103:0/132835627 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac057070 con 0x5568656890c0 2024-09-11T01:17:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.858+0000 7f2fb9200640 1 -- 172.21.15.103:0/132835627 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fac005850 con 0x5568656890c0 2024-09-11T01:17:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.858+0000 7f2fb9200640 1 -- 172.21.15.103:0/132835627 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fac035070 con 0x5568656890c0 2024-09-11T01:17:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.858+0000 7f2fce64f740 1 -- 172.21.15.103:0/132835627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5568656890c0 msgr2=0x55686568ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.858+0000 7f2fce64f740 1 --2- 172.21.15.103:0/132835627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5568656890c0 0x55686568ff20 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2fac03c7b0 tx=0x7f2fac001e70 comp rx=0 tx=0).stop 2024-09-11T01:17:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.859+0000 7f2fce64f740 1 -- 172.21.15.103:0/132835627 shutdown_connections 2024-09-11T01:17:34.864 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.859+0000 7f2fce64f740 1 --2- 172.21.15.103:0/132835627 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x55686568bb00 0x556865690460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.859+0000 7f2fce64f740 1 --2- 172.21.15.103:0/132835627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5568656890c0 0x55686568ff20 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.859+0000 7f2fce64f740 1 --2- 172.21.15.103:0/132835627 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x556865686790 0x55686568c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.859+0000 7f2fce64f740 1 -- 172.21.15.103:0/132835627 >> 172.21.15.103:0/132835627 conn(0x5568656818e0 msgr2=0x55686568bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.859+0000 7f2fce64f740 1 -- 172.21.15.103:0/132835627 shutdown_connections 2024-09-11T01:17:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.859+0000 7f2fce64f740 1 -- 172.21.15.103:0/132835627 wait complete. 2024-09-11T01:17:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.859+0000 7f2fce64f740 1 -- start start 2024-09-11T01:17:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.859+0000 7f2fce64f740 1 Processor -- start 2024-09-11T01:17:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fce64f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556865686790 0x5568656979e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fce64f740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568656890c0 0x5568656966e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fce64f740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55686568bb00 0x556865696cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fce64f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc41abee0 con 0x556865686790 2024-09-11T01:17:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fce64f740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc41ad350 con 0x55686568bb00 2024-09-11T01:17:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fce64f740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc41ac5b0 con 0x5568656890c0 2024-09-11T01:17:34.865 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fce64f740 10 client.0 _ll_register_callbacks cb 0x7f2fac009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fc9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556865686790 0x5568656979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fc9600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556865686790 0x5568656979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51194/0 (socket says 172.21.15.103:51194) 2024-09-11T01:17:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fc9600640 1 -- 172.21.15.103:0/343253243 learned_addr learned my addr 172.21.15.103:0/343253243 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fbbe00640 1 --2- 172.21.15.103:0/343253243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568656890c0 0x5568656966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fc9600640 1 --2- 172.21.15.103:0/343253243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55686568bb00 0x556865696cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fc9600640 1 -- 172.21.15.103:0/343253243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568656890c0 msgr2=0x5568656966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fc9600640 1 --2- 172.21.15.103:0/343253243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568656890c0 0x5568656966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fc9600640 1 -- 172.21.15.103:0/343253243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55686568bb00 msgr2=0x556865696cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fc9600640 1 --2- 172.21.15.103:0/343253243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55686568bb00 0x556865696cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.860+0000 7f2fc9600640 1 -- 172.21.15.103:0/343253243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556865697520 con 0x556865686790 2024-09-11T01:17:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.861+0000 7f2fc9600640 1 --2- 172.21.15.103:0/343253243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556865686790 0x5568656979e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc011dd0 tx=0x7f2fbc02ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c85bbcad5c146f03 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.861+0000 7f2fb2000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:17:34.866 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.861+0000 7f2fb2000640 1 -- 172.21.15.103:0/343253243 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc005250 con 0x556865686790 2024-09-11T01:17:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.861+0000 7f2fb2000640 1 -- 172.21.15.103:0/343253243 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f2fbc0053f0 con 0x556865686790 2024-09-11T01:17:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.861+0000 7f2fce64f740 1 -- 172.21.15.103:0/343253243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fac005850 con 0x556865686790 2024-09-11T01:17:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.861+0000 7f2fb2000640 1 -- 172.21.15.103:0/343253243 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2fbc044050 con 0x556865686790 2024-09-11T01:17:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.861+0000 7f2fce64f740 10 client.16044 fetch_fsmap learned FSMap version 33 2024-09-11T01:17:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.861+0000 7f2fce64f740 1 -- 172.21.15.103:0/343253243 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556865708840 con 0x556865686790 2024-09-11T01:17:34.867 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.862+0000 7f2fb2000640 1 -- 172.21.15.103:0/343253243 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2fac005850 con 0x556865686790 2024-09-11T01:17:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.862+0000 7f2fb2000640 1 -- 172.21.15.103:0/343253243 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f2fbc00fab0 con 0x556865686790 2024-09-11T01:17:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.862+0000 7f2fce64f740 10 client.16044 fetch_fsmap finished waiting for FSMap version 33 2024-09-11T01:17:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.862+0000 7f2fce64f740 10 client.16044 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:17:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.862+0000 7f2fce64f740 20 client.16044 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.862+0000 7f2fce64f740 1 --2- 172.21.15.103:0/343253243 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5568657090e0 0x55686570b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.862+0000 7f2fce64f740 4 client.16044 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:17:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.862+0000 7f2fce64f740 1 -- 172.21.15.103:0/343253243 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5568655f70b0 con 0x5568657090e0 2024-09-11T01:17:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.862+0000 7f2fbbe00640 1 --2- 172.21.15.103:0/343253243 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5568657090e0 0x55686570b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.863+0000 7f2fbbe00640 1 --2- 172.21.15.103:0/343253243 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5568657090e0 0x55686570b500 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e583cc6349b37b2d server_cookie=ff7bcbd1b31938e7 in_seq=0 out_seq=0 2024-09-11T01:17:34.868 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.863+0000 7f2fb2000640 10 client.16044 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:34.879 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fb2000640 1 -- 172.21.15.103:0/343253243 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5568655f70b0 con 0x5568657090e0 2024-09-11T01:17:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fb2000640 10 client.16044 handle_command_reply: tid=0 2024-09-11T01:17:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fce64f740 1 client.16044 shutdown 2024-09-11T01:17:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fce64f740 1 -- 172.21.15.103:0/343253243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556865686790 msgr2=0x5568656979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fce64f740 1 --2- 172.21.15.103:0/343253243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556865686790 0x5568656979e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc011dd0 tx=0x7f2fbc02ef90 comp rx=0 tx=0).stop 2024-09-11T01:17:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fce64f740 1 -- 172.21.15.103:0/343253243 shutdown_connections 2024-09-11T01:17:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fce64f740 1 --2- 172.21.15.103:0/343253243 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x55686568bb00 0x556865696cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fce64f740 1 --2- 172.21.15.103:0/343253243 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5568657090e0 0x55686570b500 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fce64f740 1 --2- 172.21.15.103:0/343253243 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5568656890c0 0x5568656966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fce64f740 1 --2- 172.21.15.103:0/343253243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556865686790 0x5568656979e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fb2000640 0 client.16044 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fce64f740 1 -- 172.21.15.103:0/343253243 >> 172.21.15.103:0/343253243 conn(0x5568656818e0 msgr2=0x55686568ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fce64f740 1 -- 172.21.15.103:0/343253243 shutdown_connections 2024-09-11T01:17:34.880 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fce64f740 1 -- 172.21.15.103:0/343253243 wait complete. 2024-09-11T01:17:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.877+0000 7f2fce64f740 20 client.16044 trim_cache size 0 max 16384 2024-09-11T01:17:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:17:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:17:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:17:34.881 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:17:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.878+0000 7f2fcb600640 1 -- 172.21.15.103:0/821857205 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2fa80b5360 msgr2=0x7f2fa80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.878+0000 7f2fcb600640 1 --2- 172.21.15.103:0/821857205 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2fa80b5360 0x7f2fa80b7820 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40ac560 tx=0x7f2fb40e9ca0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.878+0000 7f2fcb600640 1 -- 172.21.15.103:0/821857205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fc4104ba0 msgr2=0x7f2fc419af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.878+0000 7f2fcb600640 1 --2- 172.21.15.103:0/821857205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fc4104ba0 0x7f2fc419af80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2fb400ea60 tx=0x7f2fb400ef20 comp rx=0 tx=0).stop 2024-09-11T01:17:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.878+0000 7f2fcb600640 1 -- 172.21.15.103:0/821857205 shutdown_connections 2024-09-11T01:17:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.878+0000 7f2fcb600640 1 --2- 172.21.15.103:0/821857205 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f2fa80b5360 0x7f2fa80b7820 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.878+0000 7f2fcb600640 1 --2- 172.21.15.103:0/821857205 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f2fc41066b0 0x7f2fc419c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.878+0000 7f2fcb600640 1 --2- 172.21.15.103:0/821857205 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fc4105cf0 0x7f2fc419b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.882 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.878+0000 7f2fcb600640 1 --2- 172.21.15.103:0/821857205 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fc4104ba0 0x7f2fc419af80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.878+0000 7f2fcb600640 1 -- 172.21.15.103:0/821857205 >> 172.21.15.103:0/821857205 conn(0x7f2fc4100460 msgr2=0x7f2fc4109080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.878+0000 7f2fcb600640 1 -- 172.21.15.103:0/821857205 shutdown_connections 2024-09-11T01:17:34.883 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:34.878+0000 7f2fcb600640 1 -- 172.21.15.103:0/821857205 wait complete. 2024-09-11T01:17:35.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:34 smithi103 ceph-mon[30562]: pgmap v677: 129 pgs: 129 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 899 KiB/s wr, 403 op/s 2024-09-11T01:17:35.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:34 smithi117 ceph-mon[35358]: pgmap v677: 129 pgs: 129 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 899 KiB/s wr, 403 op/s 2024-09-11T01:17:35.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:34 smithi183 ceph-mon[34992]: pgmap v677: 129 pgs: 129 active+clean; 4.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 899 KiB/s wr, 403 op/s 2024-09-11T01:17:37.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:36 smithi103 ceph-mon[30562]: pgmap v678: 129 pgs: 129 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 110 KiB/s wr, 287 op/s 2024-09-11T01:17:37.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:36 smithi117 ceph-mon[35358]: pgmap v678: 129 pgs: 129 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 110 KiB/s wr, 287 op/s 2024-09-11T01:17:37.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:36 smithi183 ceph-mon[34992]: pgmap v678: 129 pgs: 129 active+clean; 1.9 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 110 KiB/s wr, 287 op/s 2024-09-11T01:17:39.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:38 smithi103 ceph-mon[30562]: pgmap v679: 129 pgs: 129 active+clean; 468 MiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 21 KiB/s wr, 290 op/s 2024-09-11T01:17:39.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:38 smithi117 ceph-mon[35358]: pgmap v679: 129 pgs: 129 active+clean; 468 MiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 21 KiB/s wr, 290 op/s 2024-09-11T01:17:39.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:38 smithi183 ceph-mon[34992]: pgmap v679: 129 pgs: 129 active+clean; 468 MiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 21 KiB/s wr, 290 op/s 2024-09-11T01:17:41.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:40 smithi103 ceph-mon[30562]: pgmap v680: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 19 KiB/s wr, 277 op/s 2024-09-11T01:17:41.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:40 smithi117 ceph-mon[35358]: pgmap v680: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 19 KiB/s wr, 277 op/s 2024-09-11T01:17:41.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:40 smithi183 ceph-mon[34992]: pgmap v680: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 19 KiB/s wr, 277 op/s 2024-09-11T01:17:43.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:42 smithi103 ceph-mon[30562]: pgmap v681: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 KiB/s wr, 220 op/s 2024-09-11T01:17:43.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:42 smithi117 ceph-mon[35358]: pgmap v681: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 KiB/s wr, 220 op/s 2024-09-11T01:17:43.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:42 smithi183 ceph-mon[34992]: pgmap v681: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 10 KiB/s wr, 220 op/s 2024-09-11T01:17:45.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:44 smithi103 ceph-mon[30562]: pgmap v682: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 155 op/s 2024-09-11T01:17:45.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:44 smithi117 ceph-mon[35358]: pgmap v682: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 155 op/s 2024-09-11T01:17:45.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:44 smithi183 ceph-mon[34992]: pgmap v682: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.2 KiB/s wr, 155 op/s 2024-09-11T01:17:45.395 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:17:47.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:46 smithi103 ceph-mon[30562]: pgmap v683: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.7 KiB/s wr, 114 op/s 2024-09-11T01:17:47.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:46 smithi117 ceph-mon[35358]: pgmap v683: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.7 KiB/s wr, 114 op/s 2024-09-11T01:17:47.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:46 smithi183 ceph-mon[34992]: pgmap v683: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 2.7 KiB/s wr, 114 op/s 2024-09-11T01:17:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.003+0000 7f7fca000640 1 -- 172.21.15.103:0/111095197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fc4105b00 msgr2=0x7f7fc4105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.003+0000 7f7fca000640 1 --2- 172.21.15.103:0/111095197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fc4105b00 0x7f7fc4105f80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0009930 tx=0x7f7fb002a420 comp rx=0 tx=0).stop 2024-09-11T01:17:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.003+0000 7f7fca000640 1 -- 172.21.15.103:0/111095197 shutdown_connections 2024-09-11T01:17:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.003+0000 7f7fca000640 1 --2- 172.21.15.103:0/111095197 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fc41064c0 0x7f7fc410ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.006 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.003+0000 7f7fca000640 1 --2- 172.21.15.103:0/111095197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fc4105b00 0x7f7fc4105f80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.003+0000 7f7fca000640 1 --2- 172.21.15.103:0/111095197 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc41049b0 0x7f7fc4104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.003+0000 7f7fca000640 1 -- 172.21.15.103:0/111095197 >> 172.21.15.103:0/111095197 conn(0x7f7fc4100250 msgr2=0x7f7fc4102690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.003+0000 7f7fca000640 1 -- 172.21.15.103:0/111095197 shutdown_connections 2024-09-11T01:17:48.007 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.003+0000 7f7fca000640 1 -- 172.21.15.103:0/111095197 wait complete. 2024-09-11T01:17:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.004+0000 7f7fca000640 1 Processor -- start 2024-09-11T01:17:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.004+0000 7f7fca000640 1 -- start start 2024-09-11T01:17:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.004+0000 7f7fca000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fc41049b0 0x7f7fc419ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.004+0000 7f7fca000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc4105b00 0x7f7fc419b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.005+0000 7f7fca000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fc41064c0 0x7f7fc419c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.005+0000 7f7fca000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc4110650 con 0x7f7fc41049b0 2024-09-11T01:17:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.005+0000 7f7fca000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc41104d0 con 0x7f7fc41064c0 2024-09-11T01:17:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.005+0000 7f7fca000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc41107d0 con 0x7f7fc4105b00 2024-09-11T01:17:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.005+0000 7f7fc8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fc41049b0 0x7f7fc419ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.009 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.005+0000 7f7fc8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fc41049b0 0x7f7fc419ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40778/0 (socket says 172.21.15.103:40778) 2024-09-11T01:17:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.005+0000 7f7fc8c00640 1 -- 172.21.15.103:0/2889394319 learned_addr learned my addr 172.21.15.103:0/2889394319 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.005+0000 7f7fc3e00640 1 --2- 172.21.15.103:0/2889394319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc4105b00 0x7f7fc419b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.005+0000 7f7fc9600640 1 --2- 172.21.15.103:0/2889394319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fc41064c0 0x7f7fc419c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.005+0000 7f7fc8c00640 1 -- 172.21.15.103:0/2889394319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc4105b00 msgr2=0x7f7fc419b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.005+0000 7f7fc8c00640 1 --2- 172.21.15.103:0/2889394319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc4105b00 0x7f7fc419b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.005+0000 7f7fc8c00640 1 -- 172.21.15.103:0/2889394319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fc41064c0 msgr2=0x7f7fc419c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.005+0000 7f7fc8c00640 1 --2- 172.21.15.103:0/2889394319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fc41064c0 0x7f7fc419c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.005+0000 7f7fc8c00640 1 -- 172.21.15.103:0/2889394319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc419c950 con 0x7f7fc41049b0 2024-09-11T01:17:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.006+0000 7f7fc8c00640 1 --2- 172.21.15.103:0/2889394319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fc41049b0 0x7f7fc419ae10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800e9f0 tx=0x7f7fb800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.006+0000 7f7fc1600640 1 -- 172.21.15.103:0/2889394319 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb800cd80 con 0x7f7fc41049b0 2024-09-11T01:17:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.006+0000 7f7fc1600640 1 -- 172.21.15.103:0/2889394319 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fb80108e0 con 0x7f7fc41049b0 2024-09-11T01:17:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.006+0000 7f7fc1600640 1 -- 172.21.15.103:0/2889394319 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8018980 con 0x7f7fc41049b0 2024-09-11T01:17:48.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.006+0000 7f7fca000640 1 -- 172.21.15.103:0/2889394319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc419cc40 con 0x7f7fc41049b0 2024-09-11T01:17:48.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.006+0000 7f7fca000640 1 -- 172.21.15.103:0/2889394319 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fc41a3310 con 0x7f7fc41049b0 2024-09-11T01:17:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.009+0000 7f7fce5cc740 1 Processor -- start 2024-09-11T01:17:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.009+0000 7f7fce5cc740 1 -- start start 2024-09-11T01:17:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.009+0000 7f7fce5cc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56236057c970 0x56236057ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.009+0000 7f7fce5cc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057f2a0 0x562360581690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.009+0000 7f7fce5cc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562360581ce0 0x5623605841a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.009+0000 7f7fce5cc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5623604ef6b0 con 0x562360581ce0 2024-09-11T01:17:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.009+0000 7f7fce5cc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5623604deae0 con 0x56236057f2a0 2024-09-11T01:17:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.009+0000 7f7fce5cc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5623604e28f0 con 0x56236057c970 2024-09-11T01:17:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.010+0000 7f7fc1600640 1 -- 172.21.15.103:0/2889394319 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f7fb8010430 con 0x7f7fc41049b0 2024-09-11T01:17:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.010+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562360581ce0 0x5623605841a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.010+0000 7f7fc9600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56236057c970 0x56236057ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.010+0000 7f7fc9600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56236057c970 0x56236057ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:47308/0 (socket says 172.21.15.103:47308) 2024-09-11T01:17:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.010+0000 7f7fc9600640 1 -- 172.21.15.103:0/48530850 learned_addr learned my addr 172.21.15.103:0/48530850 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.010+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562360581ce0 0x5623605841a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40790/0 (socket says 172.21.15.103:40790) 2024-09-11T01:17:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.010+0000 7f7fc8c00640 1 --2- 172.21.15.103:0/48530850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057f2a0 0x562360581690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.010+0000 7f7fc9600640 1 -- 172.21.15.103:0/48530850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057f2a0 msgr2=0x562360581690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.010+0000 7f7fc9600640 1 --2- 172.21.15.103:0/48530850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057f2a0 0x562360581690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.010+0000 7f7fc9600640 1 -- 172.21.15.103:0/48530850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562360581ce0 msgr2=0x5623605841a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.010+0000 7f7fc9600640 1 --2- 172.21.15.103:0/48530850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562360581ce0 0x5623605841a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.010+0000 7f7fc9600640 1 -- 172.21.15.103:0/48530850 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623604ab780 con 0x56236057c970 2024-09-11T01:17:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.011+0000 7f7fc9600640 1 --2- 172.21.15.103:0/48530850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56236057c970 0x56236057ed60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009f90 tx=0x7f7fbc0118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c1ddd0da8c1d79b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.011+0000 7f7fb5c00640 1 -- 172.21.15.103:0/48530850 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc004d20 con 0x56236057c970 2024-09-11T01:17:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.011+0000 7f7fb5c00640 1 -- 172.21.15.103:0/48530850 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fbc004050 con 0x56236057c970 2024-09-11T01:17:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.011+0000 7f7fb5c00640 1 -- 172.21.15.103:0/48530850 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc005280 con 0x56236057c970 2024-09-11T01:17:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.011+0000 7f7fce5cc740 1 -- 172.21.15.103:0/48530850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56236057c970 msgr2=0x56236057ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:48.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.011+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/48530850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56236057c970 0x56236057ed60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009f90 tx=0x7f7fbc0118d0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.012+0000 7f7fce5cc740 1 -- 172.21.15.103:0/48530850 shutdown_connections 2024-09-11T01:17:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.012+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/48530850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x562360581ce0 0x5623605841a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.012+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/48530850 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057f2a0 0x562360581690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.012+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/48530850 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56236057c970 0x56236057ed60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.012+0000 7f7fce5cc740 1 -- 172.21.15.103:0/48530850 >> 172.21.15.103:0/48530850 conn(0x562360577ac0 msgr2=0x562360578850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.012+0000 7f7fce5cc740 1 -- 172.21.15.103:0/48530850 shutdown_connections 2024-09-11T01:17:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.012+0000 7f7fce5cc740 1 -- 172.21.15.103:0/48530850 wait complete. 2024-09-11T01:17:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.012+0000 7f7fc1600640 1 --2- 172.21.15.103:0/2889394319 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7fac0b5200 0x7f7fac0b76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.012+0000 7f7fc1600640 1 -- 172.21.15.103:0/2889394319 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f7fb80e62d0 con 0x7f7fc41049b0 2024-09-11T01:17:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.012+0000 7f7fce5cc740 1 -- start start 2024-09-11T01:17:48.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.012+0000 7f7fc3e00640 1 --2- 172.21.15.103:0/2889394319 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7fac0b5200 0x7f7fac0b76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.013+0000 7f7fce5cc740 1 Processor -- start 2024-09-11T01:17:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.013+0000 7f7fce5cc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057c970 0x5623605860b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.013+0000 7f7fce5cc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057f2a0 0x562360586750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.013+0000 7f7fce5cc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562360581ce0 0x562360587320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.013+0000 7f7fce5cc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x562360416ab0 con 0x56236057c970 2024-09-11T01:17:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.013+0000 7f7fce5cc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x562360485570 con 0x56236057f2a0 2024-09-11T01:17:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.013+0000 7f7fce5cc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x562360584cc0 con 0x562360581ce0 2024-09-11T01:17:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.013+0000 7f7fc3e00640 1 --2- 172.21.15.103:0/2889394319 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7fac0b5200 0x7f7fac0b76c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0005ab0 tx=0x7f7fb0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.013+0000 7f7fce5cc740 10 client.0 _ll_register_callbacks cb 0x562360494100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.013+0000 7f7fc8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057c970 0x5623605860b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.013+0000 7f7fc8c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057c970 0x5623605860b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40800/0 (socket says 172.21.15.103:40800) 2024-09-11T01:17:48.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.013+0000 7f7fc8c00640 1 -- 172.21.15.103:0/1707342934 learned_addr learned my addr 172.21.15.103:0/1707342934 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.014+0000 7f7fc3e00640 1 --2- 172.21.15.103:0/1707342934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057f2a0 0x562360586750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.014+0000 7f7fc9600640 1 --2- 172.21.15.103:0/1707342934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562360581ce0 0x562360587320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.014+0000 7f7fc8c00640 1 -- 172.21.15.103:0/1707342934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562360581ce0 msgr2=0x562360587320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.014+0000 7f7fc8c00640 1 --2- 172.21.15.103:0/1707342934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562360581ce0 0x562360587320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.014+0000 7f7fc8c00640 1 -- 172.21.15.103:0/1707342934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057f2a0 msgr2=0x562360586750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.014+0000 7f7fc8c00640 1 --2- 172.21.15.103:0/1707342934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057f2a0 0x562360586750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.014+0000 7f7fc8c00640 1 -- 172.21.15.103:0/1707342934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562360240790 con 0x56236057c970 2024-09-11T01:17:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.014+0000 7f7fc8c00640 1 --2- 172.21.15.103:0/1707342934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057c970 0x5623605860b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80ac6c0 tx=0x7f7fb80a85d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b4f6338c4d4451 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.014+0000 7f7faa000640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:17:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.014+0000 7f7faa000640 1 -- 172.21.15.103:0/1707342934 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80abea0 con 0x56236057c970 2024-09-11T01:17:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.014+0000 7f7faa000640 1 -- 172.21.15.103:0/1707342934 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f7fb80abb90 con 0x56236057c970 2024-09-11T01:17:48.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.014+0000 7f7fce5cc740 1 -- 172.21.15.103:0/1707342934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fbc004050 con 0x56236057c970 2024-09-11T01:17:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.015+0000 7f7faa000640 1 -- 172.21.15.103:0/1707342934 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7fb80ac240 con 0x56236057c970 2024-09-11T01:17:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.015+0000 7f7fce5cc740 10 client.16056 fetch_fsmap learned FSMap version 33 2024-09-11T01:17:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.015+0000 7f7fce5cc740 1 -- 172.21.15.103:0/1707342934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5623602b9620 con 0x56236057c970 2024-09-11T01:17:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.015+0000 7f7faa000640 1 -- 172.21.15.103:0/1707342934 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fbc004050 con 0x56236057c970 2024-09-11T01:17:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.015+0000 7f7faa000640 1 -- 172.21.15.103:0/1707342934 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f7fb80a8080 con 0x56236057c970 2024-09-11T01:17:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.015+0000 7f7fce5cc740 10 client.16056 fetch_fsmap finished waiting for FSMap version 33 2024-09-11T01:17:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.015+0000 7f7fce5cc740 10 client.16056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:17:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.015+0000 7f7fce5cc740 20 client.16056 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.015+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/1707342934 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562360591920 0x562360593d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.015+0000 7f7fce5cc740 4 client.16056 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:17:48.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.015+0000 7f7fce5cc740 1 -- 172.21.15.103:0/1707342934 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623604f1600 con 0x562360591920 2024-09-11T01:17:48.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.016+0000 7f7fc3e00640 1 --2- 172.21.15.103:0/1707342934 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562360591920 0x562360593d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.017+0000 7f7fc3e00640 1 --2- 172.21.15.103:0/1707342934 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562360591920 0x562360593d30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5a588e236e94715 server_cookie=44fc88892adedff6 in_seq=0 out_seq=0 2024-09-11T01:17:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.017+0000 7f7faa000640 10 client.16056 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.017+0000 7f7faa000640 1 -- 172.21.15.103:0/1707342934 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5623604f1600 con 0x562360591920 2024-09-11T01:17:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.017+0000 7f7faa000640 10 client.16056 handle_command_reply: tid=0 2024-09-11T01:17:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.018+0000 7f7fce5cc740 1 client.16056 shutdown 2024-09-11T01:17:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.018+0000 7f7fce5cc740 1 -- 172.21.15.103:0/1707342934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057c970 msgr2=0x5623605860b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.018+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/1707342934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057c970 0x5623605860b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80ac6c0 tx=0x7f7fb80a85d0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.018+0000 7f7fce5cc740 1 -- 172.21.15.103:0/1707342934 shutdown_connections 2024-09-11T01:17:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.018+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/1707342934 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562360591920 0x562360593d30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.018+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/1707342934 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562360581ce0 0x562360587320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.018+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/1707342934 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057f2a0 0x562360586750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.024 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.018+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/1707342934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057c970 0x5623605860b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.018+0000 7f7fce5cc740 1 -- 172.21.15.103:0/1707342934 >> 172.21.15.103:0/1707342934 conn(0x562360577ac0 msgr2=0x562360576bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.018+0000 7f7faa000640 0 client.16056 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.018+0000 7f7fce5cc740 1 -- 172.21.15.103:0/1707342934 shutdown_connections 2024-09-11T01:17:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.018+0000 7f7fce5cc740 1 -- 172.21.15.103:0/1707342934 wait complete. 2024-09-11T01:17:48.025 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.018+0000 7f7fce5cc740 20 client.16056 trim_cache size 0 max 16384 2024-09-11T01:17:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.033+0000 7f7fce5cc740 1 Processor -- start 2024-09-11T01:17:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.033+0000 7f7fce5cc740 1 -- start start 2024-09-11T01:17:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fce5cc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56236057c970 0x5623605827d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fce5cc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057f2a0 0x5623605798f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fce5cc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562360581ce0 0x562360579e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fce5cc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc41b0140 con 0x56236057f2a0 2024-09-11T01:17:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fce5cc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc41ad980 con 0x562360581ce0 2024-09-11T01:17:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fce5cc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc41ab7d0 con 0x56236057c970 2024-09-11T01:17:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057f2a0 0x5623605798f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057f2a0 0x5623605798f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40806/0 (socket says 172.21.15.103:40806) 2024-09-11T01:17:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fc3e00640 1 -- 172.21.15.103:0/141227416 learned_addr learned my addr 172.21.15.103:0/141227416 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fc9600640 1 --2- 172.21.15.103:0/141227416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562360581ce0 0x562360579e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fc8c00640 1 --2- 172.21.15.103:0/141227416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56236057c970 0x5623605827d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fc3e00640 1 -- 172.21.15.103:0/141227416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56236057c970 msgr2=0x5623605827d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fc3e00640 1 --2- 172.21.15.103:0/141227416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56236057c970 0x5623605827d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fc3e00640 1 -- 172.21.15.103:0/141227416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562360581ce0 msgr2=0x562360579e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fc3e00640 1 --2- 172.21.15.103:0/141227416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562360581ce0 0x562360579e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fc3e00640 1 -- 172.21.15.103:0/141227416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56236057f0d0 con 0x56236057f2a0 2024-09-11T01:17:48.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.034+0000 7f7fc8c00640 1 --2- 172.21.15.103:0/141227416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56236057c970 0x5623605827d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:17:48.041 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.035+0000 7f7fc3e00640 1 --2- 172.21.15.103:0/141227416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057f2a0 0x5623605798f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0006010 tx=0x7f7fb0040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb21e2cc4eddb64a server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.035+0000 7f7fb5200640 1 -- 172.21.15.103:0/141227416 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0035040 con 0x56236057f2a0 2024-09-11T01:17:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.035+0000 7f7fb5200640 1 -- 172.21.15.103:0/141227416 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fb0003e40 con 0x56236057f2a0 2024-09-11T01:17:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.035+0000 7f7fb5200640 1 -- 172.21.15.103:0/141227416 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb003d8f0 con 0x56236057f2a0 2024-09-11T01:17:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.035+0000 7f7fce5cc740 1 -- 172.21.15.103:0/141227416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057f2a0 msgr2=0x5623605798f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.035+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/141227416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057f2a0 0x5623605798f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0006010 tx=0x7f7fb0040000 comp rx=0 tx=0).stop 2024-09-11T01:17:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.036+0000 7f7fce5cc740 1 -- 172.21.15.103:0/141227416 shutdown_connections 2024-09-11T01:17:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.036+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/141227416 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x562360581ce0 0x562360579e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.036+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/141227416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057f2a0 0x5623605798f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.036+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/141227416 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x56236057c970 0x5623605827d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.036+0000 7f7fce5cc740 1 -- 172.21.15.103:0/141227416 >> 172.21.15.103:0/141227416 conn(0x562360577ac0 msgr2=0x5623605820c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.036+0000 7f7fce5cc740 1 -- 172.21.15.103:0/141227416 shutdown_connections 2024-09-11T01:17:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.036+0000 7f7fce5cc740 1 -- 172.21.15.103:0/141227416 wait complete. 2024-09-11T01:17:48.042 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.036+0000 7f7fce5cc740 1 -- start start 2024-09-11T01:17:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.036+0000 7f7fce5cc740 1 Processor -- start 2024-09-11T01:17:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fce5cc740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057c970 0x56236058cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fce5cc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057f2a0 0x56236058d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fce5cc740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562360581ce0 0x56236058d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fce5cc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc41abe40 con 0x56236057f2a0 2024-09-11T01:17:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fce5cc740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc41ad2b0 con 0x56236057c970 2024-09-11T01:17:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fce5cc740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7fc41ac510 con 0x562360581ce0 2024-09-11T01:17:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fce5cc740 10 client.0 _ll_register_callbacks cb 0x7f7fb8009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fc3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057f2a0 0x56236058d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fc8c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057c970 0x56236058cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fc8c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057c970 0x56236058cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:40926/0 (socket says 172.21.15.103:40926) 2024-09-11T01:17:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fc8c00640 1 -- 172.21.15.103:0/3036212607 learned_addr learned my addr 172.21.15.103:0/3036212607 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:48.043 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fc9600640 1 --2- 172.21.15.103:0/3036212607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562360581ce0 0x56236058d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fc8c00640 1 -- 172.21.15.103:0/3036212607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562360581ce0 msgr2=0x56236058d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fc8c00640 1 --2- 172.21.15.103:0/3036212607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562360581ce0 0x56236058d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fc8c00640 1 -- 172.21.15.103:0/3036212607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057f2a0 msgr2=0x56236058d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fc8c00640 1 --2- 172.21.15.103:0/3036212607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057f2a0 0x56236058d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fc8c00640 1 -- 172.21.15.103:0/3036212607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56236058bca0 con 0x56236057c970 2024-09-11T01:17:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.037+0000 7f7fc3e00640 1 --2- 172.21.15.103:0/3036212607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057f2a0 0x56236058d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.038+0000 7f7fc8c00640 1 --2- 172.21.15.103:0/3036212607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057c970 0x56236058cd60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80097b0 tx=0x7f7fb80abc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45a41e4a1cf1ed6c server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.038+0000 7f7faa000640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:17:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.038+0000 7f7faa000640 1 -- 172.21.15.103:0/3036212607 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80abea0 con 0x56236057c970 2024-09-11T01:17:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.038+0000 7f7faa000640 1 -- 172.21.15.103:0/3036212607 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f7fb80b22f0 con 0x56236057c970 2024-09-11T01:17:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.038+0000 7f7fce5cc740 1 -- 172.21.15.103:0/3036212607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7fb0003e40 con 0x56236057c970 2024-09-11T01:17:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.038+0000 7f7faa000640 1 -- 172.21.15.103:0/3036212607 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7fb80ac500 con 0x56236057c970 2024-09-11T01:17:48.044 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.038+0000 7f7fce5cc740 10 client.26147 fetch_fsmap learned FSMap version 33 2024-09-11T01:17:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.038+0000 7f7fce5cc740 1 -- 172.21.15.103:0/3036212607 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5623606075e0 con 0x56236057c970 2024-09-11T01:17:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.038+0000 7f7faa000640 1 -- 172.21.15.103:0/3036212607 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7fb0003e40 con 0x56236057c970 2024-09-11T01:17:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.038+0000 7f7faa000640 1 -- 172.21.15.103:0/3036212607 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f7fb80b24f0 con 0x56236057c970 2024-09-11T01:17:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.039+0000 7f7fce5cc740 10 client.26147 fetch_fsmap finished waiting for FSMap version 33 2024-09-11T01:17:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.039+0000 7f7fce5cc740 10 client.26147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:17:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.039+0000 7f7fce5cc740 20 client.26147 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.039+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/3036212607 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562360607e80 0x56236060a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.039+0000 7f7fce5cc740 4 client.26147 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:17:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.039+0000 7f7fce5cc740 1 -- 172.21.15.103:0/3036212607 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5623604ed0b0 con 0x562360607e80 2024-09-11T01:17:48.045 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.039+0000 7f7fc3e00640 1 --2- 172.21.15.103:0/3036212607 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562360607e80 0x56236060a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.039+0000 7f7fc3e00640 1 --2- 172.21.15.103:0/3036212607 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562360607e80 0x56236060a2a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc049bbe350b5536 server_cookie=154a866e4a55beef in_seq=0 out_seq=0 2024-09-11T01:17:48.046 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.039+0000 7f7faa000640 10 client.26147 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7faa000640 1 -- 172.21.15.103:0/3036212607 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5623604ed0b0 con 0x562360607e80 2024-09-11T01:17:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7faa000640 10 client.26147 handle_command_reply: tid=0 2024-09-11T01:17:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7fce5cc740 1 client.26147 shutdown 2024-09-11T01:17:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7fce5cc740 1 -- 172.21.15.103:0/3036212607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057c970 msgr2=0x56236058cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/3036212607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057c970 0x56236058cd60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80097b0 tx=0x7f7fb80abc40 comp rx=0 tx=0).stop 2024-09-11T01:17:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7fce5cc740 1 -- 172.21.15.103:0/3036212607 shutdown_connections 2024-09-11T01:17:48.052 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/3036212607 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x562360607e80 0x56236060a2a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/3036212607 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x562360581ce0 0x56236058d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/3036212607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56236057f2a0 0x56236058d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7faa000640 0 client.26147 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7fce5cc740 1 --2- 172.21.15.103:0/3036212607 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56236057c970 0x56236058cd60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7fce5cc740 1 -- 172.21.15.103:0/3036212607 >> 172.21.15.103:0/3036212607 conn(0x562360577ac0 msgr2=0x5623605763a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7fce5cc740 1 -- 172.21.15.103:0/3036212607 shutdown_connections 2024-09-11T01:17:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7fce5cc740 1 -- 172.21.15.103:0/3036212607 wait complete. 2024-09-11T01:17:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.049+0000 7f7fce5cc740 20 client.26147 trim_cache size 0 max 16384 2024-09-11T01:17:48.053 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:17:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:17:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:17:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:17:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.050+0000 7f7fca000640 1 -- 172.21.15.103:0/2889394319 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7fac0b5200 msgr2=0x7f7fac0b76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.050+0000 7f7fca000640 1 --2- 172.21.15.103:0/2889394319 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7fac0b5200 0x7f7fac0b76c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0005ab0 tx=0x7f7fb0005a20 comp rx=0 tx=0).stop 2024-09-11T01:17:48.054 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.050+0000 7f7fca000640 1 -- 172.21.15.103:0/2889394319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fc41049b0 msgr2=0x7f7fc419ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.050+0000 7f7fca000640 1 --2- 172.21.15.103:0/2889394319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fc41049b0 0x7f7fc419ae10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800e9f0 tx=0x7f7fb800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.050+0000 7f7fca000640 1 -- 172.21.15.103:0/2889394319 shutdown_connections 2024-09-11T01:17:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.050+0000 7f7fca000640 1 --2- 172.21.15.103:0/2889394319 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f7fac0b5200 0x7f7fac0b76c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.050+0000 7f7fca000640 1 --2- 172.21.15.103:0/2889394319 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fc41064c0 0x7f7fc419c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.050+0000 7f7fca000640 1 --2- 172.21.15.103:0/2889394319 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7fc4105b00 0x7f7fc419b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.050+0000 7f7fca000640 1 --2- 172.21.15.103:0/2889394319 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7fc41049b0 0x7f7fc419ae10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.050+0000 7f7fca000640 1 -- 172.21.15.103:0/2889394319 >> 172.21.15.103:0/2889394319 conn(0x7f7fc4100250 msgr2=0x7f7fc4108e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.050+0000 7f7fca000640 1 -- 172.21.15.103:0/2889394319 shutdown_connections 2024-09-11T01:17:48.055 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:17:48.050+0000 7f7fca000640 1 -- 172.21.15.103:0/2889394319 wait complete. 2024-09-11T01:17:49.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:48 smithi117 ceph-mon[35358]: pgmap v684: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 50 op/s 2024-09-11T01:17:49.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:48 smithi183 ceph-mon[34992]: pgmap v684: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 50 op/s 2024-09-11T01:17:49.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:48 smithi103 ceph-mon[30562]: pgmap v684: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 50 op/s 2024-09-11T01:17:50.137 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:17:51.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:50 smithi117 ceph-mon[35358]: pgmap v685: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 16 op/s 2024-09-11T01:17:51.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:50 smithi183 ceph-mon[34992]: pgmap v685: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 16 op/s 2024-09-11T01:17:51.332 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:50 smithi103 ceph-mon[30562]: pgmap v685: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 853 B/s wr, 16 op/s 2024-09-11T01:17:53.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:52 smithi117 ceph-mon[35358]: pgmap v686: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-11T01:17:53.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:52 smithi183 ceph-mon[34992]: pgmap v686: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-11T01:17:53.226 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:52 smithi103 ceph-mon[30562]: pgmap v686: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 8 op/s 2024-09-11T01:17:54.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.126+0000 7fb828c00640 1 -- 172.21.15.103:0/3269361673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb82410f3e0 msgr2=0x7fb8241117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:54.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.126+0000 7fb828c00640 1 --2- 172.21.15.103:0/3269361673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb82410f3e0 0x7fb8241117d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009ca0 tx=0x7fb81c02a8b0 comp rx=0 tx=0).stop 2024-09-11T01:17:54.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.126+0000 7fb828c00640 1 -- 172.21.15.103:0/3269361673 shutdown_connections 2024-09-11T01:17:54.128 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.126+0000 7fb828c00640 1 --2- 172.21.15.103:0/3269361673 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb82410f3e0 0x7fb8241117d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:54.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.126+0000 7fb828c00640 1 --2- 172.21.15.103:0/3269361673 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb824075f40 0x7fb82410ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:54.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.126+0000 7fb828c00640 1 --2- 172.21.15.103:0/3269361673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb824075540 0x7fb824075920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:54.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.126+0000 7fb828c00640 1 -- 172.21.15.103:0/3269361673 >> 172.21.15.103:0/3269361673 conn(0x7fb8240fe830 msgr2=0x7fb824100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:54.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.126+0000 7fb828c00640 1 -- 172.21.15.103:0/3269361673 shutdown_connections 2024-09-11T01:17:54.129 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.126+0000 7fb828c00640 1 -- 172.21.15.103:0/3269361673 wait complete. 2024-09-11T01:17:54.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.127+0000 7fb828c00640 1 Processor -- start 2024-09-11T01:17:54.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.127+0000 7fb828c00640 1 -- start start 2024-09-11T01:17:54.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.128+0000 7fb828c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb824075540 0x7fb82419b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:54.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.128+0000 7fb828c00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb824075f40 0x7fb82419b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:54.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.128+0000 7fb828c00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb82410f3e0 0x7fb8241a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:54.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.128+0000 7fb828c00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb824114fd0 con 0x7fb82410f3e0 2024-09-11T01:17:54.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.128+0000 7fb828c00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb824114e50 con 0x7fb824075f40 2024-09-11T01:17:54.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.128+0000 7fb828c00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb824115150 con 0x7fb824075540 2024-09-11T01:17:54.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.128+0000 7fb821e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb824075540 0x7fb82419b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:54.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.128+0000 7fb821e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb824075540 0x7fb82419b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:54656/0 (socket says 172.21.15.103:54656) 2024-09-11T01:17:54.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.128+0000 7fb821e00640 1 -- 172.21.15.103:0/3743503473 learned_addr learned my addr 172.21.15.103:0/3743503473 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:54.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.128+0000 7fb821400640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb824075f40 0x7fb82419b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:54.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.128+0000 7fb822800640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb82410f3e0 0x7fb8241a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:54.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.129+0000 7fb821e00640 1 -- 172.21.15.103:0/3743503473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb824075f40 msgr2=0x7fb82419b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:54.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.129+0000 7fb821e00640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb824075f40 0x7fb82419b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:54.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.129+0000 7fb821e00640 1 -- 172.21.15.103:0/3743503473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb82410f3e0 msgr2=0x7fb8241a0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:54.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.129+0000 7fb821e00640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb82410f3e0 0x7fb8241a0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:54.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.129+0000 7fb821e00640 1 -- 172.21.15.103:0/3743503473 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8241a1510 con 0x7fb824075540 2024-09-11T01:17:54.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.129+0000 7fb821400640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb824075f40 0x7fb82419b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:54.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.129+0000 7fb821e00640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb824075540 0x7fb82419b460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb81400e9f0 tx=0x7fb81400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:54.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.129+0000 7fb81aa00640 1 -- 172.21.15.103:0/3743503473 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81400cd80 con 0x7fb824075540 2024-09-11T01:17:54.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.129+0000 7fb81aa00640 1 -- 172.21.15.103:0/3743503473 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8140108e0 con 0x7fb824075540 2024-09-11T01:17:54.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.129+0000 7fb828c00640 1 -- 172.21.15.103:0/3743503473 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8241a1800 con 0x7fb824075540 2024-09-11T01:17:54.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.129+0000 7fb81aa00640 1 -- 172.21.15.103:0/3743503473 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814018980 con 0x7fb824075540 2024-09-11T01:17:54.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.130+0000 7fb828c00640 1 -- 172.21.15.103:0/3743503473 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8241a8090 con 0x7fb824075540 2024-09-11T01:17:54.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.131+0000 7fb828c00640 1 -- 172.21.15.103:0/3743503473 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb824076a50 con 0x7fb824075540 2024-09-11T01:17:54.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.133+0000 7fb81aa00640 1 -- 172.21.15.103:0/3743503473 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7fb814010430 con 0x7fb824075540 2024-09-11T01:17:54.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.134+0000 7fb81aa00640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8080b5360 0x7fb8080b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:54.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.135+0000 7fb81aa00640 1 -- 172.21.15.103:0/3743503473 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fb8140e62b0 con 0x7fb824075540 2024-09-11T01:17:54.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.135+0000 7fb821400640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8080b5360 0x7fb8080b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:54.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.135+0000 7fb821400640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8080b5360 0x7fb8080b7820 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb824110a10 tx=0x7fb810005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:54.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.138+0000 7fb81aa00640 1 -- 172.21.15.103:0/3743503473 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb8140ac710 con 0x7fb824075540 2024-09-11T01:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.359+0000 7fb828c00640 1 -- 172.21.15.103:0/3743503473 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8241a8310 con 0x7fb824075540 2024-09-11T01:17:54.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.360+0000 7fb81aa00640 1 -- 172.21.15.103:0/3743503473 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11935 (secure 0 0 0) 0x7fb8140b1140 con 0x7fb824075540 2024-09-11T01:17:54.362 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:17:54.362 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":33,"btime":"2024-09-11T01:17:25:752182+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:17:25.170731+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24619,24629,24665]},"id":1}]} 2024-09-11T01:17:54.362 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 33 2024-09-11T01:17:54.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.362+0000 7fb828c00640 1 -- 172.21.15.103:0/3743503473 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8080b5360 msgr2=0x7fb8080b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:54.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.362+0000 7fb828c00640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8080b5360 0x7fb8080b7820 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb824110a10 tx=0x7fb810005f90 comp rx=0 tx=0).stop 2024-09-11T01:17:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.362+0000 7fb828c00640 1 -- 172.21.15.103:0/3743503473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb824075540 msgr2=0x7fb82419b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.362+0000 7fb828c00640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb824075540 0x7fb82419b460 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb81400e9f0 tx=0x7fb81400eeb0 comp rx=0 tx=0).stop 2024-09-11T01:17:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.362+0000 7fb828c00640 1 -- 172.21.15.103:0/3743503473 shutdown_connections 2024-09-11T01:17:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.362+0000 7fb828c00640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb8080b5360 0x7fb8080b7820 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.362+0000 7fb828c00640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb82410f3e0 0x7fb8241a0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.362+0000 7fb828c00640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb824075f40 0x7fb82419b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.362+0000 7fb828c00640 1 --2- 172.21.15.103:0/3743503473 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb824075540 0x7fb82419b460 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.362+0000 7fb828c00640 1 -- 172.21.15.103:0/3743503473 >> 172.21.15.103:0/3743503473 conn(0x7fb8240fe830 msgr2=0x7fb8241115e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.363+0000 7fb828c00640 1 -- 172.21.15.103:0/3743503473 shutdown_connections 2024-09-11T01:17:54.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:54.363+0000 7fb828c00640 1 -- 172.21.15.103:0/3743503473 wait complete. 2024-09-11T01:17:55.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:54 smithi103 ceph-mon[30562]: pgmap v687: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T01:17:55.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:54 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3743503473' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:17:55.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:54 smithi117 ceph-mon[35358]: pgmap v687: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T01:17:55.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:54 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3743503473' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:17:55.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:54 smithi183 ceph-mon[34992]: pgmap v687: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T01:17:55.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:54 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3743503473' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:17:55.318 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24665 quiesce db --set-id 6b411aaa --release --await' 2024-09-11T01:17:55.318 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24665 quiesce db --set-id 6b411aaa --release --await 2024-09-11T01:17:55.731 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:17:56.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.466+0000 7f0254400640 1 -- 172.21.15.103:0/2491620990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c075540 msgr2=0x7f024c075920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:56.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.466+0000 7f0254400640 1 --2- 172.21.15.103:0/2491620990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c075540 0x7f024c075920 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0240009860 tx=0x7f024002a340 comp rx=0 tx=0).stop 2024-09-11T01:17:56.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.466+0000 7f0254400640 1 -- 172.21.15.103:0/2491620990 shutdown_connections 2024-09-11T01:17:56.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.466+0000 7f0254400640 1 --2- 172.21.15.103:0/2491620990 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c113b20 0x7f024c115f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.466+0000 7f0254400640 1 --2- 172.21.15.103:0/2491620990 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f024c075e60 0x7f024c1135e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.466+0000 7f0254400640 1 --2- 172.21.15.103:0/2491620990 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c075540 0x7f024c075920 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.466+0000 7f0254400640 1 -- 172.21.15.103:0/2491620990 >> 172.21.15.103:0/2491620990 conn(0x7f024c0fe830 msgr2=0x7f024c100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:56.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.466+0000 7f0254400640 1 -- 172.21.15.103:0/2491620990 shutdown_connections 2024-09-11T01:17:56.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.466+0000 7f0254400640 1 -- 172.21.15.103:0/2491620990 wait complete. 2024-09-11T01:17:56.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.467+0000 7f0254400640 1 Processor -- start 2024-09-11T01:17:56.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.468+0000 7f0254400640 1 -- start start 2024-09-11T01:17:56.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.468+0000 7f0254400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c075540 0x7f024c19f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.468+0000 7f0254400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f024c075e60 0x7f024c19fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.468+0000 7f0254400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c113b20 0x7f024c1a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.468+0000 7f0254400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1193c0 con 0x7f024c075540 2024-09-11T01:17:56.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.468+0000 7f0254400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f024c119240 con 0x7f024c113b20 2024-09-11T01:17:56.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.468+0000 7f0254400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f024c119540 con 0x7f024c075e60 2024-09-11T01:17:56.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.468+0000 7f0251a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c075540 0x7f024c19f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.468+0000 7f0251a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c075540 0x7f024c19f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37066/0 (socket says 172.21.15.103:37066) 2024-09-11T01:17:56.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.468+0000 7f0251a00640 1 -- 172.21.15.103:0/769621967 learned_addr learned my addr 172.21.15.103:0/769621967 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:56.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.468+0000 7f0252400640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c113b20 0x7f024c1a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.468+0000 7f0251000640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f024c075e60 0x7f024c19fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.469+0000 7f0252400640 1 -- 172.21.15.103:0/769621967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f024c075e60 msgr2=0x7f024c19fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:56.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.469+0000 7f0252400640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f024c075e60 0x7f024c19fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.469+0000 7f0252400640 1 -- 172.21.15.103:0/769621967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c075540 msgr2=0x7f024c19f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.469+0000 7f0252400640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c075540 0x7f024c19f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.469+0000 7f0252400640 1 -- 172.21.15.103:0/769621967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024c1a59e0 con 0x7f024c113b20 2024-09-11T01:17:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.469+0000 7f0251a00640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c075540 0x7f024c19f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.469+0000 7f0251000640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f024c075e60 0x7f024c19fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.469+0000 7f0252400640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c113b20 0x7f024c1a5210 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0244005fd0 tx=0x7f024400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.469+0000 7f024a000640 1 -- 172.21.15.103:0/769621967 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244003970 con 0x7f024c113b20 2024-09-11T01:17:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.469+0000 7f0254400640 1 -- 172.21.15.103:0/769621967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024c1a5cd0 con 0x7f024c113b20 2024-09-11T01:17:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.469+0000 7f024a000640 1 -- 172.21.15.103:0/769621967 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0244004020 con 0x7f024c113b20 2024-09-11T01:17:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.470+0000 7f024a000640 1 -- 172.21.15.103:0/769621967 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024400b940 con 0x7f024c113b20 2024-09-11T01:17:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.470+0000 7f0254400640 1 -- 172.21.15.103:0/769621967 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f024c1ac390 con 0x7f024c113b20 2024-09-11T01:17:56.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.473+0000 7f024a000640 1 -- 172.21.15.103:0/769621967 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f024400b040 con 0x7f024c113b20 2024-09-11T01:17:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.475+0000 7f024a000640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f02340b52e0 0x7f02340b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.475+0000 7f024a000640 1 -- 172.21.15.103:0/769621967 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f02440e5e40 con 0x7f024c113b20 2024-09-11T01:17:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.475+0000 7f0251a00640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f02340b52e0 0x7f02340b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.476+0000 7f0251a00640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f02340b52e0 0x7f02340b77a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f02400095f0 tx=0x7f0240030340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:56.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.482+0000 7f0256feb740 1 Processor -- start 2024-09-11T01:17:56.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.483+0000 7f0256feb740 1 -- start start 2024-09-11T01:17:56.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.483+0000 7f0256feb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dbff0 0x5613422dc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.483+0000 7f0256feb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dc910 0x5613422e8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.483+0000 7f0256feb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422e88a0 0x5613422eac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.483+0000 7f0256feb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x561342253290 con 0x5613422e88a0 2024-09-11T01:17:56.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.483+0000 7f0256feb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5613422426c0 con 0x5613422dc910 2024-09-11T01:17:56.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.483+0000 7f0256feb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5613422464d0 con 0x5613422dbff0 2024-09-11T01:17:56.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.483+0000 7f0251000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dc910 0x5613422e8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.483+0000 7f0251000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dc910 0x5613422e8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:50972/0 (socket says 172.21.15.103:50972) 2024-09-11T01:17:56.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.483+0000 7f0251a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dbff0 0x5613422dc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.483+0000 7f0251000640 1 -- 172.21.15.103:0/2095452397 learned_addr learned my addr 172.21.15.103:0/2095452397 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:56.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.483+0000 7f0252400640 1 --2- 172.21.15.103:0/2095452397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422e88a0 0x5613422eac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.484+0000 7f0251000640 1 -- 172.21.15.103:0/2095452397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dbff0 msgr2=0x5613422dc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:56.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.484+0000 7f0251000640 1 --2- 172.21.15.103:0/2095452397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dbff0 0x5613422dc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.484+0000 7f0251000640 1 -- 172.21.15.103:0/2095452397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422e88a0 msgr2=0x5613422eac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:56.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.484+0000 7f0251000640 1 --2- 172.21.15.103:0/2095452397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422e88a0 0x5613422eac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.484+0000 7f0251000640 1 -- 172.21.15.103:0/2095452397 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613421cf460 con 0x5613422dc910 2024-09-11T01:17:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.484+0000 7f0251000640 1 --2- 172.21.15.103:0/2095452397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dc910 0x5613422e8360 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f02380114f0 tx=0x7f02380119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f120c96d7a99c3b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.484+0000 7f023ea00640 1 -- 172.21.15.103:0/2095452397 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238004020 con 0x5613422dc910 2024-09-11T01:17:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.485+0000 7f023ea00640 1 -- 172.21.15.103:0/2095452397 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02380041c0 con 0x5613422dc910 2024-09-11T01:17:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.485+0000 7f023ea00640 1 -- 172.21.15.103:0/2095452397 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023800f8f0 con 0x5613422dc910 2024-09-11T01:17:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.485+0000 7f0256feb740 1 -- 172.21.15.103:0/2095452397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dc910 msgr2=0x5613422e8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.485+0000 7f0256feb740 1 --2- 172.21.15.103:0/2095452397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dc910 0x5613422e8360 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f02380114f0 tx=0x7f02380119b0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.485+0000 7f0256feb740 1 -- 172.21.15.103:0/2095452397 shutdown_connections 2024-09-11T01:17:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.485+0000 7f0256feb740 1 --2- 172.21.15.103:0/2095452397 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422e88a0 0x5613422eac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.485+0000 7f0256feb740 1 --2- 172.21.15.103:0/2095452397 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dc910 0x5613422e8360 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.485+0000 7f0256feb740 1 --2- 172.21.15.103:0/2095452397 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dbff0 0x5613422dc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.485+0000 7f0256feb740 1 -- 172.21.15.103:0/2095452397 >> 172.21.15.103:0/2095452397 conn(0x5613422d9e20 msgr2=0x5613422dafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:56.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.485+0000 7f0256feb740 1 -- 172.21.15.103:0/2095452397 shutdown_connections 2024-09-11T01:17:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.486+0000 7f0256feb740 1 -- 172.21.15.103:0/2095452397 wait complete. 2024-09-11T01:17:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.486+0000 7f0256feb740 1 -- start start 2024-09-11T01:17:56.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.486+0000 7f0256feb740 1 Processor -- start 2024-09-11T01:17:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0256feb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422dbff0 0x5613422e5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0256feb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dc910 0x5613422e5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0256feb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422e88a0 0x5613422e62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0256feb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5613420a3bb0 con 0x5613422dbff0 2024-09-11T01:17:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0256feb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x5613421dd6c0 con 0x5613422e88a0 2024-09-11T01:17:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0256feb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x5613422eb550 con 0x5613422dc910 2024-09-11T01:17:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0256feb740 10 client.0 _ll_register_callbacks cb 0x5613421f8490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0251000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dc910 0x5613422e5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0251a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422dbff0 0x5613422e5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0251000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dc910 0x5613422e5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:54698/0 (socket says 172.21.15.103:54698) 2024-09-11T01:17:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0251000640 1 -- 172.21.15.103:0/2287430 learned_addr learned my addr 172.21.15.103:0/2287430 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0252400640 1 --2- 172.21.15.103:0/2287430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422e88a0 0x5613422e62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0251000640 1 -- 172.21.15.103:0/2287430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422e88a0 msgr2=0x5613422e62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0251000640 1 --2- 172.21.15.103:0/2287430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422e88a0 0x5613422e62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0251000640 1 -- 172.21.15.103:0/2287430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422dbff0 msgr2=0x5613422e5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0251000640 1 --2- 172.21.15.103:0/2287430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422dbff0 0x5613422e5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.487+0000 7f0251000640 1 -- 172.21.15.103:0/2287430 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561341fa0b00 con 0x5613422dc910 2024-09-11T01:17:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.488+0000 7f0251000640 1 --2- 172.21.15.103:0/2287430 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dc910 0x5613422e5db0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0238011eb0 tx=0x7f0238005680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15ff4221faa0dc0b server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.488+0000 7f0233400640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:17:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.488+0000 7f0233400640 1 -- 172.21.15.103:0/2287430 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238028020 con 0x5613422dc910 2024-09-11T01:17:56.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.488+0000 7f0256feb740 1 -- 172.21.15.103:0/2287430 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02380041c0 con 0x5613422dc910 2024-09-11T01:17:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.488+0000 7f0233400640 1 -- 172.21.15.103:0/2287430 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f0238016040 con 0x5613422dc910 2024-09-11T01:17:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.489+0000 7f0233400640 1 -- 172.21.15.103:0/2287430 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0238033050 con 0x5613422dc910 2024-09-11T01:17:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.489+0000 7f0256feb740 10 client.26113 fetch_fsmap learned FSMap version 33 2024-09-11T01:17:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.489+0000 7f0256feb740 1 -- 172.21.15.103:0/2287430 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561342017960 con 0x5613422dc910 2024-09-11T01:17:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.489+0000 7f0233400640 1 -- 172.21.15.103:0/2287430 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f02380041c0 con 0x5613422dc910 2024-09-11T01:17:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.489+0000 7f0233400640 1 -- 172.21.15.103:0/2287430 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f0238004880 con 0x5613422dc910 2024-09-11T01:17:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.489+0000 7f0256feb740 10 client.26113 fetch_fsmap finished waiting for FSMap version 33 2024-09-11T01:17:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.489+0000 7f0256feb740 10 client.26113 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:17:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.489+0000 7f0256feb740 20 client.26113 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.489+0000 7f0256feb740 1 --2- 172.21.15.103:0/2287430 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5613422f8350 0x5613422fa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.489+0000 7f0256feb740 4 client.26113 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:17:56.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.489+0000 7f0256feb740 1 -- 172.21.15.103:0/2287430 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613422551e0 con 0x5613422f8350 2024-09-11T01:17:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.490+0000 7f0251a00640 1 --2- 172.21.15.103:0/2287430 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5613422f8350 0x5613422fa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.490+0000 7f0251a00640 1 --2- 172.21.15.103:0/2287430 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5613422f8350 0x5613422fa740 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2a7530443dc113f server_cookie=27edfa35d1d46038 in_seq=0 out_seq=0 2024-09-11T01:17:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.490+0000 7f0233400640 10 client.26113 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.491+0000 7f0233400640 1 -- 172.21.15.103:0/2287430 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5613422551e0 con 0x5613422f8350 2024-09-11T01:17:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.491+0000 7f0233400640 10 client.26113 handle_command_reply: tid=0 2024-09-11T01:17:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.491+0000 7f0256feb740 1 client.26113 shutdown 2024-09-11T01:17:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.491+0000 7f0256feb740 1 -- 172.21.15.103:0/2287430 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dc910 msgr2=0x5613422e5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.491+0000 7f0256feb740 1 --2- 172.21.15.103:0/2287430 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dc910 0x5613422e5db0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0238011eb0 tx=0x7f0238005680 comp rx=0 tx=0).stop 2024-09-11T01:17:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.491+0000 7f0256feb740 1 -- 172.21.15.103:0/2287430 shutdown_connections 2024-09-11T01:17:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.491+0000 7f0256feb740 1 --2- 172.21.15.103:0/2287430 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422e88a0 0x5613422e62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.491+0000 7f0256feb740 1 --2- 172.21.15.103:0/2287430 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x5613422f8350 0x5613422fa740 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.491+0000 7f0256feb740 1 --2- 172.21.15.103:0/2287430 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dc910 0x5613422e5db0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.491+0000 7f0256feb740 1 --2- 172.21.15.103:0/2287430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422dbff0 0x5613422e5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.491+0000 7f0256feb740 1 -- 172.21.15.103:0/2287430 >> 172.21.15.103:0/2287430 conn(0x5613422d9e20 msgr2=0x5613422df9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:56.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.492+0000 7f0233400640 0 client.26113 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:56.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.492+0000 7f0256feb740 1 -- 172.21.15.103:0/2287430 shutdown_connections 2024-09-11T01:17:56.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.492+0000 7f0256feb740 1 -- 172.21.15.103:0/2287430 wait complete. 2024-09-11T01:17:56.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.492+0000 7f0256feb740 20 client.26113 trim_cache size 0 max 16384 2024-09-11T01:17:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.509+0000 7f0256feb740 1 Processor -- start 2024-09-11T01:17:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.510+0000 7f0256feb740 1 -- start start 2024-09-11T01:17:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.510+0000 7f0256feb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dbff0 0x5613422e4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.510+0000 7f0256feb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422dc910 0x5613422db440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.510+0000 7f0256feb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422e88a0 0x5613422d8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.510+0000 7f0256feb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1b8b30 con 0x5613422dc910 2024-09-11T01:17:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.510+0000 7f0256feb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1b6370 con 0x5613422dbff0 2024-09-11T01:17:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.510+0000 7f0256feb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1b41c0 con 0x5613422e88a0 2024-09-11T01:17:56.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.510+0000 7f0251a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dbff0 0x5613422e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.510+0000 7f0251000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422dc910 0x5613422db440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.510+0000 7f0251a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dbff0 0x5613422e4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:51004/0 (socket says 172.21.15.103:51004) 2024-09-11T01:17:56.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.510+0000 7f0251a00640 1 -- 172.21.15.103:0/1329313919 learned_addr learned my addr 172.21.15.103:0/1329313919 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:56.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.510+0000 7f0251000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422dc910 0x5613422db440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37086/0 (socket says 172.21.15.103:37086) 2024-09-11T01:17:56.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.510+0000 7f0252400640 1 --2- 172.21.15.103:0/1329313919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422e88a0 0x5613422d8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.511+0000 7f0251a00640 1 -- 172.21.15.103:0/1329313919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422e88a0 msgr2=0x5613422d8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:56.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.511+0000 7f0251a00640 1 --2- 172.21.15.103:0/1329313919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422e88a0 0x5613422d8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.511+0000 7f0251a00640 1 -- 172.21.15.103:0/1329313919 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422dc910 msgr2=0x5613422db440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:56.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.511+0000 7f0251a00640 1 --2- 172.21.15.103:0/1329313919 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422dc910 0x5613422db440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.511+0000 7f0251a00640 1 -- 172.21.15.103:0/1329313919 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613422e3d70 con 0x5613422dbff0 2024-09-11T01:17:56.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.511+0000 7f0251a00640 1 --2- 172.21.15.103:0/1329313919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dbff0 0x5613422e4760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0240009980 tx=0x7f024003f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96bf46fd74a0a3f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:56.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.511+0000 7f023e000640 1 -- 172.21.15.103:0/1329313919 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240056070 con 0x5613422dbff0 2024-09-11T01:17:56.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.511+0000 7f023e000640 1 -- 172.21.15.103:0/1329313919 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0240032ca0 con 0x5613422dbff0 2024-09-11T01:17:56.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.511+0000 7f023e000640 1 -- 172.21.15.103:0/1329313919 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240037040 con 0x5613422dbff0 2024-09-11T01:17:56.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.512+0000 7f0256feb740 1 -- 172.21.15.103:0/1329313919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dbff0 msgr2=0x5613422e4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:56.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.512+0000 7f0256feb740 1 --2- 172.21.15.103:0/1329313919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dbff0 0x5613422e4760 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0240009980 tx=0x7f024003f000 comp rx=0 tx=0).stop 2024-09-11T01:17:56.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.512+0000 7f0256feb740 1 -- 172.21.15.103:0/1329313919 shutdown_connections 2024-09-11T01:17:56.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.512+0000 7f0256feb740 1 --2- 172.21.15.103:0/1329313919 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422e88a0 0x5613422d8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.512+0000 7f0256feb740 1 --2- 172.21.15.103:0/1329313919 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422dc910 0x5613422db440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.512+0000 7f0256feb740 1 --2- 172.21.15.103:0/1329313919 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dbff0 0x5613422e4760 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.512+0000 7f0256feb740 1 -- 172.21.15.103:0/1329313919 >> 172.21.15.103:0/1329313919 conn(0x5613422d9e20 msgr2=0x5613422d8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:56.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.512+0000 7f0256feb740 1 -- 172.21.15.103:0/1329313919 shutdown_connections 2024-09-11T01:17:56.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.512+0000 7f0256feb740 1 -- 172.21.15.103:0/1329313919 wait complete. 2024-09-11T01:17:56.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.513+0000 7f0256feb740 1 -- start start 2024-09-11T01:17:56.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.513+0000 7f0256feb740 1 Processor -- start 2024-09-11T01:17:56.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.513+0000 7f0256feb740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dbff0 0x5613422f07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.513+0000 7f0256feb740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dc910 0x5613422f0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.513+0000 7f0256feb740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422e88a0 0x5613422ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.513+0000 7f0256feb740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1b4830 con 0x5613422e88a0 2024-09-11T01:17:56.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.513+0000 7f0256feb740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1b5ca0 con 0x5613422dc910 2024-09-11T01:17:56.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.513+0000 7f0256feb740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f024c1b4f00 con 0x5613422dbff0 2024-09-11T01:17:56.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.513+0000 7f0256feb740 10 client.0 _ll_register_callbacks cb 0x7f02440099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:17:56.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.514+0000 7f0251a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dbff0 0x5613422f07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.514+0000 7f0252400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422e88a0 0x5613422ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.514+0000 7f0251a00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dbff0 0x5613422f07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:54710/0 (socket says 172.21.15.103:54710) 2024-09-11T01:17:56.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.514+0000 7f0251a00640 1 -- 172.21.15.103:0/3335314101 learned_addr learned my addr 172.21.15.103:0/3335314101 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:56.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.514+0000 7f0251000640 1 --2- 172.21.15.103:0/3335314101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dc910 0x5613422f0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.514+0000 7f0252400640 1 -- 172.21.15.103:0/3335314101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dbff0 msgr2=0x5613422f07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.514+0000 7f0252400640 1 --2- 172.21.15.103:0/3335314101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dbff0 0x5613422f07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.514+0000 7f0252400640 1 -- 172.21.15.103:0/3335314101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dc910 msgr2=0x5613422f0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.514+0000 7f0252400640 1 --2- 172.21.15.103:0/3335314101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dc910 0x5613422f0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.514+0000 7f0252400640 1 -- 172.21.15.103:0/3335314101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613422edd70 con 0x5613422e88a0 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.514+0000 7f0251a00640 1 --2- 172.21.15.103:0/3335314101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dbff0 0x5613422f07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.514+0000 7f0252400640 1 --2- 172.21.15.103:0/3335314101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422e88a0 0x5613422ed7b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0244009830 tx=0x7f0244004720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=224b6782ffc49b58 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.514+0000 7f0233400640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.514+0000 7f0233400640 1 -- 172.21.15.103:0/3335314101 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02440ac650 con 0x5613422e88a0 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.515+0000 7f0233400640 1 -- 172.21.15.103:0/3335314101 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f02440974a0 con 0x5613422e88a0 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.515+0000 7f0256feb740 1 -- 172.21.15.103:0/3335314101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0240032ca0 con 0x5613422e88a0 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.515+0000 7f0233400640 1 -- 172.21.15.103:0/3335314101 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f02440ac1f0 con 0x5613422e88a0 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.515+0000 7f0256feb740 10 client.16086 fetch_fsmap learned FSMap version 33 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.515+0000 7f0256feb740 1 -- 172.21.15.103:0/3335314101 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561342365a00 con 0x5613422e88a0 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.515+0000 7f0233400640 1 -- 172.21.15.103:0/3335314101 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0240032ca0 con 0x5613422e88a0 2024-09-11T01:17:56.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.515+0000 7f0233400640 1 -- 172.21.15.103:0/3335314101 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f02440cdbd0 con 0x5613422e88a0 2024-09-11T01:17:56.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.515+0000 7f0256feb740 10 client.16086 fetch_fsmap finished waiting for FSMap version 33 2024-09-11T01:17:56.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.515+0000 7f0256feb740 10 client.16086 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:17:56.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.515+0000 7f0256feb740 20 client.16086 populate_metadata read hostname 'smithi103' 2024-09-11T01:17:56.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.515+0000 7f0256feb740 1 --2- 172.21.15.103:0/3335314101 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x561342366130 0x561342368550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:56.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.515+0000 7f0256feb740 4 client.16086 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6b411aaa", "release": true, "await": true}] 2024-09-11T01:17:56.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.515+0000 7f0256feb740 1 -- 172.21.15.103:0/3335314101 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6b411aaa", "release": true, "await": true}) -- 0x561342250c90 con 0x561342366130 2024-09-11T01:17:56.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.516+0000 7f0251a00640 1 --2- 172.21.15.103:0/3335314101 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x561342366130 0x561342368550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:56.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.516+0000 7f0251a00640 1 --2- 172.21.15.103:0/3335314101 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x561342366130 0x561342368550 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56efc049d0b4d32a server_cookie=67f6fdff7160dd3e in_seq=0 out_seq=0 2024-09-11T01:17:56.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.516+0000 7f0233400640 10 client.16086 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:56.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.518+0000 7f0233400640 1 -- 172.21.15.103:0/3335314101 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x561342250c90 con 0x561342366130 2024-09-11T01:17:56.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.518+0000 7f0233400640 10 client.16086 handle_command_reply: tid=0 2024-09-11T01:17:56.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.518+0000 7f0256feb740 1 client.16086 shutdown 2024-09-11T01:17:56.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.519+0000 7f0256feb740 1 -- 172.21.15.103:0/3335314101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422e88a0 msgr2=0x5613422ed7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:56.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.519+0000 7f0256feb740 1 --2- 172.21.15.103:0/3335314101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422e88a0 0x5613422ed7b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0244009830 tx=0x7f0244004720 comp rx=0 tx=0).stop 2024-09-11T01:17:56.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.519+0000 7f0256feb740 1 -- 172.21.15.103:0/3335314101 shutdown_connections 2024-09-11T01:17:56.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.519+0000 7f0256feb740 1 --2- 172.21.15.103:0/3335314101 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5613422e88a0 0x5613422ed7b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.519+0000 7f0256feb740 1 --2- 172.21.15.103:0/3335314101 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x5613422dc910 0x5613422f0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.519+0000 7f0256feb740 1 --2- 172.21.15.103:0/3335314101 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x561342366130 0x561342368550 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.519+0000 7f0256feb740 1 --2- 172.21.15.103:0/3335314101 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x5613422dbff0 0x5613422f07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.519+0000 7f0233400640 0 client.16086 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:17:56.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.519+0000 7f0256feb740 1 -- 172.21.15.103:0/3335314101 >> 172.21.15.103:0/3335314101 conn(0x5613422d9e20 msgr2=0x5613422e76c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:56.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.519+0000 7f0256feb740 1 -- 172.21.15.103:0/3335314101 shutdown_connections 2024-09-11T01:17:56.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.519+0000 7f0256feb740 1 -- 172.21.15.103:0/3335314101 wait complete. 2024-09-11T01:17:56.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.519+0000 7f0256feb740 20 client.16086 trim_cache size 0 max 16384 2024-09-11T01:17:56.523 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:17:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 33, 2024-09-11T01:17:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24665, 2024-09-11T01:17:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 21, 2024-09-11T01:17:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-09-11T01:17:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "6b411aaa": { 2024-09-11T01:17:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 21, 2024-09-11T01:17:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-09-11T01:17:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:17:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RELEASED", 2024-09-11T01:17:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:17:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:17:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-09-11T01:17:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 150.0, 2024-09-11T01:17:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-09-11T01:17:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-09-11T01:17:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-09-11T01:17:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-09-11T01:17:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RELEASED", 2024-09-11T01:17:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-09-11T01:17:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:17:56.525 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:17:56.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.520+0000 7f0254400640 1 -- 172.21.15.103:0/769621967 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f02340b52e0 msgr2=0x7f02340b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:56.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.520+0000 7f0254400640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f02340b52e0 0x7f02340b77a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f02400095f0 tx=0x7f0240030340 comp rx=0 tx=0).stop 2024-09-11T01:17:56.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.520+0000 7f0254400640 1 -- 172.21.15.103:0/769621967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c113b20 msgr2=0x7f024c1a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:56.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.520+0000 7f0254400640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c113b20 0x7f024c1a5210 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0244005fd0 tx=0x7f024400c800 comp rx=0 tx=0).stop 2024-09-11T01:17:56.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.520+0000 7f0254400640 1 -- 172.21.15.103:0/769621967 shutdown_connections 2024-09-11T01:17:56.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.520+0000 7f0254400640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f02340b52e0 0x7f02340b77a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.520+0000 7f0254400640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f024c113b20 0x7f024c1a5210 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.520+0000 7f0254400640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f024c075e60 0x7f024c19fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.520+0000 7f0254400640 1 --2- 172.21.15.103:0/769621967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f024c075540 0x7f024c19f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:56.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.520+0000 7f0254400640 1 -- 172.21.15.103:0/769621967 >> 172.21.15.103:0/769621967 conn(0x7f024c0fe830 msgr2=0x7f024c0ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:56.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.520+0000 7f0254400640 1 -- 172.21.15.103:0/769621967 shutdown_connections 2024-09-11T01:17:56.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:56.520+0000 7f0254400640 1 -- 172.21.15.103:0/769621967 wait complete. 2024-09-11T01:17:56.527 INFO:tasks.workunit:Stopping ['suites/ffsb.sh'] on client.0... 2024-09-11T01:17:56.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-11T01:17:57.119 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:56 smithi103 ceph-mon[30562]: pgmap v688: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T01:17:57.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:56 smithi117 ceph-mon[35358]: pgmap v688: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T01:17:57.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:56 smithi183 ceph-mon[34992]: pgmap v688: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-09-11T01:17:57.676 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6b411aaa', total seconds elapsed: 42.3 2024-09-11T01:17:58.329 DEBUG:teuthology.parallel:result is None 2024-09-11T01:17:58.329 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T01:17:58.397 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-11T01:17:58.397 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-11T01:17:58.407 INFO:tasks.quiescer:joining Quiescers 2024-09-11T01:17:58.408 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-11T01:17:58.408 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:17:58.790 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:17:59.119 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:58 smithi103 ceph-mon[30562]: pgmap v689: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T01:17:59.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:58 smithi117 ceph-mon[35358]: pgmap v689: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T01:17:59.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:58 smithi183 ceph-mon[34992]: pgmap v689: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-11T01:17:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.530+0000 7f32f1000640 1 -- 172.21.15.103:0/3527913876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32ec0776d0 msgr2=0x7f32ec077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.530+0000 7f32f1000640 1 --2- 172.21.15.103:0/3527913876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32ec0776d0 0x7f32ec077ab0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009ca0 tx=0x7f32dc02a8c0 comp rx=0 tx=0).stop 2024-09-11T01:17:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.530+0000 7f32f1000640 1 -- 172.21.15.103:0/3527913876 shutdown_connections 2024-09-11T01:17:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.530+0000 7f32f1000640 1 --2- 172.21.15.103:0/3527913876 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32ec113800 0x7f32ec115bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.530+0000 7f32f1000640 1 --2- 172.21.15.103:0/3527913876 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32ec077ff0 0x7f32ec1132c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.530+0000 7f32f1000640 1 --2- 172.21.15.103:0/3527913876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32ec0776d0 0x7f32ec077ab0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.530+0000 7f32f1000640 1 -- 172.21.15.103:0/3527913876 >> 172.21.15.103:0/3527913876 conn(0x7f32ec100840 msgr2=0x7f32ec102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:59.533 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.530+0000 7f32f1000640 1 -- 172.21.15.103:0/3527913876 shutdown_connections 2024-09-11T01:17:59.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.530+0000 7f32f1000640 1 -- 172.21.15.103:0/3527913876 wait complete. 2024-09-11T01:17:59.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.531+0000 7f32f1000640 1 Processor -- start 2024-09-11T01:17:59.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.531+0000 7f32f1000640 1 -- start start 2024-09-11T01:17:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.532+0000 7f32f1000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32ec0776d0 0x7f32ec19f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.532+0000 7f32f1000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32ec077ff0 0x7f32ec19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.532+0000 7f32f1000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32ec113800 0x7f32ec1a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.532+0000 7f32f1000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec1191f0 con 0x7f32ec0776d0 2024-09-11T01:17:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.532+0000 7f32f1000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec119070 con 0x7f32ec113800 2024-09-11T01:17:59.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.532+0000 7f32f1000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec119370 con 0x7f32ec077ff0 2024-09-11T01:17:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.532+0000 7f32eb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32ec0776d0 0x7f32ec19f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.532+0000 7f32ebe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32ec113800 0x7f32ec1a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.532+0000 7f32eb400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32ec0776d0 0x7f32ec19f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37110/0 (socket says 172.21.15.103:37110) 2024-09-11T01:17:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.532+0000 7f32eb400640 1 -- 172.21.15.103:0/1946620757 learned_addr learned my addr 172.21.15.103:0/1946620757 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:17:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.532+0000 7f32eaa00640 1 --2- 172.21.15.103:0/1946620757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32ec077ff0 0x7f32ec19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.533+0000 7f32ebe00640 1 -- 172.21.15.103:0/1946620757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32ec077ff0 msgr2=0x7f32ec19fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.533+0000 7f32ebe00640 1 --2- 172.21.15.103:0/1946620757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32ec077ff0 0x7f32ec19fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.533+0000 7f32ebe00640 1 -- 172.21.15.103:0/1946620757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32ec0776d0 msgr2=0x7f32ec19f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.533+0000 7f32ebe00640 1 --2- 172.21.15.103:0/1946620757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32ec0776d0 0x7f32ec19f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.533+0000 7f32ebe00640 1 -- 172.21.15.103:0/1946620757 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec1a5770 con 0x7f32ec113800 2024-09-11T01:17:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.533+0000 7f32ebe00640 1 --2- 172.21.15.103:0/1946620757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32ec113800 0x7f32ec1a4fa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f32e400e940 tx=0x7f32e400ee00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.533+0000 7f32e3e00640 1 -- 172.21.15.103:0/1946620757 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e400ccc0 con 0x7f32ec113800 2024-09-11T01:17:59.536 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.533+0000 7f32e3e00640 1 -- 172.21.15.103:0/1946620757 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f32e4005020 con 0x7f32ec113800 2024-09-11T01:17:59.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.533+0000 7f32f1000640 1 -- 172.21.15.103:0/1946620757 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ec1a5a60 con 0x7f32ec113800 2024-09-11T01:17:59.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.533+0000 7f32e3e00640 1 -- 172.21.15.103:0/1946620757 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32e4004a00 con 0x7f32ec113800 2024-09-11T01:17:59.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.534+0000 7f32f1000640 1 -- 172.21.15.103:0/1946620757 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ec1ac120 con 0x7f32ec113800 2024-09-11T01:17:59.537 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.534+0000 7f32f1000640 1 -- 172.21.15.103:0/1946620757 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ec077ab0 con 0x7f32ec113800 2024-09-11T01:17:59.538 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.537+0000 7f32e3e00640 1 -- 172.21.15.103:0/1946620757 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f32e4004ba0 con 0x7f32ec113800 2024-09-11T01:17:59.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.538+0000 7f32e3e00640 1 --2- 172.21.15.103:0/1946620757 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f32d00b5390 0x7f32d00b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:17:59.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.539+0000 7f32e3e00640 1 -- 172.21.15.103:0/1946620757 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f32e40e5fe0 con 0x7f32ec113800 2024-09-11T01:17:59.540 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.539+0000 7f32eb400640 1 --2- 172.21.15.103:0/1946620757 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f32d00b5390 0x7f32d00b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:17:59.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.539+0000 7f32eb400640 1 --2- 172.21.15.103:0/1946620757 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f32d00b5390 0x7f32d00b7850 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009430 tx=0x7f32dc009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:17:59.542 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.540+0000 7f32e3e00640 1 -- 172.21.15.103:0/1946620757 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f32e40acb20 con 0x7f32ec113800 2024-09-11T01:17:59.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.759+0000 7f32f1000640 1 -- 172.21.15.103:0/1946620757 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32ec1ac480 con 0x7f32ec113800 2024-09-11T01:17:59.762 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.761+0000 7f32e3e00640 1 -- 172.21.15.103:0/1946620757 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11935 (secure 0 0 0) 0x7f32e40ac420 con 0x7f32ec113800 2024-09-11T01:17:59.763 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:17:59.763 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":33,"btime":"2024-09-11T01:17:25:752182+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:17:25.170731+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24619,24629,24665]},"id":1}]} 2024-09-11T01:17:59.763 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 33 2024-09-11T01:17:59.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.763+0000 7f32f1000640 1 -- 172.21.15.103:0/1946620757 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f32d00b5390 msgr2=0x7f32d00b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:59.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.763+0000 7f32f1000640 1 --2- 172.21.15.103:0/1946620757 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f32d00b5390 0x7f32d00b7850 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009430 tx=0x7f32dc009360 comp rx=0 tx=0).stop 2024-09-11T01:17:59.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.763+0000 7f32f1000640 1 -- 172.21.15.103:0/1946620757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32ec113800 msgr2=0x7f32ec1a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:17:59.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.763+0000 7f32f1000640 1 --2- 172.21.15.103:0/1946620757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32ec113800 0x7f32ec1a4fa0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f32e400e940 tx=0x7f32e400ee00 comp rx=0 tx=0).stop 2024-09-11T01:17:59.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.764+0000 7f32f1000640 1 -- 172.21.15.103:0/1946620757 shutdown_connections 2024-09-11T01:17:59.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.764+0000 7f32f1000640 1 --2- 172.21.15.103:0/1946620757 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f32d00b5390 0x7f32d00b7850 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:59.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.764+0000 7f32f1000640 1 --2- 172.21.15.103:0/1946620757 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f32ec113800 0x7f32ec1a4fa0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:59.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.764+0000 7f32f1000640 1 --2- 172.21.15.103:0/1946620757 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f32ec077ff0 0x7f32ec19fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:59.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.764+0000 7f32f1000640 1 --2- 172.21.15.103:0/1946620757 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32ec0776d0 0x7f32ec19f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:17:59.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.764+0000 7f32f1000640 1 -- 172.21.15.103:0/1946620757 >> 172.21.15.103:0/1946620757 conn(0x7f32ec100840 msgr2=0x7f32ec102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:17:59.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.764+0000 7f32f1000640 1 -- 172.21.15.103:0/1946620757 shutdown_connections 2024-09-11T01:17:59.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:17:59.764+0000 7f32f1000640 1 -- 172.21.15.103:0/1946620757 wait complete. 2024-09-11T01:18:00.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:17:59 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1946620757' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:18:00.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:17:59 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1946620757' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:18:00.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:17:59 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1946620757' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:18:00.592 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24665 quiesce db --cancel --all' 2024-09-11T01:18:00.593 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- timeout 105 ceph tell mds.24665 quiesce db --cancel --all 2024-09-11T01:18:00.985 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:18:01.122 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:00 smithi117 ceph-mon[35358]: pgmap v690: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-11T01:18:01.123 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:00 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:18:01.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:00 smithi103 ceph-mon[30562]: pgmap v690: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-11T01:18:01.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:00 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:18:01.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:00 smithi183 ceph-mon[34992]: pgmap v690: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-09-11T01:18:01.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:00 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-11T01:18:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.176+0000 7f9bec400640 1 -- 172.21.15.103:0/3431363313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9be4102980 msgr2=0x7f9be4102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.176+0000 7f9bec400640 1 --2- 172.21.15.103:0/3431363313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9be4102980 0x7f9be4102d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009900 tx=0x7f9bd802a3f0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.176+0000 7f9bec400640 1 -- 172.21.15.103:0/3431363313 shutdown_connections 2024-09-11T01:18:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.176+0000 7f9bec400640 1 --2- 172.21.15.103:0/3431363313 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9be4104490 0x7f9be410ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.176+0000 7f9bec400640 1 --2- 172.21.15.103:0/3431363313 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9be4103ad0 0x7f9be4103f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.176+0000 7f9bec400640 1 --2- 172.21.15.103:0/3431363313 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9be4102980 0x7f9be4102d80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.176+0000 7f9bec400640 1 -- 172.21.15.103:0/3431363313 >> 172.21.15.103:0/3431363313 conn(0x7f9be40fe240 msgr2=0x7f9be4100660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:01.178 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.176+0000 7f9bec400640 1 -- 172.21.15.103:0/3431363313 shutdown_connections 2024-09-11T01:18:01.179 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.176+0000 7f9bec400640 1 -- 172.21.15.103:0/3431363313 wait complete. 2024-09-11T01:18:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.177+0000 7f9bec400640 1 Processor -- start 2024-09-11T01:18:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.178+0000 7f9bec400640 1 -- start start 2024-09-11T01:18:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.178+0000 7f9bec400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9be4102980 0x7f9be4198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.178+0000 7f9bec400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9be4103ad0 0x7f9be41993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.178+0000 7f9bec400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9be4104490 0x7f9be4199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.178+0000 7f9bec400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9be410e5d0 con 0x7f9be4102980 2024-09-11T01:18:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.178+0000 7f9bec400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9be410e450 con 0x7f9be4104490 2024-09-11T01:18:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.178+0000 7f9bec400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9be410e750 con 0x7f9be4103ad0 2024-09-11T01:18:01.182 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.178+0000 7f9be9a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9be4102980 0x7f9be4198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.178+0000 7f9be9a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9be4102980 0x7f9be4198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37976/0 (socket says 172.21.15.103:37976) 2024-09-11T01:18:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.178+0000 7f9be9a00640 1 -- 172.21.15.103:0/2954772369 learned_addr learned my addr 172.21.15.103:0/2954772369 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.178+0000 7f9bea400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9be4104490 0x7f9be4199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.178+0000 7f9be9000640 1 --2- 172.21.15.103:0/2954772369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9be4103ad0 0x7f9be41993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.179+0000 7f9bea400640 1 -- 172.21.15.103:0/2954772369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9be4103ad0 msgr2=0x7f9be41993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.179+0000 7f9bea400640 1 --2- 172.21.15.103:0/2954772369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9be4103ad0 0x7f9be41993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.179+0000 7f9bea400640 1 -- 172.21.15.103:0/2954772369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9be4102980 msgr2=0x7f9be4198d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.179+0000 7f9bea400640 1 --2- 172.21.15.103:0/2954772369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9be4102980 0x7f9be4198d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.179+0000 7f9bea400640 1 -- 172.21.15.103:0/2954772369 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be419a8b0 con 0x7f9be4104490 2024-09-11T01:18:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.179+0000 7f9be9000640 1 --2- 172.21.15.103:0/2954772369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9be4103ad0 0x7f9be41993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:18:01.183 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.179+0000 7f9bea400640 1 --2- 172.21.15.103:0/2954772369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9be4104490 0x7f9be4199ff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009fd0 tx=0x7f9bdc00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.179+0000 7f9be2000640 1 -- 172.21.15.103:0/2954772369 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc00ce20 con 0x7f9be4104490 2024-09-11T01:18:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.179+0000 7f9be2000640 1 -- 172.21.15.103:0/2954772369 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bdc005020 con 0x7f9be4104490 2024-09-11T01:18:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.179+0000 7f9bec400640 1 -- 172.21.15.103:0/2954772369 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be419aba0 con 0x7f9be4104490 2024-09-11T01:18:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.179+0000 7f9be2000640 1 -- 172.21.15.103:0/2954772369 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc010690 con 0x7f9be4104490 2024-09-11T01:18:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.179+0000 7f9bec400640 1 -- 172.21.15.103:0/2954772369 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be41a1270 con 0x7f9be4104490 2024-09-11T01:18:01.184 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.182+0000 7f9bef215740 1 Processor -- start 2024-09-11T01:18:01.186 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.184+0000 7f9be2000640 1 -- 172.21.15.103:0/2954772369 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f9bdc0054d0 con 0x7f9be4104490 2024-09-11T01:18:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.184+0000 7f9bef215740 1 -- start start 2024-09-11T01:18:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.184+0000 7f9bef215740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 0x560b1fdccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.184+0000 7f9bef215740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdcf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.184+0000 7f9bef215740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fdd23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.184+0000 7f9bef215740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560b1fd396b0 con 0x560b1fdcaba0 2024-09-11T01:18:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.184+0000 7f9bef215740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560b1fd28ae0 con 0x560b1fdcd4d0 2024-09-11T01:18:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.184+0000 7f9bef215740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560b1fd2c8f0 con 0x560b1fdcff10 2024-09-11T01:18:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.185+0000 7f9be9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 0x560b1fdccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.185+0000 7f9be9a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdcf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.187 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.185+0000 7f9be9a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdcf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:54542/0 (socket says 172.21.15.103:54542) 2024-09-11T01:18:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.185+0000 7f9be9a00640 1 -- 172.21.15.103:0/1596858379 learned_addr learned my addr 172.21.15.103:0/1596858379 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:01.188 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.185+0000 7f9be9000640 1 --2- 172.21.15.103:0/1596858379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fdd23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.185+0000 7f9be9a00640 1 -- 172.21.15.103:0/1596858379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 msgr2=0x560b1fdd23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.185+0000 7f9be9a00640 1 --2- 172.21.15.103:0/1596858379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fdd23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.185+0000 7f9be9a00640 1 -- 172.21.15.103:0/1596858379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 msgr2=0x560b1fdccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.185+0000 7f9be9a00640 1 --2- 172.21.15.103:0/1596858379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 0x560b1fdccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.185+0000 7f9be9a00640 1 -- 172.21.15.103:0/1596858379 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b1fcf5780 con 0x560b1fdcd4d0 2024-09-11T01:18:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.186+0000 7f9be9a00640 1 --2- 172.21.15.103:0/1596858379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdcf8c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8006010 tx=0x7f9bd8005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc833c04e5a95b20 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.186+0000 7f9be2000640 1 --2- 172.21.15.103:0/2954772369 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9bcc0b52e0 0x7f9bcc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.186+0000 7f9bd6a00640 1 -- 172.21.15.103:0/1596858379 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8035030 con 0x560b1fdcd4d0 2024-09-11T01:18:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.186+0000 7f9bd6a00640 1 -- 172.21.15.103:0/1596858379 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bd8040070 con 0x560b1fdcd4d0 2024-09-11T01:18:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.186+0000 7f9bd6a00640 1 -- 172.21.15.103:0/1596858379 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8003830 con 0x560b1fdcd4d0 2024-09-11T01:18:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.186+0000 7f9be2000640 1 -- 172.21.15.103:0/2954772369 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f9bdc0e66c0 con 0x7f9be4104490 2024-09-11T01:18:01.194 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.186+0000 7f9be9000640 1 --2- 172.21.15.103:0/2954772369 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9bcc0b52e0 0x7f9bcc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.187+0000 7f9bef215740 1 -- 172.21.15.103:0/1596858379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 msgr2=0x560b1fdcf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.187+0000 7f9bef215740 1 --2- 172.21.15.103:0/1596858379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdcf8c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8006010 tx=0x7f9bd8005bd0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.187+0000 7f9bef215740 1 -- 172.21.15.103:0/1596858379 shutdown_connections 2024-09-11T01:18:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.187+0000 7f9bef215740 1 --2- 172.21.15.103:0/1596858379 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fdd23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.187+0000 7f9bef215740 1 --2- 172.21.15.103:0/1596858379 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdcf8c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.187+0000 7f9bef215740 1 --2- 172.21.15.103:0/1596858379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 0x560b1fdccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.187+0000 7f9bef215740 1 -- 172.21.15.103:0/1596858379 >> 172.21.15.103:0/1596858379 conn(0x560b1fdc18e0 msgr2=0x560b1fdc2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.187+0000 7f9be9000640 1 --2- 172.21.15.103:0/2954772369 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9bcc0b52e0 0x7f9bcc0b77a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00042a0 tx=0x7f9bd0015040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.187+0000 7f9bef215740 1 -- 172.21.15.103:0/1596858379 shutdown_connections 2024-09-11T01:18:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.187+0000 7f9bef215740 1 -- 172.21.15.103:0/1596858379 wait complete. 2024-09-11T01:18:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.187+0000 7f9bef215740 1 -- start start 2024-09-11T01:18:01.195 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.188+0000 7f9bef215740 1 Processor -- start 2024-09-11T01:18:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.188+0000 7f9bef215740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 0x560b1fdd42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.188+0000 7f9bef215740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdd4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.188+0000 7f9bef215740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fdd54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.188+0000 7f9bef215740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560b1fc60ab0 con 0x560b1fdcaba0 2024-09-11T01:18:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.188+0000 7f9bef215740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x560b1fccf570 con 0x560b1fdcd4d0 2024-09-11T01:18:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.188+0000 7f9bef215740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x560b1fdd2e90 con 0x560b1fdcff10 2024-09-11T01:18:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.188+0000 7f9bef215740 10 client.0 _ll_register_callbacks cb 0x560b1fcde100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:18:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.188+0000 7f9be9000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdd4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.188+0000 7f9be9a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 0x560b1fdd42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.188+0000 7f9bea400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fdd54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.188+0000 7f9be9000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdd4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:54548/0 (socket says 172.21.15.103:54548) 2024-09-11T01:18:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.189+0000 7f9be9000640 1 -- 172.21.15.103:0/3596812270 learned_addr learned my addr 172.21.15.103:0/3596812270 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:01.196 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.189+0000 7f9bea400640 1 -- 172.21.15.103:0/3596812270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 msgr2=0x560b1fdd4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.189+0000 7f9bea400640 1 --2- 172.21.15.103:0/3596812270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdd4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.189+0000 7f9bea400640 1 -- 172.21.15.103:0/3596812270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 msgr2=0x560b1fdd42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.189+0000 7f9bea400640 1 --2- 172.21.15.103:0/3596812270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 0x560b1fdd42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.189+0000 7f9bea400640 1 -- 172.21.15.103:0/3596812270 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b1fa8a790 con 0x560b1fdcff10 2024-09-11T01:18:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.189+0000 7f9bea400640 1 --2- 172.21.15.103:0/3596812270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fdd54a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0e4180 tx=0x7f9bdc0a8300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec4b1986bbc8f8e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.189+0000 7f9bcb400640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:18:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.189+0000 7f9bcb400640 1 -- 172.21.15.103:0/3596812270 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0acad0 con 0x560b1fdcff10 2024-09-11T01:18:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.189+0000 7f9bef215740 1 -- 172.21.15.103:0/3596812270 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bd8040070 con 0x560b1fdcff10 2024-09-11T01:18:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.189+0000 7f9bcb400640 1 -- 172.21.15.103:0/3596812270 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f9bdc0a8040 con 0x560b1fdcff10 2024-09-11T01:18:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.190+0000 7f9bcb400640 1 -- 172.21.15.103:0/3596812270 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9bdc0b15b0 con 0x560b1fdcff10 2024-09-11T01:18:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.190+0000 7f9bef215740 10 client.26137 fetch_fsmap learned FSMap version 33 2024-09-11T01:18:01.197 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.190+0000 7f9bef215740 1 -- 172.21.15.103:0/3596812270 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560b1fb03620 con 0x560b1fdcff10 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.190+0000 7f9bcb400640 1 -- 172.21.15.103:0/3596812270 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bd8040070 con 0x560b1fdcff10 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.190+0000 7f9bcb400640 1 -- 172.21.15.103:0/3596812270 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f9bdc0b10f0 con 0x560b1fdcff10 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.190+0000 7f9bef215740 10 client.26137 fetch_fsmap finished waiting for FSMap version 33 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.190+0000 7f9bef215740 10 client.26137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.190+0000 7f9bef215740 20 client.26137 populate_metadata read hostname 'smithi103' 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.190+0000 7f9bef215740 1 --2- 172.21.15.103:0/3596812270 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x560b1fddfab0 0x560b1fde1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.190+0000 7f9bef215740 4 client.26137 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.190+0000 7f9bef215740 1 -- 172.21.15.103:0/3596812270 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b1fd3b600 con 0x560b1fddfab0 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.190+0000 7f9be9a00640 1 --2- 172.21.15.103:0/3596812270 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x560b1fddfab0 0x560b1fde1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.191+0000 7f9be9a00640 1 --2- 172.21.15.103:0/3596812270 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x560b1fddfab0 0x560b1fde1f00 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b82beffbb8841cf3 server_cookie=750315b3e701224d in_seq=0 out_seq=0 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.191+0000 7f9bcb400640 10 client.26137 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.191+0000 7f9bcb400640 1 -- 172.21.15.103:0/3596812270 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x560b1fd3b600 con 0x560b1fddfab0 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.191+0000 7f9bcb400640 10 client.26137 handle_command_reply: tid=0 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.192+0000 7f9bef215740 1 client.26137 shutdown 2024-09-11T01:18:01.198 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.192+0000 7f9bef215740 1 -- 172.21.15.103:0/3596812270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 msgr2=0x560b1fdd54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.192+0000 7f9bef215740 1 --2- 172.21.15.103:0/3596812270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fdd54a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0e4180 tx=0x7f9bdc0a8300 comp rx=0 tx=0).stop 2024-09-11T01:18:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.192+0000 7f9bef215740 1 -- 172.21.15.103:0/3596812270 shutdown_connections 2024-09-11T01:18:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.192+0000 7f9bef215740 1 --2- 172.21.15.103:0/3596812270 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x560b1fddfab0 0x560b1fde1f00 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.192+0000 7f9bef215740 1 --2- 172.21.15.103:0/3596812270 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fdd54a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.192+0000 7f9bcb400640 0 client.26137 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:18:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.192+0000 7f9bef215740 1 --2- 172.21.15.103:0/3596812270 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdd4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.192+0000 7f9bef215740 1 --2- 172.21.15.103:0/3596812270 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 0x560b1fdd42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.192+0000 7f9bef215740 1 -- 172.21.15.103:0/3596812270 >> 172.21.15.103:0/3596812270 conn(0x560b1fdc18e0 msgr2=0x560b1fdc0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.192+0000 7f9bef215740 1 -- 172.21.15.103:0/3596812270 shutdown_connections 2024-09-11T01:18:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.192+0000 7f9bef215740 1 -- 172.21.15.103:0/3596812270 wait complete. 2024-09-11T01:18:01.199 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.192+0000 7f9bef215740 20 client.26137 trim_cache size 0 max 16384 2024-09-11T01:18:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.208+0000 7f9bef215740 1 Processor -- start 2024-09-11T01:18:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.208+0000 7f9bef215740 1 -- start start 2024-09-11T01:18:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.208+0000 7f9bef215740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 0x560b1fdd5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.208+0000 7f9bef215740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdc5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.210 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.208+0000 7f9bef215740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fdc6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.208+0000 7f9bef215740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9be41abd80 con 0x560b1fdcaba0 2024-09-11T01:18:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.208+0000 7f9bef215740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9be41a95c0 con 0x560b1fdcd4d0 2024-09-11T01:18:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.208+0000 7f9bef215740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9be41a7410 con 0x560b1fdcff10 2024-09-11T01:18:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.208+0000 7f9be9a00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 0x560b1fdd5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.208+0000 7f9be9000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdc5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.208+0000 7f9bea400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fdc6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.208+0000 7f9be9000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdc5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:54550/0 (socket says 172.21.15.103:54550) 2024-09-11T01:18:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.208+0000 7f9be9000640 1 -- 172.21.15.103:0/1748736771 learned_addr learned my addr 172.21.15.103:0/1748736771 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.209+0000 7f9bea400640 1 -- 172.21.15.103:0/1748736771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 msgr2=0x560b1fdc5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.209+0000 7f9bea400640 1 --2- 172.21.15.103:0/1748736771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdc5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.211 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.209+0000 7f9bea400640 1 -- 172.21.15.103:0/1748736771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 msgr2=0x560b1fdd5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.212 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.209+0000 7f9bea400640 1 --2- 172.21.15.103:0/1748736771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 0x560b1fdd5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.212 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.209+0000 7f9bea400640 1 -- 172.21.15.103:0/1748736771 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b1fdd3da0 con 0x560b1fdcff10 2024-09-11T01:18:01.212 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.209+0000 7f9be9000640 1 --2- 172.21.15.103:0/1748736771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdc5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:18:01.212 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.209+0000 7f9bea400640 1 --2- 172.21.15.103:0/1748736771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fdc6180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0a9050 tx=0x7f9bdc005bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=990e8adc2f4561c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.209+0000 7f9bd6000640 1 -- 172.21.15.103:0/1748736771 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0c6070 con 0x560b1fdcff10 2024-09-11T01:18:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.209+0000 7f9bd6000640 1 -- 172.21.15.103:0/1748736771 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bdc0acad0 con 0x560b1fdcff10 2024-09-11T01:18:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.209+0000 7f9bd6000640 1 -- 172.21.15.103:0/1748736771 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0b10e0 con 0x560b1fdcff10 2024-09-11T01:18:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.210+0000 7f9bef215740 1 -- 172.21.15.103:0/1748736771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 msgr2=0x560b1fdc6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.210+0000 7f9bef215740 1 --2- 172.21.15.103:0/1748736771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fdc6180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0a9050 tx=0x7f9bdc005bb0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.210+0000 7f9bef215740 1 -- 172.21.15.103:0/1748736771 shutdown_connections 2024-09-11T01:18:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.210+0000 7f9bef215740 1 --2- 172.21.15.103:0/1748736771 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fdc6180 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.216 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.210+0000 7f9bef215740 1 --2- 172.21.15.103:0/1748736771 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcd4d0 0x560b1fdc5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.210+0000 7f9bef215740 1 --2- 172.21.15.103:0/1748736771 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcaba0 0x560b1fdd5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.210+0000 7f9bef215740 1 -- 172.21.15.103:0/1748736771 >> 172.21.15.103:0/1748736771 conn(0x560b1fdc18e0 msgr2=0x560b1fdd3290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.210+0000 7f9bef215740 1 -- 172.21.15.103:0/1748736771 shutdown_connections 2024-09-11T01:18:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.210+0000 7f9bef215740 1 -- 172.21.15.103:0/1748736771 wait complete. 2024-09-11T01:18:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.210+0000 7f9bef215740 1 -- start start 2024-09-11T01:18:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.210+0000 7f9bef215740 1 Processor -- start 2024-09-11T01:18:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.211+0000 7f9bef215740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcaba0 0x560b1fddbe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.211+0000 7f9bef215740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcd4d0 0x560b1fddab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.211+0000 7f9bef215740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fddb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.211+0000 7f9bef215740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9be41a7a80 con 0x560b1fdcd4d0 2024-09-11T01:18:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.211+0000 7f9bef215740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9be41a8ef0 con 0x560b1fdcaba0 2024-09-11T01:18:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.211+0000 7f9bef215740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9be41a8150 con 0x560b1fdcff10 2024-09-11T01:18:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.211+0000 7f9bef215740 10 client.0 _ll_register_callbacks cb 0x7f9bdc0ac240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:18:01.217 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.211+0000 7f9be9a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcaba0 0x560b1fddbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.211+0000 7f9be9a00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcaba0 0x560b1fddbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:54566/0 (socket says 172.21.15.103:54566) 2024-09-11T01:18:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.211+0000 7f9be9a00640 1 -- 172.21.15.103:0/3714510663 learned_addr learned my addr 172.21.15.103:0/3714510663 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.211+0000 7f9be9000640 1 --2- 172.21.15.103:0/3714510663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcd4d0 0x560b1fddab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.211+0000 7f9bea400640 1 --2- 172.21.15.103:0/3714510663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fddb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.212+0000 7f9bea400640 1 -- 172.21.15.103:0/3714510663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcaba0 msgr2=0x560b1fddbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.212+0000 7f9bea400640 1 --2- 172.21.15.103:0/3714510663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcaba0 0x560b1fddbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.212+0000 7f9bea400640 1 -- 172.21.15.103:0/3714510663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcd4d0 msgr2=0x560b1fddab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.212+0000 7f9bea400640 1 --2- 172.21.15.103:0/3714510663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcd4d0 0x560b1fddab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.212+0000 7f9bea400640 1 -- 172.21.15.103:0/3714510663 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b1fdd9660 con 0x560b1fdcff10 2024-09-11T01:18:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.212+0000 7f9bea400640 1 --2- 172.21.15.103:0/3714510663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fddb1c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0a9d40 tx=0x7f9bdc0b5e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18629fab04370318 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:01.218 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.212+0000 7f9bcb400640 10 client.0 ms_handle_connect on v2:172.21.15.183:3300/0 2024-09-11T01:18:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.212+0000 7f9bcb400640 1 -- 172.21.15.103:0/3714510663 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0c6070 con 0x560b1fdcff10 2024-09-11T01:18:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.212+0000 7f9bef215740 1 -- 172.21.15.103:0/3714510663 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bdc0acad0 con 0x560b1fdcff10 2024-09-11T01:18:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.212+0000 7f9bcb400640 1 -- 172.21.15.103:0/3714510663 <== mon.1 v2:172.21.15.183:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f9bdc0a8040 con 0x560b1fdcff10 2024-09-11T01:18:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.212+0000 7f9bcb400640 1 -- 172.21.15.103:0/3714510663 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9bdc0a9120 con 0x560b1fdcff10 2024-09-11T01:18:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.212+0000 7f9bef215740 10 client.26143 fetch_fsmap learned FSMap version 33 2024-09-11T01:18:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.212+0000 7f9bef215740 1 -- 172.21.15.103:0/3714510663 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560b1fe4cb90 con 0x560b1fdcff10 2024-09-11T01:18:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.213+0000 7f9bcb400640 1 -- 172.21.15.103:0/3714510663 <== mon.1 v2:172.21.15.183:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9bdc0acad0 con 0x560b1fdcff10 2024-09-11T01:18:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.213+0000 7f9bcb400640 1 -- 172.21.15.103:0/3714510663 <== mon.1 v2:172.21.15.183:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f9bdc0ab7a0 con 0x560b1fdcff10 2024-09-11T01:18:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.213+0000 7f9bef215740 10 client.26143 fetch_fsmap finished waiting for FSMap version 33 2024-09-11T01:18:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.213+0000 7f9bef215740 10 client.26143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-11T01:18:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.213+0000 7f9bef215740 20 client.26143 populate_metadata read hostname 'smithi103' 2024-09-11T01:18:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.213+0000 7f9bef215740 1 --2- 172.21.15.103:0/3714510663 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x560b1fe4d2f0 0x560b1fe4f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.213+0000 7f9bef215740 4 client.26143 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-11T01:18:01.219 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.213+0000 7f9bef215740 1 -- 172.21.15.103:0/3714510663 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560b1fd370b0 con 0x560b1fe4d2f0 2024-09-11T01:18:01.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.213+0000 7f9be9a00640 1 --2- 172.21.15.103:0/3714510663 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x560b1fe4d2f0 0x560b1fe4f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.214+0000 7f9bcb400640 10 client.26143 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:18:01.220 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.214+0000 7f9be9a00640 1 --2- 172.21.15.103:0/3714510663 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x560b1fe4d2f0 0x560b1fe4f710 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1737d4fbc820de50 server_cookie=5c12a5b828565c in_seq=0 out_seq=0 2024-09-11T01:18:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.223+0000 7f9bcb400640 1 -- 172.21.15.103:0/3714510663 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560b1fd370b0 con 0x560b1fe4d2f0 2024-09-11T01:18:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.223+0000 7f9bcb400640 10 client.26143 handle_command_reply: tid=0 2024-09-11T01:18:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.223+0000 7f9bef215740 1 client.26143 shutdown 2024-09-11T01:18:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.223+0000 7f9bef215740 1 -- 172.21.15.103:0/3714510663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 msgr2=0x560b1fddb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.223+0000 7f9bef215740 1 --2- 172.21.15.103:0/3714510663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fddb1c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0a9d40 tx=0x7f9bdc0b5e00 comp rx=0 tx=0).stop 2024-09-11T01:18:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.224+0000 7f9bef215740 1 -- 172.21.15.103:0/3714510663 shutdown_connections 2024-09-11T01:18:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.224+0000 7f9bef215740 1 --2- 172.21.15.103:0/3714510663 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x560b1fe4d2f0 0x560b1fe4f710 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.224+0000 7f9bef215740 1 --2- 172.21.15.103:0/3714510663 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x560b1fdcff10 0x560b1fddb1c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.224+0000 7f9bef215740 1 --2- 172.21.15.103:0/3714510663 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560b1fdcd4d0 0x560b1fddab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.224+0000 7f9bef215740 1 --2- 172.21.15.103:0/3714510663 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560b1fdcaba0 0x560b1fddbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.224+0000 7f9bcb400640 0 client.26143 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:18:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.224+0000 7f9bef215740 1 -- 172.21.15.103:0/3714510663 >> 172.21.15.103:0/3714510663 conn(0x560b1fdc18e0 msgr2=0x560b1fdc2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:01.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.224+0000 7f9bef215740 1 -- 172.21.15.103:0/3714510663 shutdown_connections 2024-09-11T01:18:01.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.224+0000 7f9bef215740 1 -- 172.21.15.103:0/3714510663 wait complete. 2024-09-11T01:18:01.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.224+0000 7f9bef215740 20 client.26143 trim_cache size 0 max 16384 2024-09-11T01:18:01.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-09-11T01:18:01.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-09-11T01:18:01.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-09-11T01:18:01.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-09-11T01:18:01.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.224+0000 7f9bec400640 1 -- 172.21.15.103:0/2954772369 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9bcc0b52e0 msgr2=0x7f9bcc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.224+0000 7f9bec400640 1 --2- 172.21.15.103:0/2954772369 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9bcc0b52e0 0x7f9bcc0b77a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00042a0 tx=0x7f9bd0015040 comp rx=0 tx=0).stop 2024-09-11T01:18:01.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.224+0000 7f9bec400640 1 -- 172.21.15.103:0/2954772369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9be4104490 msgr2=0x7f9be4199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.224+0000 7f9bec400640 1 --2- 172.21.15.103:0/2954772369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9be4104490 0x7f9be4199ff0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009fd0 tx=0x7f9bdc00ef10 comp rx=0 tx=0).stop 2024-09-11T01:18:01.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.225+0000 7f9bec400640 1 -- 172.21.15.103:0/2954772369 shutdown_connections 2024-09-11T01:18:01.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.225+0000 7f9bec400640 1 --2- 172.21.15.103:0/2954772369 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9bcc0b52e0 0x7f9bcc0b77a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.225+0000 7f9bec400640 1 --2- 172.21.15.103:0/2954772369 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9be4104490 0x7f9be4199ff0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.225+0000 7f9bec400640 1 --2- 172.21.15.103:0/2954772369 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9be4103ad0 0x7f9be41993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.225+0000 7f9bec400640 1 --2- 172.21.15.103:0/2954772369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9be4102980 0x7f9be4198d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.225+0000 7f9bec400640 1 -- 172.21.15.103:0/2954772369 >> 172.21.15.103:0/2954772369 conn(0x7f9be40fe240 msgr2=0x7f9be4106ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:01.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.225+0000 7f9bec400640 1 -- 172.21.15.103:0/2954772369 shutdown_connections 2024-09-11T01:18:01.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-09-11T01:18:01.225+0000 7f9bec400640 1 -- 172.21.15.103:0/2954772369 wait complete. 2024-09-11T01:18:01.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.626+0000 7f31cf000640 1 -- 172.21.15.103:0/3936123469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31c810b330 msgr2=0x7f31c8111b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.626+0000 7f31cf000640 1 --2- 172.21.15.103:0/3936123469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31c810b330 0x7f31c8111b30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009be0 tx=0x7f31c002a6c0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.626+0000 7f31cf000640 1 -- 172.21.15.103:0/3936123469 shutdown_connections 2024-09-11T01:18:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.626+0000 7f31cf000640 1 --2- 172.21.15.103:0/3936123469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31c810b330 0x7f31c8111b30 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.626+0000 7f31cf000640 1 --2- 172.21.15.103:0/3936123469 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c810a9b0 0x7f31c810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.626+0000 7f31cf000640 1 --2- 172.21.15.103:0/3936123469 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31c8104fa0 0x7f31c8105380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.626+0000 7f31cf000640 1 -- 172.21.15.103:0/3936123469 >> 172.21.15.103:0/3936123469 conn(0x7f31c8100a50 msgr2=0x7f31c8102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.626+0000 7f31cf000640 1 -- 172.21.15.103:0/3936123469 shutdown_connections 2024-09-11T01:18:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.626+0000 7f31cf000640 1 -- 172.21.15.103:0/3936123469 wait complete. 2024-09-11T01:18:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.627+0000 7f31cf000640 1 Processor -- start 2024-09-11T01:18:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.627+0000 7f31cf000640 1 -- start start 2024-09-11T01:18:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.627+0000 7f31cf000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c8104fa0 0x7f31c819b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.627+0000 7f31cf000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31c810a9b0 0x7f31c819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.627+0000 7f31cf000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31c810b330 0x7f31c81a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.627+0000 7f31cf000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8114f60 con 0x7f31c810a9b0 2024-09-11T01:18:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.627+0000 7f31cf000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f31c8114de0 con 0x7f31c810b330 2024-09-11T01:18:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.627+0000 7f31cf000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81150e0 con 0x7f31c8104fa0 2024-09-11T01:18:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.628+0000 7f31cd000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31c810b330 0x7f31c81a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.628+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c8104fa0 0x7f31c819b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.628+0000 7f31cd000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31c810b330 0x7f31c81a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:54592/0 (socket says 172.21.15.103:54592) 2024-09-11T01:18:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.628+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c8104fa0 0x7f31c819b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:56344/0 (socket says 172.21.15.103:56344) 2024-09-11T01:18:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.628+0000 7f31cd000640 1 -- 172.21.15.103:0/3707331843 learned_addr learned my addr 172.21.15.103:0/3707331843 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.628+0000 7f31bfe00640 1 --2- 172.21.15.103:0/3707331843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31c810a9b0 0x7f31c819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.628+0000 7f31cd000640 1 -- 172.21.15.103:0/3707331843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c8104fa0 msgr2=0x7f31c819b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.628+0000 7f31cd000640 1 --2- 172.21.15.103:0/3707331843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c8104fa0 0x7f31c819b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.628+0000 7f31cd000640 1 -- 172.21.15.103:0/3707331843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31c810a9b0 msgr2=0x7f31c819b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.628+0000 7f31cd000640 1 --2- 172.21.15.103:0/3707331843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31c810a9b0 0x7f31c819b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.628+0000 7f31cd000640 1 -- 172.21.15.103:0/3707331843 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c81a1540 con 0x7f31c810b330 2024-09-11T01:18:01.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.628+0000 7f31cd000640 1 --2- 172.21.15.103:0/3707331843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31c810b330 0x7f31c81a0d70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009b30 tx=0x7f31c0003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:01.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.629+0000 7f31c5600640 1 -- 172.21.15.103:0/3707331843 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0040020 con 0x7f31c810b330 2024-09-11T01:18:01.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.629+0000 7f31c5600640 1 -- 172.21.15.103:0/3707331843 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31c0030970 con 0x7f31c810b330 2024-09-11T01:18:01.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.629+0000 7f31cf000640 1 -- 172.21.15.103:0/3707331843 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31c81a17d0 con 0x7f31c810b330 2024-09-11T01:18:01.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.629+0000 7f31c5600640 1 -- 172.21.15.103:0/3707331843 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c0036040 con 0x7f31c810b330 2024-09-11T01:18:01.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.629+0000 7f31cf000640 1 -- 172.21.15.103:0/3707331843 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31c81a7ef0 con 0x7f31c810b330 2024-09-11T01:18:01.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.632+0000 7f31d1c05740 1 Processor -- start 2024-09-11T01:18:01.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.632+0000 7f31c5600640 1 -- 172.21.15.103:0/3707331843 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f31c0004500 con 0x7f31c810b330 2024-09-11T01:18:01.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.632+0000 7f31d1c05740 1 -- start start 2024-09-11T01:18:01.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.632+0000 7f31d1c05740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f0a0 0x564d42a0f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.632+0000 7f31d1c05740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a0f9c0 0x564d42a1b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.632+0000 7f31d1c05740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a1b950 0x564d42a1dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.632+0000 7f31d1c05740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564d42986ff0 con 0x564d42a0f0a0 2024-09-11T01:18:01.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.632+0000 7f31d1c05740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564d42976420 con 0x564d42a1b950 2024-09-11T01:18:01.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.632+0000 7f31d1c05740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564d4297a230 con 0x564d42a0f9c0 2024-09-11T01:18:01.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.633+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a0f9c0 0x564d42a1b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.633+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a0f9c0 0x564d42a1b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:56360/0 (socket says 172.21.15.103:56360) 2024-09-11T01:18:01.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.633+0000 7f31c7e00640 1 -- 172.21.15.103:0/3672088380 learned_addr learned my addr 172.21.15.103:0/3672088380 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:01.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.633+0000 7f31bfe00640 1 --2- 172.21.15.103:0/3672088380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f0a0 0x564d42a0f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.633+0000 7f31bfe00640 1 --2- 172.21.15.103:0/3672088380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a1b950 0x564d42a1dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.633+0000 7f31c7e00640 1 -- 172.21.15.103:0/3672088380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a1b950 msgr2=0x564d42a1dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.633+0000 7f31c7e00640 1 --2- 172.21.15.103:0/3672088380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a1b950 0x564d42a1dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.633+0000 7f31c7e00640 1 -- 172.21.15.103:0/3672088380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f0a0 msgr2=0x564d42a0f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.633+0000 7f31c7e00640 1 --2- 172.21.15.103:0/3672088380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f0a0 0x564d42a0f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.633+0000 7f31c7e00640 1 -- 172.21.15.103:0/3672088380 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d426d48b0 con 0x564d42a0f9c0 2024-09-11T01:18:01.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.633+0000 7f31bfe00640 1 --2- 172.21.15.103:0/3672088380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a1b950 0x564d42a1dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:18:01.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.633+0000 7f31c7e00640 1 --2- 172.21.15.103:0/3672088380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a0f9c0 0x564d42a1b410 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009d20 tx=0x7f31b8011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5440aee87434e5ba server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:01.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.634+0000 7f31c5600640 1 --2- 172.21.15.103:0/3707331843 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f31ac0b5360 0x7f31ac0b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.634+0000 7f31bd600640 1 -- 172.21.15.103:0/3672088380 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8004230 con 0x564d42a0f9c0 2024-09-11T01:18:01.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.634+0000 7f31bd600640 1 -- 172.21.15.103:0/3672088380 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31b80043d0 con 0x564d42a0f9c0 2024-09-11T01:18:01.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.634+0000 7f31bd600640 1 -- 172.21.15.103:0/3672088380 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8019860 con 0x564d42a0f9c0 2024-09-11T01:18:01.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.634+0000 7f31c5600640 1 -- 172.21.15.103:0/3707331843 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f31c0106dd0 con 0x7f31c810b330 2024-09-11T01:18:01.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.634+0000 7f31bfe00640 1 --2- 172.21.15.103:0/3707331843 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f31ac0b5360 0x7f31ac0b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.634+0000 7f31d1c05740 1 -- 172.21.15.103:0/3672088380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a0f9c0 msgr2=0x564d42a1b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.634+0000 7f31d1c05740 1 --2- 172.21.15.103:0/3672088380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a0f9c0 0x564d42a1b410 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f31b8009d20 tx=0x7f31b8011810 comp rx=0 tx=0).stop 2024-09-11T01:18:01.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.635+0000 7f31bfe00640 1 --2- 172.21.15.103:0/3707331843 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f31ac0b5360 0x7f31ac0b7820 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009fd0 tx=0x7f31b0009640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:01.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.635+0000 7f31d1c05740 1 -- 172.21.15.103:0/3672088380 shutdown_connections 2024-09-11T01:18:01.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.635+0000 7f31d1c05740 1 --2- 172.21.15.103:0/3672088380 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a1b950 0x564d42a1dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.635+0000 7f31d1c05740 1 --2- 172.21.15.103:0/3672088380 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a0f9c0 0x564d42a1b410 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.635+0000 7f31d1c05740 1 --2- 172.21.15.103:0/3672088380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f0a0 0x564d42a0f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.635+0000 7f31d1c05740 1 -- 172.21.15.103:0/3672088380 >> 172.21.15.103:0/3672088380 conn(0x564d42a0ced0 msgr2=0x564d42a0e070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:01.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.635+0000 7f31d1c05740 1 -- 172.21.15.103:0/3672088380 shutdown_connections 2024-09-11T01:18:01.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.635+0000 7f31d1c05740 1 -- 172.21.15.103:0/3672088380 wait complete. 2024-09-11T01:18:01.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.635+0000 7f31d1c05740 1 -- start start 2024-09-11T01:18:01.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.635+0000 7f31d1c05740 1 Processor -- start 2024-09-11T01:18:01.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31d1c05740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a0f0a0 0x564d42a1b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31d1c05740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f9c0 0x564d42a18650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31d1c05740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a1b950 0x564d42a18c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31d1c05740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564d427d7810 con 0x564d42a0f9c0 2024-09-11T01:18:01.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31d1c05740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x564d42911550 con 0x564d42a0f0a0 2024-09-11T01:18:01.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31d1c05740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x564d42a1e600 con 0x564d42a1b950 2024-09-11T01:18:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31d1c05740 10 client.0 _ll_register_callbacks cb 0x564d42921040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:18:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a0f0a0 0x564d42a1b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31bfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f9c0 0x564d42a18650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a0f0a0 0x564d42a1b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:54612/0 (socket says 172.21.15.103:54612) 2024-09-11T01:18:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31c7e00640 1 -- 172.21.15.103:0/2548803386 learned_addr learned my addr 172.21.15.103:0/2548803386 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31cd000640 1 --2- 172.21.15.103:0/2548803386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a1b950 0x564d42a18c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31c7e00640 1 -- 172.21.15.103:0/2548803386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a1b950 msgr2=0x564d42a18c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31c7e00640 1 --2- 172.21.15.103:0/2548803386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a1b950 0x564d42a18c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31c7e00640 1 -- 172.21.15.103:0/2548803386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f9c0 msgr2=0x564d42a18650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31c7e00640 1 --2- 172.21.15.103:0/2548803386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f9c0 0x564d42a18650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31c7e00640 1 -- 172.21.15.103:0/2548803386 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d42903200 con 0x564d42a0f0a0 2024-09-11T01:18:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.636+0000 7f31cd000640 1 --2- 172.21.15.103:0/2548803386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a1b950 0x564d42a18c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:18:01.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.637+0000 7f31c7e00640 1 --2- 172.21.15.103:0/2548803386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a0f0a0 0x564d42a1b200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f31b8019520 tx=0x7f31b80038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=964a82f91291acae server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.637+0000 7f31b6000640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:18:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.637+0000 7f31b6000640 1 -- 172.21.15.103:0/2548803386 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8027070 con 0x564d42a0f0a0 2024-09-11T01:18:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.637+0000 7f31d1c05740 1 -- 172.21.15.103:0/2548803386 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31b80043d0 con 0x564d42a0f0a0 2024-09-11T01:18:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.637+0000 7f31b6000640 1 -- 172.21.15.103:0/2548803386 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f31b8005240 con 0x564d42a0f0a0 2024-09-11T01:18:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.637+0000 7f31b6000640 1 -- 172.21.15.103:0/2548803386 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f31b8033050 con 0x564d42a0f0a0 2024-09-11T01:18:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.637+0000 7f31d1c05740 10 client.26207 fetch_fsmap learned FSMap version 33 2024-09-11T01:18:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.637+0000 7f31d1c05740 1 -- 172.21.15.103:0/2548803386 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564d42a29f70 con 0x564d42a0f0a0 2024-09-11T01:18:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.638+0000 7f31b6000640 1 -- 172.21.15.103:0/2548803386 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31b80043d0 con 0x564d42a0f0a0 2024-09-11T01:18:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.638+0000 7f31b6000640 1 -- 172.21.15.103:0/2548803386 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f31b8004b70 con 0x564d42a0f0a0 2024-09-11T01:18:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.638+0000 7f31d1c05740 10 client.26207 fetch_fsmap finished waiting for FSMap version 33 2024-09-11T01:18:01.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.638+0000 7f31d1c05740 10 client.26207 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:18:01.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.638+0000 7f31d1c05740 20 client.26207 populate_metadata read hostname 'smithi103' 2024-09-11T01:18:01.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.638+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2548803386 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564d42a2b380 0x564d42a2d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.638+0000 7f31d1c05740 4 client.26207 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-11T01:18:01.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.638+0000 7f31d1c05740 1 -- 172.21.15.103:0/2548803386 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d42988f40 con 0x564d42a2b380 2024-09-11T01:18:01.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.638+0000 7f31bfe00640 1 --2- 172.21.15.103:0/2548803386 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564d42a2b380 0x564d42a2d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.639+0000 7f31bfe00640 1 --2- 172.21.15.103:0/2548803386 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564d42a2b380 0x564d42a2d770 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd533eff73505775 server_cookie=ff82e8c9d8fa809e in_seq=0 out_seq=0 2024-09-11T01:18:01.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.639+0000 7f31b6000640 10 client.26207 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:18:01.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.639+0000 7f31b6000640 1 -- 172.21.15.103:0/2548803386 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564d42988f40 con 0x564d42a2b380 2024-09-11T01:18:01.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.639+0000 7f31b6000640 10 client.26207 handle_command_reply: tid=0 2024-09-11T01:18:01.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.639+0000 7f31d1c05740 1 client.26207 shutdown 2024-09-11T01:18:01.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.640+0000 7f31d1c05740 1 -- 172.21.15.103:0/2548803386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a0f0a0 msgr2=0x564d42a1b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.640+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2548803386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a0f0a0 0x564d42a1b200 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f31b8019520 tx=0x7f31b80038a0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.640+0000 7f31d1c05740 1 -- 172.21.15.103:0/2548803386 shutdown_connections 2024-09-11T01:18:01.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.640+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2548803386 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564d42a2b380 0x564d42a2d770 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.640+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2548803386 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a1b950 0x564d42a18c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.640+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2548803386 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f9c0 0x564d42a18650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.640+0000 7f31b6000640 0 client.26207 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:18:01.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.640+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2548803386 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a0f0a0 0x564d42a1b200 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.640+0000 7f31d1c05740 1 -- 172.21.15.103:0/2548803386 >> 172.21.15.103:0/2548803386 conn(0x564d42a0ced0 msgr2=0x564d42a12a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:01.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.640+0000 7f31d1c05740 1 -- 172.21.15.103:0/2548803386 shutdown_connections 2024-09-11T01:18:01.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.640+0000 7f31d1c05740 1 -- 172.21.15.103:0/2548803386 wait complete. 2024-09-11T01:18:01.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.640+0000 7f31d1c05740 20 client.26207 trim_cache size 0 max 16384 2024-09-11T01:18:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.658+0000 7f31d1c05740 1 Processor -- start 2024-09-11T01:18:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.658+0000 7f31d1c05740 1 -- start start 2024-09-11T01:18:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.658+0000 7f31d1c05740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f0a0 0x564d42a0c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.658+0000 7f31d1c05740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a0f9c0 0x564d42a1cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.658+0000 7f31d1c05740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a1b950 0x564d42a1d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.658+0000 7f31d1c05740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81b46e0 con 0x564d42a0f0a0 2024-09-11T01:18:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.658+0000 7f31d1c05740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81b1f20 con 0x564d42a1b950 2024-09-11T01:18:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.658+0000 7f31d1c05740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81afd70 con 0x564d42a0f9c0 2024-09-11T01:18:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.659+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f0a0 0x564d42a0c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.659+0000 7f31bfe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a0f9c0 0x564d42a1cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.659+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f0a0 0x564d42a0c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38068/0 (socket says 172.21.15.103:38068) 2024-09-11T01:18:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.659+0000 7f31c7e00640 1 -- 172.21.15.103:0/2011402187 learned_addr learned my addr 172.21.15.103:0/2011402187 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.659+0000 7f31cd000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a1b950 0x564d42a1d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.659+0000 7f31c7e00640 1 -- 172.21.15.103:0/2011402187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a0f9c0 msgr2=0x564d42a1cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.659+0000 7f31c7e00640 1 --2- 172.21.15.103:0/2011402187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a0f9c0 0x564d42a1cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.659+0000 7f31c7e00640 1 -- 172.21.15.103:0/2011402187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a1b950 msgr2=0x564d42a1d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.659+0000 7f31c7e00640 1 --2- 172.21.15.103:0/2011402187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a1b950 0x564d42a1d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.659+0000 7f31c7e00640 1 -- 172.21.15.103:0/2011402187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d42a13350 con 0x564d42a0f0a0 2024-09-11T01:18:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.659+0000 7f31c7e00640 1 --2- 172.21.15.103:0/2011402187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f0a0 0x564d42a0c820 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f31b8019710 tx=0x7f31b8019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7431323b42eeb721 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.660+0000 7f31bcc00640 1 -- 172.21.15.103:0/2011402187 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b803c070 con 0x564d42a0f0a0 2024-09-11T01:18:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.660+0000 7f31bcc00640 1 -- 172.21.15.103:0/2011402187 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31b8003ca0 con 0x564d42a0f0a0 2024-09-11T01:18:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.660+0000 7f31bcc00640 1 -- 172.21.15.103:0/2011402187 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8027040 con 0x564d42a0f0a0 2024-09-11T01:18:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.660+0000 7f31d1c05740 1 -- 172.21.15.103:0/2011402187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f0a0 msgr2=0x564d42a0c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.660+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2011402187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f0a0 0x564d42a0c820 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f31b8019710 tx=0x7f31b8019610 comp rx=0 tx=0).stop 2024-09-11T01:18:01.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.660+0000 7f31d1c05740 1 -- 172.21.15.103:0/2011402187 shutdown_connections 2024-09-11T01:18:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.660+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2011402187 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a1b950 0x564d42a1d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.660+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2011402187 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a0f9c0 0x564d42a1cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.660+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2011402187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f0a0 0x564d42a0c820 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.660+0000 7f31d1c05740 1 -- 172.21.15.103:0/2011402187 >> 172.21.15.103:0/2011402187 conn(0x564d42a0ced0 msgr2=0x564d42a1a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.660+0000 7f31d1c05740 1 -- 172.21.15.103:0/2011402187 shutdown_connections 2024-09-11T01:18:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.660+0000 7f31d1c05740 1 -- 172.21.15.103:0/2011402187 wait complete. 2024-09-11T01:18:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.661+0000 7f31d1c05740 1 -- start start 2024-09-11T01:18:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.661+0000 7f31d1c05740 1 Processor -- start 2024-09-11T01:18:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.661+0000 7f31d1c05740 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a0f0a0 0x564d42a23c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.661+0000 7f31d1c05740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f9c0 0x564d42a241e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.661+0000 7f31d1c05740 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a1b950 0x564d42a1e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.661+0000 7f31d1c05740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81b03e0 con 0x564d42a0f9c0 2024-09-11T01:18:01.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.661+0000 7f31d1c05740 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81b1850 con 0x564d42a0f0a0 2024-09-11T01:18:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.661+0000 7f31d1c05740 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f31c81b0ab0 con 0x564d42a1b950 2024-09-11T01:18:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.662+0000 7f31d1c05740 10 client.0 _ll_register_callbacks cb 0x7f31b8009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-11T01:18:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.662+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a0f0a0 0x564d42a23c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.662+0000 7f31bfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f9c0 0x564d42a241e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.662+0000 7f31c7e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a0f0a0 0x564d42a23c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:54636/0 (socket says 172.21.15.103:54636) 2024-09-11T01:18:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.662+0000 7f31bfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f9c0 0x564d42a241e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38072/0 (socket says 172.21.15.103:38072) 2024-09-11T01:18:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.662+0000 7f31c7e00640 1 -- 172.21.15.103:0/2658261868 learned_addr learned my addr 172.21.15.103:0/2658261868 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.662+0000 7f31cd000640 1 --2- 172.21.15.103:0/2658261868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a1b950 0x564d42a1e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.662+0000 7f31c7e00640 1 -- 172.21.15.103:0/2658261868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a1b950 msgr2=0x564d42a1e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.662+0000 7f31c7e00640 1 --2- 172.21.15.103:0/2658261868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a1b950 0x564d42a1e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.662+0000 7f31c7e00640 1 -- 172.21.15.103:0/2658261868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f9c0 msgr2=0x564d42a241e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-11T01:18:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.662+0000 7f31c7e00640 1 --2- 172.21.15.103:0/2658261868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f9c0 0x564d42a241e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.662+0000 7f31c7e00640 1 -- 172.21.15.103:0/2658261868 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d42a1e130 con 0x564d42a0f0a0 2024-09-11T01:18:01.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.662+0000 7f31bfe00640 1 --2- 172.21.15.103:0/2658261868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f9c0 0x564d42a241e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:18:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.663+0000 7f31c7e00640 1 --2- 172.21.15.103:0/2658261868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a0f0a0 0x564d42a23c60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31b8006010 tx=0x7f31b8019790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17eafe5b2a16b323 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.663+0000 7f31b6000640 10 client.0 ms_handle_connect on v2:172.21.15.117:3300/0 2024-09-11T01:18:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.663+0000 7f31b6000640 1 -- 172.21.15.103:0/2658261868 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b8045060 con 0x564d42a0f0a0 2024-09-11T01:18:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.663+0000 7f31b6000640 1 -- 172.21.15.103:0/2658261868 <== mon.2 v2:172.21.15.117:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f31b8005000 con 0x564d42a0f0a0 2024-09-11T01:18:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.663+0000 7f31d1c05740 1 -- 172.21.15.103:0/2658261868 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f31b8003ca0 con 0x564d42a0f0a0 2024-09-11T01:18:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.663+0000 7f31b6000640 1 -- 172.21.15.103:0/2658261868 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f31b804c050 con 0x564d42a0f0a0 2024-09-11T01:18:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.663+0000 7f31d1c05740 10 client.26213 fetch_fsmap learned FSMap version 33 2024-09-11T01:18:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.663+0000 7f31d1c05740 1 -- 172.21.15.103:0/2658261868 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564d42aa1460 con 0x564d42a0f0a0 2024-09-11T01:18:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.663+0000 7f31b6000640 1 -- 172.21.15.103:0/2658261868 <== mon.2 v2:172.21.15.117:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f31b8003ca0 con 0x564d42a0f0a0 2024-09-11T01:18:01.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.664+0000 7f31b6000640 1 -- 172.21.15.103:0/2658261868 <== mon.2 v2:172.21.15.117:3300/0 5 ==== fsmap(e 33) ==== 8370+0+0 (secure 0 0 0) 0x7f31b8023620 con 0x564d42a0f0a0 2024-09-11T01:18:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.664+0000 7f31d1c05740 10 client.26213 fetch_fsmap finished waiting for FSMap version 33 2024-09-11T01:18:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.664+0000 7f31d1c05740 10 client.26213 resolve_mds: validated gid 24665 aka daemon mds.b 2024-09-11T01:18:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.664+0000 7f31d1c05740 20 client.26213 populate_metadata read hostname 'smithi103' 2024-09-11T01:18:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.664+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2658261868 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564d42aa1ad0 0x564d42aa3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.664+0000 7f31d1c05740 4 client.26213 mds_command: new command op to 24665 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-11T01:18:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.664+0000 7f31d1c05740 1 -- 172.21.15.103:0/2658261868 --> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x564d429849f0 con 0x564d42aa1ad0 2024-09-11T01:18:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.664+0000 7f31bfe00640 1 --2- 172.21.15.103:0/2658261868 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564d42aa1ad0 0x564d42aa3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.664+0000 7f31bfe00640 1 --2- 172.21.15.103:0/2658261868 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564d42aa1ad0 0x564d42aa3ef0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c7933e060959150 server_cookie=c7c816ac2373ef22 in_seq=0 out_seq=0 2024-09-11T01:18:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.664+0000 7f31b6000640 10 client.26213 ms_handle_connect on v2:172.21.15.117:6838/1820809235 2024-09-11T01:18:01.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31b6000640 1 -- 172.21.15.103:0/2658261868 <== mds.0 v2:172.21.15.117:6838/1820809235 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x564d429849f0 con 0x564d42aa1ad0 2024-09-11T01:18:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31b6000640 10 client.26213 handle_command_reply: tid=0 2024-09-11T01:18:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31d1c05740 1 client.26213 shutdown 2024-09-11T01:18:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31d1c05740 1 -- 172.21.15.103:0/2658261868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a0f0a0 msgr2=0x564d42a23c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2658261868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a0f0a0 0x564d42a23c60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f31b8006010 tx=0x7f31b8019790 comp rx=0 tx=0).stop 2024-09-11T01:18:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31d1c05740 1 -- 172.21.15.103:0/2658261868 shutdown_connections 2024-09-11T01:18:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2658261868 >> [v2:172.21.15.117:6838/1820809235,v1:172.21.15.117:6839/1820809235] conn(0x564d42aa1ad0 0x564d42aa3ef0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31b6000640 0 client.26213 ms_handle_reset on v2:172.21.15.117:6838/1820809235 2024-09-11T01:18:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2658261868 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x564d42a1b950 0x564d42a1e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2658261868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564d42a0f9c0 0x564d42a241e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31d1c05740 1 --2- 172.21.15.103:0/2658261868 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x564d42a0f0a0 0x564d42a23c60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31d1c05740 1 -- 172.21.15.103:0/2658261868 >> 172.21.15.103:0/2658261868 conn(0x564d42a0ced0 msgr2=0x564d42a19c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31d1c05740 1 -- 172.21.15.103:0/2658261868 shutdown_connections 2024-09-11T01:18:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31d1c05740 1 -- 172.21.15.103:0/2658261868 wait complete. 2024-09-11T01:18:01.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.665+0000 7f31d1c05740 20 client.26213 trim_cache size 0 max 16384 2024-09-11T01:18:01.676 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:18:01.676 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 33, 2024-09-11T01:18:01.676 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24665, 2024-09-11T01:18:01.676 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 21, 2024-09-11T01:18:01.676 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": {} 2024-09-11T01:18:01.676 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:18:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.666+0000 7f31cf000640 1 -- 172.21.15.103:0/3707331843 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f31ac0b5360 msgr2=0x7f31ac0b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.666+0000 7f31cf000640 1 --2- 172.21.15.103:0/3707331843 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f31ac0b5360 0x7f31ac0b7820 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009fd0 tx=0x7f31b0009640 comp rx=0 tx=0).stop 2024-09-11T01:18:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.666+0000 7f31cf000640 1 -- 172.21.15.103:0/3707331843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31c810b330 msgr2=0x7f31c81a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:01.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.666+0000 7f31cf000640 1 --2- 172.21.15.103:0/3707331843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31c810b330 0x7f31c81a0d70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009b30 tx=0x7f31c0003c10 comp rx=0 tx=0).stop 2024-09-11T01:18:01.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.666+0000 7f31cf000640 1 -- 172.21.15.103:0/3707331843 shutdown_connections 2024-09-11T01:18:01.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.666+0000 7f31cf000640 1 --2- 172.21.15.103:0/3707331843 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f31ac0b5360 0x7f31ac0b7820 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.666+0000 7f31cf000640 1 --2- 172.21.15.103:0/3707331843 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31c810b330 0x7f31c81a0d70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.666+0000 7f31cf000640 1 --2- 172.21.15.103:0/3707331843 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31c810a9b0 0x7f31c819b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.666+0000 7f31cf000640 1 --2- 172.21.15.103:0/3707331843 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f31c8104fa0 0x7f31c819b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:01.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.666+0000 7f31cf000640 1 -- 172.21.15.103:0/3707331843 >> 172.21.15.103:0/3707331843 conn(0x7f31c8100a50 msgr2=0x7f31c8102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:01.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.666+0000 7f31cf000640 1 -- 172.21.15.103:0/3707331843 shutdown_connections 2024-09-11T01:18:01.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:01.666+0000 7f31cf000640 1 -- 172.21.15.103:0/3707331843 wait complete. 2024-09-11T01:18:02.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:02 smithi117 ceph-mon[35358]: pgmap v691: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-11T01:18:02.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:02 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:02 smithi183 ceph-mon[34992]: pgmap v691: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-11T01:18:02.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.419 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:02 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.471 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.471 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.471 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:02 smithi103 ceph-mon[30562]: pgmap v691: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.8 KiB/s wr, 9 op/s 2024-09-11T01:18:02.471 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.471 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.471 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.471 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:02 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:02.507 INFO:tasks.quiescer:done joining Quiescers 2024-09-11T01:18:02.508 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-11T01:18:02.516 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T01:18:02.527 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-11T01:18:02.537 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T01:18:02.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.750+0000 7fcf93600640 1 -- 172.21.15.103:0/3010958159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c1044a0 msgr2=0x7fcf8c10ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.750+0000 7fcf93600640 1 --2- 172.21.15.103:0/3010958159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c1044a0 0x7fcf8c10ae20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009860 tx=0x7fcf8402a340 comp rx=0 tx=0).stop 2024-09-11T01:18:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.751+0000 7fcf93600640 1 -- 172.21.15.103:0/3010958159 shutdown_connections 2024-09-11T01:18:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.751+0000 7fcf93600640 1 --2- 172.21.15.103:0/3010958159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c1044a0 0x7fcf8c10ae20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.751+0000 7fcf93600640 1 --2- 172.21.15.103:0/3010958159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf8c103ae0 0x7fcf8c103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.751+0000 7fcf93600640 1 --2- 172.21.15.103:0/3010958159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf8c102990 0x7fcf8c102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.751+0000 7fcf93600640 1 -- 172.21.15.103:0/3010958159 >> 172.21.15.103:0/3010958159 conn(0x7fcf8c0fe270 msgr2=0x7fcf8c100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.751+0000 7fcf93600640 1 -- 172.21.15.103:0/3010958159 shutdown_connections 2024-09-11T01:18:02.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.751+0000 7fcf93600640 1 -- 172.21.15.103:0/3010958159 wait complete. 2024-09-11T01:18:02.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.752+0000 7fcf93600640 1 Processor -- start 2024-09-11T01:18:02.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.752+0000 7fcf93600640 1 -- start start 2024-09-11T01:18:02.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.752+0000 7fcf93600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf8c102990 0x7fcf8c19aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:02.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.752+0000 7fcf93600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c103ae0 0x7fcf8c19b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:02.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.752+0000 7fcf93600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf8c1044a0 0x7fcf8c19c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:02.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.752+0000 7fcf93600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8c10e600 con 0x7fcf8c1044a0 2024-09-11T01:18:02.758 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.752+0000 7fcf93600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8c10e480 con 0x7fcf8c103ae0 2024-09-11T01:18:02.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.752+0000 7fcf93600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8c10e780 con 0x7fcf8c102990 2024-09-11T01:18:02.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.753+0000 7fcf91600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf8c1044a0 0x7fcf8c19c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:02.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.753+0000 7fcf8be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c103ae0 0x7fcf8c19b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:02.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.753+0000 7fcf8be00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c103ae0 0x7fcf8c19b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:54656/0 (socket says 172.21.15.103:54656) 2024-09-11T01:18:02.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.753+0000 7fcf90c00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf8c102990 0x7fcf8c19aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:02.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.753+0000 7fcf8be00640 1 -- 172.21.15.103:0/3918165083 learned_addr learned my addr 172.21.15.103:0/3918165083 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:02.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.753+0000 7fcf8be00640 1 -- 172.21.15.103:0/3918165083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf8c102990 msgr2=0x7fcf8c19aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:02.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.753+0000 7fcf8be00640 1 --2- 172.21.15.103:0/3918165083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf8c102990 0x7fcf8c19aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:02.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.753+0000 7fcf8be00640 1 -- 172.21.15.103:0/3918165083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf8c1044a0 msgr2=0x7fcf8c19c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:02.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.753+0000 7fcf8be00640 1 --2- 172.21.15.103:0/3918165083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf8c1044a0 0x7fcf8c19c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:02.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.753+0000 7fcf8be00640 1 -- 172.21.15.103:0/3918165083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8c19ca30 con 0x7fcf8c103ae0 2024-09-11T01:18:02.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.753+0000 7fcf8be00640 1 --2- 172.21.15.103:0/3918165083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c103ae0 0x7fcf8c19b540 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400e9f0 tx=0x7fcf7400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:02.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.754+0000 7fcf89600640 1 -- 172.21.15.103:0/3918165083 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf7400cd80 con 0x7fcf8c103ae0 2024-09-11T01:18:02.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.754+0000 7fcf89600640 1 -- 172.21.15.103:0/3918165083 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcf740054d0 con 0x7fcf8c103ae0 2024-09-11T01:18:02.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.754+0000 7fcf89600640 1 -- 172.21.15.103:0/3918165083 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf74010690 con 0x7fcf8c103ae0 2024-09-11T01:18:02.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.754+0000 7fcf93600640 1 -- 172.21.15.103:0/3918165083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8c19cd20 con 0x7fcf8c103ae0 2024-09-11T01:18:02.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.754+0000 7fcf93600640 1 -- 172.21.15.103:0/3918165083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf8c1a33f0 con 0x7fcf8c103ae0 2024-09-11T01:18:02.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.755+0000 7fcf93600640 1 -- 172.21.15.103:0/3918165083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf8c1a35c0 con 0x7fcf8c103ae0 2024-09-11T01:18:02.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.757+0000 7fcf89600640 1 -- 172.21.15.103:0/3918165083 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7fcf74004e90 con 0x7fcf8c103ae0 2024-09-11T01:18:02.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.758+0000 7fcf89600640 1 --2- 172.21.15.103:0/3918165083 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcf700b52e0 0x7fcf700b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:02.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.759+0000 7fcf89600640 1 -- 172.21.15.103:0/3918165083 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fcf740e63f0 con 0x7fcf8c103ae0 2024-09-11T01:18:02.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.759+0000 7fcf90c00640 1 --2- 172.21.15.103:0/3918165083 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcf700b52e0 0x7fcf700b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:02.761 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.759+0000 7fcf90c00640 1 --2- 172.21.15.103:0/3918165083 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcf700b52e0 0x7fcf700b77a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c005fd0 tx=0x7fcf7c010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:02.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.762+0000 7fcf89600640 1 -- 172.21.15.103:0/3918165083 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fcf740acea0 con 0x7fcf8c103ae0 2024-09-11T01:18:02.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.950+0000 7fcf93600640 1 -- 172.21.15.103:0/3918165083 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf8c1a3bf0 con 0x7fcf8c103ae0 2024-09-11T01:18:02.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.952+0000 7fcf89600640 1 -- 172.21.15.103:0/3918165083 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24984 (secure 0 0 0) 0x7fcf740ac7a0 con 0x7fcf8c103ae0 2024-09-11T01:18:02.954 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:18:02.954 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","created":"2024-09-11T00:56:46.242882+0000","modified":"2024-09-11T01:06:41.586918+0000","last_up_change":"2024-09-11T01:04:34.895368+0000","last_in_change":"2024-09-11T01:04:11.663436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:00:33.745338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T01:05:27.486014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T01:05:29.797513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T01:05:38.956635+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1b3e4222-43fd-4af0-bf97-3ba1000221b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6803","nonce":1867193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6805","nonce":1867193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6809","nonce":1867193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6807","nonce":1867193874}]},"public_addr":"172.21.15.103:6803/1867193874","cluster_addr":"172.21.15.103:6805/1867193874","heartbeat_back_addr":"172.21.15.103:6809/1867193874","heartbeat_front_addr":"172.21.15.103:6807/1867193874","state":["exists","up"]},{"osd":1,"uuid":"9a2b40da-7361-4c4f-a9dc-a769b427a0fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6801","nonce":2629532556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6803","nonce":2629532556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6807","nonce":2629532556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6805","nonce":2629532556}]},"public_addr":"172.21.15.117:6801/2629532556","cluster_addr":"172.21.15.117:6803/2629532556","heartbeat_back_addr":"172.21.15.117:6807/2629532556","heartbeat_front_addr":"172.21.15.117:6805/2629532556","state":["exists","up"]},{"osd":2,"uuid":"5db919c1-90a7-4ba7-acf3-89eeb77ae131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6801","nonce":3208966770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6803","nonce":3208966770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6807","nonce":3208966770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6805","nonce":3208966770}]},"public_addr":"172.21.15.183:6801/3208966770","cluster_addr":"172.21.15.183:6803/3208966770","heartbeat_back_addr":"172.21.15.183:6807/3208966770","heartbeat_front_addr":"172.21.15.183:6805/3208966770","state":["exists","up"]},{"osd":3,"uuid":"bdc465f2-06a5-4667-9651-4e168700d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6811","nonce":2238128162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6813","nonce":2238128162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6817","nonce":2238128162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6815","nonce":2238128162}]},"public_addr":"172.21.15.103:6811/2238128162","cluster_addr":"172.21.15.103:6813/2238128162","heartbeat_back_addr":"172.21.15.103:6817/2238128162","heartbeat_front_addr":"172.21.15.103:6815/2238128162","state":["exists","up"]},{"osd":4,"uuid":"be86a5d2-5e86-4bf4-8464-9dff7a801e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6809","nonce":2368878504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6811","nonce":2368878504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6815","nonce":2368878504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6813","nonce":2368878504}]},"public_addr":"172.21.15.117:6809/2368878504","cluster_addr":"172.21.15.117:6811/2368878504","heartbeat_back_addr":"172.21.15.117:6815/2368878504","heartbeat_front_addr":"172.21.15.117:6813/2368878504","state":["exists","up"]},{"osd":5,"uuid":"090b20ec-d9ff-4e10-ad9f-52ab41dbf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6809","nonce":1668069547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6811","nonce":1668069547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6815","nonce":1668069547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6813","nonce":1668069547}]},"public_addr":"172.21.15.183:6809/1668069547","cluster_addr":"172.21.15.183:6811/1668069547","heartbeat_back_addr":"172.21.15.183:6815/1668069547","heartbeat_front_addr":"172.21.15.183:6813/1668069547","state":["exists","up"]},{"osd":6,"uuid":"19abe982-3522-40f9-a628-ddaef462cdb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6819","nonce":4203476972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6821","nonce":4203476972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6825","nonce":4203476972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6823","nonce":4203476972}]},"public_addr":"172.21.15.103:6819/4203476972","cluster_addr":"172.21.15.103:6821/4203476972","heartbeat_back_addr":"172.21.15.103:6825/4203476972","heartbeat_front_addr":"172.21.15.103:6823/4203476972","state":["exists","up"]},{"osd":7,"uuid":"e875ff09-805a-40ff-9d6a-dd2607ce3432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6817","nonce":1207680713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6819","nonce":1207680713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6823","nonce":1207680713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6821","nonce":1207680713}]},"public_addr":"172.21.15.117:6817/1207680713","cluster_addr":"172.21.15.117:6819/1207680713","heartbeat_back_addr":"172.21.15.117:6823/1207680713","heartbeat_front_addr":"172.21.15.117:6821/1207680713","state":["exists","up"]},{"osd":8,"uuid":"2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6817","nonce":2935820593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6819","nonce":2935820593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6823","nonce":2935820593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6821","nonce":2935820593}]},"public_addr":"172.21.15.183:6817/2935820593","cluster_addr":"172.21.15.183:6819/2935820593","heartbeat_back_addr":"172.21.15.183:6823/2935820593","heartbeat_front_addr":"172.21.15.183:6821/2935820593","state":["exists","up"]},{"osd":9,"uuid":"c36d17d2-0bc8-4322-a998-9c8eff970e58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6827","nonce":2104855877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6829","nonce":2104855877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6833","nonce":2104855877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6831","nonce":2104855877}]},"public_addr":"172.21.15.103:6827/2104855877","cluster_addr":"172.21.15.103:6829/2104855877","heartbeat_back_addr":"172.21.15.103:6833/2104855877","heartbeat_front_addr":"172.21.15.103:6831/2104855877","state":["exists","up"]},{"osd":10,"uuid":"e71bc5f7-a829-43cf-a10b-b2444da1d773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6825","nonce":3792981873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6827","nonce":3792981873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6831","nonce":3792981873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6829","nonce":3792981873}]},"public_addr":"172.21.15.117:6825/3792981873","cluster_addr":"172.21.15.117:6827/3792981873","heartbeat_back_addr":"172.21.15.117:6831/3792981873","heartbeat_front_addr":"172.21.15.117:6829/3792981873","state":["exists","up"]},{"osd":11,"uuid":"8f36697f-4d18-4efa-bf14-d68a13464958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6825","nonce":1250387289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6827","nonce":1250387289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6831","nonce":1250387289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6829","nonce":1250387289}]},"public_addr":"172.21.15.183:6825/1250387289","cluster_addr":"172.21.15.183:6827/1250387289","heartbeat_back_addr":"172.21.15.183:6831/1250387289","heartbeat_front_addr":"172.21.15.183:6829/1250387289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:59:39.916330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:06.042858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:30.703648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:59.493376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:25.190299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:50.480326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:20.815441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:46.398318+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:11.499922+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:41.895096+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:08.411538+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:32.943466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/366890372":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6800/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2372812363":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2844264136":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/2046654364":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6801/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/211510947":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6801/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6800/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/189409602":"2024-09-12T00:57:11.412015+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:18:02.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.954+0000 7fcf93600640 1 -- 172.21.15.103:0/3918165083 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcf700b52e0 msgr2=0x7fcf700b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:02.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.954+0000 7fcf93600640 1 --2- 172.21.15.103:0/3918165083 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcf700b52e0 0x7fcf700b77a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c005fd0 tx=0x7fcf7c010040 comp rx=0 tx=0).stop 2024-09-11T01:18:02.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.954+0000 7fcf93600640 1 -- 172.21.15.103:0/3918165083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c103ae0 msgr2=0x7fcf8c19b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:02.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.955+0000 7fcf93600640 1 --2- 172.21.15.103:0/3918165083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c103ae0 0x7fcf8c19b540 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400e9f0 tx=0x7fcf7400edf0 comp rx=0 tx=0).stop 2024-09-11T01:18:02.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.955+0000 7fcf93600640 1 -- 172.21.15.103:0/3918165083 shutdown_connections 2024-09-11T01:18:02.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.955+0000 7fcf93600640 1 --2- 172.21.15.103:0/3918165083 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fcf700b52e0 0x7fcf700b77a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:02.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.955+0000 7fcf93600640 1 --2- 172.21.15.103:0/3918165083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf8c1044a0 0x7fcf8c19c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:02.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.955+0000 7fcf93600640 1 --2- 172.21.15.103:0/3918165083 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcf8c103ae0 0x7fcf8c19b540 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:02.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.955+0000 7fcf93600640 1 --2- 172.21.15.103:0/3918165083 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fcf8c102990 0x7fcf8c19aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:02.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.955+0000 7fcf93600640 1 -- 172.21.15.103:0/3918165083 >> 172.21.15.103:0/3918165083 conn(0x7fcf8c0fe270 msgr2=0x7fcf8c075380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:02.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.955+0000 7fcf93600640 1 -- 172.21.15.103:0/3918165083 shutdown_connections 2024-09-11T01:18:02.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:02.955+0000 7fcf93600640 1 -- 172.21.15.103:0/3918165083 wait complete. 2024-09-11T01:18:02.973 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T01:00:33.745338+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-11T01:05:27.486014+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-11T01:05:29.797513+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-11T01:05:38.956635+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-11T01:18:02.974 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-11T01:18:03.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.140+0000 7f43cae00640 1 -- 172.21.15.103:0/499684855 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43c4105cb0 msgr2=0x7f43c4106130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:03.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.140+0000 7f43cae00640 1 --2- 172.21.15.103:0/499684855 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43c4105cb0 0x7f43c4106130 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f43b0009890 tx=0x7f43b002a360 comp rx=0 tx=0).stop 2024-09-11T01:18:03.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.140+0000 7f43cae00640 1 -- 172.21.15.103:0/499684855 shutdown_connections 2024-09-11T01:18:03.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.140+0000 7f43cae00640 1 --2- 172.21.15.103:0/499684855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43c4106670 0x7f43c410cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.140+0000 7f43cae00640 1 --2- 172.21.15.103:0/499684855 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43c4105cb0 0x7f43c4106130 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.140+0000 7f43cae00640 1 --2- 172.21.15.103:0/499684855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c4104b60 0x7f43c4104f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.140+0000 7f43cae00640 1 -- 172.21.15.103:0/499684855 >> 172.21.15.103:0/499684855 conn(0x7f43c4100400 msgr2=0x7f43c4102840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:03.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.140+0000 7f43cae00640 1 -- 172.21.15.103:0/499684855 shutdown_connections 2024-09-11T01:18:03.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.140+0000 7f43cae00640 1 -- 172.21.15.103:0/499684855 wait complete. 2024-09-11T01:18:03.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.141+0000 7f43cae00640 1 Processor -- start 2024-09-11T01:18:03.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.141+0000 7f43cae00640 1 -- start start 2024-09-11T01:18:03.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.141+0000 7f43cae00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c4104b60 0x7f43c419aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:03.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.141+0000 7f43cae00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43c4105cb0 0x7f43c419b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:03.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.141+0000 7f43cae00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43c4106670 0x7f43c419c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:03.144 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.141+0000 7f43cae00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f43c41107d0 con 0x7f43c4104b60 2024-09-11T01:18:03.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.141+0000 7f43cae00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f43c4110650 con 0x7f43c4105cb0 2024-09-11T01:18:03.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.141+0000 7f43cae00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f43c4110950 con 0x7f43c4106670 2024-09-11T01:18:03.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.141+0000 7f43c3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c4104b60 0x7f43c419aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:03.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.141+0000 7f43c3400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43c4105cb0 0x7f43c419b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:03.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.142+0000 7f43c3e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c4104b60 0x7f43c419aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38108/0 (socket says 172.21.15.103:38108) 2024-09-11T01:18:03.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.142+0000 7f43c3e00640 1 -- 172.21.15.103:0/600820724 learned_addr learned my addr 172.21.15.103:0/600820724 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:03.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.142+0000 7f43c3400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43c4105cb0 0x7f43c419b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:54676/0 (socket says 172.21.15.103:54676) 2024-09-11T01:18:03.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.142+0000 7f43c8e00640 1 --2- 172.21.15.103:0/600820724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43c4106670 0x7f43c419c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:03.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.142+0000 7f43c3400640 1 -- 172.21.15.103:0/600820724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43c4106670 msgr2=0x7f43c419c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:03.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.142+0000 7f43c3400640 1 --2- 172.21.15.103:0/600820724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43c4106670 0x7f43c419c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.142+0000 7f43c3400640 1 -- 172.21.15.103:0/600820724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c4104b60 msgr2=0x7f43c419aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:03.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.142+0000 7f43c3400640 1 --2- 172.21.15.103:0/600820724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c4104b60 0x7f43c419aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.145 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.142+0000 7f43c3400640 1 -- 172.21.15.103:0/600820724 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c419ca30 con 0x7f43c4105cb0 2024-09-11T01:18:03.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.142+0000 7f43c3400640 1 --2- 172.21.15.103:0/600820724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43c4105cb0 0x7f43c419b540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f43b002a880 tx=0x7f43b0032d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:03.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.142+0000 7f43c0c00640 1 -- 172.21.15.103:0/600820724 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0037040 con 0x7f43c4105cb0 2024-09-11T01:18:03.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.142+0000 7f43c0c00640 1 -- 172.21.15.103:0/600820724 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f43b0030520 con 0x7f43c4105cb0 2024-09-11T01:18:03.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.142+0000 7f43cae00640 1 -- 172.21.15.103:0/600820724 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c419ccc0 con 0x7f43c4105cb0 2024-09-11T01:18:03.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.143+0000 7f43c0c00640 1 -- 172.21.15.103:0/600820724 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b0003850 con 0x7f43c4105cb0 2024-09-11T01:18:03.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.143+0000 7f43cae00640 1 -- 172.21.15.103:0/600820724 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c41a33f0 con 0x7f43c4105cb0 2024-09-11T01:18:03.146 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.144+0000 7f43cae00640 1 -- 172.21.15.103:0/600820724 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c410be70 con 0x7f43c4105cb0 2024-09-11T01:18:03.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.146+0000 7f43c0c00640 1 -- 172.21.15.103:0/600820724 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f43b0030b20 con 0x7f43c4105cb0 2024-09-11T01:18:03.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.148+0000 7f43c0c00640 1 --2- 172.21.15.103:0/600820724 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f43a80b5360 0x7f43a80b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:03.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.148+0000 7f43c0c00640 1 -- 172.21.15.103:0/600820724 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f43b0105440 con 0x7f43c4105cb0 2024-09-11T01:18:03.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.148+0000 7f43c3e00640 1 --2- 172.21.15.103:0/600820724 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f43a80b5360 0x7f43a80b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:03.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.149+0000 7f43c3e00640 1 --2- 172.21.15.103:0/600820724 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f43a80b5360 0x7f43a80b7820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f43b4005c80 tx=0x7f43b4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:03.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.149+0000 7f43c0c00640 1 -- 172.21.15.103:0/600820724 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f43b004a060 con 0x7f43c4105cb0 2024-09-11T01:18:03.275 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:03 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3918165083' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:18:03.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.339+0000 7f43cae00640 1 -- 172.21.15.103:0/600820724 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f43c4063d50 con 0x7f43c4105cb0 2024-09-11T01:18:03.341 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.340+0000 7f43c0c00640 1 -- 172.21.15.103:0/600820724 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7f43b00cbf70 con 0x7f43c4105cb0 2024-09-11T01:18:03.342 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-09-11T01:18:03.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.343+0000 7f43cae00640 1 -- 172.21.15.103:0/600820724 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f43a80b5360 msgr2=0x7f43a80b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:03.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.343+0000 7f43cae00640 1 --2- 172.21.15.103:0/600820724 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f43a80b5360 0x7f43a80b7820 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f43b4005c80 tx=0x7f43b4009260 comp rx=0 tx=0).stop 2024-09-11T01:18:03.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.343+0000 7f43cae00640 1 -- 172.21.15.103:0/600820724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43c4105cb0 msgr2=0x7f43c419b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:03.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.343+0000 7f43cae00640 1 --2- 172.21.15.103:0/600820724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43c4105cb0 0x7f43c419b540 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f43b002a880 tx=0x7f43b0032d50 comp rx=0 tx=0).stop 2024-09-11T01:18:03.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.343+0000 7f43cae00640 1 -- 172.21.15.103:0/600820724 shutdown_connections 2024-09-11T01:18:03.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.343+0000 7f43cae00640 1 --2- 172.21.15.103:0/600820724 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f43a80b5360 0x7f43a80b7820 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.343+0000 7f43cae00640 1 --2- 172.21.15.103:0/600820724 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f43c4106670 0x7f43c419c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.343+0000 7f43cae00640 1 --2- 172.21.15.103:0/600820724 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f43c4105cb0 0x7f43c419b540 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.343+0000 7f43cae00640 1 --2- 172.21.15.103:0/600820724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f43c4104b60 0x7f43c419aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.343+0000 7f43cae00640 1 -- 172.21.15.103:0/600820724 >> 172.21.15.103:0/600820724 conn(0x7f43c4100400 msgr2=0x7f43c4109040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:03.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.343+0000 7f43cae00640 1 -- 172.21.15.103:0/600820724 shutdown_connections 2024-09-11T01:18:03.345 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.343+0000 7f43cae00640 1 -- 172.21.15.103:0/600820724 wait complete. 2024-09-11T01:18:03.360 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-11T01:18:03.372 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:03 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3918165083' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:18:03.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:03 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3918165083' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:18:03.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.521+0000 7f8a7fe00640 1 -- 172.21.15.103:0/405657483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78076f90 msgr2=0x7f8a780755e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:03.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.521+0000 7f8a7fe00640 1 --2- 172.21.15.103:0/405657483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78076f90 0x7f8a780755e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c009900 tx=0x7f8a6c02a410 comp rx=0 tx=0).stop 2024-09-11T01:18:03.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.521+0000 7f8a7fe00640 1 -- 172.21.15.103:0/405657483 shutdown_connections 2024-09-11T01:18:03.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.521+0000 7f8a7fe00640 1 --2- 172.21.15.103:0/405657483 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a78106470 0x7f8a78111150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.521+0000 7f8a7fe00640 1 --2- 172.21.15.103:0/405657483 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a78075b20 0x7f8a78075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.521+0000 7f8a7fe00640 1 --2- 172.21.15.103:0/405657483 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78076f90 0x7f8a780755e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.521+0000 7f8a7fe00640 1 -- 172.21.15.103:0/405657483 >> 172.21.15.103:0/405657483 conn(0x7f8a780fe220 msgr2=0x7f8a78100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:03.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.521+0000 7f8a7fe00640 1 -- 172.21.15.103:0/405657483 shutdown_connections 2024-09-11T01:18:03.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.521+0000 7f8a7fe00640 1 -- 172.21.15.103:0/405657483 wait complete. 2024-09-11T01:18:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.522+0000 7f8a7fe00640 1 Processor -- start 2024-09-11T01:18:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.522+0000 7f8a7fe00640 1 -- start start 2024-09-11T01:18:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7fe00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78075b20 0x7f8a7819f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7fe00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a78076f90 0x7f8a7819f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7fe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a781a05d0 0x7f8a781a0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7fe00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78114bc0 con 0x7f8a781a05d0 2024-09-11T01:18:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7fe00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78114a40 con 0x7f8a78075b20 2024-09-11T01:18:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7fe00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8a78114d40 con 0x7f8a78076f90 2024-09-11T01:18:03.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a781a05d0 0x7f8a781a0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:03.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7de00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a781a05d0 0x7f8a781a0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38130/0 (socket says 172.21.15.103:38130) 2024-09-11T01:18:03.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7de00640 1 -- 172.21.15.103:0/3195347275 learned_addr learned my addr 172.21.15.103:0/3195347275 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:03.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7ca00640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a78076f90 0x7f8a7819f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:03.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7d400640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78075b20 0x7f8a7819f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:03.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7de00640 1 -- 172.21.15.103:0/3195347275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a78076f90 msgr2=0x7f8a7819f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:03.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7de00640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a78076f90 0x7f8a7819f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7de00640 1 -- 172.21.15.103:0/3195347275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78075b20 msgr2=0x7f8a7819f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:03.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7de00640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78075b20 0x7f8a7819f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7de00640 1 -- 172.21.15.103:0/3195347275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a781a1280 con 0x7f8a781a05d0 2024-09-11T01:18:03.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.523+0000 7f8a7d400640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78075b20 0x7f8a7819f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:18:03.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.524+0000 7f8a7de00640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a781a05d0 0x7f8a781a0a80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000eb10 tx=0x7f8a7000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:03.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.524+0000 7f8a76000640 1 -- 172.21.15.103:0/3195347275 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70004b20 con 0x7f8a781a05d0 2024-09-11T01:18:03.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.524+0000 7f8a7fe00640 1 -- 172.21.15.103:0/3195347275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a781a7670 con 0x7f8a781a05d0 2024-09-11T01:18:03.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.524+0000 7f8a76000640 1 -- 172.21.15.103:0/3195347275 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8a70004cc0 con 0x7f8a781a05d0 2024-09-11T01:18:03.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.524+0000 7f8a76000640 1 -- 172.21.15.103:0/3195347275 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70018630 con 0x7f8a781a05d0 2024-09-11T01:18:03.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.524+0000 7f8a7fe00640 1 -- 172.21.15.103:0/3195347275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a781a7b60 con 0x7f8a781a05d0 2024-09-11T01:18:03.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.526+0000 7f8a7fe00640 1 -- 172.21.15.103:0/3195347275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a781049f0 con 0x7f8a781a05d0 2024-09-11T01:18:03.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.528+0000 7f8a76000640 1 -- 172.21.15.103:0/3195347275 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f8a70005000 con 0x7f8a781a05d0 2024-09-11T01:18:03.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.529+0000 7f8a76000640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8a600b52e0 0x7f8a600b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:03.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.529+0000 7f8a76000640 1 -- 172.21.15.103:0/3195347275 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f8a700e65c0 con 0x7f8a781a05d0 2024-09-11T01:18:03.531 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.529+0000 7f8a7d400640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8a600b52e0 0x7f8a600b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:03.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.530+0000 7f8a7d400640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8a600b52e0 0x7f8a600b77a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c000c00 tx=0x7f8a6c0314a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:03.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.533+0000 7f8a76000640 1 -- 172.21.15.103:0/3195347275 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8a700ad070 con 0x7f8a781a05d0 2024-09-11T01:18:03.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.734+0000 7f8a7fe00640 1 -- 172.21.15.103:0/3195347275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8a7802e5c0 con 0x7f8a781a05d0 2024-09-11T01:18:03.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.746+0000 7f8a76000640 1 -- 172.21.15.103:0/3195347275 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f8a700ac970 con 0x7f8a781a05d0 2024-09-11T01:18:03.748 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-09-11T01:18:03.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.749+0000 7f8a7fe00640 1 -- 172.21.15.103:0/3195347275 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8a600b52e0 msgr2=0x7f8a600b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:03.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.749+0000 7f8a7fe00640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8a600b52e0 0x7f8a600b77a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c000c00 tx=0x7f8a6c0314a0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.749+0000 7f8a7fe00640 1 -- 172.21.15.103:0/3195347275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a781a05d0 msgr2=0x7f8a781a0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:03.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.749+0000 7f8a7fe00640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a781a05d0 0x7f8a781a0a80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8a7000eb10 tx=0x7f8a7000c2d0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.749+0000 7f8a7fe00640 1 -- 172.21.15.103:0/3195347275 shutdown_connections 2024-09-11T01:18:03.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.749+0000 7f8a7fe00640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8a600b52e0 0x7f8a600b77a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.749+0000 7f8a7fe00640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8a781a05d0 0x7f8a781a0a80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.749+0000 7f8a7fe00640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8a78076f90 0x7f8a7819f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.749+0000 7f8a7fe00640 1 --2- 172.21.15.103:0/3195347275 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8a78075b20 0x7f8a7819f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.749+0000 7f8a7fe00640 1 -- 172.21.15.103:0/3195347275 >> 172.21.15.103:0/3195347275 conn(0x7f8a780fe220 msgr2=0x7f8a78100610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:03.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.749+0000 7f8a7fe00640 1 -- 172.21.15.103:0/3195347275 shutdown_connections 2024-09-11T01:18:03.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.749+0000 7f8a7fe00640 1 -- 172.21.15.103:0/3195347275 wait complete. 2024-09-11T01:18:03.768 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-11T01:18:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.934+0000 7f5ac6800640 1 -- 172.21.15.103:0/2106133582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac0102960 msgr2=0x7f5ac0102d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.934+0000 7f5ac6800640 1 --2- 172.21.15.103:0/2106133582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac0102960 0x7f5ac0102d60 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0009930 tx=0x7f5ab002a420 comp rx=0 tx=0).stop 2024-09-11T01:18:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.934+0000 7f5ac6800640 1 -- 172.21.15.103:0/2106133582 shutdown_connections 2024-09-11T01:18:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.934+0000 7f5ac6800640 1 --2- 172.21.15.103:0/2106133582 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ac0104470 0x7f5ac010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.934+0000 7f5ac6800640 1 --2- 172.21.15.103:0/2106133582 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ac0103ab0 0x7f5ac0103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.934+0000 7f5ac6800640 1 --2- 172.21.15.103:0/2106133582 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac0102960 0x7f5ac0102d60 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.934+0000 7f5ac6800640 1 -- 172.21.15.103:0/2106133582 >> 172.21.15.103:0/2106133582 conn(0x7f5ac00fe220 msgr2=0x7f5ac0100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.934+0000 7f5ac6800640 1 -- 172.21.15.103:0/2106133582 shutdown_connections 2024-09-11T01:18:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.934+0000 7f5ac6800640 1 -- 172.21.15.103:0/2106133582 wait complete. 2024-09-11T01:18:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.935+0000 7f5ac6800640 1 Processor -- start 2024-09-11T01:18:03.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.935+0000 7f5ac6800640 1 -- start start 2024-09-11T01:18:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5ac6800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ac0102960 0x7f5ac0198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5ac6800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ac0103ab0 0x7f5ac01993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5ac6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac0104470 0x7f5ac019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5ac6800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac010e600 con 0x7f5ac0104470 2024-09-11T01:18:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5ac6800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac010e480 con 0x7f5ac0102960 2024-09-11T01:18:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5ac6800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac010e780 con 0x7f5ac0103ab0 2024-09-11T01:18:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5abea00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ac0103ab0 0x7f5ac01993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5abfe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac0104470 0x7f5ac019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5abf400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ac0102960 0x7f5ac0198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5abea00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ac0103ab0 0x7f5ac01993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:56430/0 (socket says 172.21.15.103:56430) 2024-09-11T01:18:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5abea00640 1 -- 172.21.15.103:0/3175719446 learned_addr learned my addr 172.21.15.103:0/3175719446 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:03.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5abea00640 1 -- 172.21.15.103:0/3175719446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ac0102960 msgr2=0x7f5ac0198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5abea00640 1 --2- 172.21.15.103:0/3175719446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ac0102960 0x7f5ac0198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5abea00640 1 -- 172.21.15.103:0/3175719446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac0104470 msgr2=0x7f5ac019a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5abea00640 1 --2- 172.21.15.103:0/3175719446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac0104470 0x7f5ac019a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.936+0000 7f5abea00640 1 -- 172.21.15.103:0/3175719446 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac019a8c0 con 0x7f5ac0103ab0 2024-09-11T01:18:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.937+0000 7f5abea00640 1 --2- 172.21.15.103:0/3175719446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ac0103ab0 0x7f5ac01993d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00ea60 tx=0x7f5aac00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.937+0000 7f5ab7e00640 1 -- 172.21.15.103:0/3175719446 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac00cde0 con 0x7f5ac0103ab0 2024-09-11T01:18:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.937+0000 7f5ab7e00640 1 -- 172.21.15.103:0/3175719446 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5aac0035f0 con 0x7f5ac0103ab0 2024-09-11T01:18:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.937+0000 7f5ac6800640 1 -- 172.21.15.103:0/3175719446 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac019abb0 con 0x7f5ac0103ab0 2024-09-11T01:18:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.937+0000 7f5ab7e00640 1 -- 172.21.15.103:0/3175719446 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac010690 con 0x7f5ac0103ab0 2024-09-11T01:18:03.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.937+0000 7f5ac6800640 1 -- 172.21.15.103:0/3175719446 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac01a1280 con 0x7f5ac0103ab0 2024-09-11T01:18:03.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.938+0000 7f5ac6800640 1 -- 172.21.15.103:0/3175719446 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac0109cd0 con 0x7f5ac0103ab0 2024-09-11T01:18:03.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.942+0000 7f5ab7e00640 1 -- 172.21.15.103:0/3175719446 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f5aac004000 con 0x7f5ac0103ab0 2024-09-11T01:18:03.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.943+0000 7f5ab7e00640 1 --2- 172.21.15.103:0/3175719446 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5aa40b5360 0x7f5aa40b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:03.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.943+0000 7f5ab7e00640 1 -- 172.21.15.103:0/3175719446 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f5aac0e61e0 con 0x7f5ac0103ab0 2024-09-11T01:18:03.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.943+0000 7f5abf400640 1 --2- 172.21.15.103:0/3175719446 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5aa40b5360 0x7f5aa40b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:03.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.944+0000 7f5ab7e00640 1 -- 172.21.15.103:0/3175719446 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f5aac0accd0 con 0x7f5ac0103ab0 2024-09-11T01:18:03.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:03.944+0000 7f5abf400640 1 --2- 172.21.15.103:0/3175719446 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5aa40b5360 0x7f5aa40b7820 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0005ab0 tx=0x7f5ab0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.154+0000 7f5ac6800640 1 -- 172.21.15.103:0/3175719446 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5ac002e5c0 con 0x7f5ac0103ab0 2024-09-11T01:18:04.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.155+0000 7f5ab7e00640 1 -- 172.21.15.103:0/3175719446 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f5aac0ac5d0 con 0x7f5ac0103ab0 2024-09-11T01:18:04.156 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 64 2024-09-11T01:18:04.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.158+0000 7f5ac6800640 1 -- 172.21.15.103:0/3175719446 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5aa40b5360 msgr2=0x7f5aa40b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:04.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.158+0000 7f5ac6800640 1 --2- 172.21.15.103:0/3175719446 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5aa40b5360 0x7f5aa40b7820 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0005ab0 tx=0x7f5ab0005a20 comp rx=0 tx=0).stop 2024-09-11T01:18:04.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.158+0000 7f5ac6800640 1 -- 172.21.15.103:0/3175719446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ac0103ab0 msgr2=0x7f5ac01993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:04.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.158+0000 7f5ac6800640 1 --2- 172.21.15.103:0/3175719446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ac0103ab0 0x7f5ac01993d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00ea60 tx=0x7f5aac00ef20 comp rx=0 tx=0).stop 2024-09-11T01:18:04.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.158+0000 7f5ac6800640 1 -- 172.21.15.103:0/3175719446 shutdown_connections 2024-09-11T01:18:04.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.158+0000 7f5ac6800640 1 --2- 172.21.15.103:0/3175719446 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f5aa40b5360 0x7f5aa40b7820 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.158+0000 7f5ac6800640 1 --2- 172.21.15.103:0/3175719446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ac0104470 0x7f5ac019a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.158+0000 7f5ac6800640 1 --2- 172.21.15.103:0/3175719446 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f5ac0103ab0 0x7f5ac01993d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.158+0000 7f5ac6800640 1 --2- 172.21.15.103:0/3175719446 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5ac0102960 0x7f5ac0198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.158+0000 7f5ac6800640 1 -- 172.21.15.103:0/3175719446 >> 172.21.15.103:0/3175719446 conn(0x7f5ac00fe220 msgr2=0x7f5ac0106ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:04.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.158+0000 7f5ac6800640 1 -- 172.21.15.103:0/3175719446 shutdown_connections 2024-09-11T01:18:04.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.158+0000 7f5ac6800640 1 -- 172.21.15.103:0/3175719446 wait complete. 2024-09-11T01:18:04.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:04 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/600820724' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T01:18:04.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:04 smithi183 ceph-mon[34992]: pgmap v692: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-11T01:18:04.168 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:04 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3195347275' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T01:18:04.179 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-11T01:18:04.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.349+0000 7f10b1200640 1 -- 172.21.15.103:0/1969107180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ac075ac0 msgr2=0x7f10ac075f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:04.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.349+0000 7f10b1200640 1 --2- 172.21.15.103:0/1969107180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ac075ac0 0x7f10ac075f40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1094009900 tx=0x7f109402a3f0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.349+0000 7f10b1200640 1 -- 172.21.15.103:0/1969107180 shutdown_connections 2024-09-11T01:18:04.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.349+0000 7f10b1200640 1 --2- 172.21.15.103:0/1969107180 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10ac10a8e0 0x7f10ac10cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.349+0000 7f10b1200640 1 --2- 172.21.15.103:0/1969107180 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ac075ac0 0x7f10ac075f40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.349+0000 7f10b1200640 1 --2- 172.21.15.103:0/1969107180 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10ac076f30 0x7f10ac075580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.349+0000 7f10b1200640 1 -- 172.21.15.103:0/1969107180 >> 172.21.15.103:0/1969107180 conn(0x7f10ac0fe220 msgr2=0x7f10ac100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:04.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.349+0000 7f10b1200640 1 -- 172.21.15.103:0/1969107180 shutdown_connections 2024-09-11T01:18:04.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.349+0000 7f10b1200640 1 -- 172.21.15.103:0/1969107180 wait complete. 2024-09-11T01:18:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.350+0000 7f10b1200640 1 Processor -- start 2024-09-11T01:18:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.350+0000 7f10b1200640 1 -- start start 2024-09-11T01:18:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10b1200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10ac075ac0 0x7f10ac19af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10b1200640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ac076f30 0x7f10ac19b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10b1200640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10ac10a8e0 0x7f10ac19c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10b1200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac1107d0 con 0x7f10ac075ac0 2024-09-11T01:18:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10b1200640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac110650 con 0x7f10ac10a8e0 2024-09-11T01:18:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10b1200640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac110950 con 0x7f10ac076f30 2024-09-11T01:18:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10a9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10ac075ac0 0x7f10ac19af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10a3e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ac076f30 0x7f10ac19b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10a9e00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10ac075ac0 0x7f10ac19af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38142/0 (socket says 172.21.15.103:38142) 2024-09-11T01:18:04.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10a9e00640 1 -- 172.21.15.103:0/4013206159 learned_addr learned my addr 172.21.15.103:0/4013206159 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:04.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10aa800640 1 --2- 172.21.15.103:0/4013206159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10ac10a8e0 0x7f10ac19c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:04.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10a3e00640 1 -- 172.21.15.103:0/4013206159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10ac10a8e0 msgr2=0x7f10ac19c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:04.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10a3e00640 1 --2- 172.21.15.103:0/4013206159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10ac10a8e0 0x7f10ac19c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10a3e00640 1 -- 172.21.15.103:0/4013206159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10ac075ac0 msgr2=0x7f10ac19af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:04.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10a3e00640 1 --2- 172.21.15.103:0/4013206159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10ac075ac0 0x7f10ac19af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10a3e00640 1 -- 172.21.15.103:0/4013206159 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ac19cac0 con 0x7f10ac076f30 2024-09-11T01:18:04.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.351+0000 7f10a9e00640 1 --2- 172.21.15.103:0/4013206159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10ac075ac0 0x7f10ac19af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:18:04.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.352+0000 7f10a3e00640 1 --2- 172.21.15.103:0/4013206159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ac076f30 0x7f10ac19b5d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1094006010 tx=0x7f10940042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:04.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.352+0000 7f10a2a00640 1 -- 172.21.15.103:0/4013206159 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109403f030 con 0x7f10ac076f30 2024-09-11T01:18:04.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.352+0000 7f10a2a00640 1 -- 172.21.15.103:0/4013206159 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1094031910 con 0x7f10ac076f30 2024-09-11T01:18:04.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.352+0000 7f10a2a00640 1 -- 172.21.15.103:0/4013206159 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094035070 con 0x7f10ac076f30 2024-09-11T01:18:04.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.352+0000 7f10b1200640 1 -- 172.21.15.103:0/4013206159 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10ac19cd50 con 0x7f10ac076f30 2024-09-11T01:18:04.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.352+0000 7f10b1200640 1 -- 172.21.15.103:0/4013206159 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10ac1a3480 con 0x7f10ac076f30 2024-09-11T01:18:04.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.353+0000 7f10b1200640 1 -- 172.21.15.103:0/4013206159 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10ac075f40 con 0x7f10ac076f30 2024-09-11T01:18:04.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.355+0000 7f10a2a00640 1 -- 172.21.15.103:0/4013206159 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f109403ba10 con 0x7f10ac076f30 2024-09-11T01:18:04.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.357+0000 7f10a2a00640 1 --2- 172.21.15.103:0/4013206159 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f10900b5360 0x7f10900b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:04.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.357+0000 7f10a2a00640 1 -- 172.21.15.103:0/4013206159 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f10941067b0 con 0x7f10ac076f30 2024-09-11T01:18:04.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.357+0000 7f10a9e00640 1 --2- 172.21.15.103:0/4013206159 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f10900b5360 0x7f10900b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:04.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.358+0000 7f10a9e00640 1 --2- 172.21.15.103:0/4013206159 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f10900b5360 0x7f10900b7820 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f109c011500 tx=0x7f109c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:04.362 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.360+0000 7f10a2a00640 1 -- 172.21.15.103:0/4013206159 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f10940ccc10 con 0x7f10ac076f30 2024-09-11T01:18:04.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:04 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/600820724' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T01:18:04.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:04 smithi117 ceph-mon[35358]: pgmap v692: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-11T01:18:04.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:04 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3195347275' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T01:18:04.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.554+0000 7f10b1200640 1 -- 172.21.15.103:0/4013206159 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f10ac063d50 con 0x7f10ac076f30 2024-09-11T01:18:04.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.555+0000 7f10a2a00640 1 -- 172.21.15.103:0/4013206159 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v89) ==== 103+0+11 (secure 0 0 0) 0x7f10940d1640 con 0x7f10ac076f30 2024-09-11T01:18:04.557 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-09-11T01:18:04.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.557+0000 7f10b1200640 1 -- 172.21.15.103:0/4013206159 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f10900b5360 msgr2=0x7f10900b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:04.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.557+0000 7f10b1200640 1 --2- 172.21.15.103:0/4013206159 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f10900b5360 0x7f10900b7820 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f109c011500 tx=0x7f109c005f90 comp rx=0 tx=0).stop 2024-09-11T01:18:04.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.557+0000 7f10b1200640 1 -- 172.21.15.103:0/4013206159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ac076f30 msgr2=0x7f10ac19b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:04.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.557+0000 7f10b1200640 1 --2- 172.21.15.103:0/4013206159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ac076f30 0x7f10ac19b5d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1094006010 tx=0x7f10940042f0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.557+0000 7f10b1200640 1 -- 172.21.15.103:0/4013206159 shutdown_connections 2024-09-11T01:18:04.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.557+0000 7f10b1200640 1 --2- 172.21.15.103:0/4013206159 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f10900b5360 0x7f10900b7820 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.557+0000 7f10b1200640 1 --2- 172.21.15.103:0/4013206159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f10ac10a8e0 0x7f10ac19c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.557+0000 7f10b1200640 1 --2- 172.21.15.103:0/4013206159 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f10ac076f30 0x7f10ac19b5d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.557+0000 7f10b1200640 1 --2- 172.21.15.103:0/4013206159 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f10ac075ac0 0x7f10ac19af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.557+0000 7f10b1200640 1 -- 172.21.15.103:0/4013206159 >> 172.21.15.103:0/4013206159 conn(0x7f10ac0fe220 msgr2=0x7f10ac1068c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:04.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.558+0000 7f10b1200640 1 -- 172.21.15.103:0/4013206159 shutdown_connections 2024-09-11T01:18:04.560 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.558+0000 7f10b1200640 1 -- 172.21.15.103:0/4013206159 wait complete. 2024-09-11T01:18:04.573 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:04 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/600820724' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-11T01:18:04.573 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:04 smithi103 ceph-mon[30562]: pgmap v692: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.6 KiB/s wr, 9 op/s 2024-09-11T01:18:04.573 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:04 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3195347275' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-11T01:18:04.576 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-11T01:18:04.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.758+0000 7f14b2400640 1 -- 172.21.15.103:0/955299772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14ac103900 msgr2=0x7f14ac103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:04.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.758+0000 7f14b2400640 1 --2- 172.21.15.103:0/955299772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14ac103900 0x7f14ac103d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f1498009860 tx=0x7f149802a340 comp rx=0 tx=0).stop 2024-09-11T01:18:04.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.758+0000 7f14b2400640 1 -- 172.21.15.103:0/955299772 shutdown_connections 2024-09-11T01:18:04.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.758+0000 7f14b2400640 1 --2- 172.21.15.103:0/955299772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac1042c0 0x7f14ac10ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.758+0000 7f14b2400640 1 --2- 172.21.15.103:0/955299772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14ac103900 0x7f14ac103d80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.758+0000 7f14b2400640 1 --2- 172.21.15.103:0/955299772 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14ac1027b0 0x7f14ac102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.758+0000 7f14b2400640 1 -- 172.21.15.103:0/955299772 >> 172.21.15.103:0/955299772 conn(0x7f14ac0fe070 msgr2=0x7f14ac100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:04.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.758+0000 7f14b2400640 1 -- 172.21.15.103:0/955299772 shutdown_connections 2024-09-11T01:18:04.760 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.758+0000 7f14b2400640 1 -- 172.21.15.103:0/955299772 wait complete. 2024-09-11T01:18:04.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.759+0000 7f14b2400640 1 Processor -- start 2024-09-11T01:18:04.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.759+0000 7f14b2400640 1 -- start start 2024-09-11T01:18:04.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.759+0000 7f14b2400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14ac1027b0 0x7f14ac19ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:04.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.759+0000 7f14b2400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac103900 0x7f14ac19b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:04.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.759+0000 7f14b2400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14ac1042c0 0x7f14ac19c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:04.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.759+0000 7f14b2400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f14ac10e420 con 0x7f14ac103900 2024-09-11T01:18:04.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.759+0000 7f14b2400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f14ac10e2a0 con 0x7f14ac1027b0 2024-09-11T01:18:04.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.759+0000 7f14b2400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f14ac10e5a0 con 0x7f14ac1042c0 2024-09-11T01:18:04.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.760+0000 7f14abe00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac103900 0x7f14ac19b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:04.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.760+0000 7f14b1000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14ac1027b0 0x7f14ac19ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:04.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.760+0000 7f14b1000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14ac1027b0 0x7f14ac19ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:54734/0 (socket says 172.21.15.103:54734) 2024-09-11T01:18:04.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.760+0000 7f14b1000640 1 -- 172.21.15.103:0/937220441 learned_addr learned my addr 172.21.15.103:0/937220441 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:04.763 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.760+0000 7f14b1a00640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14ac1042c0 0x7f14ac19c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:04.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.760+0000 7f14b1000640 1 -- 172.21.15.103:0/937220441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14ac1042c0 msgr2=0x7f14ac19c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:04.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.760+0000 7f14b1000640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14ac1042c0 0x7f14ac19c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.760+0000 7f14b1000640 1 -- 172.21.15.103:0/937220441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac103900 msgr2=0x7f14ac19b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:04.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.760+0000 7f14b1000640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac103900 0x7f14ac19b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:04.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.760+0000 7f14b1000640 1 -- 172.21.15.103:0/937220441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ac19c8d0 con 0x7f14ac1027b0 2024-09-11T01:18:04.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.760+0000 7f14b1a00640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14ac1042c0 0x7f14ac19c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:18:04.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.760+0000 7f14abe00640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac103900 0x7f14ac19b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:18:04.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.760+0000 7f14b1000640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14ac1027b0 0x7f14ac19ad90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f149c00eb90 tx=0x7f149c00c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:04.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.760+0000 7f14a9600640 1 -- 172.21.15.103:0/937220441 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c004d20 con 0x7f14ac1027b0 2024-09-11T01:18:04.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.761+0000 7f14b2400640 1 -- 172.21.15.103:0/937220441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14ac19cbc0 con 0x7f14ac1027b0 2024-09-11T01:18:04.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.761+0000 7f14a9600640 1 -- 172.21.15.103:0/937220441 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f149c00ee90 con 0x7f14ac1027b0 2024-09-11T01:18:04.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.761+0000 7f14a9600640 1 -- 172.21.15.103:0/937220441 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c010670 con 0x7f14ac1027b0 2024-09-11T01:18:04.764 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.761+0000 7f14b2400640 1 -- 172.21.15.103:0/937220441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ac1a3290 con 0x7f14ac1027b0 2024-09-11T01:18:04.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.762+0000 7f14b2400640 1 -- 172.21.15.103:0/937220441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14ac1a3460 con 0x7f14ac1027b0 2024-09-11T01:18:04.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.764+0000 7f14a9600640 1 -- 172.21.15.103:0/937220441 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f149c0108d0 con 0x7f14ac1027b0 2024-09-11T01:18:04.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.765+0000 7f14a9600640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f14900b5360 0x7f14900b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:04.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.766+0000 7f14a9600640 1 -- 172.21.15.103:0/937220441 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f149c0e6860 con 0x7f14ac1027b0 2024-09-11T01:18:04.767 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.766+0000 7f14abe00640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f14900b5360 0x7f14900b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:04.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.767+0000 7f14abe00640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f14900b5360 0x7f14900b7820 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1498009830 tx=0x7f1498030480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:04.768 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:04.767+0000 7f14a9600640 1 -- 172.21.15.103:0/937220441 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f149c056220 con 0x7f14ac1027b0 2024-09-11T01:18:05.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:05.009+0000 7f14b2400640 1 -- 172.21.15.103:0/937220441 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f14ac1a3630 con 0x7f14ac1027b0 2024-09-11T01:18:05.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:05.018+0000 7f14a9600640 1 -- 172.21.15.103:0/937220441 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+827952 (secure 0 0 0) 0x7f149c0ad310 con 0x7f14ac1027b0 2024-09-11T01:18:05.031 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:18:05.031 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:18:05.031 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 20, 2024-09-11T01:18:05.031 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.031 INFO:teuthology.orchestra.run.smithi103.stdout: "active_gid": 14150, 2024-09-11T01:18:05.031 INFO:teuthology.orchestra.run.smithi103.stdout: "active_name": "x", 2024-09-11T01:18:05.031 INFO:teuthology.orchestra.run.smithi103.stdout: "active_addrs": { 2024-09-11T01:18:05.031 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-11T01:18:05.031 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.031 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-11T01:18:05.031 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2024-09-11T01:18:05.032 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3230239737 2024-09-11T01:18:05.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.032 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.032 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-09-11T01:18:05.032 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2024-09-11T01:18:05.032 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3230239737 2024-09-11T01:18:05.032 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.032 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-11T01:18:05.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.032 INFO:teuthology.orchestra.run.smithi103.stdout: "active_addr": "172.21.15.103:6801/3230239737", 2024-09-11T01:18:05.032 INFO:teuthology.orchestra.run.smithi103.stdout: "active_change": "2024-09-11T00:57:39.411554+0000", 2024-09-11T01:18:05.032 INFO:teuthology.orchestra.run.smithi103.stdout: "active_mgr_features": 4540719139924082687, 2024-09-11T01:18:05.032 INFO:teuthology.orchestra.run.smithi103.stdout: "available": true, 2024-09-11T01:18:05.032 INFO:teuthology.orchestra.run.smithi103.stdout: "standbys": [ 2024-09-11T01:18:05.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.033 INFO:teuthology.orchestra.run.smithi103.stdout: "gid": 24142, 2024-09-11T01:18:05.033 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "z", 2024-09-11T01:18:05.033 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_features": 4540719139924082687, 2024-09-11T01:18:05.033 INFO:teuthology.orchestra.run.smithi103.stdout: "available_modules": [ 2024-09-11T01:18:05.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.033 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "alerts", 2024-09-11T01:18:05.033 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.033 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.033 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.033 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:05.033 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:05.033 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.033 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.034 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.034 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:05.034 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.034 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.034 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.034 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T01:18:05.034 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.034 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.034 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.034 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.034 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.034 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.034 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.035 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.036 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.036 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.036 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.036 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.036 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.036 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.036 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.036 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.036 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.036 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.036 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.036 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.036 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.037 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.037 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.037 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.037 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.037 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.037 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.037 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.037 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.037 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.037 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.037 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.037 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.037 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.038 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.038 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.038 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.038 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.038 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.038 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.038 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.038 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.038 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.038 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.038 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.038 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.038 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.039 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.039 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.039 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.039 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.039 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.039 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.039 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.039 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.039 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.039 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_destination": { 2024-09-11T01:18:05.039 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_destination", 2024-09-11T01:18:05.039 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_from_name": { 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_from_name", 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.040 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "Ceph", 2024-09-11T01:18:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email From: name", 2024-09-11T01:18:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_host": { 2024-09-11T01:18:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_host", 2024-09-11T01:18:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.041 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP server", 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_password": { 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_password", 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.042 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.043 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.043 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.043 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.043 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.043 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Password to authenticate with", 2024-09-11T01:18:05.043 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.043 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.043 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.043 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.043 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_port": { 2024-09-11T01:18:05.043 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_port", 2024-09-11T01:18:05.043 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.043 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.043 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.044 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "465", 2024-09-11T01:18:05.044 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.044 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.044 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.044 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP port", 2024-09-11T01:18:05.044 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.044 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.044 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.044 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_sender": { 2024-09-11T01:18:05.044 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_sender", 2024-09-11T01:18:05.044 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.044 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.044 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.045 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.045 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.045 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.045 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.045 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP envelope sender", 2024-09-11T01:18:05.045 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.045 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.045 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.045 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_ssl": { 2024-09-11T01:18:05.045 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_ssl", 2024-09-11T01:18:05.045 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.045 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.046 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.046 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.046 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.046 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.046 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.046 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T01:18:05.046 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.046 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.046 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.046 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_user": { 2024-09-11T01:18:05.046 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_user", 2024-09-11T01:18:05.046 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.046 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "User to authenticate as", 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.047 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.048 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.048 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.048 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.048 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.048 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.048 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.048 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.048 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.048 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.048 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.048 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "balancer", 2024-09-11T01:18:05.048 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.049 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.049 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.049 INFO:teuthology.orchestra.run.smithi103.stdout: "active": { 2024-09-11T01:18:05.049 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "active", 2024-09-11T01:18:05.049 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.049 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.049 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.049 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.049 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.049 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.049 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.049 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T01:18:05.049 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.049 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_time": { 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_time", 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0000", 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_weekday": { 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_weekday", 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.051 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_max_iterations": { 2024-09-11T01:18:05.052 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_max_iterations", 2024-09-11T01:18:05.052 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:05.052 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.052 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.052 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "25", 2024-09-11T01:18:05.052 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-11T01:18:05.052 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "250", 2024-09-11T01:18:05.052 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.052 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T01:18:05.052 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.052 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.052 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.052 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_metrics": { 2024-09-11T01:18:05.053 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_metrics", 2024-09-11T01:18:05.053 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.053 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.053 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.053 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T01:18:05.053 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.053 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.053 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.053 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T01:18:05.053 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T01:18:05.053 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.053 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.053 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_step": { 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_step", 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.5", 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0.001", 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "0.999", 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "aggressiveness of optimization", 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: "end_time": { 2024-09-11T01:18:05.054 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_time", 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2359", 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: "end_weekday": { 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_weekday", 2024-09-11T01:18:05.055 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:05.056 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.056 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.056 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.056 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-09-11T01:18:05.056 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-09-11T01:18:05.056 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.056 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T01:18:05.056 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T01:18:05.056 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.056 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.056 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.056 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.057 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.057 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.057 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.057 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.057 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.057 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.057 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.057 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.057 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.057 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.057 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.057 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.057 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.057 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.058 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.058 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.058 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.058 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.058 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.058 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.058 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.058 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.058 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.058 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.058 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.058 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.058 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.059 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.059 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.059 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.059 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.059 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.059 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.059 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.059 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.059 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.059 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.059 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.059 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.059 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.060 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.061 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.061 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.061 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.061 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.061 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.061 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.061 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.061 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.061 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.061 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.061 INFO:teuthology.orchestra.run.smithi103.stdout: "min_score": { 2024-09-11T01:18:05.061 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_score", 2024-09-11T01:18:05.061 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.062 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.063 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.063 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "upmap", 2024-09-11T01:18:05.063 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.063 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.063 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.063 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-compat", 2024-09-11T01:18:05.063 INFO:teuthology.orchestra.run.smithi103.stdout: "none", 2024-09-11T01:18:05.063 INFO:teuthology.orchestra.run.smithi103.stdout: "read", 2024-09-11T01:18:05.063 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap", 2024-09-11T01:18:05.063 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap-read" 2024-09-11T01:18:05.063 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.063 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Balancer mode", 2024-09-11T01:18:05.063 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.063 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.064 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.064 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_ids": { 2024-09-11T01:18:05.064 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_ids", 2024-09-11T01:18:05.064 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.064 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.064 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.064 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.064 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.064 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.064 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.064 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T01:18:05.064 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.064 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.065 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.065 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.065 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:05.065 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:05.065 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.065 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.065 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.065 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:05.065 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.065 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.065 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.065 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T01:18:05.065 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.065 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.066 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_deviation": { 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_deviation", 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_optimizations": { 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_optimizations", 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.068 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.069 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.069 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm", 2024-09-11T01:18:05.069 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.069 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.069 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.069 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_down_multiplier": { 2024-09-11T01:18:05.069 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_down_multiplier", 2024-09-11T01:18:05.069 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:05.069 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.069 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.069 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-09-11T01:18:05.069 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.069 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.070 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.070 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T01:18:05.070 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.070 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.070 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.070 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_refresh_rate": { 2024-09-11T01:18:05.070 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_refresh_rate", 2024-09-11T01:18:05.070 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.070 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.070 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.070 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "20", 2024-09-11T01:18:05.070 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_starting_port": { 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_starting_port", 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4721", 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.071 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T01:18:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_ptrace": { 2024-09-11T01:18:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_ptrace", 2024-09-11T01:18:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.072 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T01:18:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T01:18:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_interval": { 2024-09-11T01:18:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_interval", 2024-09-11T01:18:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.073 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.074 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.074 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T01:18:05.074 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.074 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.074 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.074 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_memory_target_ratio": { 2024-09-11T01:18:05.074 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T01:18:05.074 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:05.074 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.074 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.074 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.7", 2024-09-11T01:18:05.074 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.074 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.075 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.075 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T01:18:05.075 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.075 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.075 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.075 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm_log_destination": { 2024-09-11T01:18:05.075 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm_log_destination", 2024-09-11T01:18:05.075 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.075 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.075 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.075 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.075 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: "file", 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: "file,syslog", 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: "syslog" 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: "cgroups_split": { 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cgroups_split", 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.076 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.077 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.077 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.077 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.077 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.077 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.077 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T01:18:05.077 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.077 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.077 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.077 INFO:teuthology.orchestra.run.smithi103.stdout: "config_checks_enabled": { 2024-09-11T01:18:05.077 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_checks_enabled", 2024-09-11T01:18:05.077 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.077 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: "config_dashboard": { 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_dashboard", 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.078 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.079 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.079 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.079 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.079 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.079 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T01:18:05.079 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.079 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.079 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.079 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_alertmanager": { 2024-09-11T01:18:05.079 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_alertmanager", 2024-09-11T01:18:05.079 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.079 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.079 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.080 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-11T01:18:05.080 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.080 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.080 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.080 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-11T01:18:05.080 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.080 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.080 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.080 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.080 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_base": { 2024-09-11T01:18:05.080 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_base", 2024-09-11T01:18:05.080 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.080 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.080 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Container image name, without the tag", 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_elasticsearch": { 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_elasticsearch", 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.081 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T01:18:05.082 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.082 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.082 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.082 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "elasticsearch container image", 2024-09-11T01:18:05.082 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.082 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.082 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.082 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_grafana": { 2024-09-11T01:18:05.082 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_grafana", 2024-09-11T01:18:05.082 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.082 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.082 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.083 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-11T01:18:05.083 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.083 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.083 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.083 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-11T01:18:05.083 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.083 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.083 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.083 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.083 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_haproxy": { 2024-09-11T01:18:05.083 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_haproxy", 2024-09-11T01:18:05.083 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.083 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.083 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "HAproxy container image", 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_agent": { 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_agent", 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.084 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T01:18:05.085 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.085 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.085 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.085 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger agent container image", 2024-09-11T01:18:05.085 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.085 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.085 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.085 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.085 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_collector": { 2024-09-11T01:18:05.085 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_collector", 2024-09-11T01:18:05.085 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.085 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.085 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger collector container image", 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_query": { 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_query", 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.086 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T01:18:05.087 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.087 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.087 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.087 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger query container image", 2024-09-11T01:18:05.087 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.087 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.087 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.087 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_keepalived": { 2024-09-11T01:18:05.087 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_keepalived", 2024-09-11T01:18:05.087 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.087 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.087 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.087 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T01:18:05.088 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.088 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.088 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.088 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Keepalived container image", 2024-09-11T01:18:05.088 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.088 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.088 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.088 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_loki": { 2024-09-11T01:18:05.088 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_loki", 2024-09-11T01:18:05.088 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.088 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.088 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.088 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T01:18:05.089 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.089 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.089 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.089 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Loki container image", 2024-09-11T01:18:05.089 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.089 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.089 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.089 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_nginx": { 2024-09-11T01:18:05.089 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_nginx", 2024-09-11T01:18:05.089 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.090 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.090 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.090 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-11T01:18:05.090 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.090 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.090 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.090 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Nginx container image", 2024-09-11T01:18:05.090 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.090 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.090 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.090 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_node_exporter": { 2024-09-11T01:18:05.090 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_node_exporter", 2024-09-11T01:18:05.090 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_nvmeof": { 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_nvmeof", 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.091 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.092 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.092 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-11T01:18:05.092 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.092 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.092 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.092 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Nvme-of container image", 2024-09-11T01:18:05.092 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.092 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.092 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.092 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_oauth2_proxy": { 2024-09-11T01:18:05.092 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_oauth2_proxy", 2024-09-11T01:18:05.092 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.092 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.093 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.093 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-11T01:18:05.093 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.093 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.093 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.093 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "oauth2-proxy container image", 2024-09-11T01:18:05.093 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.093 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.093 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.093 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_prometheus": { 2024-09-11T01:18:05.093 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_prometheus", 2024-09-11T01:18:05.093 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.093 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.094 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.094 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-11T01:18:05.094 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.094 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.094 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.094 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-11T01:18:05.094 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.094 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.094 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.094 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_promtail": { 2024-09-11T01:18:05.094 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_promtail", 2024-09-11T01:18:05.094 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.094 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.095 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.095 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T01:18:05.095 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.095 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.095 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.095 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Promtail container image", 2024-09-11T01:18:05.095 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.095 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.095 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.095 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_samba": { 2024-09-11T01:18:05.095 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_samba", 2024-09-11T01:18:05.095 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.095 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.096 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.096 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T01:18:05.096 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.096 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.096 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.096 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Samba/SMB container image", 2024-09-11T01:18:05.096 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.096 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.096 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.096 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_samba_metrics": { 2024-09-11T01:18:05.096 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_samba_metrics", 2024-09-11T01:18:05.096 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.096 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.097 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.097 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-11T01:18:05.097 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.097 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.097 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.097 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-11T01:18:05.097 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.097 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.097 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.097 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_snmp_gateway": { 2024-09-11T01:18:05.097 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_snmp_gateway", 2024-09-11T01:18:05.097 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.097 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SNMP Gateway container image", 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: "container_init": { 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_init", 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.098 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.099 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.099 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.099 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.099 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.099 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T01:18:05.099 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.099 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.099 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.099 INFO:teuthology.orchestra.run.smithi103.stdout: "daemon_cache_timeout": { 2024-09-11T01:18:05.099 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "daemon_cache_timeout", 2024-09-11T01:18:05.099 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.099 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.099 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.100 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:05.100 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.100 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.100 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.100 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T01:18:05.100 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.100 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.100 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.100 INFO:teuthology.orchestra.run.smithi103.stdout: "default_cephadm_command_timeout": { 2024-09-11T01:18:05.100 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T01:18:05.100 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.100 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.100 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "900", 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: "default_registry": { 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_registry", 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.101 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io", 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: "device_cache_timeout": { 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_cache_timeout", 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1800", 2024-09-11T01:18:05.102 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache device inventory", 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: "device_enhanced_scan": { 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_enhanced_scan", 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.103 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.104 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.104 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T01:18:05.104 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.104 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.104 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.104 INFO:teuthology.orchestra.run.smithi103.stdout: "facts_cache_timeout": { 2024-09-11T01:18:05.104 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "facts_cache_timeout", 2024-09-11T01:18:05.104 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.104 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.104 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.104 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:05.104 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.104 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache host facts data", 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: "grafana_dashboards_path": { 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "grafana_dashboards_path", 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.105 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.106 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T01:18:05.106 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.106 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.106 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.106 INFO:teuthology.orchestra.run.smithi103.stdout: "host_check_interval": { 2024-09-11T01:18:05.106 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "host_check_interval", 2024-09-11T01:18:05.106 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.106 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.106 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.106 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:05.106 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.106 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to perform a host check", 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: "hw_monitoring": { 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hw_monitoring", 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.107 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.108 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T01:18:05.108 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.108 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.108 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.108 INFO:teuthology.orchestra.run.smithi103.stdout: "inventory_list_all": { 2024-09-11T01:18:05.108 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "inventory_list_all", 2024-09-11T01:18:05.108 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.108 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.108 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.108 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.108 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.108 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.108 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.109 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T01:18:05.109 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.109 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.109 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.109 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.109 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.109 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.109 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.109 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.109 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.109 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.109 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: "log_refresh_metadata": { 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_refresh_metadata", 2024-09-11T01:18:05.110 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.111 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.112 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.113 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.113 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.113 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.113 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.113 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.113 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.113 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.113 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.113 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.113 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.113 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.113 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.113 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.114 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.115 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T01:18:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T01:18:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "*", 2024-09-11T01:18:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T01:18:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.116 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.117 INFO:teuthology.orchestra.run.smithi103.stdout: "max_count_per_host": { 2024-09-11T01:18:05.117 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_count_per_host", 2024-09-11T01:18:05.117 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.117 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.117 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.117 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.117 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.117 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.117 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.117 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of daemons per service per host", 2024-09-11T01:18:05.117 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.117 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.117 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.118 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd_draining_count": { 2024-09-11T01:18:05.118 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_osd_draining_count", 2024-09-11T01:18:05.118 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.118 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.118 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.118 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.118 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.118 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.118 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.118 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T01:18:05.118 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.118 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.118 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.119 INFO:teuthology.orchestra.run.smithi103.stdout: "migration_current": { 2024-09-11T01:18:05.119 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "migration_current", 2024-09-11T01:18:05.119 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.119 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.119 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.119 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.119 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.119 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.119 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.119 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "internal - do not modify", 2024-09-11T01:18:05.119 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.119 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.119 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.120 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-09-11T01:18:05.120 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-09-11T01:18:05.120 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.120 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.120 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.120 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "root", 2024-09-11T01:18:05.120 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.120 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.120 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.120 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm-package", 2024-09-11T01:18:05.120 INFO:teuthology.orchestra.run.smithi103.stdout: "root" 2024-09-11T01:18:05.120 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.120 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T01:18:05.121 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.121 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.121 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.121 INFO:teuthology.orchestra.run.smithi103.stdout: "oob_default_addr": { 2024-09-11T01:18:05.121 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "oob_default_addr", 2024-09-11T01:18:05.121 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.121 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.121 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.122 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "169.254.1.1", 2024-09-11T01:18:05.122 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.122 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.122 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.122 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T01:18:05.122 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.122 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.122 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.122 INFO:teuthology.orchestra.run.smithi103.stdout: "prometheus_alerts_path": { 2024-09-11T01:18:05.122 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus_alerts_path", 2024-09-11T01:18:05.122 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.122 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_insecure": { 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_insecure", 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.123 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.124 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.124 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.124 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.124 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T01:18:05.124 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.124 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.124 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.124 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_password": { 2024-09-11T01:18:05.124 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_password", 2024-09-11T01:18:05.124 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.124 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.124 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.124 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.125 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.125 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.125 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.125 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T01:18:05.125 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.125 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.125 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.125 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_url": { 2024-09-11T01:18:05.125 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_url", 2024-09-11T01:18:05.125 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.125 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.125 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.125 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.126 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.126 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.126 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.126 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T01:18:05.126 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.126 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.126 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.126 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_username": { 2024-09-11T01:18:05.126 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_username", 2024-09-11T01:18:05.126 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.126 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.126 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.126 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: "secure_monitoring_stack": { 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secure_monitoring_stack", 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.127 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.128 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.128 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.128 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T01:18:05.128 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.128 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.128 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.128 INFO:teuthology.orchestra.run.smithi103.stdout: "service_discovery_port": { 2024-09-11T01:18:05.128 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "service_discovery_port", 2024-09-11T01:18:05.128 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.128 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.128 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.128 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8765", 2024-09-11T01:18:05.128 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.129 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.129 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.129 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "cephadm service discovery port", 2024-09-11T01:18:05.129 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.129 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.129 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.129 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.129 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.129 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.129 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.129 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.129 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.129 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.129 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.130 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.130 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.130 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.130 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.130 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.130 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.130 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.130 INFO:teuthology.orchestra.run.smithi103.stdout: "ssh_config_file": { 2024-09-11T01:18:05.130 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssh_config_file", 2024-09-11T01:18:05.130 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.130 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.130 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.130 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.130 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: "use_agent": { 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_agent", 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.131 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.132 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.132 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T01:18:05.132 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.132 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.132 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.132 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.132 INFO:teuthology.orchestra.run.smithi103.stdout: "use_repo_digest": { 2024-09-11T01:18:05.132 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_repo_digest", 2024-09-11T01:18:05.132 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.132 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.132 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.132 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.132 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_failed_host_check": { 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_failed_host_check", 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.133 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.134 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.134 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T01:18:05.134 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.134 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.134 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.134 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_daemons": { 2024-09-11T01:18:05.134 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_daemons", 2024-09-11T01:18:05.134 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.134 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.134 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.134 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.134 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.135 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.135 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.135 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T01:18:05.135 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.135 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.135 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.135 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.135 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_hosts": { 2024-09-11T01:18:05.135 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_hosts", 2024-09-11T01:18:05.135 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.135 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.135 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.135 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.135 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T01:18:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crash", 2024-09-11T01:18:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.136 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.137 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.138 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.139 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.139 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.139 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.139 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.139 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.139 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.139 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.139 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.139 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.139 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.139 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.139 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.139 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.140 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.141 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.141 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.141 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.141 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.141 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.141 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.141 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.141 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.141 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.141 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.141 INFO:teuthology.orchestra.run.smithi103.stdout: "retain_interval": { 2024-09-11T01:18:05.141 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retain_interval", 2024-09-11T01:18:05.141 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "31536000", 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.142 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.143 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.143 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.143 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.143 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.143 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.143 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.143 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.143 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.143 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.143 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_recent_interval": { 2024-09-11T01:18:05.143 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_recent_interval", 2024-09-11T01:18:05.143 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.143 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.144 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.144 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1209600", 2024-09-11T01:18:05.144 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.144 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.144 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.144 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T01:18:05.144 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.144 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.144 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.144 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.144 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.144 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.144 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dashboard", 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.145 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.146 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.147 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_ENABLED": { 2024-09-11T01:18:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T01:18:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.148 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T01:18:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T01:18:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.149 INFO:teuthology.orchestra.run.smithi103.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T01:18:05.150 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.151 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.151 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.151 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.151 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.151 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.151 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.151 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.151 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.151 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.151 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.151 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T01:18:05.151 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T01:18:05.151 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.152 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.153 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.154 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.155 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.156 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.156 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.156 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.156 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.156 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.156 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T01:18:05.156 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T01:18:05.156 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.156 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.156 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.156 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.156 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.156 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.157 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.157 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.157 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.157 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.157 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.157 INFO:teuthology.orchestra.run.smithi103.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T01:18:05.157 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T01:18:05.157 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.157 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.157 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.157 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.157 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.157 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.158 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.158 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.158 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.158 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.158 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.158 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T01:18:05.158 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T01:18:05.158 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.158 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.158 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.158 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-11T01:18:05.158 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.158 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.159 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.160 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.160 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.160 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.160 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.160 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_URL": { 2024-09-11T01:18:05.160 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_URL", 2024-09-11T01:18:05.160 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.160 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.160 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.160 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.160 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.160 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.160 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.161 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.162 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.163 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.163 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.163 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T01:18:05.163 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T01:18:05.163 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.163 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.163 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.163 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.163 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.163 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.163 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.163 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.163 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.164 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.165 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "[]", 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "MULTICLUSTER_CONFIG": { 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "{}", 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T01:18:05.167 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T01:18:05.168 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.168 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.168 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.168 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.168 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.168 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.168 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.168 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.168 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.168 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.168 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.168 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T01:18:05.168 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T01:18:05.169 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.169 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.169 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.169 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.169 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.169 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.169 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.169 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.169 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.169 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.169 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.169 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T01:18:05.169 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T01:18:05.170 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.170 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.170 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.170 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.170 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.170 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.170 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.170 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.170 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.170 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.170 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.170 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T01:18:05.170 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T01:18:05.171 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T01:18:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T01:18:05.172 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.173 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.173 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.173 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.173 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.173 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.173 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.173 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.173 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.173 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.173 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.173 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T01:18:05.173 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T01:18:05.173 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.174 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.175 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.175 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.175 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.175 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.175 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.175 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.175 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.175 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.175 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T01:18:05.175 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T01:18:05.175 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.175 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.175 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.176 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.177 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.177 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.177 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.177 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.177 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.177 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.177 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.177 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T01:18:05.177 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T01:18:05.177 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.177 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.177 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.177 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.178 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8", 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.179 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.180 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.180 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.180 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.180 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.180 INFO:teuthology.orchestra.run.smithi103.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T01:18:05.180 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T01:18:05.180 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.180 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.180 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.180 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "45", 2024-09-11T01:18:05.180 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.180 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.181 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.181 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.181 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.181 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.181 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.181 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T01:18:05.181 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T01:18:05.181 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.181 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.181 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.181 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.181 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.181 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.182 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.183 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.184 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: "UNSAFE_TLS_v1_2": { 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.185 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.187 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T01:18:05.188 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T01:18:05.188 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.188 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.188 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.188 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:05.188 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.188 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.188 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.188 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.188 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.188 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.188 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.188 INFO:teuthology.orchestra.run.smithi103.stdout: "cross_origin_url": { 2024-09-11T01:18:05.189 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cross_origin_url", 2024-09-11T01:18:05.189 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.189 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.189 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.189 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.189 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.189 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.189 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.189 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.189 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.189 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.190 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.190 INFO:teuthology.orchestra.run.smithi103.stdout: "crt_file": { 2024-09-11T01:18:05.190 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crt_file", 2024-09-11T01:18:05.190 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.190 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.190 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.190 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.190 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.190 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.190 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.190 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.190 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: "debug": { 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "debug", 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable/disable debug options", 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.191 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: "jwt_token_ttl": { 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "jwt_token_ttl", 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "28800", 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.192 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.193 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-09-11T01:18:05.193 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-09-11T01:18:05.193 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.193 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.193 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.193 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.193 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.193 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.193 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.193 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.193 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.193 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.193 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.194 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.194 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.194 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.194 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.194 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.194 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.194 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.194 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.194 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.194 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.194 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.194 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.194 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.195 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.196 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.197 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: "motd": { 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "motd", 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.198 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "The message of the day", 2024-09-11T01:18:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect_resolve_ip_addr": { 2024-09-11T01:18:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T01:18:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.199 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.200 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.200 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.200 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.200 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.200 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.200 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.200 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.200 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.200 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.200 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-11T01:18:05.200 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-11T01:18:05.200 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.200 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.201 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8080", 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.202 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.203 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl_server_port": { 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl_server_port", 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8443", 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.204 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "redirect", 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.205 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect" 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-09-11T01:18:05.206 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.207 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.207 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.207 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.207 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.207 INFO:teuthology.orchestra.run.smithi103.stdout: "url_prefix": { 2024-09-11T01:18:05.207 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url_prefix", 2024-09-11T01:18:05.207 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.207 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.207 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.207 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.207 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.207 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.207 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.208 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.208 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.208 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.208 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.208 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.208 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.208 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "devicehealth", 2024-09-11T01:18:05.208 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.208 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.208 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.208 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_monitoring": { 2024-09-11T01:18:05.208 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_monitoring", 2024-09-11T01:18:05.209 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.209 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.209 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.209 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.209 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.209 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.209 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.209 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "monitor device health metrics", 2024-09-11T01:18:05.209 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.209 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.209 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.209 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.210 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.211 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.212 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.212 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.212 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.212 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.212 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.212 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.212 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.212 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.212 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.212 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.212 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.212 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.212 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.213 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mark_out_threshold": { 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mark_out_threshold", 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.214 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2419200", 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": { 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_name", 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "device_health_metrics", 2024-09-11T01:18:05.215 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: "retention_period": { 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retention_period", 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15552000", 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.216 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain device health metrics", 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_frequency": { 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_frequency", 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.217 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: "self_heal": { 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "self_heal", 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T01:18:05.218 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.219 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.219 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.219 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:05.219 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:05.219 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.219 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.219 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.219 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:05.219 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.219 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.219 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.219 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T01:18:05.219 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.220 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.221 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.221 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_threshold": { 2024-09-11T01:18:05.221 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_threshold", 2024-09-11T01:18:05.221 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.221 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.221 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.221 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7257600", 2024-09-11T01:18:05.221 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.221 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.221 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.221 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T01:18:05.221 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.221 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.222 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.222 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.222 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.222 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "diskprediction_local", 2024-09-11T01:18:05.222 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.222 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.222 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.222 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.222 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.222 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.222 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.222 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.223 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.225 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.225 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.225 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.225 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.225 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.225 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.225 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.225 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.225 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.225 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.225 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.225 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.225 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.225 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.226 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: "predict_interval": { 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predict_interval", 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.227 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: "predictor_model": { 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predictor_model", 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "prophetstor", 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.228 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.229 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.229 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.229 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.229 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:05.229 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:05.229 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.229 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.229 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.229 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:05.229 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.229 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.229 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.229 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.230 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.231 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.231 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.231 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.231 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.231 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "influx", 2024-09-11T01:18:05.231 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": false, 2024-09-11T01:18:05.231 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "influxdb python module not found", 2024-09-11T01:18:05.231 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.231 INFO:teuthology.orchestra.run.smithi103.stdout: "batch_size": { 2024-09-11T01:18:05.231 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "batch_size", 2024-09-11T01:18:05.231 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.231 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.232 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.232 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5000", 2024-09-11T01:18:05.232 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.232 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.232 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.232 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T01:18:05.232 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.232 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.232 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.232 INFO:teuthology.orchestra.run.smithi103.stdout: "database": { 2024-09-11T01:18:05.232 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "database", 2024-09-11T01:18:05.232 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.232 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.233 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.233 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "ceph", 2024-09-11T01:18:05.233 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.233 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.233 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.233 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T01:18:05.233 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.233 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.233 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.233 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": { 2024-09-11T01:18:05.233 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hostname", 2024-09-11T01:18:05.233 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.234 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.234 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.234 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.234 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.234 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.234 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.234 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server hostname", 2024-09-11T01:18:05.234 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.234 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.234 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.234 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:05.234 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:05.234 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.235 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.235 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.235 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "30", 2024-09-11T01:18:05.235 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "5", 2024-09-11T01:18:05.235 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.235 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.235 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T01:18:05.235 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.235 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.235 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.235 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.235 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.235 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.236 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.236 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.236 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.236 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.236 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.236 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.236 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.236 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.236 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.236 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.236 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.236 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.236 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.236 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.237 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.237 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.237 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.237 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.237 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.237 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.237 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.237 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.237 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.237 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.237 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.237 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.237 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.238 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.238 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.238 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.238 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.238 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.238 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.238 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.238 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.238 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.238 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.238 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.238 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.238 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.239 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.239 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.239 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.239 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.239 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.239 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.239 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.239 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.239 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.239 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.239 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.239 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.239 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.239 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: "password": { 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "password", 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.240 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.241 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.241 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.241 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.241 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.241 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.241 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "password of InfluxDB server user", 2024-09-11T01:18:05.241 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.241 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.241 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.241 INFO:teuthology.orchestra.run.smithi103.stdout: "port": { 2024-09-11T01:18:05.241 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "port", 2024-09-11T01:18:05.241 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.241 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8086", 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server port", 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.242 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.243 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "false", 2024-09-11T01:18:05.244 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.244 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.244 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.244 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T01:18:05.244 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.244 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.244 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.244 INFO:teuthology.orchestra.run.smithi103.stdout: "threads": { 2024-09-11T01:18:05.244 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threads", 2024-09-11T01:18:05.244 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.244 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.244 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.244 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:05.245 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-11T01:18:05.245 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "32", 2024-09-11T01:18:05.245 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.245 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T01:18:05.245 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.245 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.245 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.245 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.245 INFO:teuthology.orchestra.run.smithi103.stdout: "username": { 2024-09-11T01:18:05.245 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "username", 2024-09-11T01:18:05.245 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.245 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.245 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.245 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "username of InfluxDB server user", 2024-09-11T01:18:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: "verify_ssl": { 2024-09-11T01:18:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "verify_ssl", 2024-09-11T01:18:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "true", 2024-09-11T01:18:05.247 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.247 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.247 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.247 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T01:18:05.247 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.247 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.247 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.247 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.247 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.247 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.247 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "insights", 2024-09-11T01:18:05.247 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.247 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.248 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.249 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.249 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.249 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.249 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.249 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.249 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.249 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.249 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.249 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.249 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.249 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.249 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.249 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.250 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.251 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.251 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.251 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.251 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.251 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.251 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.251 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.251 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.251 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.251 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.251 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.251 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.251 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.251 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.252 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.253 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.253 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.253 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.253 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.253 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.253 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.253 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.253 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.253 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.253 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.253 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.253 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.253 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "iostat", 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.254 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.255 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.255 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.255 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.255 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.255 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.255 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.255 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.255 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.255 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.255 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.255 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.255 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.255 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.256 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.257 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.257 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.257 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.257 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.257 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.257 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.257 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.257 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.257 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.257 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.257 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.257 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.257 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.257 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.258 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.258 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.258 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.258 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.258 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.258 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.258 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.258 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.258 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.258 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.258 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.258 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.258 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.259 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.259 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.259 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.259 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.259 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.259 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.259 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.259 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.259 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.259 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.259 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.259 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "k8sevents", 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_event_retention_days": { 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ceph_event_retention_days", 2024-09-11T01:18:05.260 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.261 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.261 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.261 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7", 2024-09-11T01:18:05.261 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.261 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.261 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.261 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T01:18:05.261 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.261 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.261 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.261 INFO:teuthology.orchestra.run.smithi103.stdout: "config_check_secs": { 2024-09-11T01:18:05.261 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_check_secs", 2024-09-11T01:18:05.261 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "10", 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.262 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.263 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.264 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.264 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.264 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.264 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.264 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.264 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.264 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.264 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.264 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.264 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.264 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.264 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.264 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.265 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.265 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.265 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.265 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.265 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.265 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.265 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.265 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.265 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.265 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.265 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.265 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.265 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.265 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.266 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.267 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.267 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.267 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.267 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.267 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.267 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.267 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.267 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.267 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.267 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.267 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.267 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.267 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.267 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "localpool", 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.268 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.269 INFO:teuthology.orchestra.run.smithi103.stdout: "failure_domain": { 2024-09-11T01:18:05.269 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "failure_domain", 2024-09-11T01:18:05.269 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.269 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.269 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.269 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "host", 2024-09-11T01:18:05.269 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.269 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.269 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.269 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "failure domain for any created local pool", 2024-09-11T01:18:05.269 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T01:18:05.269 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.269 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.270 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.270 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.270 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.270 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.270 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.270 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.270 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.270 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.270 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.270 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.270 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.270 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.270 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.270 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.271 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.272 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.272 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.272 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.272 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.272 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.272 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.272 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.272 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.272 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.272 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.272 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.272 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.272 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.273 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.273 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.273 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.273 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.273 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.273 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.273 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.273 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.273 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.273 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.273 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.273 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.273 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.273 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.274 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": { 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_size", 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default min_size for any created local pool", 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: "num_rep": { 2024-09-11T01:18:05.275 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "num_rep", 2024-09-11T01:18:05.276 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.276 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.276 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.276 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3", 2024-09-11T01:18:05.276 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.276 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.276 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.276 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default replica count for any created local pool", 2024-09-11T01:18:05.276 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.276 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.276 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.276 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": { 2024-09-11T01:18:05.276 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_num", 2024-09-11T01:18:05.277 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.277 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.277 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.277 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "128", 2024-09-11T01:18:05.277 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.277 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.277 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.277 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T01:18:05.277 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.277 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.277 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.277 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.277 INFO:teuthology.orchestra.run.smithi103.stdout: "prefix": { 2024-09-11T01:18:05.277 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prefix", 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name prefix for any created local pool", 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.278 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "subtree": { 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "subtree", 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.279 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "rack", 2024-09-11T01:18:05.280 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.280 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.280 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.280 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T01:18:05.280 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T01:18:05.280 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.280 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.280 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.280 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.280 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.280 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.280 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mds_autoscaler", 2024-09-11T01:18:05.280 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.280 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.281 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.281 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.281 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.281 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.281 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.281 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.281 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.281 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.281 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.281 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.281 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.281 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.281 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.281 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.282 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.283 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.283 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.283 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.283 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.283 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.283 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.283 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.283 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.283 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.283 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.283 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.283 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.283 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.284 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.285 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.285 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.285 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.285 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.285 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.285 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.285 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.285 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.285 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.285 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.285 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.285 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.285 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.286 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.286 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.286 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.286 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.286 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.286 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.286 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.286 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.286 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.286 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.286 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.286 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.286 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.286 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirroring", 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.287 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.288 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.288 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.288 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.288 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.288 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.288 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.288 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.288 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.288 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.288 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.288 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.288 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.288 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.288 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.289 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.290 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.290 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.290 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.290 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.290 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.290 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.290 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.290 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.290 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.290 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.290 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.291 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.292 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.293 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.293 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.293 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.293 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.293 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.293 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.293 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.293 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "nfs", 2024-09-11T01:18:05.293 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.293 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.293 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.293 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.294 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.295 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.296 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.296 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.296 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.296 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.296 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.296 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.296 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.296 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.296 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.296 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.296 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.296 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.296 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.297 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.297 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.297 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.297 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.297 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.297 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.297 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.297 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.297 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.297 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.297 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.297 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.297 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.297 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.298 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.299 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.299 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.299 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.299 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.299 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.299 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.299 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.299 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.299 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.299 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.299 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.299 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-09-11T01:18:05.300 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.300 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.300 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.300 INFO:teuthology.orchestra.run.smithi103.stdout: "fail_fs": { 2024-09-11T01:18:05.300 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "fail_fs", 2024-09-11T01:18:05.300 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.300 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.300 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.300 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.300 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.300 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.300 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.300 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T01:18:05.300 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.301 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.301 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.301 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.301 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.301 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.301 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.301 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.301 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.301 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.301 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.301 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.301 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.301 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.301 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.302 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.303 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.305 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator": { 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm", 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: "rook", 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: "test_orchestrator" 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Orchestrator backend", 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.306 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.307 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.308 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.308 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.308 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.308 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.308 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_perf_query", 2024-09-11T01:18:05.308 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.308 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.308 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.308 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.308 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.308 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.308 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.308 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.308 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.310 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.310 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.310 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.310 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.310 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.310 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.310 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.310 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.310 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.310 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.310 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.310 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.310 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.310 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.311 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.312 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.312 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.312 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.312 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.312 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.312 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.312 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.312 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.312 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.312 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.312 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.312 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.312 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.313 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.314 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.314 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.314 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.314 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.314 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.314 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.314 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.314 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.314 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.314 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_support", 2024-09-11T01:18:05.314 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.314 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.314 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.314 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.315 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.316 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.316 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.316 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.316 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.316 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.316 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.316 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.316 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.316 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.316 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.316 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.316 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.316 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.316 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.317 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.318 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.319 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_autoscaler", 2024-09-11T01:18:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.320 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.321 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.322 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.323 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.325 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.328 INFO:teuthology.orchestra.run.smithi103.stdout: "threshold": { 2024-09-11T01:18:05.328 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threshold", 2024-09-11T01:18:05.328 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:05.328 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.328 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.328 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-09-11T01:18:05.328 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1.0", 2024-09-11T01:18:05.328 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.328 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.328 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "scaling threshold", 2024-09-11T01:18:05.328 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T01:18:05.328 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.328 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.328 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.329 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.329 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "progress", 2024-09-11T01:18:05.329 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.329 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.329 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.329 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_pg_recovery_event": { 2024-09-11T01:18:05.329 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_pg_recovery_event", 2024-09-11T01:18:05.329 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.329 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.329 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.329 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.330 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.330 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.330 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.330 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T01:18:05.330 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.330 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.330 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.330 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-09-11T01:18:05.330 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-09-11T01:18:05.330 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.330 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.330 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.330 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.331 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.332 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.333 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.334 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.335 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.335 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.335 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.335 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.335 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.335 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.335 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.335 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.335 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.335 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.335 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.335 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.335 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.335 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.336 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.336 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.336 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.336 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.336 INFO:teuthology.orchestra.run.smithi103.stdout: "max_completed_events": { 2024-09-11T01:18:05.336 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_completed_events", 2024-09-11T01:18:05.336 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.336 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.336 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.336 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "50", 2024-09-11T01:18:05.336 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.336 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.336 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.336 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "number of past completed events to remember", 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long the module is going to sleep", 2024-09-11T01:18:05.337 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.338 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.339 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.339 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.339 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.339 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.339 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus", 2024-09-11T01:18:05.339 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.339 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.339 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.339 INFO:teuthology.orchestra.run.smithi103.stdout: "cache": { 2024-09-11T01:18:05.339 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cache", 2024-09-11T01:18:05.339 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.340 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.340 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.340 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.340 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.340 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.340 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.340 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.340 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.340 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.340 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.340 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.340 INFO:teuthology.orchestra.run.smithi103.stdout: "exclude_perf_counters": { 2024-09-11T01:18:05.340 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "exclude_perf_counters", 2024-09-11T01:18:05.340 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T01:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T01:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.341 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.342 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.342 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.342 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.342 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.342 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.342 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.342 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.342 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.342 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.342 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.342 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.342 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.342 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.342 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.343 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.344 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.345 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.345 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.345 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.345 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.345 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.345 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.345 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.345 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.345 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.345 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.345 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.345 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.345 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools": { 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools", 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.346 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "300", 2024-09-11T01:18:05.347 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.348 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.348 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.348 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.348 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.348 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.348 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.348 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.348 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_interval": { 2024-09-11T01:18:05.348 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_interval", 2024-09-11T01:18:05.348 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:05.348 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.348 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.348 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15.0", 2024-09-11T01:18:05.348 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.349 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.350 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.350 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T01:18:05.350 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.350 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.350 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.350 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-11T01:18:05.350 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-11T01:18:05.350 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.350 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.350 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.350 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "9283", 2024-09-11T01:18:05.350 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.350 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.351 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.352 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.352 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.352 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.352 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.352 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.352 INFO:teuthology.orchestra.run.smithi103.stdout: "stale_cache_strategy": { 2024-09-11T01:18:05.352 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stale_cache_strategy", 2024-09-11T01:18:05.352 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.352 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.352 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.352 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "log", 2024-09-11T01:18:05.352 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.352 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.353 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.353 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.353 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.353 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.353 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.353 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.353 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-09-11T01:18:05.353 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-09-11T01:18:05.353 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.353 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.353 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.353 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "default", 2024-09-11T01:18:05.353 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.353 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.354 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.354 INFO:teuthology.orchestra.run.smithi103.stdout: "default", 2024-09-11T01:18:05.354 INFO:teuthology.orchestra.run.smithi103.stdout: "error" 2024-09-11T01:18:05.354 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.354 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.354 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.354 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.354 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.354 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.354 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-09-11T01:18:05.354 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-09-11T01:18:05.354 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.354 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_support", 2024-09-11T01:18:05.355 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.356 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.356 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.356 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.356 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.356 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.356 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.356 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.356 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.356 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.356 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.356 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.356 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.356 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.357 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.357 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.357 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.357 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.357 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.357 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.357 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.357 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.357 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.357 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.357 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.357 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.357 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.358 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.358 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.358 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.358 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.358 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.358 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.358 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.358 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.358 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.358 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.358 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.358 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.358 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.359 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.360 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.360 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.360 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.360 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.360 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.360 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.360 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.360 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.360 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.360 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.360 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.360 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.360 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.361 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.361 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_snap_create": { 2024-09-11T01:18:05.361 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_snap_create", 2024-09-11T01:18:05.361 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.361 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.361 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.361 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.361 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.361 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.361 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.361 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.361 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.361 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: "mirror_snapshot_schedule": { 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.362 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.363 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.363 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.363 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.363 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.363 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.363 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.363 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.363 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.363 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.363 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.363 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.363 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.363 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: "trash_purge_schedule": { 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "trash_purge_schedule", 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.364 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.365 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.365 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.365 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "restful", 2024-09-11T01:18:05.365 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.365 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.365 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.365 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_auth": { 2024-09-11T01:18:05.365 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_auth", 2024-09-11T01:18:05.365 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.365 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.365 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.365 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.366 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.367 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.368 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.368 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.368 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.368 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.368 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.368 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.368 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.368 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.368 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.368 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.368 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.368 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.368 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.369 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.369 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.369 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.369 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.369 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.369 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.369 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.369 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.369 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.369 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.369 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.369 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.369 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.370 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.371 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.371 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.371 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.371 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.371 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.371 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.371 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.371 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.371 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.371 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.371 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.371 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.371 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: "max_requests": { 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_requests", 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.372 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-11T01:18:05.373 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.373 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.373 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.373 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-11T01:18:05.373 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-11T01:18:05.373 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.373 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.373 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.373 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.373 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.373 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.373 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.373 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.374 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.374 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.374 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.374 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-11T01:18:05.374 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-11T01:18:05.374 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.374 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.374 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.374 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.374 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.374 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.374 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.374 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.375 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.375 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.375 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.375 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.375 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.375 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.375 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.375 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.375 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.375 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.375 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.375 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.376 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.376 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.376 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.376 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.376 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.376 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.376 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rgw", 2024-09-11T01:18:05.376 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.376 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.376 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.376 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.376 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.377 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.377 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.378 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.378 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.378 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.378 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.378 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.378 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.378 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.378 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.378 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.378 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.378 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.378 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.378 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.379 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.379 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.379 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.379 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.379 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.379 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.379 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.379 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.379 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.379 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.379 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.379 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.379 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.380 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.380 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.380 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.380 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.380 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.380 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.380 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.380 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.380 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.380 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.381 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.381 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.381 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.381 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.381 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.381 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.381 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.381 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.381 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.381 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.381 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.381 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.381 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.382 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.382 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.382 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.382 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.382 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.382 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.382 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.382 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.382 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.382 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.383 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.383 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.383 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.383 INFO:teuthology.orchestra.run.smithi103.stdout: "secondary_zone_period_retry_limit": { 2024-09-11T01:18:05.383 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-11T01:18:05.383 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.383 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.383 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.383 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:05.383 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.383 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.383 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.383 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-11T01:18:05.384 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.384 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.384 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.384 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.384 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.384 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.384 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.384 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.384 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.384 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.384 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.384 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.385 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.385 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.385 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.385 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.385 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.385 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.385 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rook", 2024-09-11T01:18:05.385 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.385 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.385 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.385 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.385 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.386 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.386 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.386 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.386 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.386 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.386 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.386 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.386 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.386 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.386 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.386 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.386 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.386 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.387 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.387 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.387 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.387 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.387 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.387 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.387 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.387 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.387 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.387 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.387 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.388 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.388 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.388 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.388 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.388 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.388 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.388 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.388 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.388 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.388 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.388 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.388 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.388 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.391 INFO:teuthology.orchestra.run.smithi103.stdout: "storage_class": { 2024-09-11T01:18:05.392 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "storage_class", 2024-09-11T01:18:05.392 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.392 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.392 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.392 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "local", 2024-09-11T01:18:05.392 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.392 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.392 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.392 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T01:18:05.392 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.392 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.392 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.392 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.393 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.393 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "selftest", 2024-09-11T01:18:05.393 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.393 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.393 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.393 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.393 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.393 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.393 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.393 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.394 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.394 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.394 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.394 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.394 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.394 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.394 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.394 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.394 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.394 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.394 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.394 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.394 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.394 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.395 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.396 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.396 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.396 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.396 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.396 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.396 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.396 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.396 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.396 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.396 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.396 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.396 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.396 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.397 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.397 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.397 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.397 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.397 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.397 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.397 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.397 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.397 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.397 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.397 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.397 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.397 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.398 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.398 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.398 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.398 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.398 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.398 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.398 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.398 INFO:teuthology.orchestra.run.smithi103.stdout: "roption1": { 2024-09-11T01:18:05.398 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption1", 2024-09-11T01:18:05.398 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.398 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.398 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.398 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.399 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.399 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.399 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.399 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.399 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.399 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.399 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.399 INFO:teuthology.orchestra.run.smithi103.stdout: "roption2": { 2024-09-11T01:18:05.399 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption2", 2024-09-11T01:18:05.399 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.399 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.399 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.399 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "xyz", 2024-09-11T01:18:05.400 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.400 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.400 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.400 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.400 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.400 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.400 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.400 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption1": { 2024-09-11T01:18:05.400 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption1", 2024-09-11T01:18:05.400 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.400 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.400 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.400 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.401 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.401 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.401 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.401 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.401 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.401 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.401 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.401 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption2": { 2024-09-11T01:18:05.401 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption2", 2024-09-11T01:18:05.401 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.401 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.401 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.402 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.402 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.402 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.402 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.402 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.402 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.402 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.402 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.402 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption3": { 2024-09-11T01:18:05.402 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption3", 2024-09-11T01:18:05.402 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:05.402 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.403 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.403 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.403 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.403 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.403 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.403 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.403 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.403 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.403 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.403 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.403 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption4": { 2024-09-11T01:18:05.403 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption4", 2024-09-11T01:18:05.403 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.403 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.404 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.404 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.404 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.404 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.404 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.404 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.404 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.404 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.404 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.404 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption5": { 2024-09-11T01:18:05.404 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption5", 2024-09-11T01:18:05.404 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.405 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.405 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.405 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.405 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.405 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.405 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.405 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.405 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.405 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.405 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.405 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption6": { 2024-09-11T01:18:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption6", 2024-09-11T01:18:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.407 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption7": { 2024-09-11T01:18:05.407 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption7", 2024-09-11T01:18:05.407 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.407 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.407 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.407 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.407 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-11T01:18:05.407 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "42", 2024-09-11T01:18:05.407 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.407 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.407 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.407 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.407 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.407 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.408 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.408 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.408 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.408 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.408 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.408 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.408 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.408 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.408 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.408 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.408 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.408 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.408 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.409 INFO:teuthology.orchestra.run.smithi103.stdout: "testkey": { 2024-09-11T01:18:05.409 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testkey", 2024-09-11T01:18:05.409 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.409 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.409 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.409 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.409 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.409 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.412 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.412 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.412 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.412 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.412 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.412 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.412 INFO:teuthology.orchestra.run.smithi103.stdout: "testlkey": { 2024-09-11T01:18:05.412 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testlkey", 2024-09-11T01:18:05.412 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.413 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.413 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.413 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.413 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.413 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.413 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.413 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.413 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.413 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.413 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.413 INFO:teuthology.orchestra.run.smithi103.stdout: "testnewline": { 2024-09-11T01:18:05.413 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testnewline", 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.414 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smb", 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "internal_store_backend": { 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "internal_store_backend", 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-11T01:18:05.415 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.416 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.417 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.418 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.418 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.418 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.418 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.418 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.418 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.418 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.418 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.418 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.418 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.418 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.418 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.418 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.419 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.420 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.420 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.420 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.420 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.420 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.420 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.420 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.420 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.420 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.420 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.420 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.420 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.420 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.421 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.421 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.421 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.421 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.421 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.421 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.421 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.421 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.421 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.421 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.421 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.421 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.421 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.422 INFO:teuthology.orchestra.run.smithi103.stdout: "update_orchestration": { 2024-09-11T01:18:05.422 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "update_orchestration", 2024-09-11T01:18:05.422 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.422 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.422 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.422 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.422 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.422 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.422 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.422 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-11T01:18:05.422 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.422 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.423 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.423 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.423 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.423 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snap_schedule", 2024-09-11T01:18:05.423 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.423 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.423 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.423 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_m_granularity": { 2024-09-11T01:18:05.423 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_m_granularity", 2024-09-11T01:18:05.423 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.424 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.424 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.424 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.424 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.424 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.424 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.424 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T01:18:05.424 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.424 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.424 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.424 INFO:teuthology.orchestra.run.smithi103.stdout: "dump_on_update": { 2024-09-11T01:18:05.424 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dump_on_update", 2024-09-11T01:18:05.425 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.425 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.425 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.425 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.425 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.425 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.425 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.425 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "dump database to debug log on update", 2024-09-11T01:18:05.425 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.425 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.425 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.425 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.426 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.427 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.427 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.427 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.427 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.427 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.427 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.427 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.427 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.427 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.427 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.427 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.427 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.427 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.428 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.428 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.428 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.428 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.428 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.428 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.428 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.428 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.428 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.428 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.428 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.428 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.428 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.429 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.429 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.429 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.429 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.429 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.429 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.429 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.429 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.429 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.429 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.429 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.429 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.429 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.429 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.431 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.432 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.432 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.432 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stats", 2024-09-11T01:18:05.432 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.432 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.432 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.432 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.432 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.432 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.432 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.432 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.432 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.432 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.432 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.433 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.433 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.433 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.433 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.433 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.433 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.433 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.433 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.433 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.433 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.433 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.433 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.434 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.435 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.435 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.435 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.435 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.435 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.435 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.435 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.435 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.435 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.435 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.435 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.435 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.435 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.436 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.436 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.436 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.436 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.436 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.436 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.436 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.436 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.436 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.436 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.436 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.436 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.436 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.437 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.437 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.437 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.437 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.437 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.437 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.437 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.437 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.437 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.437 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.437 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.437 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.438 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.438 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.438 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.438 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.438 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.438 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.438 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.438 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.438 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.438 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.438 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.438 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.438 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.439 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.439 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "status", 2024-09-11T01:18:05.439 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.439 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.439 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.439 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.439 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.439 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.439 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.439 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.439 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.439 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.439 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.439 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.440 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.440 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.440 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.440 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.440 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.440 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.440 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.440 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.440 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.440 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.440 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.440 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.440 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.440 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.441 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.441 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.441 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.441 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.441 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.441 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.441 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.441 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.441 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.441 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.441 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.441 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.441 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.441 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.442 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.442 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.442 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.442 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.442 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.442 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.442 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.442 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.442 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.442 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.442 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.442 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.442 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.442 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.443 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.443 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.443 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.443 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.443 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.443 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.443 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.443 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.443 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.443 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.443 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.443 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.443 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.443 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.444 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.444 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.444 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.444 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.444 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.444 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.444 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.444 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.444 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.444 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.444 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.444 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.445 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.445 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.445 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.445 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.445 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.445 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.445 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.445 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.445 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.445 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.445 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telegraf", 2024-09-11T01:18:05.445 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.445 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.445 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: "address": { 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "address", 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.446 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:05.447 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:05.447 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.447 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.447 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.447 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15", 2024-09-11T01:18:05.447 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.447 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.447 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.447 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.447 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.447 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.447 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.447 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.447 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.448 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.449 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.450 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.451 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.451 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.451 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.451 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.451 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.451 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.451 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.451 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.451 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.451 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.451 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.451 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.451 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.452 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.452 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.452 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.452 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.452 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.452 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.452 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.452 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.452 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.452 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.452 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.452 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.452 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.453 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.453 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.453 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.453 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.453 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.453 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.453 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.453 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.453 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.453 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.453 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.453 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.453 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.454 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.454 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telemetry", 2024-09-11T01:18:05.454 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.454 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.454 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.454 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_basic": { 2024-09-11T01:18:05.454 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_basic", 2024-09-11T01:18:05.454 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.454 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.454 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.454 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_crash": { 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_crash", 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.455 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.456 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.456 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.456 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T01:18:05.456 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.456 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.456 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.456 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.456 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_device": { 2024-09-11T01:18:05.456 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_device", 2024-09-11T01:18:05.456 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.456 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.456 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.456 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.456 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.457 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.457 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.457 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T01:18:05.457 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.457 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.457 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.457 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.457 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_ident": { 2024-09-11T01:18:05.457 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_ident", 2024-09-11T01:18:05.457 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.457 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.457 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.457 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_perf": { 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_perf", 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.458 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: "contact": { 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "contact", 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.459 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.460 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.460 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.460 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.460 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.460 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.460 INFO:teuthology.orchestra.run.smithi103.stdout: "description": { 2024-09-11T01:18:05.460 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "description", 2024-09-11T01:18:05.460 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.461 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.461 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.461 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.461 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.461 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.461 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.461 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.461 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.461 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.461 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.461 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.461 INFO:teuthology.orchestra.run.smithi103.stdout: "device_url": { 2024-09-11T01:18:05.461 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_url", 2024-09-11T01:18:05.462 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.462 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.462 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.462 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T01:18:05.462 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.462 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.462 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.462 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.462 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.462 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.462 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.462 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-09-11T01:18:05.462 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.463 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "24", 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "8", 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: "last_opt_revision": { 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "last_opt_revision", 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.464 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1", 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard": { 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard", 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.465 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard_description": { 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard_description", 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.466 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.467 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.468 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.469 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.469 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.469 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.469 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.469 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.469 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.469 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.469 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.469 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.469 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.469 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.469 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.470 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.470 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.470 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.470 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.470 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.470 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.470 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.470 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.470 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.470 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.470 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.470 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.470 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.471 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: "organization": { 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "organization", 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.472 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.473 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.473 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.473 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.473 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.473 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.473 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.473 INFO:teuthology.orchestra.run.smithi103.stdout: "proxy": { 2024-09-11T01:18:05.473 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "proxy", 2024-09-11T01:18:05.473 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.473 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.473 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.473 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.473 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.474 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.474 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.474 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.474 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.474 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.474 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.474 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.474 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.474 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.474 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.474 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.474 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: "url": { 2024-09-11T01:18:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url", 2024-09-11T01:18:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.475 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "test_orchestrator", 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.476 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.477 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.477 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.477 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.477 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.477 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.477 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.477 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.477 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.477 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.477 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.477 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.477 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.477 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.477 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.478 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.478 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.478 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.478 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.478 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.478 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.478 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.478 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.478 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.478 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.478 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.478 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.478 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.479 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.479 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.479 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.479 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.479 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.479 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.479 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.479 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.479 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.479 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.479 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.480 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.480 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.480 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.480 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.480 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.480 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.480 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.480 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.480 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.480 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.480 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.480 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.480 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.480 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.481 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.481 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.481 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.481 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.481 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.481 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.481 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.481 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.481 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.481 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.481 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.481 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.481 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.482 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "volumes", 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.483 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.484 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.485 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.486 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.486 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.486 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.486 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.486 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.486 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.486 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.486 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.486 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.486 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.486 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.486 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.486 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.486 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.487 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.487 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.487 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.487 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.487 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.487 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.487 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.487 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.487 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.487 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.487 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.487 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.487 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_clones": { 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_clones", 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4", 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.488 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.489 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.489 INFO:teuthology.orchestra.run.smithi103.stdout: "periodic_async_work": { 2024-09-11T01:18:05.489 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "periodic_async_work", 2024-09-11T01:18:05.489 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.489 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.489 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.489 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.489 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.489 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.489 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.489 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Periodically check for async work", 2024-09-11T01:18:05.489 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.489 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.490 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.490 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_delay": { 2024-09-11T01:18:05.490 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_delay", 2024-09-11T01:18:05.490 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.490 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.490 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.490 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.490 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.490 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.490 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.490 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T01:18:05.490 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.490 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_no_wait": { 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.492 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.492 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.492 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.492 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.492 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.492 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.492 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.492 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.492 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.492 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.492 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.492 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.492 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix", 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: "discovery_interval": { 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "discovery_interval", 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "100", 2024-09-11T01:18:05.493 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: "identifier": { 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "identifier", 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.494 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.495 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.496 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.496 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.496 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.496 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.496 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.496 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.496 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.496 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.496 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.496 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.496 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.496 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.497 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.497 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.497 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.497 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.497 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.497 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.497 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.497 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.497 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.497 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.497 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.497 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.498 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.499 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.500 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.500 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.500 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.500 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.500 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.500 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.500 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.500 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.500 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.500 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.500 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.500 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.500 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.500 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.501 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_host": { 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_host", 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.502 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_port": { 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_port", 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10051", 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.503 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_sender": { 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_sender", 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.504 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.505 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-11T01:18:05.505 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.505 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.505 INFO:teuthology.orchestra.run.smithi103.stdout: "gid": 24170, 2024-09-11T01:18:05.505 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "y", 2024-09-11T01:18:05.505 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_features": 4540719139924082687, 2024-09-11T01:18:05.505 INFO:teuthology.orchestra.run.smithi103.stdout: "available_modules": [ 2024-09-11T01:18:05.505 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.505 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "alerts", 2024-09-11T01:18:05.505 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.505 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.506 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.506 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:05.506 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:05.506 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.506 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.506 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.506 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:05.506 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.506 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.506 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.506 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T01:18:05.506 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.506 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.506 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.507 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.507 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.507 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.507 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.507 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.507 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.507 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.507 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.507 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.507 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.507 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.507 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.507 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.508 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.508 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.508 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.508 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.508 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.508 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.508 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.508 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.508 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.508 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.508 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.508 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.508 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.508 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.509 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.510 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.510 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.510 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.510 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.510 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.510 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.510 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.510 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.510 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.510 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.510 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.510 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.510 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.511 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.511 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.511 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.511 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.511 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.511 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.511 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.511 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.511 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.511 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.511 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.511 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.511 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_destination": { 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_destination", 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.512 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_from_name": { 2024-09-11T01:18:05.513 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_from_name", 2024-09-11T01:18:05.513 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.513 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.513 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.513 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "Ceph", 2024-09-11T01:18:05.513 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.513 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.513 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.513 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email From: name", 2024-09-11T01:18:05.513 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.513 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.513 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.513 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.513 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_host": { 2024-09-11T01:18:05.514 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_host", 2024-09-11T01:18:05.514 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.514 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.514 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.514 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.514 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.514 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.514 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.514 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP server", 2024-09-11T01:18:05.514 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.514 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.514 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.514 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.514 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_password": { 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_password", 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Password to authenticate with", 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_port": { 2024-09-11T01:18:05.515 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_port", 2024-09-11T01:18:05.516 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.516 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.516 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.516 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "465", 2024-09-11T01:18:05.516 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.516 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.516 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.516 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP port", 2024-09-11T01:18:05.516 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.516 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.516 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.516 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_sender": { 2024-09-11T01:18:05.516 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_sender", 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP envelope sender", 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_ssl": { 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_ssl", 2024-09-11T01:18:05.517 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_user": { 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_user", 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.518 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.519 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.519 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.519 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.519 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.519 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.519 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "User to authenticate as", 2024-09-11T01:18:05.519 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.519 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.519 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.519 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.519 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.519 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.520 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "balancer", 2024-09-11T01:18:05.521 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.521 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.521 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.521 INFO:teuthology.orchestra.run.smithi103.stdout: "active": { 2024-09-11T01:18:05.521 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "active", 2024-09-11T01:18:05.521 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.521 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.521 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.521 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.521 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.521 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.521 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.521 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T01:18:05.522 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.522 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.522 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.522 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_time": { 2024-09-11T01:18:05.522 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_time", 2024-09-11T01:18:05.522 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.522 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.522 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.522 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0000", 2024-09-11T01:18:05.522 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.522 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.522 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.522 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_weekday": { 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_weekday", 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T01:18:05.523 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T01:18:05.524 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.524 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.524 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_max_iterations": { 2024-09-11T01:18:05.524 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_max_iterations", 2024-09-11T01:18:05.524 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:05.524 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.524 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.524 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "25", 2024-09-11T01:18:05.524 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-11T01:18:05.524 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "250", 2024-09-11T01:18:05.524 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.525 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T01:18:05.525 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.525 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.525 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.525 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_metrics": { 2024-09-11T01:18:05.525 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_metrics", 2024-09-11T01:18:05.525 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.525 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.525 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.525 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T01:18:05.525 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.525 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.525 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.526 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T01:18:05.526 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T01:18:05.526 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.526 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.526 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_step": { 2024-09-11T01:18:05.526 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_step", 2024-09-11T01:18:05.526 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:05.526 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.526 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.526 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.5", 2024-09-11T01:18:05.526 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0.001", 2024-09-11T01:18:05.526 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "0.999", 2024-09-11T01:18:05.526 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "aggressiveness of optimization", 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: "end_time": { 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_time", 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2359", 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.527 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "end_weekday": { 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_weekday", 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T01:18:05.528 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.529 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.530 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.531 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.531 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.531 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.531 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.531 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.531 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.531 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.531 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.531 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.531 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.531 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.531 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.533 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.533 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.533 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.533 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.533 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.533 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.533 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.533 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.533 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.533 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.533 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.533 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.533 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: "min_score": { 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_score", 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.534 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-09-11T01:18:05.535 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-09-11T01:18:05.535 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.535 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.535 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.535 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "upmap", 2024-09-11T01:18:05.535 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.535 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.535 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.535 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-compat", 2024-09-11T01:18:05.535 INFO:teuthology.orchestra.run.smithi103.stdout: "none", 2024-09-11T01:18:05.535 INFO:teuthology.orchestra.run.smithi103.stdout: "read", 2024-09-11T01:18:05.535 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap", 2024-09-11T01:18:05.535 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap-read" 2024-09-11T01:18:05.535 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.536 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Balancer mode", 2024-09-11T01:18:05.536 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.536 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.536 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.536 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_ids": { 2024-09-11T01:18:05.536 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_ids", 2024-09-11T01:18:05.536 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.536 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.536 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.536 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.536 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.536 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.536 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.537 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T01:18:05.537 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.537 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.537 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.537 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:05.537 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:05.537 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.537 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.537 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.537 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:05.537 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.537 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.538 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.539 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.539 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.539 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.539 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_deviation": { 2024-09-11T01:18:05.539 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_deviation", 2024-09-11T01:18:05.539 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.539 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.539 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.539 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:05.539 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-11T01:18:05.539 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.539 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.539 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T01:18:05.540 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T01:18:05.540 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.540 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.540 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_optimizations": { 2024-09-11T01:18:05.540 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_optimizations", 2024-09-11T01:18:05.540 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:05.540 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.540 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.540 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.540 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.540 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.540 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm", 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_down_multiplier": { 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_down_multiplier", 2024-09-11T01:18:05.541 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:05.542 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.542 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.542 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-09-11T01:18:05.542 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.542 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.542 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.542 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T01:18:05.542 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.542 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.542 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.542 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_refresh_rate": { 2024-09-11T01:18:05.542 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_refresh_rate", 2024-09-11T01:18:05.542 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.543 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.543 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.543 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "20", 2024-09-11T01:18:05.543 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.543 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.543 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.543 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T01:18:05.543 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.543 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.543 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.543 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_starting_port": { 2024-09-11T01:18:05.543 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_starting_port", 2024-09-11T01:18:05.544 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.544 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.544 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.544 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4721", 2024-09-11T01:18:05.544 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.544 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.544 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.544 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T01:18:05.544 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.544 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.544 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.544 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_ptrace": { 2024-09-11T01:18:05.545 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_ptrace", 2024-09-11T01:18:05.545 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.545 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.545 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.545 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.545 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.545 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.545 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.545 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T01:18:05.545 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T01:18:05.545 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.545 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.546 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_interval": { 2024-09-11T01:18:05.546 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_interval", 2024-09-11T01:18:05.546 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.546 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.546 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.546 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:05.546 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.546 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.546 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.546 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T01:18:05.546 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.546 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.546 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.547 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_memory_target_ratio": { 2024-09-11T01:18:05.547 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T01:18:05.547 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:05.547 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.547 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.547 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.7", 2024-09-11T01:18:05.547 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.547 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.547 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.547 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T01:18:05.547 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.547 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.547 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.548 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm_log_destination": { 2024-09-11T01:18:05.548 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm_log_destination", 2024-09-11T01:18:05.548 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.548 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.548 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.548 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.548 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.548 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.548 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.548 INFO:teuthology.orchestra.run.smithi103.stdout: "file", 2024-09-11T01:18:05.548 INFO:teuthology.orchestra.run.smithi103.stdout: "file,syslog", 2024-09-11T01:18:05.548 INFO:teuthology.orchestra.run.smithi103.stdout: "syslog" 2024-09-11T01:18:05.549 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.549 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T01:18:05.549 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.549 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.549 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.549 INFO:teuthology.orchestra.run.smithi103.stdout: "cgroups_split": { 2024-09-11T01:18:05.549 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cgroups_split", 2024-09-11T01:18:05.549 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.549 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.549 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.549 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.549 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.550 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.550 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.550 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T01:18:05.550 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.550 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.550 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.550 INFO:teuthology.orchestra.run.smithi103.stdout: "config_checks_enabled": { 2024-09-11T01:18:05.550 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_checks_enabled", 2024-09-11T01:18:05.550 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.550 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.550 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.550 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.551 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.551 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.551 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.551 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T01:18:05.551 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.551 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.551 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.551 INFO:teuthology.orchestra.run.smithi103.stdout: "config_dashboard": { 2024-09-11T01:18:05.551 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_dashboard", 2024-09-11T01:18:05.551 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.551 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.551 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.551 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.552 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.552 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.552 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.552 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T01:18:05.552 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.552 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.552 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.552 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_alertmanager": { 2024-09-11T01:18:05.552 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_alertmanager", 2024-09-11T01:18:05.552 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.552 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.552 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.552 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-11T01:18:05.553 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.553 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.553 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.553 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-11T01:18:05.553 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.553 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.553 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.553 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_base": { 2024-09-11T01:18:05.553 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_base", 2024-09-11T01:18:05.553 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.553 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.553 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Container image name, without the tag", 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_elasticsearch": { 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_elasticsearch", 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.554 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T01:18:05.555 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.555 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.555 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.555 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "elasticsearch container image", 2024-09-11T01:18:05.555 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.555 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.555 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.555 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_grafana": { 2024-09-11T01:18:05.555 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_grafana", 2024-09-11T01:18:05.555 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.555 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.555 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.555 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_haproxy": { 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_haproxy", 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T01:18:05.556 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.557 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.557 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.557 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "HAproxy container image", 2024-09-11T01:18:05.557 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.557 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.557 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.557 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_agent": { 2024-09-11T01:18:05.557 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_agent", 2024-09-11T01:18:05.557 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.557 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.557 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.557 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T01:18:05.557 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.558 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.558 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.558 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger agent container image", 2024-09-11T01:18:05.558 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.558 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.558 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.558 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_collector": { 2024-09-11T01:18:05.558 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_collector", 2024-09-11T01:18:05.558 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.558 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.558 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.558 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T01:18:05.558 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger collector container image", 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_query": { 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_query", 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.559 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.560 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.560 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger query container image", 2024-09-11T01:18:05.560 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.560 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.560 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.560 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_keepalived": { 2024-09-11T01:18:05.560 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_keepalived", 2024-09-11T01:18:05.560 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.560 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.560 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.560 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T01:18:05.562 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.562 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.562 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.562 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Keepalived container image", 2024-09-11T01:18:05.562 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.562 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.562 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.562 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_loki": { 2024-09-11T01:18:05.562 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_loki", 2024-09-11T01:18:05.562 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.562 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.562 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.563 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T01:18:05.563 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.563 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.563 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.563 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Loki container image", 2024-09-11T01:18:05.563 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.563 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.563 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.563 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_nginx": { 2024-09-11T01:18:05.563 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_nginx", 2024-09-11T01:18:05.563 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.563 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.564 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.564 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-11T01:18:05.564 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.564 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.564 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.564 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Nginx container image", 2024-09-11T01:18:05.564 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.564 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.564 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.564 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_node_exporter": { 2024-09-11T01:18:05.564 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_node_exporter", 2024-09-11T01:18:05.564 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.564 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.565 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.565 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-11T01:18:05.565 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.565 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.565 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.565 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-11T01:18:05.565 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.565 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.565 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.565 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_nvmeof": { 2024-09-11T01:18:05.565 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_nvmeof", 2024-09-11T01:18:05.565 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.565 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.566 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.566 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-11T01:18:05.566 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.566 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.566 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.566 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Nvme-of container image", 2024-09-11T01:18:05.566 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.566 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.566 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.566 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_oauth2_proxy": { 2024-09-11T01:18:05.566 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_oauth2_proxy", 2024-09-11T01:18:05.566 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.567 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.567 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.567 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-11T01:18:05.567 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.567 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.567 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.567 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "oauth2-proxy container image", 2024-09-11T01:18:05.567 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.567 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.567 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.567 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_prometheus": { 2024-09-11T01:18:05.567 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_prometheus", 2024-09-11T01:18:05.567 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.568 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.568 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.568 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-11T01:18:05.568 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.568 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.568 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.568 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-11T01:18:05.568 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.568 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.568 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.568 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.568 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_promtail": { 2024-09-11T01:18:05.568 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_promtail", 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Promtail container image", 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_samba": { 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_samba", 2024-09-11T01:18:05.569 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Samba/SMB container image", 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_samba_metrics": { 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_samba_metrics", 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.570 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.571 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.571 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-11T01:18:05.571 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.571 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.571 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.571 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-11T01:18:05.571 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.571 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.571 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.571 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.571 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_snmp_gateway": { 2024-09-11T01:18:05.572 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_snmp_gateway", 2024-09-11T01:18:05.572 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.572 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.572 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.572 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T01:18:05.572 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.572 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.572 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.572 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SNMP Gateway container image", 2024-09-11T01:18:05.572 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.572 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.572 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.572 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.572 INFO:teuthology.orchestra.run.smithi103.stdout: "container_init": { 2024-09-11T01:18:05.573 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_init", 2024-09-11T01:18:05.573 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.573 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.573 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.573 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.573 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.573 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.573 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.573 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T01:18:05.573 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.573 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.573 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.573 INFO:teuthology.orchestra.run.smithi103.stdout: "daemon_cache_timeout": { 2024-09-11T01:18:05.574 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "daemon_cache_timeout", 2024-09-11T01:18:05.574 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.574 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.574 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.574 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:05.574 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.574 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.574 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.574 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T01:18:05.574 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.574 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.574 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.574 INFO:teuthology.orchestra.run.smithi103.stdout: "default_cephadm_command_timeout": { 2024-09-11T01:18:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T01:18:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "900", 2024-09-11T01:18:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T01:18:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.575 INFO:teuthology.orchestra.run.smithi103.stdout: "default_registry": { 2024-09-11T01:18:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_registry", 2024-09-11T01:18:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io", 2024-09-11T01:18:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T01:18:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.576 INFO:teuthology.orchestra.run.smithi103.stdout: "device_cache_timeout": { 2024-09-11T01:18:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_cache_timeout", 2024-09-11T01:18:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1800", 2024-09-11T01:18:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache device inventory", 2024-09-11T01:18:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.577 INFO:teuthology.orchestra.run.smithi103.stdout: "device_enhanced_scan": { 2024-09-11T01:18:05.578 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_enhanced_scan", 2024-09-11T01:18:05.578 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.578 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.578 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.578 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.578 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.578 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.578 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.578 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T01:18:05.578 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.578 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.578 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.578 INFO:teuthology.orchestra.run.smithi103.stdout: "facts_cache_timeout": { 2024-09-11T01:18:05.579 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "facts_cache_timeout", 2024-09-11T01:18:05.579 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.579 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.579 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.579 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:05.579 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.579 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.579 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.579 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache host facts data", 2024-09-11T01:18:05.579 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.579 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.579 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.579 INFO:teuthology.orchestra.run.smithi103.stdout: "grafana_dashboards_path": { 2024-09-11T01:18:05.580 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "grafana_dashboards_path", 2024-09-11T01:18:05.580 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.580 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.580 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.580 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T01:18:05.580 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.580 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.580 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.580 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T01:18:05.580 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.580 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.580 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.580 INFO:teuthology.orchestra.run.smithi103.stdout: "host_check_interval": { 2024-09-11T01:18:05.581 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "host_check_interval", 2024-09-11T01:18:05.581 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.581 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.581 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.581 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:05.581 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.581 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.581 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.581 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to perform a host check", 2024-09-11T01:18:05.581 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.581 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.581 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.582 INFO:teuthology.orchestra.run.smithi103.stdout: "hw_monitoring": { 2024-09-11T01:18:05.582 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hw_monitoring", 2024-09-11T01:18:05.582 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.582 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.582 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.582 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.582 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.582 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.582 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.582 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T01:18:05.582 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.582 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.582 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.583 INFO:teuthology.orchestra.run.smithi103.stdout: "inventory_list_all": { 2024-09-11T01:18:05.583 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "inventory_list_all", 2024-09-11T01:18:05.583 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.583 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.583 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.583 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.583 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.583 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.583 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.583 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T01:18:05.583 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.583 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.583 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.584 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.584 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.584 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.584 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.584 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.584 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.584 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.584 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.584 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.584 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.584 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.584 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.584 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: "log_refresh_metadata": { 2024-09-11T01:18:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_refresh_metadata", 2024-09-11T01:18:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.585 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.586 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.586 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.586 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.586 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.586 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T01:18:05.586 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.586 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.586 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.586 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.586 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.586 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.586 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.587 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.587 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.587 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.587 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.587 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.587 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.587 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T01:18:05.587 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.587 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.587 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.587 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.587 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.587 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.587 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.588 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.588 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.588 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.588 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.588 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.588 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.588 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.588 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.588 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.588 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.588 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.588 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.588 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.588 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.589 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.589 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.589 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.589 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.589 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.589 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.589 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.589 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.589 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.589 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.589 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.590 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.591 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T01:18:05.591 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.591 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.591 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.591 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T01:18:05.591 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T01:18:05.591 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.591 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.591 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.591 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "*", 2024-09-11T01:18:05.591 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.591 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T01:18:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: "max_count_per_host": { 2024-09-11T01:18:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_count_per_host", 2024-09-11T01:18:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.592 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of daemons per service per host", 2024-09-11T01:18:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd_draining_count": { 2024-09-11T01:18:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_osd_draining_count", 2024-09-11T01:18:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.593 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.594 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.594 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T01:18:05.594 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.594 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.594 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.594 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.594 INFO:teuthology.orchestra.run.smithi103.stdout: "migration_current": { 2024-09-11T01:18:05.594 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "migration_current", 2024-09-11T01:18:05.594 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.594 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.594 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.594 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.594 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.595 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.595 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.595 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "internal - do not modify", 2024-09-11T01:18:05.595 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.595 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.595 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.595 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.595 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-09-11T01:18:05.595 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-09-11T01:18:05.595 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.595 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.595 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.595 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "root", 2024-09-11T01:18:05.595 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.596 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.596 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.596 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm-package", 2024-09-11T01:18:05.596 INFO:teuthology.orchestra.run.smithi103.stdout: "root" 2024-09-11T01:18:05.596 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.596 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T01:18:05.596 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.596 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.596 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.596 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.596 INFO:teuthology.orchestra.run.smithi103.stdout: "oob_default_addr": { 2024-09-11T01:18:05.596 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "oob_default_addr", 2024-09-11T01:18:05.597 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.597 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.597 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.597 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "169.254.1.1", 2024-09-11T01:18:05.597 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.597 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.597 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.597 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T01:18:05.597 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.597 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.597 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.597 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.597 INFO:teuthology.orchestra.run.smithi103.stdout: "prometheus_alerts_path": { 2024-09-11T01:18:05.598 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus_alerts_path", 2024-09-11T01:18:05.598 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.598 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.598 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.598 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T01:18:05.598 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.598 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.598 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.598 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T01:18:05.598 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.598 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.598 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.598 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.598 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_insecure": { 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_insecure", 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_password": { 2024-09-11T01:18:05.599 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_password", 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_url": { 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_url", 2024-09-11T01:18:05.600 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.601 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.601 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.601 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.601 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.601 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.601 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.601 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T01:18:05.601 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.601 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.601 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.601 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.601 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_username": { 2024-09-11T01:18:05.601 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_username", 2024-09-11T01:18:05.602 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.602 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.602 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.602 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.602 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.602 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.602 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.602 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T01:18:05.602 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.602 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.602 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.602 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.602 INFO:teuthology.orchestra.run.smithi103.stdout: "secure_monitoring_stack": { 2024-09-11T01:18:05.602 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secure_monitoring_stack", 2024-09-11T01:18:05.603 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.603 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.603 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.603 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.603 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.603 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.603 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.603 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T01:18:05.603 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.603 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.603 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.603 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.603 INFO:teuthology.orchestra.run.smithi103.stdout: "service_discovery_port": { 2024-09-11T01:18:05.603 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "service_discovery_port", 2024-09-11T01:18:05.604 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.604 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.604 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.604 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8765", 2024-09-11T01:18:05.604 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.604 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.604 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.604 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "cephadm service discovery port", 2024-09-11T01:18:05.604 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.604 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.604 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.604 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.604 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.604 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: "ssh_config_file": { 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssh_config_file", 2024-09-11T01:18:05.605 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.606 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.606 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.606 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.606 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.606 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.606 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.606 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T01:18:05.606 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.606 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.606 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.606 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.606 INFO:teuthology.orchestra.run.smithi103.stdout: "use_agent": { 2024-09-11T01:18:05.606 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_agent", 2024-09-11T01:18:05.606 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: "use_repo_digest": { 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_repo_digest", 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.607 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.608 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.608 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.608 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.608 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.608 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.608 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T01:18:05.608 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.608 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.608 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.608 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.608 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_failed_host_check": { 2024-09-11T01:18:05.608 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_failed_host_check", 2024-09-11T01:18:05.608 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.608 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.609 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.609 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.609 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.609 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.609 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.609 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T01:18:05.609 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.609 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.609 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.609 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.609 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_daemons": { 2024-09-11T01:18:05.609 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_daemons", 2024-09-11T01:18:05.609 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.610 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.610 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.610 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.610 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.610 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.610 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.610 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T01:18:05.610 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.610 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.610 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.610 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.610 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_hosts": { 2024-09-11T01:18:05.610 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_hosts", 2024-09-11T01:18:05.610 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.611 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.611 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.611 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.611 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.611 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.611 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.611 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T01:18:05.611 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.611 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.611 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.611 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.611 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.612 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.612 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.612 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crash", 2024-09-11T01:18:05.612 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.612 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.612 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.612 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.612 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.612 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.612 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.612 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.612 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.612 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.613 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.613 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.613 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.613 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.613 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.613 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.613 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.613 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.613 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.613 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.613 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.613 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.613 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.613 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.614 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.614 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.614 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.614 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.614 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.614 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.614 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.614 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.614 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.614 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.614 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.614 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.614 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.615 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.616 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.616 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.616 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.616 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.616 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.616 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.616 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.616 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.616 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.616 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.616 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.616 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.616 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: "retain_interval": { 2024-09-11T01:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retain_interval", 2024-09-11T01:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.617 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "31536000", 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.618 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.619 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.619 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.619 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.619 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.619 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.619 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.619 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.619 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_recent_interval": { 2024-09-11T01:18:05.619 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_recent_interval", 2024-09-11T01:18:05.619 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.619 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.619 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.619 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1209600", 2024-09-11T01:18:05.619 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.620 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.620 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.620 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T01:18:05.620 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.620 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.620 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.620 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.620 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.620 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.620 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dashboard", 2024-09-11T01:18:05.620 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.620 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.620 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.621 INFO:teuthology.orchestra.run.smithi103.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T01:18:05.621 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T01:18:05.621 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.621 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.621 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.621 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.621 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.621 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.621 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.621 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.621 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.621 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.621 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.621 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.622 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T01:18:05.622 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T01:18:05.622 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.622 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.622 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.622 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.622 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.622 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.622 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.622 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.622 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.622 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.622 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.623 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T01:18:05.623 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T01:18:05.623 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.623 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.623 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.623 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.623 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.623 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.623 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.623 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.623 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.623 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.623 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.623 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.624 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_ENABLED": { 2024-09-11T01:18:05.624 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T01:18:05.624 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.624 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.624 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.624 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.624 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.624 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.624 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.624 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.624 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.624 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.624 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.625 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.625 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T01:18:05.625 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T01:18:05.625 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.625 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.625 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.625 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.625 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.625 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.625 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.625 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.625 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.625 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.626 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T01:18:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T01:18:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.627 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.628 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.628 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T01:18:05.628 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T01:18:05.628 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.628 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.628 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.628 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.628 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.628 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.628 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.628 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.628 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.628 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.628 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.629 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.629 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T01:18:05.629 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T01:18:05.629 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.629 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.629 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.629 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.629 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.629 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.629 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.629 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.629 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.629 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.629 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.630 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T01:18:05.630 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T01:18:05.630 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.630 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.630 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.630 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.630 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.630 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.630 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.630 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.630 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.630 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.630 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T01:18:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T01:18:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.632 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.634 INFO:teuthology.orchestra.run.smithi103.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T01:18:05.634 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T01:18:05.634 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.634 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.634 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.634 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.634 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.634 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.634 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.634 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.634 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.634 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.634 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.634 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.635 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T01:18:05.635 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T01:18:05.635 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.635 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.635 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.635 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-11T01:18:05.635 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.635 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.635 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.635 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.635 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.635 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.635 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.635 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.636 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T01:18:05.636 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T01:18:05.636 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.636 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.636 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.636 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.636 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.636 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.636 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.636 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.636 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.636 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.636 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.637 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_URL": { 2024-09-11T01:18:05.637 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_URL", 2024-09-11T01:18:05.637 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.637 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.637 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.637 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.637 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.637 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.637 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.637 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.637 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.637 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T01:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T01:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-11T01:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.638 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T01:18:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T01:18:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.639 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T01:18:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T01:18:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.640 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.641 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.641 INFO:teuthology.orchestra.run.smithi103.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T01:18:05.641 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T01:18:05.641 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.641 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.641 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.641 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.641 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.641 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.641 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.641 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.641 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.641 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.642 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.642 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.642 INFO:teuthology.orchestra.run.smithi103.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T01:18:05.642 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T01:18:05.642 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.642 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.642 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.642 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.642 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.642 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.642 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.642 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.642 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.642 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.643 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.643 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.643 INFO:teuthology.orchestra.run.smithi103.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-11T01:18:05.643 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-11T01:18:05.643 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.643 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.643 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.643 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "[]", 2024-09-11T01:18:05.643 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.643 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.643 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.643 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.643 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.644 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.644 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.644 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.644 INFO:teuthology.orchestra.run.smithi103.stdout: "MULTICLUSTER_CONFIG": { 2024-09-11T01:18:05.644 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-11T01:18:05.644 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.644 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.644 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.644 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "{}", 2024-09-11T01:18:05.644 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.644 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.644 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.644 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.645 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.645 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.645 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.645 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.645 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T01:18:05.645 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T01:18:05.645 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.645 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.645 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.645 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.645 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.645 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.645 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.646 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.646 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.646 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.646 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.646 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.646 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T01:18:05.646 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T01:18:05.646 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.646 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.646 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.646 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.646 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.646 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.647 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.647 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.647 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.647 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.647 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.647 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.647 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T01:18:05.647 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T01:18:05.647 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.647 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.647 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.647 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.647 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.647 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.648 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.649 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.649 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.649 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.649 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.649 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.649 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T01:18:05.649 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T01:18:05.649 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.649 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.649 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.649 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.649 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.649 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.650 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.650 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.650 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.650 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.650 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.650 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.650 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T01:18:05.650 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T01:18:05.650 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.650 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.650 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.650 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.650 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.650 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.651 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.651 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.651 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.651 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.651 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.651 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.651 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T01:18:05.651 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T01:18:05.651 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.651 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.651 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.651 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.651 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.651 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.652 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.652 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.652 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.652 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.652 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.652 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.652 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T01:18:05.652 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T01:18:05.652 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.652 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.652 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.652 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.652 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.652 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.653 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.653 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.653 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.653 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.653 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.653 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.653 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T01:18:05.653 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T01:18:05.653 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.653 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.653 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.653 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.653 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.654 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.655 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.656 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.656 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.656 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.656 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.656 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.656 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T01:18:05.656 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T01:18:05.656 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.656 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.656 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.656 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.656 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.656 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.657 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.657 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.657 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.657 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.657 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.657 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.657 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T01:18:05.657 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T01:18:05.657 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.657 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.657 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.657 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8", 2024-09-11T01:18:05.657 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.658 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.658 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.658 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.658 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.658 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.658 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.658 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.658 INFO:teuthology.orchestra.run.smithi103.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T01:18:05.658 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T01:18:05.658 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.658 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.658 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.658 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "45", 2024-09-11T01:18:05.658 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.659 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.660 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.660 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.660 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.660 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.660 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.660 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.660 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T01:18:05.660 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T01:18:05.660 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.660 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.660 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.660 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-11T01:18:05.660 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.661 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.661 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.661 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.661 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.661 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.661 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.661 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.661 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T01:18:05.661 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T01:18:05.661 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.661 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.662 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.663 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.663 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.663 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.663 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.663 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.663 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.663 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.663 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.663 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.663 INFO:teuthology.orchestra.run.smithi103.stdout: "UNSAFE_TLS_v1_2": { 2024-09-11T01:18:05.663 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-11T01:18:05.663 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.663 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.663 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.664 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.664 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.664 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.664 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.664 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.664 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.664 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.664 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.664 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.664 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T01:18:05.664 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T01:18:05.664 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T01:18:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T01:18:05.665 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.666 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.666 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.666 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.666 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.666 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.666 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.666 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.666 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.666 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.666 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.666 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.666 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T01:18:05.666 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "cross_origin_url": { 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cross_origin_url", 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.667 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: "crt_file": { 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crt_file", 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.668 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.669 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.669 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.669 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.669 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.669 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.669 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.669 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.669 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.669 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.669 INFO:teuthology.orchestra.run.smithi103.stdout: "debug": { 2024-09-11T01:18:05.669 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "debug", 2024-09-11T01:18:05.669 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.669 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable/disable debug options", 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: "jwt_token_ttl": { 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "jwt_token_ttl", 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.670 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.671 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "28800", 2024-09-11T01:18:05.671 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.671 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.671 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.671 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.671 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.671 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.671 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.671 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.671 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-09-11T01:18:05.671 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-09-11T01:18:05.671 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.671 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.671 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.672 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.672 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.672 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.672 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.672 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.672 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.672 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.672 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.672 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.672 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.672 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.672 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.672 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.673 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.673 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.673 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.673 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.673 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.673 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.673 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.673 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.673 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.673 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.673 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.673 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.673 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.673 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.674 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.674 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.674 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.674 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.674 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.674 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.674 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.674 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.674 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.674 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.674 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.674 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.674 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.674 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.675 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.676 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.676 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.676 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.676 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.676 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.676 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.676 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.676 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.676 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.676 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.676 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.676 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.676 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.677 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.677 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.677 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.677 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.677 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.677 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.677 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.677 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.677 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.677 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.677 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.677 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.677 INFO:teuthology.orchestra.run.smithi103.stdout: "motd": { 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "motd", 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "The message of the day", 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect_resolve_ip_addr": { 2024-09-11T01:18:05.678 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T01:18:05.679 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.679 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.679 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.679 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.679 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.679 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.679 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.679 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.679 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.679 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.679 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.679 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.679 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-11T01:18:05.679 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-11T01:18:05.680 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.680 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.680 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.680 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-09-11T01:18:05.680 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.680 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.680 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.680 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.680 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.680 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.680 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.680 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.680 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-11T01:18:05.680 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-11T01:18:05.681 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.681 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.681 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.681 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8080", 2024-09-11T01:18:05.681 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.681 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.681 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.681 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.681 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.681 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.681 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.681 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.681 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-09-11T01:18:05.682 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-09-11T01:18:05.683 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.683 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.683 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.683 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.683 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.683 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.683 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.683 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.683 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.683 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.683 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.683 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.683 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl_server_port": { 2024-09-11T01:18:05.684 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl_server_port", 2024-09-11T01:18:05.684 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.684 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.684 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.684 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8443", 2024-09-11T01:18:05.684 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.684 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.684 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.684 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.684 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.684 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.684 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-09-11T01:18:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-09-11T01:18:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "redirect", 2024-09-11T01:18:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect" 2024-09-11T01:18:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.685 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.686 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.687 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.687 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.687 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.687 INFO:teuthology.orchestra.run.smithi103.stdout: "url_prefix": { 2024-09-11T01:18:05.687 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url_prefix", 2024-09-11T01:18:05.687 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.687 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.687 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.687 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.687 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.687 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.687 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.687 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.687 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.688 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.688 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.688 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.688 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.688 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.688 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.688 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "devicehealth", 2024-09-11T01:18:05.688 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.688 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.688 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.688 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_monitoring": { 2024-09-11T01:18:05.688 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_monitoring", 2024-09-11T01:18:05.688 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "monitor device health metrics", 2024-09-11T01:18:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.689 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.690 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.690 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.690 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.690 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.690 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.690 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.690 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.690 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.690 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.690 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.690 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.691 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.691 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.691 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.691 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.691 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.691 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.691 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.691 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.691 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.691 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.691 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.691 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.691 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.692 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.692 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.692 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.692 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.692 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.692 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.692 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.692 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.692 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.692 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.692 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.692 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.693 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.693 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.693 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.693 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.693 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.693 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.693 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.693 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.693 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.693 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.693 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.693 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.693 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.693 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.694 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.694 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.694 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.694 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.694 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.694 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.694 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.694 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.694 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.694 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.694 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.694 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.694 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.694 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.695 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.695 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.695 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.695 INFO:teuthology.orchestra.run.smithi103.stdout: "mark_out_threshold": { 2024-09-11T01:18:05.695 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mark_out_threshold", 2024-09-11T01:18:05.695 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.695 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.695 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.695 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2419200", 2024-09-11T01:18:05.695 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.695 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.695 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.695 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T01:18:05.696 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.696 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.696 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.696 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.696 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": { 2024-09-11T01:18:05.696 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_name", 2024-09-11T01:18:05.696 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.696 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.696 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.696 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "device_health_metrics", 2024-09-11T01:18:05.696 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.697 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.697 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.697 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T01:18:05.697 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.697 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.697 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.697 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.697 INFO:teuthology.orchestra.run.smithi103.stdout: "retention_period": { 2024-09-11T01:18:05.697 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retention_period", 2024-09-11T01:18:05.697 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.697 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.697 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.698 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15552000", 2024-09-11T01:18:05.698 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.698 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.698 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.698 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain device health metrics", 2024-09-11T01:18:05.698 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.698 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.698 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.698 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.698 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_frequency": { 2024-09-11T01:18:05.698 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_frequency", 2024-09-11T01:18:05.698 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.698 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.698 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.699 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-09-11T01:18:05.699 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.699 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.699 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.699 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T01:18:05.699 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.699 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.699 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.699 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.699 INFO:teuthology.orchestra.run.smithi103.stdout: "self_heal": { 2024-09-11T01:18:05.699 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "self_heal", 2024-09-11T01:18:05.699 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.699 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.700 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.701 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_threshold": { 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_threshold", 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7257600", 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.702 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "diskprediction_local", 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.703 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.704 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.704 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.704 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.704 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.704 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.704 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.704 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.704 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.704 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.704 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.704 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.704 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.704 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.704 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.705 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.705 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.705 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.705 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.705 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.705 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.705 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.705 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.705 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.705 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.705 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.705 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.705 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.706 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.706 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.706 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.706 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.706 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.706 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.706 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.706 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.706 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.706 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.706 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.706 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.706 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.706 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.707 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.707 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.707 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.707 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.707 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.707 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.707 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.707 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.707 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.707 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.707 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.707 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.707 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.708 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.708 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.708 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.708 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.708 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.708 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.708 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.708 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.708 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.708 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.708 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.708 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.708 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.709 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.709 INFO:teuthology.orchestra.run.smithi103.stdout: "predict_interval": { 2024-09-11T01:18:05.709 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predict_interval", 2024-09-11T01:18:05.709 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.709 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.709 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.709 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-09-11T01:18:05.709 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.709 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.709 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.709 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.709 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.709 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.709 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.710 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.710 INFO:teuthology.orchestra.run.smithi103.stdout: "predictor_model": { 2024-09-11T01:18:05.710 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predictor_model", 2024-09-11T01:18:05.710 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.710 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.710 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.710 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "prophetstor", 2024-09-11T01:18:05.710 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.710 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.710 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.710 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.710 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.710 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.710 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.711 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.711 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:05.711 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:05.711 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.711 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.711 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.711 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:05.711 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.711 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.711 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.711 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.711 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.711 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.711 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.712 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.712 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.712 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.712 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.712 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.712 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.712 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.712 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.712 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.712 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.712 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.712 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.712 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.713 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.713 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.713 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.713 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.713 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.713 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "influx", 2024-09-11T01:18:05.713 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": false, 2024-09-11T01:18:05.713 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "influxdb python module not found", 2024-09-11T01:18:05.713 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.713 INFO:teuthology.orchestra.run.smithi103.stdout: "batch_size": { 2024-09-11T01:18:05.713 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "batch_size", 2024-09-11T01:18:05.713 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.713 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.714 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.714 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5000", 2024-09-11T01:18:05.714 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.714 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.714 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.714 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T01:18:05.714 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.714 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.714 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.714 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.714 INFO:teuthology.orchestra.run.smithi103.stdout: "database": { 2024-09-11T01:18:05.714 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "database", 2024-09-11T01:18:05.714 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.714 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.715 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.715 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "ceph", 2024-09-11T01:18:05.715 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.715 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.715 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.715 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T01:18:05.715 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.715 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.715 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.715 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.715 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": { 2024-09-11T01:18:05.715 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hostname", 2024-09-11T01:18:05.715 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.715 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.716 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.716 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.716 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.716 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.716 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.716 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server hostname", 2024-09-11T01:18:05.716 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.716 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.716 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.716 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.716 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:05.716 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:05.716 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.717 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.717 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.717 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "30", 2024-09-11T01:18:05.717 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "5", 2024-09-11T01:18:05.717 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.717 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.717 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T01:18:05.717 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.717 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.717 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.717 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.717 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.717 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.718 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.718 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.718 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.718 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.718 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.718 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.718 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.718 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.718 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.718 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.718 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.718 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.718 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.719 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.720 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.720 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.720 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.720 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.720 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.720 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.720 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.720 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.720 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.720 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.720 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.720 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.720 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.721 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.721 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.721 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.721 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.721 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.721 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.721 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.721 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.721 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.721 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.721 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.721 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.721 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.721 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.722 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.722 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.722 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.722 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.722 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.722 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.722 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.722 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.722 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.722 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.722 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.722 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.722 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.723 INFO:teuthology.orchestra.run.smithi103.stdout: "password": { 2024-09-11T01:18:05.723 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "password", 2024-09-11T01:18:05.723 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.723 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.723 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.723 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.723 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.723 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.723 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.723 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "password of InfluxDB server user", 2024-09-11T01:18:05.723 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.723 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.723 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.723 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.724 INFO:teuthology.orchestra.run.smithi103.stdout: "port": { 2024-09-11T01:18:05.724 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "port", 2024-09-11T01:18:05.724 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.724 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.724 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.724 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8086", 2024-09-11T01:18:05.724 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.724 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.724 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.724 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server port", 2024-09-11T01:18:05.724 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.724 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.725 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.725 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.725 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.725 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.725 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.725 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.725 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.725 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.725 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.725 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.725 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.725 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.725 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.725 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.726 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.726 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.726 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-09-11T01:18:05.726 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-09-11T01:18:05.726 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.726 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.726 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.726 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "false", 2024-09-11T01:18:05.726 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.726 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.726 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.726 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T01:18:05.726 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.727 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.727 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.727 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.727 INFO:teuthology.orchestra.run.smithi103.stdout: "threads": { 2024-09-11T01:18:05.727 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threads", 2024-09-11T01:18:05.727 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.727 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.727 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.727 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:05.727 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-11T01:18:05.727 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "32", 2024-09-11T01:18:05.727 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.727 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T01:18:05.727 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: "username": { 2024-09-11T01:18:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "username", 2024-09-11T01:18:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "username of InfluxDB server user", 2024-09-11T01:18:05.728 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.729 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.729 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.729 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.729 INFO:teuthology.orchestra.run.smithi103.stdout: "verify_ssl": { 2024-09-11T01:18:05.729 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "verify_ssl", 2024-09-11T01:18:05.729 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.729 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.729 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.729 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "true", 2024-09-11T01:18:05.729 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.729 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.729 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.729 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "insights", 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.730 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.731 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.731 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.731 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.731 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.731 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.731 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.731 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.731 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.731 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.731 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.731 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.731 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.731 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.731 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.732 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.732 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.732 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.732 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.732 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.732 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.732 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.732 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.732 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.732 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.732 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.732 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.733 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.733 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.733 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.733 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.733 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.733 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.733 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.733 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.733 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.733 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.733 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.733 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.733 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.734 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.734 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.734 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.734 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.734 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.734 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.734 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.734 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.734 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.734 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.734 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.734 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.734 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.734 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.735 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.735 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.735 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.735 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.735 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.735 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.735 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.735 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.735 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.735 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.735 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.735 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.736 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.736 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.736 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.736 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.736 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.736 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.736 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.736 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.736 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.736 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.736 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.736 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.736 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.736 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.737 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.737 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.737 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.737 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.737 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "iostat", 2024-09-11T01:18:05.737 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.737 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.737 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.737 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.737 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.737 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.737 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.737 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.738 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.739 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.740 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.740 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.740 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.740 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.740 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.740 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.740 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.740 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.740 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.740 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.740 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.740 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.740 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.740 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.741 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.741 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.741 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.741 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.741 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.741 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.741 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.741 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.741 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.741 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.741 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.741 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.741 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.742 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.742 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.742 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.742 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.742 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.742 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.742 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.742 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.742 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.742 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.742 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.742 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.742 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.742 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.743 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.743 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.743 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.743 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.743 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.743 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.743 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.743 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.743 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.743 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.743 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.743 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "k8sevents", 2024-09-11T01:18:05.743 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.743 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.744 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.744 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_event_retention_days": { 2024-09-11T01:18:05.744 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ceph_event_retention_days", 2024-09-11T01:18:05.744 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.744 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.744 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.744 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7", 2024-09-11T01:18:05.744 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.744 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.744 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.744 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T01:18:05.744 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.744 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.744 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.745 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.745 INFO:teuthology.orchestra.run.smithi103.stdout: "config_check_secs": { 2024-09-11T01:18:05.745 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_check_secs", 2024-09-11T01:18:05.745 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.745 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.745 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.745 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.745 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "10", 2024-09-11T01:18:05.745 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.745 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.745 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T01:18:05.745 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.745 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.745 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.746 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.746 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.746 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.746 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.746 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.746 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.746 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.746 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.746 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.746 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.746 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.746 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.747 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.747 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.747 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.747 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.747 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.747 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.747 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.747 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.747 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.747 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.747 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.747 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.747 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.747 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.748 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.748 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.748 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.748 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.748 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.748 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.748 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.748 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.748 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.748 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.748 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.748 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.748 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.748 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.749 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.749 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.749 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.749 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.749 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.749 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.749 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.749 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.749 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.749 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.749 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.749 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.749 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.749 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.752 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.752 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.752 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.752 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.752 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.752 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.752 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "localpool", 2024-09-11T01:18:05.752 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.752 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.752 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.752 INFO:teuthology.orchestra.run.smithi103.stdout: "failure_domain": { 2024-09-11T01:18:05.752 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "failure_domain", 2024-09-11T01:18:05.752 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.752 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "host", 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "failure domain for any created local pool", 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.753 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.754 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.755 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.756 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.756 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.756 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.756 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.756 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.756 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.756 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.756 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.756 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.756 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.756 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.756 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.756 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.756 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.757 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.757 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.757 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.757 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.757 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.757 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.757 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.757 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.757 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.757 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.757 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.757 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.757 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": { 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_size", 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.758 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.759 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.759 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default min_size for any created local pool", 2024-09-11T01:18:05.759 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T01:18:05.759 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.759 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.759 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.759 INFO:teuthology.orchestra.run.smithi103.stdout: "num_rep": { 2024-09-11T01:18:05.759 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "num_rep", 2024-09-11T01:18:05.759 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.759 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.759 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.759 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3", 2024-09-11T01:18:05.759 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.759 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.760 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.760 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default replica count for any created local pool", 2024-09-11T01:18:05.760 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.760 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.760 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.760 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.760 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": { 2024-09-11T01:18:05.760 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_num", 2024-09-11T01:18:05.760 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.760 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.760 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.760 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "128", 2024-09-11T01:18:05.760 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.761 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.761 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.761 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T01:18:05.761 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.761 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.761 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.761 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.761 INFO:teuthology.orchestra.run.smithi103.stdout: "prefix": { 2024-09-11T01:18:05.761 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prefix", 2024-09-11T01:18:05.761 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.762 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.762 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.762 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.762 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.762 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.762 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.762 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name prefix for any created local pool", 2024-09-11T01:18:05.762 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.762 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.762 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.762 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.762 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.762 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.763 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.763 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.763 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.763 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.763 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.763 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.763 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.763 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.763 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.763 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.763 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.763 INFO:teuthology.orchestra.run.smithi103.stdout: "subtree": { 2024-09-11T01:18:05.763 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "subtree", 2024-09-11T01:18:05.764 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.764 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.764 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.764 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "rack", 2024-09-11T01:18:05.764 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.764 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.764 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.764 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T01:18:05.764 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T01:18:05.764 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.764 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.764 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.764 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.764 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.765 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.765 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mds_autoscaler", 2024-09-11T01:18:05.765 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.765 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.765 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.765 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.765 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.765 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.765 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.765 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.765 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.765 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.765 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.766 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.766 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.766 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.766 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.766 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.766 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.766 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.766 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.766 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.766 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.766 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.766 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.766 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.767 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.767 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.767 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.767 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.767 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.767 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.767 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.767 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.767 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.767 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.767 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.767 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.767 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.767 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.768 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.768 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.768 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.768 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.768 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.768 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.768 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.768 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.768 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.768 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.768 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.768 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.768 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.768 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.769 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.770 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirroring", 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.771 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.772 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.773 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.773 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.773 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.773 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.773 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.773 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.773 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.773 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.773 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.773 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.773 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.773 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.773 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.773 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.774 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.775 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.775 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.775 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.775 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.775 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.775 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.775 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.775 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.775 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.775 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.775 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.775 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.775 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.776 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.776 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.776 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.776 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.776 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.776 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.776 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.776 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.776 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.776 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.776 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.776 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.776 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.777 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.777 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.777 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.777 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.777 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.777 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.777 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.777 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.777 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.777 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.777 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.777 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "nfs", 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.778 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.779 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.780 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.781 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.782 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.783 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: "fail_fs": { 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "fail_fs", 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.784 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.785 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.786 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.786 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.786 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.786 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.786 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.786 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.786 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.786 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.786 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.786 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.786 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.786 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.786 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.786 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.787 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.787 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.787 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.787 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.787 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.787 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.787 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.787 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.787 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.787 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.787 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.787 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.787 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.788 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.788 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.788 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.788 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.788 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.788 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.788 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.788 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.788 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.788 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.788 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.788 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.789 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator": { 2024-09-11T01:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-09-11T01:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.790 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm", 2024-09-11T01:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "rook", 2024-09-11T01:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "test_orchestrator" 2024-09-11T01:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Orchestrator backend", 2024-09-11T01:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.791 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.792 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_perf_query", 2024-09-11T01:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.793 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.794 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.795 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.795 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.795 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.795 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.795 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.795 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.795 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.795 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.795 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.795 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.795 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.795 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.795 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.796 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.796 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.796 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.796 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.796 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.796 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.796 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.796 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.796 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.796 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.796 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.796 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.796 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.797 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.797 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.797 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.797 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.797 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.797 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.797 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.797 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.797 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.797 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.797 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.798 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.799 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.799 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.799 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.799 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.799 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.799 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.799 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.799 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.799 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.799 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.799 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.799 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_support", 2024-09-11T01:18:05.800 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.800 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.800 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.800 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.800 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.800 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.800 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.800 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.800 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.800 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.800 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.800 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.800 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.800 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.801 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.801 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.801 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.801 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.801 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.801 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.801 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.801 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.801 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.801 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.801 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.801 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.801 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.802 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.802 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.802 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.802 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.802 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.802 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.802 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.802 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.802 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.802 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.802 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.803 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.803 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.803 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.803 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.803 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.803 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.803 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.803 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.803 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.803 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.803 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.803 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.803 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.804 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.804 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.804 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.804 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.804 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.804 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.804 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.804 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.804 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.804 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.804 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.804 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.804 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.804 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.805 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.806 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.806 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.806 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.806 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.806 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.806 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.806 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.806 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.806 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.806 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_autoscaler", 2024-09-11T01:18:05.806 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.806 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.806 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.807 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.807 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.807 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.807 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.807 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.807 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.807 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.807 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.807 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.807 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.807 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.807 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.807 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.807 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.808 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.808 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.808 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.808 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.808 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.808 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.808 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.808 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.808 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.808 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.808 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.808 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.808 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.809 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.810 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:05.811 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:05.812 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.812 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.812 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.812 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:05.812 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.812 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.812 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.812 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.812 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.812 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.812 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.812 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.812 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.812 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.813 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.813 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.813 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.813 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.813 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.813 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.813 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.813 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.813 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.813 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.813 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.813 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.813 INFO:teuthology.orchestra.run.smithi103.stdout: "threshold": { 2024-09-11T01:18:05.813 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threshold", 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1.0", 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "scaling threshold", 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.814 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.815 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "progress", 2024-09-11T01:18:05.815 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.815 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.815 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.815 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_pg_recovery_event": { 2024-09-11T01:18:05.815 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_pg_recovery_event", 2024-09-11T01:18:05.815 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.815 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.815 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.815 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.815 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.815 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.815 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.815 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T01:18:05.816 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.816 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.816 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.816 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-09-11T01:18:05.816 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-09-11T01:18:05.816 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.816 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.816 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.816 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.816 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.816 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.816 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.816 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.817 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.817 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.817 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.817 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.817 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.817 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.817 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.817 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.817 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.817 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.817 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.817 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.817 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.818 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.819 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.819 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.819 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.819 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.819 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.819 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.819 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.819 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.819 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.819 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.819 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.819 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.820 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: "max_completed_events": { 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_completed_events", 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "50", 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "number of past completed events to remember", 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.822 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long the module is going to sleep", 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.823 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus", 2024-09-11T01:18:05.824 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "cache": { 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cache", 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.825 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: "exclude_perf_counters": { 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "exclude_perf_counters", 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.827 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.827 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.827 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.827 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.827 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.827 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.827 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.827 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.827 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.827 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.827 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.827 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.827 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.827 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.828 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.829 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.830 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.830 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.830 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.830 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.830 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.830 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.830 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.830 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.830 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.830 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.830 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools": { 2024-09-11T01:18:05.831 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools", 2024-09-11T01:18:05.832 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.832 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.832 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.832 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.832 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.832 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.832 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.832 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.832 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.832 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.832 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.832 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.832 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T01:18:05.833 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T01:18:05.833 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.833 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.833 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.833 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "300", 2024-09-11T01:18:05.833 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.833 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.833 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.833 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.833 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.833 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.833 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.833 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_interval": { 2024-09-11T01:18:05.834 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_interval", 2024-09-11T01:18:05.834 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:05.834 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.834 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.834 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15.0", 2024-09-11T01:18:05.834 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.834 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.834 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.834 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.834 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.834 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.835 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.835 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-11T01:18:05.835 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-11T01:18:05.835 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.835 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.835 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.835 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-09-11T01:18:05.835 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.835 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.835 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.835 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T01:18:05.835 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.835 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.836 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.836 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.836 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-11T01:18:05.836 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-11T01:18:05.836 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.836 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.836 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.836 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "9283", 2024-09-11T01:18:05.836 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.836 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.836 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.836 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T01:18:05.836 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.837 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.837 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.837 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.837 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.837 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.837 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.837 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.837 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.837 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.837 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.837 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.837 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.837 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.838 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.838 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.838 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.838 INFO:teuthology.orchestra.run.smithi103.stdout: "stale_cache_strategy": { 2024-09-11T01:18:05.838 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stale_cache_strategy", 2024-09-11T01:18:05.838 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.838 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.838 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.838 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "log", 2024-09-11T01:18:05.838 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.838 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.838 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.839 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.839 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.839 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.839 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.839 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.839 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-09-11T01:18:05.839 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-09-11T01:18:05.839 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.839 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.839 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.839 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "default", 2024-09-11T01:18:05.839 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.839 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.839 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: "default", 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: "error" 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-11T01:18:05.840 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-09-11T01:18:05.841 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-09-11T01:18:05.841 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.841 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.841 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.841 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.841 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.841 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.841 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.841 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.841 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_support", 2024-09-11T01:18:05.841 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.841 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.842 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.842 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.842 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.842 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.842 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.842 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.842 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.842 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.842 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.842 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.842 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.842 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.842 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.843 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.843 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.843 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.843 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.843 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.843 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.843 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.843 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.843 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.843 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.843 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.844 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.844 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.844 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.844 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.844 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.844 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.844 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.844 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.844 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.844 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.844 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.844 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.845 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.845 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.845 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.845 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.845 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.845 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.845 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.845 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.845 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.845 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.845 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.845 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.845 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.845 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.846 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.846 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.846 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.846 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.846 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.846 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.846 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.846 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.846 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.846 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.846 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.847 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.847 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.847 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.847 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.847 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.847 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.847 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_snap_create": { 2024-09-11T01:18:05.847 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_snap_create", 2024-09-11T01:18:05.847 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.847 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.847 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.848 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:05.848 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.848 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.848 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.848 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.848 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.848 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.848 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.848 INFO:teuthology.orchestra.run.smithi103.stdout: "mirror_snapshot_schedule": { 2024-09-11T01:18:05.848 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T01:18:05.848 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.848 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.848 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.849 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.850 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.850 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.850 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.850 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.850 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.850 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.850 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.850 INFO:teuthology.orchestra.run.smithi103.stdout: "trash_purge_schedule": { 2024-09-11T01:18:05.850 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "trash_purge_schedule", 2024-09-11T01:18:05.850 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.850 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.850 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.850 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.851 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.851 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.851 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.851 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.851 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.851 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.851 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.851 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.851 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.851 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "restful", 2024-09-11T01:18:05.851 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.851 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.852 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.852 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_auth": { 2024-09-11T01:18:05.852 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_auth", 2024-09-11T01:18:05.852 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.852 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.852 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.852 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.852 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.852 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.852 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.852 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.852 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.852 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.852 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.853 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-09-11T01:18:05.853 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-09-11T01:18:05.853 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.853 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.853 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.853 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.853 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.853 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.853 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.853 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.853 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.853 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.854 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.854 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.854 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.854 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.854 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.854 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.854 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.854 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.854 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.854 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.854 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.854 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.854 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.855 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.855 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.855 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.855 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.855 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.855 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.855 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.855 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.855 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.855 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.855 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.856 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.856 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.856 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.856 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.856 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.856 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.856 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.856 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.856 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.856 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.856 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.857 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.857 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.857 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.857 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.857 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.857 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.857 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.857 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.857 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.857 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.857 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.857 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.858 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.858 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.858 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.858 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.858 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.858 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.858 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.858 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.858 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.858 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.858 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.858 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.859 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.859 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.859 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.859 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.859 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.859 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.859 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.859 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.859 INFO:teuthology.orchestra.run.smithi103.stdout: "max_requests": { 2024-09-11T01:18:05.859 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_requests", 2024-09-11T01:18:05.859 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.859 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.859 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.860 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-11T01:18:05.860 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.860 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.860 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.860 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-11T01:18:05.860 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.860 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.860 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.860 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-11T01:18:05.860 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-11T01:18:05.860 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.860 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-11T01:18:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-11T01:18:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.861 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.862 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rgw", 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.863 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.864 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.865 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.866 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.867 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "secondary_zone_period_retry_limit": { 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.868 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.869 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.869 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-11T01:18:05.869 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.869 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.869 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.869 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.869 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.869 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.869 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.869 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.869 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.869 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.869 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rook", 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.870 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.871 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.872 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.873 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.874 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.875 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: "storage_class": { 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "storage_class", 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "local", 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.876 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "selftest", 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.877 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.878 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.879 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.880 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.881 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: "roption1": { 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption1", 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.882 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "roption2": { 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption2", 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "xyz", 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.883 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.884 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption1": { 2024-09-11T01:18:05.884 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption1", 2024-09-11T01:18:05.884 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.884 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.884 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.884 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.884 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.884 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.884 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.884 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.884 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.884 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption2": { 2024-09-11T01:18:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption2", 2024-09-11T01:18:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.885 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption3": { 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption3", 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.886 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.887 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.887 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption4": { 2024-09-11T01:18:05.887 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption4", 2024-09-11T01:18:05.887 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.887 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.887 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.887 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.887 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.887 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.887 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.887 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.887 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.888 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.888 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.888 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption5": { 2024-09-11T01:18:05.888 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption5", 2024-09-11T01:18:05.888 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.888 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.888 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.888 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.888 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.888 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.888 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.888 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption6": { 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption6", 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.889 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.890 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.890 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption7": { 2024-09-11T01:18:05.890 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption7", 2024-09-11T01:18:05.890 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.890 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.890 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.890 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.890 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-11T01:18:05.890 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "42", 2024-09-11T01:18:05.890 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.890 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.890 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.890 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.891 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.891 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.891 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.891 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.891 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.891 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.891 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.891 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.891 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.891 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.891 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.891 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.891 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.892 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.892 INFO:teuthology.orchestra.run.smithi103.stdout: "testkey": { 2024-09-11T01:18:05.892 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testkey", 2024-09-11T01:18:05.892 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.892 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.892 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.892 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.892 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.892 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.892 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.892 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.892 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.893 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.893 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.893 INFO:teuthology.orchestra.run.smithi103.stdout: "testlkey": { 2024-09-11T01:18:05.893 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testlkey", 2024-09-11T01:18:05.893 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.893 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.893 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.893 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.893 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.893 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.893 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.894 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.894 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.894 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.894 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.894 INFO:teuthology.orchestra.run.smithi103.stdout: "testnewline": { 2024-09-11T01:18:05.894 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testnewline", 2024-09-11T01:18:05.894 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.894 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.894 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.894 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.894 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.894 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smb", 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: "internal_store_backend": { 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "internal_store_backend", 2024-09-11T01:18:05.895 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.896 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.896 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.896 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.896 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.896 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.896 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.896 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-11T01:18:05.896 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.896 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.896 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.896 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.896 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.897 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.897 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.897 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.897 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.897 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.897 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.897 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.897 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.897 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.897 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.897 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.897 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.898 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.898 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.898 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.898 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.898 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.898 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.898 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.898 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.898 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.898 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.898 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.898 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.898 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.899 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.899 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.899 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.899 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.899 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.899 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.899 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.899 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.899 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.899 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.899 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.900 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.900 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.900 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.900 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.900 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.900 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.900 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.900 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.900 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.900 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.900 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.900 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.900 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.901 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.901 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.901 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.901 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.901 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.901 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.901 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.901 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.901 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.901 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.901 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.901 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.901 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.902 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: "update_orchestration": { 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "update_orchestration", 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.903 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.904 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snap_schedule", 2024-09-11T01:18:05.904 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.904 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.904 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.904 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_m_granularity": { 2024-09-11T01:18:05.904 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_m_granularity", 2024-09-11T01:18:05.904 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.904 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.904 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.904 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.904 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.904 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.905 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.905 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T01:18:05.905 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.905 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.905 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.905 INFO:teuthology.orchestra.run.smithi103.stdout: "dump_on_update": { 2024-09-11T01:18:05.905 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dump_on_update", 2024-09-11T01:18:05.905 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.905 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.905 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.905 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.905 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.905 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "dump database to debug log on update", 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.906 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.907 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.908 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.908 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.908 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.908 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.908 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.908 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.908 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.908 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.908 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.908 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.908 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.908 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.909 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.909 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.909 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.909 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.909 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.909 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.909 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.909 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.909 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.909 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.909 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.909 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.909 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.909 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.910 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.910 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.910 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.910 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.910 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.910 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.910 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.910 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.910 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.910 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.910 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.910 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.910 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.911 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.911 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.911 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.911 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.911 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.911 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.911 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.911 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.911 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.911 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.911 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.911 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.912 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.912 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.912 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.912 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.912 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.912 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.912 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stats", 2024-09-11T01:18:05.912 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.912 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.912 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.913 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.914 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.915 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.915 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.915 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.915 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.915 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.915 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.915 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.915 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.915 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.915 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.915 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.915 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.915 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.916 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.917 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.917 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.917 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.917 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.917 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.917 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.917 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.917 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.917 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.917 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.917 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.917 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.917 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.918 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "status", 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.919 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.920 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.921 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.922 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.923 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.924 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.924 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.924 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.924 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.924 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.924 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.924 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.924 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.924 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.924 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.924 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telegraf", 2024-09-11T01:18:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: "address": { 2024-09-11T01:18:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "address", 2024-09-11T01:18:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T01:18:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.925 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.926 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.926 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.926 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:05.926 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:05.926 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.926 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.926 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.926 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15", 2024-09-11T01:18:05.926 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.926 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.926 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.926 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.926 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.927 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.928 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.928 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.928 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.928 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.928 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.928 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.928 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.928 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.928 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.928 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.928 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.928 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.929 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.931 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.932 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telemetry", 2024-09-11T01:18:05.933 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.933 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.933 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.933 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_basic": { 2024-09-11T01:18:05.933 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_basic", 2024-09-11T01:18:05.933 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.933 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.933 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.933 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.933 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.933 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.933 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.933 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_crash": { 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_crash", 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.934 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.935 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.935 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_device": { 2024-09-11T01:18:05.935 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_device", 2024-09-11T01:18:05.935 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.935 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.935 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.935 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.935 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.935 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.935 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.935 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T01:18:05.935 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.935 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.936 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.936 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_ident": { 2024-09-11T01:18:05.936 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_ident", 2024-09-11T01:18:05.936 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.936 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.936 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.936 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.936 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.936 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.936 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.936 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T01:18:05.936 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.937 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.937 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.937 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_perf": { 2024-09-11T01:18:05.937 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_perf", 2024-09-11T01:18:05.937 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.937 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.937 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.937 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.937 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.937 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.937 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.937 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T01:18:05.937 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: "contact": { 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "contact", 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.938 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.939 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.939 INFO:teuthology.orchestra.run.smithi103.stdout: "description": { 2024-09-11T01:18:05.939 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "description", 2024-09-11T01:18:05.939 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.939 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.939 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.939 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.939 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.939 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.939 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.939 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.939 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.939 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.940 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.940 INFO:teuthology.orchestra.run.smithi103.stdout: "device_url": { 2024-09-11T01:18:05.940 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_url", 2024-09-11T01:18:05.940 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.940 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.940 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.940 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T01:18:05.940 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.940 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.940 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.940 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.941 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.941 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.941 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.941 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-09-11T01:18:05.941 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-09-11T01:18:05.941 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.941 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.941 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.941 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.941 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.941 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.941 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.941 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "24", 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "8", 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.942 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: "last_opt_revision": { 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "last_opt_revision", 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1", 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.943 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard": { 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard", 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.944 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.945 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard_description": { 2024-09-11T01:18:05.945 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard_description", 2024-09-11T01:18:05.945 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.945 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.945 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.945 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.945 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.945 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.945 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.945 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.945 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.945 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.946 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.946 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.946 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.946 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.946 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.946 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.946 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.946 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.946 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.946 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.946 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.946 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.946 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.947 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.947 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.947 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.947 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.947 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.947 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.947 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.947 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.947 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.947 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.947 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.947 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.948 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.948 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.948 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.948 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.948 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.948 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.948 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.948 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.948 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.948 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.948 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.948 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.948 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.949 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.949 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.949 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.949 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.949 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.949 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.949 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.949 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.949 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.949 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.949 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.949 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.952 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.952 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.952 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.952 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.952 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.952 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.952 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.952 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.952 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.952 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.952 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.953 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.953 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.953 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.953 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.953 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.953 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.953 INFO:teuthology.orchestra.run.smithi103.stdout: "organization": { 2024-09-11T01:18:05.953 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "organization", 2024-09-11T01:18:05.953 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.953 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.953 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.953 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.953 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.954 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.954 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.954 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.954 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.954 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.954 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.954 INFO:teuthology.orchestra.run.smithi103.stdout: "proxy": { 2024-09-11T01:18:05.954 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "proxy", 2024-09-11T01:18:05.954 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.954 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.954 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.954 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.955 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.955 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.955 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.955 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.955 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.955 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.955 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.955 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.955 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.955 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.956 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.956 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.956 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.956 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.956 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.956 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.956 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.956 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.956 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.956 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.956 INFO:teuthology.orchestra.run.smithi103.stdout: "url": { 2024-09-11T01:18:05.957 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url", 2024-09-11T01:18:05.957 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.957 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.957 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.957 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T01:18:05.957 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.957 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.957 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.957 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.957 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.957 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.957 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.957 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "test_orchestrator", 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.958 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.959 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.960 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.961 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.961 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.961 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.961 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.961 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.961 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.961 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.961 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.961 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.961 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.961 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.961 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.961 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.961 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.962 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.962 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.962 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.962 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.962 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.962 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.962 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.962 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.962 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.962 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.962 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.962 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.962 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.963 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "volumes", 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.964 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.965 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.965 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.965 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.965 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.965 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.965 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.965 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.965 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.965 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.965 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.965 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.965 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.965 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.966 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.966 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.966 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.966 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.966 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.966 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.966 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.966 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.966 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.966 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.966 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.966 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.966 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.967 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.968 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.968 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.968 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.968 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.968 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.968 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.968 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.968 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.968 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.968 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.968 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.968 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.968 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_clones": { 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_clones", 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4", 2024-09-11T01:18:05.969 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "periodic_async_work": { 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "periodic_async_work", 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.970 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.971 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Periodically check for async work", 2024-09-11T01:18:05.971 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.971 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.971 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.971 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_delay": { 2024-09-11T01:18:05.971 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_delay", 2024-09-11T01:18:05.971 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.971 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.971 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.971 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.971 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.971 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.971 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T01:18:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_no_wait": { 2024-09-11T01:18:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T01:18:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.972 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.973 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T01:18:05.973 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.973 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.973 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.973 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.973 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.973 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.973 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.973 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.973 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.973 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.973 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.973 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix", 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: "discovery_interval": { 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "discovery_interval", 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:05.974 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "100", 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "identifier": { 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "identifier", 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.975 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.976 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.976 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.976 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.976 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.976 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.976 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.976 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.976 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:05.976 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:05.976 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.976 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.976 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.976 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:05.977 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.977 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.977 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.977 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.977 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.977 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.977 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.977 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.977 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.977 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.977 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.977 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.977 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.978 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.979 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.979 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.979 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.979 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.979 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.979 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.979 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.979 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.979 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.979 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.979 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.979 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.979 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.980 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.981 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.982 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.982 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.982 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.982 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:05.982 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:05.982 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.982 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:05.982 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.982 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:05.982 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.982 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.983 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.983 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.983 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.983 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.983 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.983 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.983 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_host": { 2024-09-11T01:18:05.983 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_host", 2024-09-11T01:18:05.983 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.983 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.983 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.983 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.983 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.983 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.984 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.984 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.984 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.984 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.984 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.984 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_port": { 2024-09-11T01:18:05.984 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_port", 2024-09-11T01:18:05.984 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.984 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.984 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.984 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10051", 2024-09-11T01:18:05.984 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.984 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.985 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.985 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.985 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.985 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.985 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.985 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.985 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_sender": { 2024-09-11T01:18:05.985 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_sender", 2024-09-11T01:18:05.985 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.985 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.985 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:05.985 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T01:18:05.985 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.986 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.986 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.986 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.986 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.986 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.986 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.986 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.986 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.986 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.986 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-11T01:18:05.986 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:05.986 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.986 INFO:teuthology.orchestra.run.smithi103.stdout: "modules": [ 2024-09-11T01:18:05.986 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm", 2024-09-11T01:18:05.987 INFO:teuthology.orchestra.run.smithi103.stdout: "dashboard", 2024-09-11T01:18:05.987 INFO:teuthology.orchestra.run.smithi103.stdout: "iostat", 2024-09-11T01:18:05.987 INFO:teuthology.orchestra.run.smithi103.stdout: "nfs", 2024-09-11T01:18:05.987 INFO:teuthology.orchestra.run.smithi103.stdout: "restful" 2024-09-11T01:18:05.987 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.987 INFO:teuthology.orchestra.run.smithi103.stdout: "available_modules": [ 2024-09-11T01:18:05.987 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:05.987 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "alerts", 2024-09-11T01:18:05.987 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:05.987 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:05.987 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:05.987 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:05.987 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:05.987 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:05.988 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.988 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.988 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:05.988 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.988 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.988 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.988 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How frequently to reexamine health status", 2024-09-11T01:18:05.988 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.988 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.988 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.988 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:05.988 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:05.989 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.989 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.989 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.989 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.989 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.989 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.989 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.989 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.989 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.989 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.989 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.989 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.989 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.989 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.990 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:05.991 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.992 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.993 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:05.993 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.993 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.993 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.993 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:05.993 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.993 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.993 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.993 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.993 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_destination": { 2024-09-11T01:18:05.993 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_destination", 2024-09-11T01:18:05.993 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.993 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.994 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.994 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.994 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.994 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.994 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.994 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-11T01:18:05.994 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.994 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.994 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.994 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.994 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_from_name": { 2024-09-11T01:18:05.994 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_from_name", 2024-09-11T01:18:05.994 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "Ceph", 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email From: name", 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_host": { 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_host", 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.995 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.996 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.996 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.996 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.996 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.996 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.996 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP server", 2024-09-11T01:18:05.996 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.996 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.996 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.996 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_password": { 2024-09-11T01:18:05.996 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_password", 2024-09-11T01:18:05.996 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.997 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.997 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.997 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.997 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.997 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.997 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.997 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Password to authenticate with", 2024-09-11T01:18:05.997 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.997 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.997 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.997 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.997 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_port": { 2024-09-11T01:18:05.997 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_port", 2024-09-11T01:18:05.997 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "465", 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP port", 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_sender": { 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_sender", 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:05.998 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:05.999 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:05.999 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:05.999 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:05.999 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:05.999 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP envelope sender", 2024-09-11T01:18:05.999 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:05.999 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:05.999 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:05.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:05.999 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_ssl": { 2024-09-11T01:18:05.999 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_ssl", 2024-09-11T01:18:05.999 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.000 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.000 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.000 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.000 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.000 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.000 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.000 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-11T01:18:06.000 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.000 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.000 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.000 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.000 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_user": { 2024-09-11T01:18:06.000 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_user", 2024-09-11T01:18:06.001 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.001 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.001 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.001 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.001 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.001 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.001 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.001 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "User to authenticate as", 2024-09-11T01:18:06.001 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.001 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.001 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.001 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.001 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.001 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.002 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.002 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.002 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.002 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.002 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.002 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.002 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.002 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.002 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.002 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.002 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.002 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.002 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.002 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.003 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.003 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "balancer", 2024-09-11T01:18:06.003 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.003 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.003 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.003 INFO:teuthology.orchestra.run.smithi103.stdout: "active": { 2024-09-11T01:18:06.003 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "active", 2024-09-11T01:18:06.003 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.003 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.003 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.003 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.003 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.003 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically balance PGs across cluster", 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_time": { 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_time", 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0000", 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.004 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "beginning time of day to automatically balance", 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_weekday": { 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_weekday", 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.005 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_max_iterations": { 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_max_iterations", 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "25", 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "250", 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.006 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_metrics": { 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_metrics", 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "pgs,objects,bytes", 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_step": { 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_step", 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.5", 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0.001", 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "0.999", 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "aggressiveness of optimization", 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.008 INFO:teuthology.orchestra.run.smithi103.stdout: "end_time": { 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_time", 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2359", 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ending time of day to automatically balance", 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: "end_weekday": { 2024-09-11T01:18:06.009 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_weekday", 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.010 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.011 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.012 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.013 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.014 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "min_score": { 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_score", 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-11T01:18:06.015 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.016 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.016 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.016 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.016 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-09-11T01:18:06.016 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-09-11T01:18:06.016 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.016 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.016 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.016 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "upmap", 2024-09-11T01:18:06.016 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.016 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.016 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.016 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-compat", 2024-09-11T01:18:06.016 INFO:teuthology.orchestra.run.smithi103.stdout: "none", 2024-09-11T01:18:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: "read", 2024-09-11T01:18:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap", 2024-09-11T01:18:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap-read" 2024-09-11T01:18:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Balancer mode", 2024-09-11T01:18:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_ids": { 2024-09-11T01:18:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_ids", 2024-09-11T01:18:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.017 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.018 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.018 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.018 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.018 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.018 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-11T01:18:06.018 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.018 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.018 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.018 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:06.018 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:06.018 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.018 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.018 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.019 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:06.019 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.019 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.019 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.019 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-11T01:18:06.019 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.019 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.019 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.019 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.019 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.019 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.019 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.019 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_deviation": { 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_deviation", 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.020 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_optimizations": { 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_optimizations", 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:06.021 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm", 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_down_multiplier": { 2024-09-11T01:18:06.022 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_down_multiplier", 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_refresh_rate": { 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_refresh_rate", 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.023 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "20", 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_starting_port": { 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_starting_port", 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.024 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.025 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4721", 2024-09-11T01:18:06.025 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.025 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.025 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.025 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-11T01:18:06.025 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.025 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.025 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.025 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_ptrace": { 2024-09-11T01:18:06.025 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_ptrace", 2024-09-11T01:18:06.025 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.025 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.026 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.026 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.026 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.026 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.026 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.026 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-11T01:18:06.026 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-11T01:18:06.026 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.026 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.026 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_interval": { 2024-09-11T01:18:06.026 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_interval", 2024-09-11T01:18:06.026 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.026 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_memory_target_ratio": { 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_memory_target_ratio", 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.027 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.7", 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm_log_destination": { 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm_log_destination", 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.028 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.029 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.029 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.029 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.029 INFO:teuthology.orchestra.run.smithi103.stdout: "file", 2024-09-11T01:18:06.029 INFO:teuthology.orchestra.run.smithi103.stdout: "file,syslog", 2024-09-11T01:18:06.029 INFO:teuthology.orchestra.run.smithi103.stdout: "syslog" 2024-09-11T01:18:06.029 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.029 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-11T01:18:06.029 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.029 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.029 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.029 INFO:teuthology.orchestra.run.smithi103.stdout: "cgroups_split": { 2024-09-11T01:18:06.029 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cgroups_split", 2024-09-11T01:18:06.030 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.030 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.030 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.030 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.030 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.030 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.030 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.030 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-11T01:18:06.030 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.030 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.030 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.030 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.030 INFO:teuthology.orchestra.run.smithi103.stdout: "config_checks_enabled": { 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_checks_enabled", 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: "config_dashboard": { 2024-09-11T01:18:06.031 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_dashboard", 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_alertmanager": { 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_alertmanager", 2024-09-11T01:18:06.032 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_base": { 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_base", 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.033 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.034 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-11T01:18:06.034 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.034 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.034 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.034 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Container image name, without the tag", 2024-09-11T01:18:06.034 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.034 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.034 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.034 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_elasticsearch": { 2024-09-11T01:18:06.034 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_elasticsearch", 2024-09-11T01:18:06.034 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.034 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.034 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "elasticsearch container image", 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_grafana": { 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_grafana", 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-11T01:18:06.035 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.036 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.036 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.036 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-11T01:18:06.036 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.036 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.036 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.036 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_haproxy": { 2024-09-11T01:18:06.036 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_haproxy", 2024-09-11T01:18:06.036 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.036 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.036 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.036 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-11T01:18:06.036 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.037 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.037 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.037 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "HAproxy container image", 2024-09-11T01:18:06.037 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.037 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.037 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.037 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_agent": { 2024-09-11T01:18:06.037 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_agent", 2024-09-11T01:18:06.037 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.037 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.037 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.037 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-11T01:18:06.037 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.038 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.038 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.038 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger agent container image", 2024-09-11T01:18:06.038 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.038 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.038 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.038 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_collector": { 2024-09-11T01:18:06.038 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_collector", 2024-09-11T01:18:06.038 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.038 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.038 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.038 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-11T01:18:06.038 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger collector container image", 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_query": { 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_query", 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.039 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger query container image", 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_keepalived": { 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_keepalived", 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.040 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Keepalived container image", 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_loki": { 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_loki", 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.041 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Loki container image", 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_nginx": { 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_nginx", 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/nginx:1.26.1", 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Nginx container image", 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.042 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_node_exporter": { 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_node_exporter", 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.043 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_nvmeof": { 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_nvmeof", 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Nvme-of container image", 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.044 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_oauth2_proxy": { 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_oauth2_proxy", 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "oauth2-proxy container image", 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_prometheus": { 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_prometheus", 2024-09-11T01:18:06.045 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.046 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.046 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.046 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-11T01:18:06.046 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.046 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.046 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.046 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-09-11T01:18:06.046 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.046 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.046 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.046 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_promtail": { 2024-09-11T01:18:06.046 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_promtail", 2024-09-11T01:18:06.046 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-11T01:18:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Promtail container image", 2024-09-11T01:18:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_samba": { 2024-09-11T01:18:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_samba", 2024-09-11T01:18:06.047 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.048 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.048 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.048 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-11T01:18:06.048 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.048 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.048 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.048 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Samba/SMB container image", 2024-09-11T01:18:06.048 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.048 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.048 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.048 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_samba_metrics": { 2024-09-11T01:18:06.048 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_samba_metrics", 2024-09-11T01:18:06.048 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.049 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.049 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.049 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-11T01:18:06.049 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.049 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.049 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.049 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-11T01:18:06.049 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.049 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.049 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.049 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_snmp_gateway": { 2024-09-11T01:18:06.049 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_snmp_gateway", 2024-09-11T01:18:06.049 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SNMP Gateway container image", 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "container_init": { 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_init", 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.050 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.051 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.051 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.051 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.051 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.051 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Run podman/docker with `--init`", 2024-09-11T01:18:06.051 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.051 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.051 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.051 INFO:teuthology.orchestra.run.smithi103.stdout: "daemon_cache_timeout": { 2024-09-11T01:18:06.051 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "daemon_cache_timeout", 2024-09-11T01:18:06.051 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.051 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.052 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.052 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:06.052 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.052 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.052 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.052 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-11T01:18:06.052 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.052 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.052 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.052 INFO:teuthology.orchestra.run.smithi103.stdout: "default_cephadm_command_timeout": { 2024-09-11T01:18:06.052 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_cephadm_command_timeout", 2024-09-11T01:18:06.052 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "900", 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "default_registry": { 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_registry", 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.053 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io", 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: "device_cache_timeout": { 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_cache_timeout", 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.054 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1800", 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache device inventory", 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "device_enhanced_scan": { 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_enhanced_scan", 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.055 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.056 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.056 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-11T01:18:06.056 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.056 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.056 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.056 INFO:teuthology.orchestra.run.smithi103.stdout: "facts_cache_timeout": { 2024-09-11T01:18:06.056 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "facts_cache_timeout", 2024-09-11T01:18:06.056 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.056 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.056 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.056 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:06.056 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.056 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache host facts data", 2024-09-11T01:18:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: "grafana_dashboards_path": { 2024-09-11T01:18:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "grafana_dashboards_path", 2024-09-11T01:18:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-11T01:18:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.057 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: "host_check_interval": { 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "host_check_interval", 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.058 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.059 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to perform a host check", 2024-09-11T01:18:06.059 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.059 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.059 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.059 INFO:teuthology.orchestra.run.smithi103.stdout: "hw_monitoring": { 2024-09-11T01:18:06.059 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hw_monitoring", 2024-09-11T01:18:06.059 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.059 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.059 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.059 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.059 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.059 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.059 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.060 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-11T01:18:06.060 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.060 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.060 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.060 INFO:teuthology.orchestra.run.smithi103.stdout: "inventory_list_all": { 2024-09-11T01:18:06.060 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "inventory_list_all", 2024-09-11T01:18:06.060 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.060 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.060 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.060 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.060 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.060 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.061 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.061 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-11T01:18:06.061 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.061 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.061 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.061 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.061 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.061 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.061 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.061 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.061 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.061 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.061 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.062 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.062 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.062 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.062 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.062 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.062 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.062 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.062 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.062 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.062 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.062 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.062 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.062 INFO:teuthology.orchestra.run.smithi103.stdout: "log_refresh_metadata": { 2024-09-11T01:18:06.063 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_refresh_metadata", 2024-09-11T01:18:06.063 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.063 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.063 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.063 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.063 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.063 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.063 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.063 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-11T01:18:06.063 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.063 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.063 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.063 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.064 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.064 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.064 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.064 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.064 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.064 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.064 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.064 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.064 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-11T01:18:06.064 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.064 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.064 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.064 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.065 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.065 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.065 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.065 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.065 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.065 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.065 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.065 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.065 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.065 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.065 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.065 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.065 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.066 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.066 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.066 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.066 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.066 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.066 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.066 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.066 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.066 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.066 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.066 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.067 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.067 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.067 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.067 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.067 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.067 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.067 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.067 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.067 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-11T01:18:06.067 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-11T01:18:06.067 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.068 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.069 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.069 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "*", 2024-09-11T01:18:06.069 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.069 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.069 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.069 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-11T01:18:06.069 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.069 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.069 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.069 INFO:teuthology.orchestra.run.smithi103.stdout: "max_count_per_host": { 2024-09-11T01:18:06.069 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_count_per_host", 2024-09-11T01:18:06.069 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.069 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of daemons per service per host", 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd_draining_count": { 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_osd_draining_count", 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.070 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "migration_current": { 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "migration_current", 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.071 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "internal - do not modify", 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "root", 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.072 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm-package", 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: "root" 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "mode for remote execution of cephadm", 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: "oob_default_addr": { 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "oob_default_addr", 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.073 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "169.254.1.1", 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: "prometheus_alerts_path": { 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus_alerts_path", 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-11T01:18:06.074 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_insecure": { 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_insecure", 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.075 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_password": { 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_password", 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.076 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_url": { 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_url", 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-11T01:18:06.077 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_username": { 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_username", 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.078 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: "secure_monitoring_stack": { 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secure_monitoring_stack", 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.079 INFO:teuthology.orchestra.run.smithi103.stdout: "service_discovery_port": { 2024-09-11T01:18:06.080 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "service_discovery_port", 2024-09-11T01:18:06.080 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.080 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.080 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.080 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8765", 2024-09-11T01:18:06.080 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.080 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.080 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.080 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "cephadm service discovery port", 2024-09-11T01:18:06.080 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.080 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.080 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.080 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.080 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: "ssh_config_file": { 2024-09-11T01:18:06.081 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssh_config_file", 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "use_agent": { 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_agent", 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.082 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: "use_repo_digest": { 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_repo_digest", 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.083 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_failed_host_check": { 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_failed_host_check", 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.084 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.085 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.085 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.085 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.085 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if the host check fails", 2024-09-11T01:18:06.085 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.085 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.085 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.085 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.085 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_daemons": { 2024-09-11T01:18:06.085 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_daemons", 2024-09-11T01:18:06.085 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.085 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.085 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.086 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.086 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.086 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.086 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.086 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-11T01:18:06.086 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.086 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.086 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.086 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_hosts": { 2024-09-11T01:18:06.086 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_hosts", 2024-09-11T01:18:06.086 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.086 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.087 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.087 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.087 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.087 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.087 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.087 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-11T01:18:06.087 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.087 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.087 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.087 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.087 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.087 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crash", 2024-09-11T01:18:06.088 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.088 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.088 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.088 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.088 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.088 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.088 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.088 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.088 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.088 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.088 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.088 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.088 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.089 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.089 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.089 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.089 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.089 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.089 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.089 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.089 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.089 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.089 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.089 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.089 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.090 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.090 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.090 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.090 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.090 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.090 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.090 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.090 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.090 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.090 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.090 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.090 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.090 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.091 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.092 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.092 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.092 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.092 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.092 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.092 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.092 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.092 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.092 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.092 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.092 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: "retain_interval": { 2024-09-11T01:18:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retain_interval", 2024-09-11T01:18:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "31536000", 2024-09-11T01:18:06.093 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.094 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_recent_interval": { 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_recent_interval", 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1209600", 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.095 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.096 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-11T01:18:06.096 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.096 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.096 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.096 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.096 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.096 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dashboard", 2024-09-11T01:18:06.096 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.096 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.096 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.096 INFO:teuthology.orchestra.run.smithi103.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-11T01:18:06.096 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-11T01:18:06.097 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.097 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.097 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.097 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:06.097 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.097 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.097 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.097 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.097 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.097 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.097 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.097 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_HOST": { 2024-09-11T01:18:06.097 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-11T01:18:06.098 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_ENABLED": { 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_ENABLED", 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.099 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.100 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.100 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.100 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.100 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.100 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.100 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.100 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.100 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.100 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-11T01:18:06.100 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-11T01:18:06.100 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.100 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.100 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: "ENABLE_BROWSABLE_API": { 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.101 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.102 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.102 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.102 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.102 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.102 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.102 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.102 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.102 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-11T01:18:06.102 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-11T01:18:06.102 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.102 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.102 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.102 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.103 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.104 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.104 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.104 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.104 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.104 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.104 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.104 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-11T01:18:06.104 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-11T01:18:06.104 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.104 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.104 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.104 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.104 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.105 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.105 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.105 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.105 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.105 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.105 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.105 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-11T01:18:06.105 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-11T01:18:06.105 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.105 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.105 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.105 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.106 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.106 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.106 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.106 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.106 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.106 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.106 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.106 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-11T01:18:06.106 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-11T01:18:06.106 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.106 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.106 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.106 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.107 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.107 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.107 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.107 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.107 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.107 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.107 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.107 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-11T01:18:06.107 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-11T01:18:06.107 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.107 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.107 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.107 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.108 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.108 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.108 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.108 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.108 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.108 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.108 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.108 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-11T01:18:06.108 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-11T01:18:06.108 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.108 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.108 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.108 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.109 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.109 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.109 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.109 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.109 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.109 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.109 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.109 INFO:teuthology.orchestra.run.smithi103.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-11T01:18:06.109 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-11T01:18:06.109 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.109 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.109 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.109 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.110 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.110 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.110 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.110 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.110 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.110 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.110 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.110 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_PASSWORD": { 2024-09-11T01:18:06.110 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-11T01:18:06.110 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.110 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.110 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.110 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-11T01:18:06.111 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.111 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.111 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.111 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.111 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.111 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.111 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.111 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.111 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-11T01:18:06.111 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-11T01:18:06.111 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.112 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.112 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.112 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.112 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.112 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.112 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.112 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.112 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.112 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.112 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.112 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_URL": { 2024-09-11T01:18:06.112 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_URL", 2024-09-11T01:18:06.113 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.113 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.113 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.113 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.113 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.113 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.113 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.113 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.113 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.113 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.113 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.113 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.113 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_USERNAME": { 2024-09-11T01:18:06.113 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-11T01:18:06.114 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.114 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.114 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.114 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-11T01:18:06.114 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.114 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.114 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.114 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.114 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.114 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.114 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.114 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-11T01:18:06.115 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-11T01:18:06.115 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.115 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.115 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.115 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.115 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.115 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.115 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.115 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.115 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.115 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.115 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.115 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.116 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-11T01:18:06.116 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-11T01:18:06.116 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.116 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.116 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.116 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.116 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.116 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.116 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.116 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.116 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.116 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.116 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.117 INFO:teuthology.orchestra.run.smithi103.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-11T01:18:06.117 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-11T01:18:06.117 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.117 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.117 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.117 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.117 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.117 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.117 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.117 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.117 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.117 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "[]", 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.119 INFO:teuthology.orchestra.run.smithi103.stdout: "MULTICLUSTER_CONFIG": { 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "{}", 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_HOST": { 2024-09-11T01:18:06.120 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-11T01:18:06.121 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.122 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.123 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.124 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.125 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.125 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.125 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.125 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.125 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.125 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.125 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-11T01:18:06.125 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-11T01:18:06.125 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.125 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.125 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.125 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.125 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.126 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.127 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.128 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.129 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.129 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.129 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.129 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.129 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_ENABLED": { 2024-09-11T01:18:06.129 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-11T01:18:06.129 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.129 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.129 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.129 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.129 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.129 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.129 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.130 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.130 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.130 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.130 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.130 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.130 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-11T01:18:06.130 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-11T01:18:06.130 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.130 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.130 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.130 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-11T01:18:06.130 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.130 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.130 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.131 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.131 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.131 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.131 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.131 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-11T01:18:06.131 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-11T01:18:06.131 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.131 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.131 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.131 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:06.131 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.131 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.131 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.132 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.132 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.132 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.132 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.132 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.132 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-11T01:18:06.132 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-11T01:18:06.132 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.132 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.132 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.132 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8", 2024-09-11T01:18:06.132 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.132 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-11T01:18:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-11T01:18:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "45", 2024-09-11T01:18:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.134 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.134 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.134 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.134 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.134 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.134 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ACCESS_KEY": { 2024-09-11T01:18:06.134 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-11T01:18:06.134 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.134 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.134 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.134 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.134 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.135 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.136 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.136 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.136 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.136 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.136 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.136 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.136 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SECRET_KEY": { 2024-09-11T01:18:06.136 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-11T01:18:06.136 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.136 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.136 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.136 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.136 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.136 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SSL_VERIFY": { 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.137 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: "UNSAFE_TLS_v1_2": { 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.138 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.139 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.140 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-11T01:18:06.140 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-11T01:18:06.140 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.140 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.140 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.140 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:06.140 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.140 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.140 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.140 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.140 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.140 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.140 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.141 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-11T01:18:06.141 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-11T01:18:06.141 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.141 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.141 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.141 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:06.141 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.141 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.141 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.141 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.141 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.141 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: "cross_origin_url": { 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cross_origin_url", 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.142 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: "crt_file": { 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crt_file", 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.143 INFO:teuthology.orchestra.run.smithi103.stdout: "debug": { 2024-09-11T01:18:06.144 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "debug", 2024-09-11T01:18:06.144 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.144 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.144 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.144 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.144 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.144 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.144 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.144 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable/disable debug options", 2024-09-11T01:18:06.144 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.144 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.144 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.144 INFO:teuthology.orchestra.run.smithi103.stdout: "jwt_token_ttl": { 2024-09-11T01:18:06.145 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "jwt_token_ttl", 2024-09-11T01:18:06.145 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.145 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.145 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.145 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "28800", 2024-09-11T01:18:06.145 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.145 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.145 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.145 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.145 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.145 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.145 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.146 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.147 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.148 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.148 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.148 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.148 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.148 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.148 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.148 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.148 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.148 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.148 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.148 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.148 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.149 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.150 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.150 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.150 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.150 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.150 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.150 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.150 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.150 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.150 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.150 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.150 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.150 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "motd": { 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "motd", 2024-09-11T01:18:06.151 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "The message of the day", 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect_resolve_ip_addr": { 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "redirect_resolve_ip_addr", 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.152 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.153 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8080", 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.154 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.155 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.156 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.156 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.156 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.156 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-09-11T01:18:06.156 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-09-11T01:18:06.156 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.156 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.156 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.156 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.156 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.156 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.156 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.156 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.157 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.157 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.157 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.157 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl_server_port": { 2024-09-11T01:18:06.157 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl_server_port", 2024-09-11T01:18:06.157 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.157 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.157 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.157 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8443", 2024-09-11T01:18:06.157 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.157 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.157 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.157 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.158 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.158 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.158 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.158 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-09-11T01:18:06.158 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-09-11T01:18:06.158 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.158 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.158 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.158 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "redirect", 2024-09-11T01:18:06.158 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.158 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.158 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.158 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect" 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-09-11T01:18:06.159 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: "url_prefix": { 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url_prefix", 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.160 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.161 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.161 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.161 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.161 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.161 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.161 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.161 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.161 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.161 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "devicehealth", 2024-09-11T01:18:06.161 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.161 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.161 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.161 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_monitoring": { 2024-09-11T01:18:06.161 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_monitoring", 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "monitor device health metrics", 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.162 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.163 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.164 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.165 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.166 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.166 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.166 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.166 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.166 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.166 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.166 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.166 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.166 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.166 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.166 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.166 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.166 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.167 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.167 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.167 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.167 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.167 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.167 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.167 INFO:teuthology.orchestra.run.smithi103.stdout: "mark_out_threshold": { 2024-09-11T01:18:06.167 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mark_out_threshold", 2024-09-11T01:18:06.167 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.167 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.167 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.167 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2419200", 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": { 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_name", 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "device_health_metrics", 2024-09-11T01:18:06.168 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: "retention_period": { 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retention_period", 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15552000", 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.169 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain device health metrics", 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_frequency": { 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_frequency", 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.170 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "self_heal": { 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "self_heal", 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.171 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and check device health", 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.173 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_threshold": { 2024-09-11T01:18:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_threshold", 2024-09-11T01:18:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7257600", 2024-09-11T01:18:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-11T01:18:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.174 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "diskprediction_local", 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.175 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.176 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.176 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.176 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.176 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.176 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.176 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.176 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.176 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.176 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.176 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.176 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.176 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.177 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.177 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.177 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.177 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.177 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.177 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.177 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.177 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.177 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.177 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.177 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.177 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.177 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.178 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.179 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "predict_interval": { 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predict_interval", 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.180 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.181 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.181 INFO:teuthology.orchestra.run.smithi103.stdout: "predictor_model": { 2024-09-11T01:18:06.181 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predictor_model", 2024-09-11T01:18:06.181 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.181 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.181 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.181 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "prophetstor", 2024-09-11T01:18:06.181 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.181 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.181 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.181 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.181 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.181 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.182 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.182 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:06.182 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:06.182 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.182 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.182 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.182 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-09-11T01:18:06.182 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.182 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.182 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.182 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.183 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.183 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.183 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.183 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.183 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.183 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.183 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.183 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.183 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.183 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.183 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.183 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.184 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.184 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.184 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.184 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.184 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.184 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.184 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.184 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "influx", 2024-09-11T01:18:06.184 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": false, 2024-09-11T01:18:06.184 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "influxdb python module not found", 2024-09-11T01:18:06.184 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.185 INFO:teuthology.orchestra.run.smithi103.stdout: "batch_size": { 2024-09-11T01:18:06.185 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "batch_size", 2024-09-11T01:18:06.185 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.185 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.185 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.185 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5000", 2024-09-11T01:18:06.185 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.185 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.185 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.185 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-11T01:18:06.185 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.185 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.185 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.186 INFO:teuthology.orchestra.run.smithi103.stdout: "database": { 2024-09-11T01:18:06.186 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "database", 2024-09-11T01:18:06.186 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.186 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.186 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.186 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "ceph", 2024-09-11T01:18:06.186 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.186 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.186 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.186 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-11T01:18:06.186 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.186 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.186 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.187 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": { 2024-09-11T01:18:06.187 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hostname", 2024-09-11T01:18:06.187 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.187 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.187 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.187 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.187 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.187 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.187 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.187 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server hostname", 2024-09-11T01:18:06.187 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.187 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.187 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.188 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:06.188 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:06.188 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.188 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.188 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.188 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "30", 2024-09-11T01:18:06.188 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "5", 2024-09-11T01:18:06.188 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.188 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.188 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-11T01:18:06.188 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.188 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.188 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.189 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.190 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.190 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.190 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.190 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.190 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.190 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.190 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.190 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.190 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.190 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.190 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.190 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.190 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.191 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.192 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.192 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.192 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.192 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.192 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.192 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.192 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.192 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.192 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.192 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.192 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.192 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.193 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.193 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.193 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.193 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.193 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.193 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.193 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.193 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.193 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.193 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.193 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.193 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.193 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: "password": { 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "password", 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "password of InfluxDB server user", 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: "port": { 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "port", 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8086", 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server port", 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.195 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.196 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.196 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.196 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.196 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.196 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.196 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.196 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.196 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.196 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.196 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.196 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.196 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "false", 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: "threads": { 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threads", 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "32", 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.198 INFO:teuthology.orchestra.run.smithi103.stdout: "username": { 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "username", 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "username of InfluxDB server user", 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "verify_ssl": { 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "verify_ssl", 2024-09-11T01:18:06.199 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "true", 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "insights", 2024-09-11T01:18:06.200 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.201 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.201 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.201 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.201 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.201 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.201 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.201 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.201 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.201 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.201 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.201 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.201 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.201 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.201 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.202 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.203 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.204 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.205 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.205 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.205 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.205 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.205 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.205 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.205 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.205 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.205 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.205 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.205 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.205 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.205 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.206 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.206 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.206 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.206 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.206 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.206 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.206 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.206 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.206 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.206 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.206 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.206 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.206 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.206 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.207 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "iostat", 2024-09-11T01:18:06.207 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.207 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.207 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.207 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.207 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.207 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.207 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.207 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.207 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.207 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.207 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.208 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.208 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.208 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.208 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.208 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.208 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.208 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.208 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.208 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.208 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.208 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.208 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.208 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.209 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.209 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.209 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.209 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.209 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.209 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.209 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.209 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.209 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.209 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.209 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.209 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.209 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.210 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.210 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.210 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.210 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.210 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.210 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.210 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.210 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.210 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.210 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.210 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.210 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.210 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.210 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.211 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.211 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.211 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.211 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.211 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.211 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.211 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.211 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.211 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.211 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.211 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.211 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.211 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.212 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.212 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.212 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.212 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.212 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.212 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.212 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.212 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.212 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.212 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.212 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.212 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.212 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.213 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.213 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.213 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.213 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.213 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.213 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.213 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.213 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.213 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "k8sevents", 2024-09-11T01:18:06.213 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.213 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.213 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.213 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_event_retention_days": { 2024-09-11T01:18:06.214 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ceph_event_retention_days", 2024-09-11T01:18:06.214 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.214 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.214 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.214 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7", 2024-09-11T01:18:06.214 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.214 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.214 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.214 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-11T01:18:06.214 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.214 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.214 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.214 INFO:teuthology.orchestra.run.smithi103.stdout: "config_check_secs": { 2024-09-11T01:18:06.215 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_check_secs", 2024-09-11T01:18:06.215 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.215 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.215 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.215 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:06.215 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "10", 2024-09-11T01:18:06.215 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.215 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.215 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-11T01:18:06.215 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.215 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.215 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.215 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.215 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.216 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.216 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.216 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.216 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.216 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.216 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.216 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.216 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.216 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.216 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.216 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.216 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.216 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.216 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.217 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.217 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.217 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.217 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.217 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.217 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.217 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.217 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.217 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.217 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.217 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.217 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.217 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.218 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.218 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.218 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.218 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.218 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.218 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.218 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.218 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.218 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.218 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.218 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.218 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.219 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.220 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.221 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "localpool", 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "failure_domain": { 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "failure_domain", 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "host", 2024-09-11T01:18:06.222 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "failure domain for any created local pool", 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.223 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.224 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.225 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.226 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.227 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": { 2024-09-11T01:18:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_size", 2024-09-11T01:18:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.228 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default min_size for any created local pool", 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "num_rep": { 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "num_rep", 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3", 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.229 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default replica count for any created local pool", 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": { 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_num", 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "128", 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.230 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default pg_num for any created local pool", 2024-09-11T01:18:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "prefix": { 2024-09-11T01:18:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prefix", 2024-09-11T01:18:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.231 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name prefix for any created local pool", 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.232 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "subtree": { 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "subtree", 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "rack", 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.233 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mds_autoscaler", 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.234 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.235 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.236 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.237 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.238 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.239 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirroring", 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.240 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.241 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.242 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.242 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.242 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.242 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.242 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.242 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.242 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.242 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.242 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.242 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.242 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.242 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.242 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.242 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.243 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.244 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.245 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.245 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.245 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.245 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.245 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.245 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.245 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.245 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.245 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.245 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.245 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.245 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.245 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.245 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "nfs", 2024-09-11T01:18:06.246 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.247 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.248 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.248 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.248 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.248 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.248 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.248 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.248 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.248 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.248 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.248 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.248 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.249 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.249 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.249 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.249 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.249 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.249 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.249 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.249 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.249 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.249 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.249 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.250 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.251 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.252 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: "fail_fs": { 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "fail_fs", 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.253 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.254 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.255 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.256 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.257 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.257 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.257 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.257 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.257 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.257 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.257 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.257 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.257 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.257 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.257 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.257 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.257 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.257 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.258 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.258 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.258 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.258 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.258 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.258 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.258 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.258 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.258 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.258 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.258 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.258 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.258 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.259 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator": { 2024-09-11T01:18:06.259 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-09-11T01:18:06.259 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.259 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.259 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.259 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.259 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.259 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.259 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.259 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm", 2024-09-11T01:18:06.259 INFO:teuthology.orchestra.run.smithi103.stdout: "rook", 2024-09-11T01:18:06.259 INFO:teuthology.orchestra.run.smithi103.stdout: "test_orchestrator" 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Orchestrator backend", 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.260 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.261 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.261 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.261 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.261 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.261 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.261 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.261 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.261 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_perf_query", 2024-09-11T01:18:06.261 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.261 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.261 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.261 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.261 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.262 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.263 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.264 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.265 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.266 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_support", 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.267 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.268 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.270 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.271 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.272 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.273 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.273 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.273 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.273 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.273 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.273 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.273 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.273 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_autoscaler", 2024-09-11T01:18:06.273 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.273 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.273 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.273 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.273 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.273 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.274 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.275 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.275 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.275 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.275 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.275 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.275 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.275 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.275 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.275 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.275 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.275 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.275 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.275 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.276 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.276 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.276 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.276 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.276 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.276 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.276 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.276 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.276 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.276 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.276 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.277 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.277 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.277 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.277 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.277 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.277 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.277 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.277 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.277 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.277 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.277 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.277 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:06.278 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.279 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "threshold": { 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threshold", 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.280 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1.0", 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "scaling threshold", 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "progress", 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.281 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_pg_recovery_event": { 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_pg_recovery_event", 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.282 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.283 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.284 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.285 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.286 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.286 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.286 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.286 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.286 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.286 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.286 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.286 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.286 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.286 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.286 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.286 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.286 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.287 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: "max_completed_events": { 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_completed_events", 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "50", 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.288 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "number of past completed events to remember", 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.289 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long the module is going to sleep", 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.290 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus", 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: "cache": { 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cache", 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.291 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: "exclude_perf_counters": { 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "exclude_perf_counters", 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.292 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.293 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.293 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.293 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.293 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.293 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-11T01:18:06.293 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-11T01:18:06.293 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.293 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.293 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.293 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.293 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.293 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.293 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.294 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.295 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.296 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.296 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.296 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.296 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.296 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.296 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.296 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.296 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.296 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.296 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.296 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.296 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.296 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.296 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.297 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.297 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.297 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.297 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.297 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.297 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.297 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.297 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.297 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.297 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.297 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.297 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.297 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.297 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools": { 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools", 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.298 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.299 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.299 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.299 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.299 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.299 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-11T01:18:06.299 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-11T01:18:06.299 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.299 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.299 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.299 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "300", 2024-09-11T01:18:06.299 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.299 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_interval": { 2024-09-11T01:18:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_interval", 2024-09-11T01:18:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15.0", 2024-09-11T01:18:06.300 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-11T01:18:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-11T01:18:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-09-11T01:18:06.301 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.302 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.302 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.302 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-11T01:18:06.302 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.302 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.302 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.302 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.302 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-11T01:18:06.302 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-11T01:18:06.302 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.302 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.302 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.302 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "9283", 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.303 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.304 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.304 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.304 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.304 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.304 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.304 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.304 INFO:teuthology.orchestra.run.smithi103.stdout: "stale_cache_strategy": { 2024-09-11T01:18:06.304 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stale_cache_strategy", 2024-09-11T01:18:06.304 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.304 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.304 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.304 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "log", 2024-09-11T01:18:06.304 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.305 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.305 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.305 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.305 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.305 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.305 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.305 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-09-11T01:18:06.305 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-09-11T01:18:06.305 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.305 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.305 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.306 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "default", 2024-09-11T01:18:06.306 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.306 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.306 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.306 INFO:teuthology.orchestra.run.smithi103.stdout: "default", 2024-09-11T01:18:06.306 INFO:teuthology.orchestra.run.smithi103.stdout: "error" 2024-09-11T01:18:06.306 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.306 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.306 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.306 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.306 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.306 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-09-11T01:18:06.306 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-09-11T01:18:06.307 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.307 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.307 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.307 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-11T01:18:06.307 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-09-11T01:18:06.307 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-09-11T01:18:06.307 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.307 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.307 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.307 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.307 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.307 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.307 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_support", 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.308 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.309 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.310 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.311 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.311 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.311 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.311 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.311 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.311 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.311 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.311 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.311 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.311 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.311 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.311 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.311 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.312 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.312 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.312 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.312 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.312 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.312 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.312 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.312 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.312 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.312 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.312 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.312 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.312 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.312 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_snap_create": { 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_snap_create", 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.313 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.314 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.314 INFO:teuthology.orchestra.run.smithi103.stdout: "mirror_snapshot_schedule": { 2024-09-11T01:18:06.314 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirror_snapshot_schedule", 2024-09-11T01:18:06.314 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.314 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.314 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.314 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.314 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.314 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.314 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.314 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.314 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.314 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.314 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.315 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.315 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.315 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.315 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.315 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.315 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.315 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.315 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.315 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.315 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.315 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.315 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.315 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.316 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.316 INFO:teuthology.orchestra.run.smithi103.stdout: "trash_purge_schedule": { 2024-09-11T01:18:06.316 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "trash_purge_schedule", 2024-09-11T01:18:06.316 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.316 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.316 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.316 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.316 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.316 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.316 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.316 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.316 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.316 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.317 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.317 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.317 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.317 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.317 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.317 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "restful", 2024-09-11T01:18:06.317 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.317 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.317 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.317 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_auth": { 2024-09-11T01:18:06.317 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_auth", 2024-09-11T01:18:06.317 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.317 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.318 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.318 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.318 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.318 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.318 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.318 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.318 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.318 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.318 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.318 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-09-11T01:18:06.318 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-09-11T01:18:06.318 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.319 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.319 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.319 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.319 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.319 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.319 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.319 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.319 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.319 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.319 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.319 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.319 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.319 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.320 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.320 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.320 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.320 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.320 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.320 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.320 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.320 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.320 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.320 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.320 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.320 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.320 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.320 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.321 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.321 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.321 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.321 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.321 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.321 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.321 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.321 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.321 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.321 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.321 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.321 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.321 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.322 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.322 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.322 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.322 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.322 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.322 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.322 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.322 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.322 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.322 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.322 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.322 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.322 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.323 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.324 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.324 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.324 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.324 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.324 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.324 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.324 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.324 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.324 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.324 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.324 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.324 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.324 INFO:teuthology.orchestra.run.smithi103.stdout: "max_requests": { 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_requests", 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-09-11T01:18:06.325 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.326 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.327 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rgw", 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.328 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.329 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.330 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.331 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.332 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "secondary_zone_period_retry_limit": { 2024-09-11T01:18:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-11T01:18:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-09-11T01:18:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-11T01:18:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.334 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.335 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rook", 2024-09-11T01:18:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.336 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.338 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.339 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.340 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.341 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.341 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.341 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.341 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.341 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.341 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.341 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.341 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.341 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.341 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.341 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.341 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.341 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.341 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.342 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.342 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.342 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.342 INFO:teuthology.orchestra.run.smithi103.stdout: "storage_class": { 2024-09-11T01:18:06.342 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "storage_class", 2024-09-11T01:18:06.342 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.342 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.342 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.342 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "local", 2024-09-11T01:18:06.342 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.342 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.342 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "selftest", 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.343 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.344 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.344 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.344 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.344 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.344 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.344 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.344 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.344 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.344 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.344 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.344 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.344 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.344 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.344 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.345 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.345 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.345 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.345 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.345 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.345 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.345 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.345 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.345 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.345 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.345 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.345 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.345 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.346 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.346 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.346 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.346 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.346 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.346 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.346 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.346 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.346 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.346 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.346 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.346 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.347 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.347 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.347 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.347 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.347 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.347 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.347 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.347 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.347 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.347 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.347 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.347 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.347 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.347 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.348 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.348 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.348 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.348 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.348 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.348 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.348 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.348 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.348 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.348 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.348 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.348 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.348 INFO:teuthology.orchestra.run.smithi103.stdout: "roption1": { 2024-09-11T01:18:06.348 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption1", 2024-09-11T01:18:06.349 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.349 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.349 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.349 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.349 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.349 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.349 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.349 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.349 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.349 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.349 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.349 INFO:teuthology.orchestra.run.smithi103.stdout: "roption2": { 2024-09-11T01:18:06.350 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption2", 2024-09-11T01:18:06.350 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.350 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.350 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.350 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "xyz", 2024-09-11T01:18:06.350 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.350 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.350 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.350 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.350 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.350 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.350 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption1": { 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption1", 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.351 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption2": { 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption2", 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption3": { 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption3", 2024-09-11T01:18:06.352 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption4": { 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption4", 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.353 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption5": { 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption5", 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.354 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption6": { 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption6", 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.355 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption7": { 2024-09-11T01:18:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption7", 2024-09-11T01:18:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-09-11T01:18:06.356 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "42", 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.357 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "testkey": { 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testkey", 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.358 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: "testlkey": { 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testlkey", 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.359 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: "testnewline": { 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testnewline", 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.360 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smb", 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: "internal_store_backend": { 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "internal_store_backend", 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.361 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.362 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.363 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.364 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.366 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.367 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.367 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.367 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.367 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.367 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.367 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.367 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.367 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.367 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.367 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.367 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.367 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.367 INFO:teuthology.orchestra.run.smithi103.stdout: "update_orchestration": { 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "update_orchestration", 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snap_schedule", 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_m_granularity": { 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_m_granularity", 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow minute scheduled snapshots", 2024-09-11T01:18:06.369 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.370 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.370 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.370 INFO:teuthology.orchestra.run.smithi103.stdout: "dump_on_update": { 2024-09-11T01:18:06.370 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dump_on_update", 2024-09-11T01:18:06.370 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.370 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.370 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.370 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.370 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.370 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.370 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.370 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "dump database to debug log on update", 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.371 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.372 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.372 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.372 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.372 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.372 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.372 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.372 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.372 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.372 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.372 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.372 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.372 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.372 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.373 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.373 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.373 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.373 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.373 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.373 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.373 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.373 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.373 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.373 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.373 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.373 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.373 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.374 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.376 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.376 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.376 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.376 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.376 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.376 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.376 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.376 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.376 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.376 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.376 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.376 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.376 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.377 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.377 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.377 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stats", 2024-09-11T01:18:06.377 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.377 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.377 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.377 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.377 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.377 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.377 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.377 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.377 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.378 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.379 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.380 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.382 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "status", 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.383 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.384 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.384 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.384 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.384 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.384 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.384 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.384 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.384 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.384 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.384 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.384 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.385 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.385 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.385 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.385 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.385 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.385 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.385 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.385 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.385 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.385 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.385 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.385 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.385 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.386 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.386 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.386 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.386 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.386 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.386 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.386 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.386 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.386 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.386 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.386 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.386 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.386 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.387 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.387 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.387 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.387 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.387 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.387 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.387 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.387 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.387 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.387 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.387 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.387 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.388 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.388 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.388 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.388 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.388 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.388 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.388 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.388 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.388 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.388 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.388 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.388 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.388 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.389 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.389 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.389 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.389 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.389 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.389 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.389 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.389 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.389 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.389 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.389 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telegraf", 2024-09-11T01:18:06.389 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.389 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.390 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.390 INFO:teuthology.orchestra.run.smithi103.stdout: "address": { 2024-09-11T01:18:06.390 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "address", 2024-09-11T01:18:06.390 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.390 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.390 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.390 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-11T01:18:06.390 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.390 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.390 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.390 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.390 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.390 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.390 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15", 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.392 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.393 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.393 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.393 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.393 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.393 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.393 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.393 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.393 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.393 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.393 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.393 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.393 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.394 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.394 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.394 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.394 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.394 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.394 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.394 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.394 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.394 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.394 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.394 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.394 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.394 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.394 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.396 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.396 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.396 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.396 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.396 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.396 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.396 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.396 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.396 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.396 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.396 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.396 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.396 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.397 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.398 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.398 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.398 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.398 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telemetry", 2024-09-11T01:18:06.398 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.398 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.398 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.398 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_basic": { 2024-09-11T01:18:06.398 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_basic", 2024-09-11T01:18:06.398 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.398 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.398 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.398 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_crash": { 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_crash", 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.399 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_device": { 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_device", 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.400 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.401 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-11T01:18:06.401 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.401 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.401 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.401 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_ident": { 2024-09-11T01:18:06.401 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_ident", 2024-09-11T01:18:06.401 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.401 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.401 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.401 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.401 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_perf": { 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_perf", 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.402 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: "contact": { 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "contact", 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.403 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: "description": { 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "description", 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.404 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: "device_url": { 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_url", 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.405 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.406 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.406 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-09-11T01:18:06.406 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-09-11T01:18:06.406 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.406 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.406 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.406 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.406 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.406 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.406 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.406 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.406 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.407 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.407 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.407 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.407 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:06.407 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:06.407 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.407 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.407 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.407 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "24", 2024-09-11T01:18:06.407 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "8", 2024-09-11T01:18:06.407 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.407 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.407 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.408 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.408 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.408 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.408 INFO:teuthology.orchestra.run.smithi103.stdout: "last_opt_revision": { 2024-09-11T01:18:06.408 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "last_opt_revision", 2024-09-11T01:18:06.408 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.408 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.408 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.408 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1", 2024-09-11T01:18:06.408 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.408 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.408 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.409 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.409 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.409 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.409 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.409 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard": { 2024-09-11T01:18:06.409 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard", 2024-09-11T01:18:06.409 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.409 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.409 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.409 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.409 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.409 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.410 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.410 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.410 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.410 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.410 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.410 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard_description": { 2024-09-11T01:18:06.410 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard_description", 2024-09-11T01:18:06.410 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.410 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.410 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.410 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.410 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.410 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.411 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.411 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.411 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.411 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.411 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.411 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.411 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.411 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.411 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.411 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.411 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.411 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.411 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.412 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.412 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.412 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.412 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.412 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.412 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.412 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.412 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.412 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.412 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.412 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.412 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.413 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.413 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.413 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.413 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.413 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.413 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.413 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.413 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.413 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.413 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.413 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.413 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.414 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.414 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.414 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.414 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.414 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.414 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.414 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.414 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.414 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.414 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.414 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.414 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.414 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.415 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.415 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.415 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.415 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.415 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.415 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.415 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.415 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.415 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.415 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.415 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.415 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.415 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.415 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.416 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.416 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.416 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.416 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.416 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.416 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.416 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.416 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.416 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.416 INFO:teuthology.orchestra.run.smithi103.stdout: "organization": { 2024-09-11T01:18:06.416 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "organization", 2024-09-11T01:18:06.416 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.417 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.417 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.417 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.417 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.417 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.417 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.417 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.417 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.417 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.417 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.417 INFO:teuthology.orchestra.run.smithi103.stdout: "proxy": { 2024-09-11T01:18:06.417 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "proxy", 2024-09-11T01:18:06.417 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.418 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.418 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.418 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.418 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.418 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.418 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.418 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.418 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.418 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.418 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.418 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.418 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.418 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.419 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.419 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.419 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.419 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.419 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.419 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.419 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.419 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.419 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.419 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.419 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.419 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.419 INFO:teuthology.orchestra.run.smithi103.stdout: "url": { 2024-09-11T01:18:06.420 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url", 2024-09-11T01:18:06.420 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.420 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.420 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.420 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-11T01:18:06.420 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.420 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.420 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.420 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.420 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.420 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.420 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.420 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.420 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.421 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.421 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.421 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "test_orchestrator", 2024-09-11T01:18:06.421 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.421 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.421 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.421 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.421 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.421 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.421 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.421 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.421 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.421 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.421 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.422 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.422 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.422 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.422 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.422 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.422 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.422 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.422 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.422 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.422 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.422 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.422 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.422 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.423 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.423 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.423 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.423 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.423 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.423 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.423 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.423 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.423 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.423 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.423 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.423 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.423 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.424 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.424 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.424 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.424 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.424 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.424 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.424 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.424 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.424 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.424 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.424 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.424 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.424 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.425 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.426 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.426 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.426 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.426 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.426 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.426 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.426 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.426 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.426 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.426 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.426 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.426 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.426 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.427 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.427 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.427 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.427 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.427 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.427 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.427 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.427 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.427 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.427 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.427 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "volumes", 2024-09-11T01:18:06.427 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.427 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.427 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.428 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.429 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.429 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.429 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.429 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.429 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.429 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.429 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.429 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.429 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.429 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.429 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.429 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.429 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.429 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.430 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.431 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.432 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.432 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.432 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.432 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.432 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.432 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.432 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.432 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.432 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.432 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.432 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.432 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_clones": { 2024-09-11T01:18:06.432 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_clones", 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4", 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: "periodic_async_work": { 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "periodic_async_work", 2024-09-11T01:18:06.433 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Periodically check for async work", 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_delay": { 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_delay", 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.434 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_no_wait": { 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_no_wait", 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.435 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-09-11T01:18:06.436 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.436 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.436 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.436 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-11T01:18:06.436 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.436 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.436 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.436 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.436 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.436 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.436 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.436 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.436 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.436 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.437 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.437 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.437 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.437 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.437 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.437 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.437 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.437 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.437 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.437 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.437 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix", 2024-09-11T01:18:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-09-11T01:18:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-09-11T01:18:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-09-11T01:18:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "discovery_interval": { 2024-09-11T01:18:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "discovery_interval", 2024-09-11T01:18:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-09-11T01:18:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "100", 2024-09-11T01:18:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.438 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "identifier": { 2024-09-11T01:18:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "identifier", 2024-09-11T01:18:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.439 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.440 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.441 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.441 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.441 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.441 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-09-11T01:18:06.441 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-09-11T01:18:06.441 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.441 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.441 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.441 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.441 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.441 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.441 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.441 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.441 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.442 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-09-11T01:18:06.443 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.444 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-09-11T01:18:06.445 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-09-11T01:18:06.445 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-09-11T01:18:06.445 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.445 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.445 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-09-11T01:18:06.445 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.445 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.445 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.445 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.445 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.445 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.445 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.446 INFO:teuthology.orchestra.run.smithi103.stdout: "sqlite3_killpoint": { 2024-09-11T01:18:06.446 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sqlite3_killpoint", 2024-09-11T01:18:06.446 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.446 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "dev", 2024-09-11T01:18:06.446 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-09-11T01:18:06.446 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-09-11T01:18:06.446 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.446 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.446 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.446 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.446 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.446 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.447 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.447 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.447 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_host": { 2024-09-11T01:18:06.447 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_host", 2024-09-11T01:18:06.447 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.447 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.447 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.447 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-09-11T01:18:06.447 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.447 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.447 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.447 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.447 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.447 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.448 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.448 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_port": { 2024-09-11T01:18:06.448 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_port", 2024-09-11T01:18:06.448 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-09-11T01:18:06.448 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.448 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.448 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10051", 2024-09-11T01:18:06.448 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.448 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.448 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.448 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.448 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.448 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.449 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.449 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.449 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_sender": { 2024-09-11T01:18:06.449 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_sender", 2024-09-11T01:18:06.449 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-09-11T01:18:06.449 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-09-11T01:18:06.449 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-09-11T01:18:06.449 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-11T01:18:06.449 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-09-11T01:18:06.449 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-09-11T01:18:06.449 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-09-11T01:18:06.449 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-09-11T01:18:06.449 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-09-11T01:18:06.450 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-09-11T01:18:06.450 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-09-11T01:18:06.450 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.450 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.450 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.450 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.450 INFO:teuthology.orchestra.run.smithi103.stdout: "services": { 2024-09-11T01:18:06.450 INFO:teuthology.orchestra.run.smithi103.stdout: "dashboard": "https://172.21.15.103:8443/" 2024-09-11T01:18:06.450 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.450 INFO:teuthology.orchestra.run.smithi103.stdout: "always_on_modules": { 2024-09-11T01:18:06.450 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus": [ 2024-09-11T01:18:06.450 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-09-11T01:18:06.450 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-11T01:18:06.450 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-09-11T01:18:06.451 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-09-11T01:18:06.451 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-09-11T01:18:06.451 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-09-11T01:18:06.451 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-09-11T01:18:06.451 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-09-11T01:18:06.451 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-09-11T01:18:06.451 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-09-11T01:18:06.451 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.451 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific": [ 2024-09-11T01:18:06.451 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-09-11T01:18:06.451 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-11T01:18:06.451 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy": [ 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-09-11T01:18:06.452 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-09-11T01:18:06.453 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-09-11T01:18:06.453 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-09-11T01:18:06.453 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-09-11T01:18:06.453 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-09-11T01:18:06.453 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.453 INFO:teuthology.orchestra.run.smithi103.stdout: "reef": [ 2024-09-11T01:18:06.453 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-09-11T01:18:06.453 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-11T01:18:06.453 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-09-11T01:18:06.453 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-09-11T01:18:06.453 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-09-11T01:18:06.453 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "squid": [ 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-09-11T01:18:06.454 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: "force_disabled_modules": {}, 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: "last_failure_osd_epoch": 3, 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: "active_clients": [ 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "devicehealth", 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1474968635 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-11T01:18:06.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.456 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.456 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "libcephsqlite", 2024-09-11T01:18:06.456 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-11T01:18:06.456 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.456 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-11T01:18:06.456 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-09-11T01:18:06.456 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2990920642 2024-09-11T01:18:06.456 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.456 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-11T01:18:06.456 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.456 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.456 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_support", 2024-09-11T01:18:06.456 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-11T01:18:06.456 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.457 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-11T01:18:06.457 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-09-11T01:18:06.457 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3930871094 2024-09-11T01:18:06.457 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.457 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-11T01:18:06.457 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:06.457 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.457 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "volumes", 2024-09-11T01:18:06.457 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-09-11T01:18:06.457 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-11T01:18:06.457 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-09-11T01:18:06.457 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-09-11T01:18:06.457 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 4067976787 2024-09-11T01:18:06.457 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.458 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-11T01:18:06.458 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:06.458 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-11T01:18:06.458 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:18:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:05.026+0000 7f14b2400640 1 -- 172.21.15.103:0/937220441 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f14900b5360 msgr2=0x7f14900b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:05.026+0000 7f14b2400640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f14900b5360 0x7f14900b7820 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1498009830 tx=0x7f1498030480 comp rx=0 tx=0).stop 2024-09-11T01:18:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:05.026+0000 7f14b2400640 1 -- 172.21.15.103:0/937220441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14ac1027b0 msgr2=0x7f14ac19ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:05.026+0000 7f14b2400640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14ac1027b0 0x7f14ac19ad90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f149c00eb90 tx=0x7f149c00c6a0 comp rx=0 tx=0).stop 2024-09-11T01:18:06.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:05.026+0000 7f14b2400640 1 -- 172.21.15.103:0/937220441 shutdown_connections 2024-09-11T01:18:06.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:05.026+0000 7f14b2400640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f14900b5360 0x7f14900b7820 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:06.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:05.026+0000 7f14b2400640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f14ac1042c0 0x7f14ac19c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:06.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:05.026+0000 7f14b2400640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac103900 0x7f14ac19b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:06.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:05.026+0000 7f14b2400640 1 --2- 172.21.15.103:0/937220441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f14ac1027b0 0x7f14ac19ad90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:06.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:05.026+0000 7f14b2400640 1 -- 172.21.15.103:0/937220441 >> 172.21.15.103:0/937220441 conn(0x7f14ac0fe070 msgr2=0x7f14ac075380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:06.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:05.026+0000 7f14b2400640 1 -- 172.21.15.103:0/937220441 shutdown_connections 2024-09-11T01:18:06.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:05.026+0000 7f14b2400640 1 -- 172.21.15.103:0/937220441 wait complete. 2024-09-11T01:18:06.466 DEBUG:tasks.check_counter:Getting stats from a 2024-09-11T01:18:06.467 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-11T01:18:06.467 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:05 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3175719446' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T01:18:06.467 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:06.467 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:06.467 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:05 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/4013206159' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-11T01:18:06.467 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:05 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/937220441' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-11T01:18:06.468 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T01:18:06.468 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T01:18:06.468 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T01:18:06.468 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T01:18:06.468 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:18:06.468 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:18:06.468 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:05 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:06.469 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:05 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3175719446' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T01:18:06.469 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:06.469 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:06.469 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:05 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/4013206159' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-11T01:18:06.469 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:05 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/937220441' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-11T01:18:06.469 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T01:18:06.469 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T01:18:06.470 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T01:18:06.470 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T01:18:06.470 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:18:06.470 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:18:06.470 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:05 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:06.470 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:05 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3175719446' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-11T01:18:06.470 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:06.470 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:06.470 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:05 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/4013206159' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-11T01:18:06.470 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:05 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/937220441' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-11T01:18:06.470 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-11T01:18:06.470 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-11T01:18:06.471 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-11T01:18:06.471 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-11T01:18:06.471 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-11T01:18:06.471 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-11T01:18:06.471 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:05 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' 2024-09-11T01:18:06.471 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:06 smithi183 ceph-mon[34992]: Adjusting osd_memory_target on smithi103 to 176.4M 2024-09-11T01:18:06.471 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:06 smithi183 ceph-mon[34992]: Unable to set osd_memory_target on smithi103 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-09-11T01:18:06.471 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:06 smithi183 ceph-mon[34992]: pgmap v693: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-11T01:18:06.521 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:06 smithi103 ceph-mon[30562]: Adjusting osd_memory_target on smithi103 to 176.4M 2024-09-11T01:18:06.521 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:06 smithi103 ceph-mon[30562]: Unable to set osd_memory_target on smithi103 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-09-11T01:18:06.521 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:06 smithi103 ceph-mon[30562]: pgmap v693: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-11T01:18:06.622 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:06 smithi117 ceph-mon[35358]: Adjusting osd_memory_target on smithi103 to 176.4M 2024-09-11T01:18:06.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:06 smithi117 ceph-mon[35358]: Unable to set osd_memory_target on smithi103 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-09-11T01:18:06.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:06 smithi117 ceph-mon[35358]: pgmap v693: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.7 KiB/s wr, 9 op/s 2024-09-11T01:18:06.848 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:18:07.512 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:18:07.512 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T01:18:07.512 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 0, 2024-09-11T01:18:07.512 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 3, 2024-09-11T01:18:07.512 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 0, 2024-09-11T01:18:07.512 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 0, 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 5, 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.004190408, 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.001229660, 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:07.513 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 214, 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 209, 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 983968, 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 127280, 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 2, 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.054538649, 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.024512267, 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.038708188, 2024-09-11T01:18:07.514 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 207, 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.075340583, 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000363964 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 983968, 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 127280 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 5, 2024-09-11T01:18:07.515 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 159, 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 3152, 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 110512, 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 3, 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.031541900, 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.025281067, 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.004516624, 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 158, 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.032959768, 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000208606 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:07.516 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:07.517 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:07.517 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:07.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:07.517 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-11T01:18:07.517 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 110512 2024-09-11T01:18:07.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:07.517 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-09-11T01:18:07.517 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-09-11T01:18:07.517 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-09-11T01:18:07.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T01:18:07.518 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-09-11T01:18:07.519 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-09-11T01:18:07.519 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-09-11T01:18:07.519 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-09-11T01:18:07.519 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T01:18:07.519 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T01:18:07.519 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T01:18:07.519 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T01:18:07.519 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T01:18:07.519 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-09-11T01:18:07.519 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-09-11T01:18:07.519 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-09-11T01:18:07.519 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T01:18:07.519 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T01:18:07.520 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-09-11T01:18:07.520 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-09-11T01:18:07.520 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-09-11T01:18:07.520 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-09-11T01:18:07.520 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T01:18:07.520 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-09-11T01:18:07.521 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T01:18:07.521 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-09-11T01:18:07.521 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 148991, 2024-09-11T01:18:07.521 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 29, 2024-09-11T01:18:07.521 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-09-11T01:18:07.521 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-09-11T01:18:07.522 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-09-11T01:18:07.522 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-09-11T01:18:07.522 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-09-11T01:18:07.522 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-09-11T01:18:07.522 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-09-11T01:18:07.522 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-09-11T01:18:07.523 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-09-11T01:18:07.523 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-09-11T01:18:07.523 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T01:18:07.523 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-09-11T01:18:07.523 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-09-11T01:18:07.524 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-09-11T01:18:07.524 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 968, 2024-09-11T01:18:07.524 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-09-11T01:18:07.524 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-09-11T01:18:07.524 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-09-11T01:18:07.524 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-09-11T01:18:07.525 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-09-11T01:18:07.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:07.525 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T01:18:07.525 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-11T01:18:07.525 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-11T01:18:07.525 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-11T01:18:07.526 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 215, 2024-09-11T01:18:07.526 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 953733, 2024-09-11T01:18:07.526 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:07.526 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 215, 2024-09-11T01:18:07.526 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-11T01:18:07.526 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-11T01:18:07.527 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 215, 2024-09-11T01:18:07.527 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 953733, 2024-09-11T01:18:07.527 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-11T01:18:07.527 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:07.527 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:07.528 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:07.528 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:07.528 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:07.529 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:18:08.348 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-11T01:18:08.348 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-11T01:18:08.348 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.a 2024-09-11T01:18:08.348 DEBUG:tasks.check_counter:Getting stats from d 2024-09-11T01:18:08.349 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-11T01:18:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:08 smithi103 ceph-mon[30562]: pgmap v694: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-11T01:18:08.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:08 smithi183 ceph-mon[34992]: pgmap v694: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-11T01:18:08.743 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:18:08.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:08 smithi117 ceph-mon[35358]: pgmap v694: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-11T01:18:09.361 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:18:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T01:18:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 218, 2024-09-11T01:18:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 213, 2024-09-11T01:18:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 830464, 2024-09-11T01:18:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 131104, 2024-09-11T01:18:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-09-11T01:18:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-09-11T01:18:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.061077146, 2024-09-11T01:18:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.030227800, 2024-09-11T01:18:09.362 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.037410534, 2024-09-11T01:18:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 212, 2024-09-11T01:18:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.048236268, 2024-09-11T01:18:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000227529 2024-09-11T01:18:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 830464, 2024-09-11T01:18:09.363 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 131104 2024-09-11T01:18:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T01:18:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 1, 2024-09-11T01:18:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 162, 2024-09-11T01:18:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 160, 2024-09-11T01:18:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 108768, 2024-09-11T01:18:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 3, 2024-09-11T01:18:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 2, 2024-09-11T01:18:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.026092063, 2024-09-11T01:18:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.021316813, 2024-09-11T01:18:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.001782260, 2024-09-11T01:18:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:09.364 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 160, 2024-09-11T01:18:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.019330240, 2024-09-11T01:18:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000120814 2024-09-11T01:18:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T01:18:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 108768 2024-09-11T01:18:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T01:18:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 4, 2024-09-11T01:18:09.365 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 4, 2024-09-11T01:18:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 2992, 2024-09-11T01:18:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 448, 2024-09-11T01:18:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 2, 2024-09-11T01:18:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-09-11T01:18:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.003562777, 2024-09-11T01:18:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000062344, 2024-09-11T01:18:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.003420139, 2024-09-11T01:18:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3, 2024-09-11T01:18:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.006034858, 2024-09-11T01:18:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.002011619 2024-09-11T01:18:09.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T01:18:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T01:18:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-09-11T01:18:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-09-11T01:18:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-09-11T01:18:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-09-11T01:18:09.367 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-09-11T01:18:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-09-11T01:18:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T01:18:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-09-11T01:18:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T01:18:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-09-11T01:18:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T01:18:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T01:18:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T01:18:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T01:18:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T01:18:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-09-11T01:18:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T01:18:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T01:18:09.368 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-09-11T01:18:09.369 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-09-11T01:18:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-09-11T01:18:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-09-11T01:18:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T01:18:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-09-11T01:18:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T01:18:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-09-11T01:18:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 151029, 2024-09-11T01:18:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 31, 2024-09-11T01:18:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-09-11T01:18:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-09-11T01:18:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-09-11T01:18:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-09-11T01:18:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-09-11T01:18:09.370 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 968, 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-09-11T01:18:09.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T01:18:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-11T01:18:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-11T01:18:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-11T01:18:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 219, 2024-09-11T01:18:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 799649, 2024-09-11T01:18:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 219, 2024-09-11T01:18:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-11T01:18:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-11T01:18:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 219, 2024-09-11T01:18:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 799649, 2024-09-11T01:18:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-11T01:18:09.372 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:09.373 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:09.373 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:09.373 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:09.373 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:09.373 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:18:10.200 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-11T01:18:10.200 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-11T01:18:10.200 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-11T01:18:10.201 DEBUG:tasks.check_counter:Getting stats from g 2024-09-11T01:18:10.201 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-11T01:18:10.575 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:18:10.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:10 smithi183 ceph-mon[34992]: pgmap v695: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-11T01:18:10.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:10 smithi103 ceph-mon[30562]: pgmap v695: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-11T01:18:10.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:10 smithi117 ceph-mon[35358]: pgmap v695: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-11T01:18:11.208 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:18:11.208 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T01:18:11.209 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 0, 2024-09-11T01:18:11.209 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 2, 2024-09-11T01:18:11.209 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 0, 2024-09-11T01:18:11.209 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 0, 2024-09-11T01:18:11.209 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-09-11T01:18:11.209 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-09-11T01:18:11.209 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.003282921, 2024-09-11T01:18:11.209 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T01:18:11.209 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.000576839, 2024-09-11T01:18:11.209 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:11.209 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:11.209 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:11.209 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:11.209 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:11.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:11.210 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:11.210 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:11.210 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:11.210 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:11.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:11.210 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T01:18:11.210 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T01:18:11.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:11.210 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T01:18:11.210 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 5, 2024-09-11T01:18:11.210 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 161, 2024-09-11T01:18:11.210 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 3152, 2024-09-11T01:18:11.210 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 108688, 2024-09-11T01:18:11.211 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 3, 2024-09-11T01:18:11.211 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 2, 2024-09-11T01:18:11.211 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.025542087, 2024-09-11T01:18:11.211 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.019330728, 2024-09-11T01:18:11.211 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.004255093, 2024-09-11T01:18:11.211 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:11.211 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:11.211 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 160, 2024-09-11T01:18:11.211 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.031197240, 2024-09-11T01:18:11.211 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000194982 2024-09-11T01:18:11.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:11.211 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:11.211 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:11.211 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 108688 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 214, 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 209, 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 829376, 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 128544, 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 2, 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.065674136, 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.038267150, 2024-09-11T01:18:11.212 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.034527535, 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 208, 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.051935279, 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000249688 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 829376, 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 128544 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:11.213 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-09-11T01:18:11.214 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-09-11T01:18:11.214 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-09-11T01:18:11.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:11.214 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-09-11T01:18:11.214 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-09-11T01:18:11.214 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-09-11T01:18:11.214 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T01:18:11.214 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-09-11T01:18:11.214 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T01:18:11.214 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-09-11T01:18:11.214 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T01:18:11.214 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T01:18:11.214 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T01:18:11.214 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T01:18:11.215 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T01:18:11.215 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-09-11T01:18:11.215 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T01:18:11.215 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T01:18:11.215 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-09-11T01:18:11.215 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-09-11T01:18:11.215 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-09-11T01:18:11.215 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-09-11T01:18:11.215 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T01:18:11.215 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T01:18:11.215 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T01:18:11.215 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T01:18:11.215 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T01:18:11.215 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-09-11T01:18:11.216 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-09-11T01:18:11.216 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-09-11T01:18:11.216 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T01:18:11.216 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T01:18:11.216 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-09-11T01:18:11.216 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-09-11T01:18:11.216 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-09-11T01:18:11.216 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-09-11T01:18:11.216 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T01:18:11.216 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-09-11T01:18:11.216 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T01:18:11.216 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-09-11T01:18:11.216 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 149998, 2024-09-11T01:18:11.216 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 30, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-09-11T01:18:11.217 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 968, 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 215, 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 799129, 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 215, 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-11T01:18:11.218 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-11T01:18:11.219 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 215, 2024-09-11T01:18:11.219 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 799129, 2024-09-11T01:18:11.219 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-11T01:18:11.219 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:11.219 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:11.219 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:11.219 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:11.219 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:11.219 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:18:12.161 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-11T01:18:12.161 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-11T01:18:12.161 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-11T01:18:12.161 DEBUG:tasks.check_counter:Getting stats from j 2024-09-11T01:18:12.162 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-11T01:18:12.534 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:18:12.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:12 smithi183 ceph-mon[34992]: pgmap v696: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-11T01:18:12.673 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:12 smithi103 ceph-mon[30562]: pgmap v696: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-11T01:18:12.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:12 smithi117 ceph-mon[35358]: pgmap v696: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-09-11T01:18:13.196 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-11T01:18:13.196 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T01:18:13.196 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 220, 2024-09-11T01:18:13.196 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 215, 2024-09-11T01:18:13.196 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 831008, 2024-09-11T01:18:13.196 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 132384, 2024-09-11T01:18:13.197 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-09-11T01:18:13.197 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-09-11T01:18:13.197 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.050802996, 2024-09-11T01:18:13.197 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.018684162, 2024-09-11T01:18:13.197 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.036504589, 2024-09-11T01:18:13.197 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:13.197 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:13.197 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 214, 2024-09-11T01:18:13.197 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.042461399, 2024-09-11T01:18:13.197 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000198417 2024-09-11T01:18:13.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:13.197 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:13.197 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:13.197 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 831008, 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 132384 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 5, 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 166, 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 3152, 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 109568, 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 3, 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 2, 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.031084586, 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.024279366, 2024-09-11T01:18:13.198 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.004545720, 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 165, 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.034058167, 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000206413 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 109568 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:13.199 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 0, 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 2, 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 0, 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 0, 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 2, 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.001130686, 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.000946738, 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:13.200 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:13.201 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:13.201 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:13.201 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:13.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:13.201 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T01:18:13.201 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T01:18:13.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:13.201 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-09-11T01:18:13.201 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-09-11T01:18:13.201 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-09-11T01:18:13.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:13.201 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-09-11T01:18:13.201 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-09-11T01:18:13.202 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-09-11T01:18:13.203 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-09-11T01:18:13.203 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T01:18:13.203 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T01:18:13.203 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T01:18:13.203 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T01:18:13.203 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T01:18:13.203 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-09-11T01:18:13.203 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-09-11T01:18:13.203 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-09-11T01:18:13.203 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T01:18:13.203 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T01:18:13.203 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-09-11T01:18:13.203 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-09-11T01:18:13.204 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-09-11T01:18:13.204 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-09-11T01:18:13.204 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T01:18:13.204 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-09-11T01:18:13.204 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T01:18:13.204 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-09-11T01:18:13.204 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 149998, 2024-09-11T01:18:13.204 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 30, 2024-09-11T01:18:13.204 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-09-11T01:18:13.204 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-09-11T01:18:13.204 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-09-11T01:18:13.204 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-09-11T01:18:13.204 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-09-11T01:18:13.204 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 968, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-11T01:18:13.205 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T01:18:13.206 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-09-11T01:18:13.206 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-09-11T01:18:13.206 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-09-11T01:18:13.206 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 221, 2024-09-11T01:18:13.206 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 799909, 2024-09-11T01:18:13.206 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:13.206 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 221, 2024-09-11T01:18:13.206 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-09-11T01:18:13.206 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-09-11T01:18:13.206 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 221, 2024-09-11T01:18:13.206 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 799909, 2024-09-11T01:18:13.206 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-09-11T01:18:13.206 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-09-11T01:18:13.206 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-09-11T01:18:13.207 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-09-11T01:18:13.207 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:13.207 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-11T01:18:13.207 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-11T01:18:14.030 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-11T01:18:14.030 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-11T01:18:14.030 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.j 2024-09-11T01:18:14.030 DEBUG:tasks.check_counter:Getting stats from b 2024-09-11T01:18:14.030 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-11T01:18:14.292 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T01:18:14.724 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:14 smithi117 ceph-mon[35358]: pgmap v697: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-11T01:18:14.773 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:14 smithi183 ceph-mon[34992]: pgmap v697: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-11T01:18:14.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:14 smithi103 ceph-mon[30562]: pgmap v697: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-11T01:18:14.925 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-11T01:18:14.925 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T01:18:14.925 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 6037, 2024-09-11T01:18:14.925 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 8387, 2024-09-11T01:18:14.925 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 1938012, 2024-09-11T01:18:14.925 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 14745557, 2024-09-11T01:18:14.925 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 85, 2024-09-11T01:18:14.926 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 5, 2024-09-11T01:18:14.926 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.564118771, 2024-09-11T01:18:14.926 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.285810530, 2024-09-11T01:18:14.926 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.212115289, 2024-09-11T01:18:14.926 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.086932055, 2024-09-11T01:18:14.926 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:14.926 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 8385, 2024-09-11T01:18:14.927 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 1.674512665, 2024-09-11T01:18:14.927 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000199703 2024-09-11T01:18:14.927 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.927 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:14.927 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 5327, 2024-09-11T01:18:14.927 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.001442057, 2024-09-11T01:18:14.927 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000270 2024-09-11T01:18:14.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.928 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 91696, 2024-09-11T01:18:14.928 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 34864 2024-09-11T01:18:14.928 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.928 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T01:18:14.928 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 1998, 2024-09-11T01:18:14.928 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 2372, 2024-09-11T01:18:14.929 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 679135, 2024-09-11T01:18:14.929 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 1850360, 2024-09-11T01:18:14.929 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 28, 2024-09-11T01:18:14.929 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 6, 2024-09-11T01:18:14.929 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.175622325, 2024-09-11T01:18:14.929 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.080729454, 2024-09-11T01:18:14.930 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.072607505, 2024-09-11T01:18:14.930 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.026256843, 2024-09-11T01:18:14.930 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:14.930 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 2370, 2024-09-11T01:18:14.930 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 1.485279687, 2024-09-11T01:18:14.930 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000626700 2024-09-11T01:18:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1813, 2024-09-11T01:18:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000355200, 2024-09-11T01:18:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000195 2024-09-11T01:18:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.931 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T01:18:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 370640 2024-09-11T01:18:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T01:18:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 4255, 2024-09-11T01:18:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 3674, 2024-09-11T01:18:14.932 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 2135391, 2024-09-11T01:18:14.933 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 1939822, 2024-09-11T01:18:14.933 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 10, 2024-09-11T01:18:14.933 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 6, 2024-09-11T01:18:14.933 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.347199377, 2024-09-11T01:18:14.933 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.179459823, 2024-09-11T01:18:14.933 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.154003531, 2024-09-11T01:18:14.934 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.037072381, 2024-09-11T01:18:14.934 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:14.934 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 3674, 2024-09-11T01:18:14.934 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 1.827726096, 2024-09-11T01:18:14.934 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000497475 2024-09-11T01:18:14.934 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.934 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 4583, 2024-09-11T01:18:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000617247, 2024-09-11T01:18:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000134 2024-09-11T01:18:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 913520, 2024-09-11T01:18:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 137536 2024-09-11T01:18:14.935 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.936 INFO:teuthology.orchestra.run.smithi117.stdout: "cct": { 2024-09-11T01:18:14.936 INFO:teuthology.orchestra.run.smithi117.stdout: "total_workers": 1, 2024-09-11T01:18:14.936 INFO:teuthology.orchestra.run.smithi117.stdout: "unhealthy_workers": 0 2024-09-11T01:18:14.936 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.936 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-MDSRank": { 2024-09-11T01:18:14.936 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-11T01:18:14.936 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-11T01:18:14.937 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1639, 2024-09-11T01:18:14.937 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 1.853796598, 2024-09-11T01:18:14.937 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001131053 2024-09-11T01:18:14.937 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:14.937 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.937 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-PurgeQueue": { 2024-09-11T01:18:14.938 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-11T01:18:14.938 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-11T01:18:14.938 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1163, 2024-09-11T01:18:14.938 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.133471123, 2024-09-11T01:18:14.938 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000114764 2024-09-11T01:18:14.938 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:14.938 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.938 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-09-11T01:18:14.939 INFO:teuthology.orchestra.run.smithi117.stdout: "request": 2054, 2024-09-11T01:18:14.939 INFO:teuthology.orchestra.run.smithi117.stdout: "reply": 2053, 2024-09-11T01:18:14.939 INFO:teuthology.orchestra.run.smithi117.stdout: "reply_latency": { 2024-09-11T01:18:14.939 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 2053, 2024-09-11T01:18:14.939 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 48.162986473, 2024-09-11T01:18:14.939 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.023459808 2024-09-11T01:18:14.939 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.939 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_reply": 0, 2024-09-11T01:18:14.939 INFO:teuthology.orchestra.run.smithi117.stdout: "forward": 1, 2024-09-11T01:18:14.939 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_complete": 0, 2024-09-11T01:18:14.939 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_keys": 0, 2024-09-11T01:18:14.940 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_commit": 346, 2024-09-11T01:18:14.940 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_split": 0, 2024-09-11T01:18:14.940 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_merge": 0, 2024-09-11T01:18:14.940 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes": 18, 2024-09-11T01:18:14.940 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_top": 1, 2024-09-11T01:18:14.940 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_bottom": 3, 2024-09-11T01:18:14.940 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pin_tail": 14, 2024-09-11T01:18:14.940 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pinned": 16, 2024-09-11T01:18:14.940 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_expired": 280, 2024-09-11T01:18:14.940 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_with_caps": 3, 2024-09-11T01:18:14.940 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": 3, 2024-09-11T01:18:14.940 INFO:teuthology.orchestra.run.smithi117.stdout: "subtrees": 3, 2024-09-11T01:18:14.940 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse": 2766, 2024-09-11T01:18:14.940 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_hit": 2626, 2024-09-11T01:18:14.941 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_forward": 0, 2024-09-11T01:18:14.941 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_discover": 0, 2024-09-11T01:18:14.941 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_dir_fetch": 0, 2024-09-11T01:18:14.941 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_remote_ino": 0, 2024-09-11T01:18:14.941 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_lock": 50, 2024-09-11T01:18:14.941 INFO:teuthology.orchestra.run.smithi117.stdout: "load_cent": 0, 2024-09-11T01:18:14.941 INFO:teuthology.orchestra.run.smithi117.stdout: "q": 0, 2024-09-11T01:18:14.941 INFO:teuthology.orchestra.run.smithi117.stdout: "exported": 63, 2024-09-11T01:18:14.941 INFO:teuthology.orchestra.run.smithi117.stdout: "exported_inodes": 191, 2024-09-11T01:18:14.941 INFO:teuthology.orchestra.run.smithi117.stdout: "imported": 4, 2024-09-11T01:18:14.941 INFO:teuthology.orchestra.run.smithi117.stdout: "imported_inodes": 61, 2024-09-11T01:18:14.941 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_dir_fetch": 0, 2024-09-11T01:18:14.941 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_backtrace_fetch": 0, 2024-09-11T01:18:14.942 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_peer_discover": 0, 2024-09-11T01:18:14.942 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rfiles": 4, 2024-09-11T01:18:14.942 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rbytes": 234, 2024-09-11T01:18:14.942 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rsnaps": 0, 2024-09-11T01:18:14.942 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T01:18:14.942 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_set_tag": 0, 2024-09-11T01:18:14.942 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T01:18:14.942 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_inotable_repaired": 0, 2024-09-11T01:18:14.942 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_inodes": 0, 2024-09-11T01:18:14.942 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T01:18:14.942 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T01:18:14.942 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_file_inodes": 0, 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_inode_file_caps": 8, 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_revoke": 482, 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_grant": 1763, 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_trunc": 6, 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps": 1332, 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps_dirty": 604, 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_cap_release": 91, 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: "process_request_cap_release": 1054 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache": { 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update": 2, 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update_receipt": 0, 2024-09-11T01:18:14.943 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_try_discover": 0, 2024-09-11T01:18:14.944 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_send_discover": 0, 2024-09-11T01:18:14.944 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_handle_discover": 71, 2024-09-11T01:18:14.944 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays": 0, 2024-09-11T01:18:14.944 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_delayed": 0, 2024-09-11T01:18:14.944 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_enqueuing": 0, 2024-09-11T01:18:14.944 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_created": 687, 2024-09-11T01:18:14.944 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_enqueued": 626, 2024-09-11T01:18:14.944 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_reintegrated": 61, 2024-09-11T01:18:14.944 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_migrated": 0, 2024-09-11T01:18:14.944 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_processing": 0, 2024-09-11T01:18:14.944 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_enqueued": 0, 2024-09-11T01:18:14.944 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_prioritized": 0, 2024-09-11T01:18:14.944 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_started": 0, 2024-09-11T01:18:14.945 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_completed": 0, 2024-09-11T01:18:14.945 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_path": 5, 2024-09-11T01:18:14.945 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_inode": 676, 2024-09-11T01:18:14.945 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T01:18:14.945 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_exportdir": 63, 2024-09-11T01:18:14.945 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_flush": 0, 2024-09-11T01:18:14.945 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragmentdir": 0, 2024-09-11T01:18:14.945 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragstats": 0, 2024-09-11T01:18:14.945 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_inodestats": 0, 2024-09-11T01:18:14.945 INFO:teuthology.orchestra.run.smithi117.stdout: "uninline_started": 0, 2024-09-11T01:18:14.945 INFO:teuthology.orchestra.run.smithi117.stdout: "uninline_succeeded": 0, 2024-09-11T01:18:14.945 INFO:teuthology.orchestra.run.smithi117.stdout: "uninline_write_failed": 0 2024-09-11T01:18:14.945 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.945 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log": { 2024-09-11T01:18:14.946 INFO:teuthology.orchestra.run.smithi117.stdout: "evlrg": 0, 2024-09-11T01:18:14.946 INFO:teuthology.orchestra.run.smithi117.stdout: "evadd": 3387, 2024-09-11T01:18:14.946 INFO:teuthology.orchestra.run.smithi117.stdout: "evex": 3384, 2024-09-11T01:18:14.946 INFO:teuthology.orchestra.run.smithi117.stdout: "evtrm": 3384, 2024-09-11T01:18:14.946 INFO:teuthology.orchestra.run.smithi117.stdout: "ev": 3, 2024-09-11T01:18:14.946 INFO:teuthology.orchestra.run.smithi117.stdout: "evexg": 0, 2024-09-11T01:18:14.946 INFO:teuthology.orchestra.run.smithi117.stdout: "evexd": 5, 2024-09-11T01:18:14.946 INFO:teuthology.orchestra.run.smithi117.stdout: "segadd": 33, 2024-09-11T01:18:14.946 INFO:teuthology.orchestra.run.smithi117.stdout: "segex": 32, 2024-09-11T01:18:14.946 INFO:teuthology.orchestra.run.smithi117.stdout: "segtrm": 32, 2024-09-11T01:18:14.946 INFO:teuthology.orchestra.run.smithi117.stdout: "seg": 1, 2024-09-11T01:18:14.946 INFO:teuthology.orchestra.run.smithi117.stdout: "segmjr": 1, 2024-09-11T01:18:14.946 INFO:teuthology.orchestra.run.smithi117.stdout: "segexg": 0, 2024-09-11T01:18:14.947 INFO:teuthology.orchestra.run.smithi117.stdout: "segexd": 1, 2024-09-11T01:18:14.947 INFO:teuthology.orchestra.run.smithi117.stdout: "expos": 12524024, 2024-09-11T01:18:14.947 INFO:teuthology.orchestra.run.smithi117.stdout: "wrpos": 12526963, 2024-09-11T01:18:14.947 INFO:teuthology.orchestra.run.smithi117.stdout: "rdpos": 0, 2024-09-11T01:18:14.947 INFO:teuthology.orchestra.run.smithi117.stdout: "jlat": { 2024-09-11T01:18:14.947 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 736, 2024-09-11T01:18:14.947 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 13.525989469, 2024-09-11T01:18:14.947 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.018377703 2024-09-11T01:18:14.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.947 INFO:teuthology.orchestra.run.smithi117.stdout: "replayed": 0 2024-09-11T01:18:14.947 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.948 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_mem": { 2024-09-11T01:18:14.948 INFO:teuthology.orchestra.run.smithi117.stdout: "ino": 19, 2024-09-11T01:18:14.948 INFO:teuthology.orchestra.run.smithi117.stdout: "ino+": 781, 2024-09-11T01:18:14.948 INFO:teuthology.orchestra.run.smithi117.stdout: "ino-": 762, 2024-09-11T01:18:14.948 INFO:teuthology.orchestra.run.smithi117.stdout: "dir": 18, 2024-09-11T01:18:14.948 INFO:teuthology.orchestra.run.smithi117.stdout: "dir+": 119, 2024-09-11T01:18:14.948 INFO:teuthology.orchestra.run.smithi117.stdout: "dir-": 101, 2024-09-11T01:18:14.948 INFO:teuthology.orchestra.run.smithi117.stdout: "dn": 18, 2024-09-11T01:18:14.948 INFO:teuthology.orchestra.run.smithi117.stdout: "dn+": 1343, 2024-09-11T01:18:14.948 INFO:teuthology.orchestra.run.smithi117.stdout: "dn-": 1325, 2024-09-11T01:18:14.948 INFO:teuthology.orchestra.run.smithi117.stdout: "cap": 3, 2024-09-11T01:18:14.948 INFO:teuthology.orchestra.run.smithi117.stdout: "cap+": 924, 2024-09-11T01:18:14.948 INFO:teuthology.orchestra.run.smithi117.stdout: "cap-": 921, 2024-09-11T01:18:14.948 INFO:teuthology.orchestra.run.smithi117.stdout: "rss": 64360, 2024-09-11T01:18:14.949 INFO:teuthology.orchestra.run.smithi117.stdout: "heap": 287170560 2024-09-11T01:18:14.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.949 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_server": { 2024-09-11T01:18:14.949 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_client_request": 2514, 2024-09-11T01:18:14.949 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_server_request": 8, 2024-09-11T01:18:14.949 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_request": 2054, 2024-09-11T01:18:14.949 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_session": 78, 2024-09-11T01:18:14.949 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_peer_request": 28, 2024-09-11T01:18:14.949 INFO:teuthology.orchestra.run.smithi117.stdout: "req_create_latency": { 2024-09-11T01:18:14.949 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 648, 2024-09-11T01:18:14.949 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.663127189, 2024-09-11T01:18:14.949 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001023344 2024-09-11T01:18:14.949 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getattr_latency": { 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 92, 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.022782482, 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000247635 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getfilelock_latency": { 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: "req_link_latency": { 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 61, 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.045006697, 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000737814 2024-09-11T01:18:14.950 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookup_latency": { 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 168, 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.043181865, 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000257034 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookuphash_latency": { 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupino_latency": { 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 2, 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000340489, 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000170244 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.951 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupname_latency": { 2024-09-11T01:18:14.952 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.952 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.952 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.952 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupparent_latency": { 2024-09-11T01:18:14.952 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.952 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.952 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.952 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.952 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupsnap_latency": { 2024-09-11T01:18:14.952 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.952 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.953 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.953 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lssnap_latency": { 2024-09-11T01:18:14.953 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.953 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.953 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.953 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.954 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mkdir_latency": { 2024-09-11T01:18:14.954 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 105, 2024-09-11T01:18:14.954 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.091858155, 2024-09-11T01:18:14.954 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000874839 2024-09-11T01:18:14.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.954 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mknod_latency": { 2024-09-11T01:18:14.954 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.954 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.954 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.954 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.955 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mksnap_latency": { 2024-09-11T01:18:14.955 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.955 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.955 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.955 INFO:teuthology.orchestra.run.smithi117.stdout: "req_open_latency": { 2024-09-11T01:18:14.955 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 49, 2024-09-11T01:18:14.955 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.009556831, 2024-09-11T01:18:14.955 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000195037 2024-09-11T01:18:14.955 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.955 INFO:teuthology.orchestra.run.smithi117.stdout: "req_readdir_latency": { 2024-09-11T01:18:14.955 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 127, 2024-09-11T01:18:14.955 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.807427628, 2024-09-11T01:18:14.956 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.006357697 2024-09-11T01:18:14.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.956 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rename_latency": { 2024-09-11T01:18:14.956 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 113, 2024-09-11T01:18:14.956 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 9.966503768, 2024-09-11T01:18:14.956 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.088199148 2024-09-11T01:18:14.956 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.956 INFO:teuthology.orchestra.run.smithi117.stdout: "req_renamesnap_latency": { 2024-09-11T01:18:14.956 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.956 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.957 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.957 INFO:teuthology.orchestra.run.smithi117.stdout: "req_snapdiff_latency": { 2024-09-11T01:18:14.957 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.957 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.957 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.957 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmdir_latency": { 2024-09-11T01:18:14.957 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 38, 2024-09-11T01:18:14.957 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 35.678401131, 2024-09-11T01:18:14.957 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.938905292 2024-09-11T01:18:14.957 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.958 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmsnap_latency": { 2024-09-11T01:18:14.958 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.958 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.958 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.958 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmxattr_latency": { 2024-09-11T01:18:14.958 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.958 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.958 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.958 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.958 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setattr_latency": { 2024-09-11T01:18:14.958 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 8, 2024-09-11T01:18:14.958 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.028922208, 2024-09-11T01:18:14.958 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.003615276 2024-09-11T01:18:14.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.959 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setdirlayout_latency": { 2024-09-11T01:18:14.959 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.959 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.959 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.959 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setfilelock_latency": { 2024-09-11T01:18:14.959 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 4, 2024-09-11T01:18:14.959 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.001004220, 2024-09-11T01:18:14.959 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000251055 2024-09-11T01:18:14.959 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.959 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setlayout_latency": { 2024-09-11T01:18:14.959 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.960 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.960 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.960 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setxattr_latency": { 2024-09-11T01:18:14.960 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 9, 2024-09-11T01:18:14.960 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.020236402, 2024-09-11T01:18:14.960 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.002248489 2024-09-11T01:18:14.960 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.960 INFO:teuthology.orchestra.run.smithi117.stdout: "req_symlink_latency": { 2024-09-11T01:18:14.960 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 13, 2024-09-11T01:18:14.960 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.007206721, 2024-09-11T01:18:14.961 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000554363 2024-09-11T01:18:14.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.961 INFO:teuthology.orchestra.run.smithi117.stdout: "req_unlink_latency": { 2024-09-11T01:18:14.961 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 616, 2024-09-11T01:18:14.961 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.777430687, 2024-09-11T01:18:14.961 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001262062 2024-09-11T01:18:14.961 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.961 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_revoke_eviction": 0, 2024-09-11T01:18:14.961 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_acquisition_throttle": 0, 2024-09-11T01:18:14.961 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getvxattr_latency": { 2024-09-11T01:18:14.961 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.961 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.961 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.962 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:14.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.962 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_sessions": { 2024-09-11T01:18:14.962 INFO:teuthology.orchestra.run.smithi117.stdout: "session_count": 1, 2024-09-11T01:18:14.962 INFO:teuthology.orchestra.run.smithi117.stdout: "session_add": 4, 2024-09-11T01:18:14.962 INFO:teuthology.orchestra.run.smithi117.stdout: "session_remove": 3, 2024-09-11T01:18:14.962 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_open": 1, 2024-09-11T01:18:14.962 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_stale": 0, 2024-09-11T01:18:14.962 INFO:teuthology.orchestra.run.smithi117.stdout: "total_load": 192, 2024-09-11T01:18:14.962 INFO:teuthology.orchestra.run.smithi117.stdout: "average_load": 192, 2024-09-11T01:18:14.962 INFO:teuthology.orchestra.run.smithi117.stdout: "avg_session_uptime": 597, 2024-09-11T01:18:14.962 INFO:teuthology.orchestra.run.smithi117.stdout: "mdthresh_evicted": 0 2024-09-11T01:18:14.962 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.962 INFO:teuthology.orchestra.run.smithi117.stdout: "mempool": { 2024-09-11T01:18:14.963 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_bytes": 360, 2024-09-11T01:18:14.963 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_items": 360, 2024-09-11T01:18:14.963 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T01:18:14.963 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_items": 0, 2024-09-11T01:18:14.963 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T01:18:14.963 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_items": 0, 2024-09-11T01:18:14.963 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T01:18:14.963 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T01:18:14.963 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T01:18:14.963 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T01:18:14.963 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T01:18:14.963 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_items": 0, 2024-09-11T01:18:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T01:18:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T01:18:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_bytes": 0, 2024-09-11T01:18:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_items": 0, 2024-09-11T01:18:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_bytes": 0, 2024-09-11T01:18:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_items": 0, 2024-09-11T01:18:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T01:18:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T01:18:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T01:18:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T01:18:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T01:18:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_items": 0, 2024-09-11T01:18:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_bytes": 0, 2024-09-11T01:18:14.964 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_items": 0, 2024-09-11T01:18:14.965 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T01:18:14.965 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T01:18:14.965 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_bytes": 0, 2024-09-11T01:18:14.965 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_items": 0, 2024-09-11T01:18:14.965 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_bytes": 0, 2024-09-11T01:18:14.966 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_items": 0, 2024-09-11T01:18:14.966 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T01:18:14.966 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_items": 0, 2024-09-11T01:18:14.966 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T01:18:14.966 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_items": 0, 2024-09-11T01:18:14.966 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_bytes": 294832, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_items": 99, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_bytes": 0, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_items": 0, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bytes": 0, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_items": 0, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_bytes": 0, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_items": 0, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_bytes": 0, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_items": 0, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_bytes": 8952, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_items": 168, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_items": 0, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_bytes": 0, 2024-09-11T01:18:14.967 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_items": 0, 2024-09-11T01:18:14.968 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_bytes": 83341, 2024-09-11T01:18:14.968 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_items": 535, 2024-09-11T01:18:14.968 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_bytes": 0, 2024-09-11T01:18:14.968 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_items": 0, 2024-09-11T01:18:14.968 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_bytes": 0, 2024-09-11T01:18:14.968 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_items": 0 2024-09-11T01:18:14.968 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.968 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter": { 2024-09-11T01:18:14.968 INFO:teuthology.orchestra.run.smithi117.stdout: "op_active": 0, 2024-09-11T01:18:14.968 INFO:teuthology.orchestra.run.smithi117.stdout: "op_laggy": 0, 2024-09-11T01:18:14.968 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send": 4222, 2024-09-11T01:18:14.968 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send_bytes": 9587443, 2024-09-11T01:18:14.968 INFO:teuthology.orchestra.run.smithi117.stdout: "op_resend": 37, 2024-09-11T01:18:14.968 INFO:teuthology.orchestra.run.smithi117.stdout: "op_reply": 4222, 2024-09-11T01:18:14.969 INFO:teuthology.orchestra.run.smithi117.stdout: "op_latency": { 2024-09-11T01:18:14.969 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 4222, 2024-09-11T01:18:14.969 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 441.419616791, 2024-09-11T01:18:14.969 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.104552254 2024-09-11T01:18:14.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.969 INFO:teuthology.orchestra.run.smithi117.stdout: "op_inflight": 0, 2024-09-11T01:18:14.969 INFO:teuthology.orchestra.run.smithi117.stdout: "oplen_avg": { 2024-09-11T01:18:14.969 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 4222, 2024-09-11T01:18:14.969 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 6751 2024-09-11T01:18:14.969 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.969 INFO:teuthology.orchestra.run.smithi117.stdout: "op": 4222, 2024-09-11T01:18:14.969 INFO:teuthology.orchestra.run.smithi117.stdout: "op_r": 22, 2024-09-11T01:18:14.969 INFO:teuthology.orchestra.run.smithi117.stdout: "op_w": 4200, 2024-09-11T01:18:14.970 INFO:teuthology.orchestra.run.smithi117.stdout: "op_rmw": 0, 2024-09-11T01:18:14.970 INFO:teuthology.orchestra.run.smithi117.stdout: "op_pg": 0, 2024-09-11T01:18:14.970 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_stat": 248, 2024-09-11T01:18:14.970 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_create": 1153, 2024-09-11T01:18:14.970 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_read": 22, 2024-09-11T01:18:14.970 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_write": 758, 2024-09-11T01:18:14.970 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writefull": 131, 2024-09-11T01:18:14.970 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writesame": 0, 2024-09-11T01:18:14.970 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_append": 0, 2024-09-11T01:18:14.970 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_zero": 0, 2024-09-11T01:18:14.970 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_truncate": 0, 2024-09-11T01:18:14.970 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_delete": 1715, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_mapext": 0, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_sparse_read": 0, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_clonerange": 0, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_getxattr": 0, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_setxattr": 1820, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_cmpxattr": 0, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_rmxattr": 0, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_resetxattrs": 0, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_call": 0, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_watch": 0, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_notify": 0, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls": 0, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls_filter": 0, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_other": 6, 2024-09-11T01:18:14.971 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_active": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_send": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_resend": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_ping": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_active": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_send": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_resend": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_active": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_send": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_resend": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_active": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_send": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_resend": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "command_active": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "command_send": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "command_resend": 0, 2024-09-11T01:18:14.972 INFO:teuthology.orchestra.run.smithi117.stdout: "map_epoch": 89, 2024-09-11T01:18:14.973 INFO:teuthology.orchestra.run.smithi117.stdout: "map_full": 0, 2024-09-11T01:18:14.973 INFO:teuthology.orchestra.run.smithi117.stdout: "map_inc": 9, 2024-09-11T01:18:14.973 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_sessions": 12, 2024-09-11T01:18:14.973 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_open": 12, 2024-09-11T01:18:14.973 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_close": 0, 2024-09-11T01:18:14.973 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_laggy": 0, 2024-09-11T01:18:14.973 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_wr": 793, 2024-09-11T01:18:14.973 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_rd": 0, 2024-09-11T01:18:14.973 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_del": 105 2024-09-11T01:18:14.973 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.973 INFO:teuthology.orchestra.run.smithi117.stdout: "oft": { 2024-09-11T01:18:14.973 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_objs": 1, 2024-09-11T01:18:14.973 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_kv_pairs": 0, 2024-09-11T01:18:14.974 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_updates": 0, 2024-09-11T01:18:14.974 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_removes": 0 2024-09-11T01:18:14.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.974 INFO:teuthology.orchestra.run.smithi117.stdout: "purge_queue": { 2024-09-11T01:18:14.974 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops": 0, 2024-09-11T01:18:14.974 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops_high_water": 17, 2024-09-11T01:18:14.974 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing": 0, 2024-09-11T01:18:14.974 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_high_water": 13, 2024-09-11T01:18:14.974 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed_ops": 1201, 2024-09-11T01:18:14.974 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed": 626, 2024-09-11T01:18:14.974 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_item_in_journal": 0 2024-09-11T01:18:14.974 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.975 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T01:18:14.975 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:14.975 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-11T01:18:14.975 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:14.975 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 12286, 2024-09-11T01:18:14.975 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 3684019, 2024-09-11T01:18:14.975 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:14.975 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 12286, 2024-09-11T01:18:14.975 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-11T01:18:14.975 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 12286, 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 3684019, 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_bytes": { 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-11T01:18:14.976 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:14.977 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:14.977 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 4222, 2024-09-11T01:18:14.977 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 9655269, 2024-09-11T01:18:14.977 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 4222, 2024-09-11T01:18:14.977 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 9655269, 2024-09-11T01:18:14.977 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:14.977 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.977 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.977 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.977 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:14.978 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.978 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_ops": { 2024-09-11T01:18:14.978 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:14.978 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 1024, 2024-09-11T01:18:14.978 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:14.978 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-11T01:18:14.978 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-11T01:18:14.978 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:14.978 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:14.978 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 4222, 2024-09-11T01:18:14.979 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 4222, 2024-09-11T01:18:14.979 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 4222, 2024-09-11T01:18:14.979 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 4222, 2024-09-11T01:18:14.979 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:14.979 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.979 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.979 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.979 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:14.979 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.979 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle": { 2024-09-11T01:18:14.979 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:14.979 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-11T01:18:14.980 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:14.980 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 626, 2024-09-11T01:18:14.980 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 67826, 2024-09-11T01:18:14.980 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:14.980 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 626, 2024-09-11T01:18:14.980 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-11T01:18:14.980 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-11T01:18:14.980 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 22, 2024-09-11T01:18:14.980 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 67826, 2024-09-11T01:18:14.980 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:14.981 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.981 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.981 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.981 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:14.981 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.981 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle-0x561d3ea10dc0": { 2024-09-11T01:18:14.981 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:14.981 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-11T01:18:14.981 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:14.981 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 3387, 2024-09-11T01:18:14.981 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 8332659, 2024-09-11T01:18:14.981 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:14.982 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 3387, 2024-09-11T01:18:14.982 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-11T01:18:14.982 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-11T01:18:14.982 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 736, 2024-09-11T01:18:14.982 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 8332659, 2024-09-11T01:18:14.982 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:14.982 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:14.982 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:14.982 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:14.982 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:14.982 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:14.982 INFO:teuthology.orchestra.run.smithi117.stdout: "trackedop": { 2024-09-11T01:18:14.983 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_ops_count": 682 2024-09-11T01:18:14.983 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:14.983 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-11T01:18:15.968 INFO:tasks.check_counter:Daemon mds.b mds.exported=63 2024-09-11T01:18:15.968 INFO:tasks.check_counter:Daemon mds.b mds.imported=4 2024-09-11T01:18:15.968 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=0 2024-09-11T01:18:15.968 DEBUG:tasks.check_counter:Getting stats from e 2024-09-11T01:18:15.968 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-11T01:18:16.231 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T01:18:16.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:16 smithi117 ceph-mon[35358]: pgmap v698: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-11T01:18:16.755 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-11T01:18:16.756 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T01:18:16.756 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 2083, 2024-09-11T01:18:16.756 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 2083, 2024-09-11T01:18:16.756 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 1786404, 2024-09-11T01:18:16.756 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 661577, 2024-09-11T01:18:16.756 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 6, 2024-09-11T01:18:16.756 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 2, 2024-09-11T01:18:16.756 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.180920849, 2024-09-11T01:18:16.756 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.076484689, 2024-09-11T01:18:16.756 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.039737979, 2024-09-11T01:18:16.756 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.053426020, 2024-09-11T01:18:16.756 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:16.756 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 2082, 2024-09-11T01:18:16.756 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.084021520, 2024-09-11T01:18:16.757 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000040356 2024-09-11T01:18:16.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.757 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:16.757 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.757 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.757 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.757 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T01:18:16.757 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T01:18:16.757 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.757 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T01:18:16.757 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 237, 2024-09-11T01:18:16.757 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 223, 2024-09-11T01:18:16.757 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 885548, 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 133626, 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 3, 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 2, 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.037774902, 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.018629145, 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.026768811, 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.000048666, 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 222, 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.011756238, 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000052956 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.758 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.759 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.759 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 884992, 2024-09-11T01:18:16.759 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 132928 2024-09-11T01:18:16.759 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.759 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T01:18:16.759 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 2, 2024-09-11T01:18:16.759 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 164, 2024-09-11T01:18:16.759 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 428, 2024-09-11T01:18:16.759 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 354574, 2024-09-11T01:18:16.759 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 4, 2024-09-11T01:18:16.759 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 3, 2024-09-11T01:18:16.759 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.011280116, 2024-09-11T01:18:16.759 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.008753286, 2024-09-11T01:18:16.760 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.001096660, 2024-09-11T01:18:16.760 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.000018704, 2024-09-11T01:18:16.760 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:16.760 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 162, 2024-09-11T01:18:16.760 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.008007996, 2024-09-11T01:18:16.760 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000049432 2024-09-11T01:18:16.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.760 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:16.760 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.760 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.760 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.760 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.760 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T01:18:16.761 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 354256 2024-09-11T01:18:16.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.761 INFO:teuthology.orchestra.run.smithi117.stdout: "cct": { 2024-09-11T01:18:16.761 INFO:teuthology.orchestra.run.smithi117.stdout: "total_workers": 1, 2024-09-11T01:18:16.761 INFO:teuthology.orchestra.run.smithi117.stdout: "unhealthy_workers": 0 2024-09-11T01:18:16.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.761 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-MDSRank": { 2024-09-11T01:18:16.761 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-11T01:18:16.761 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-11T01:18:16.761 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 3492, 2024-09-11T01:18:16.761 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.079559256, 2024-09-11T01:18:16.761 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000022783 2024-09-11T01:18:16.761 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:16.761 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.762 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-PurgeQueue": { 2024-09-11T01:18:16.762 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-11T01:18:16.762 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-11T01:18:16.762 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.762 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.762 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.762 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:16.762 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.762 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-09-11T01:18:16.762 INFO:teuthology.orchestra.run.smithi117.stdout: "request": 0, 2024-09-11T01:18:16.762 INFO:teuthology.orchestra.run.smithi117.stdout: "reply": 0, 2024-09-11T01:18:16.762 INFO:teuthology.orchestra.run.smithi117.stdout: "reply_latency": { 2024-09-11T01:18:16.762 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.762 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.763 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.763 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.763 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_reply": 0, 2024-09-11T01:18:16.763 INFO:teuthology.orchestra.run.smithi117.stdout: "forward": 0, 2024-09-11T01:18:16.763 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_complete": 0, 2024-09-11T01:18:16.763 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_keys": 0, 2024-09-11T01:18:16.763 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_commit": 0, 2024-09-11T01:18:16.763 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_split": 0, 2024-09-11T01:18:16.763 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_merge": 0, 2024-09-11T01:18:16.763 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes": 115, 2024-09-11T01:18:16.763 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_top": 0, 2024-09-11T01:18:16.763 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_bottom": 115, 2024-09-11T01:18:16.763 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pin_tail": 0, 2024-09-11T01:18:16.763 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pinned": 115, 2024-09-11T01:18:16.764 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_expired": 0, 2024-09-11T01:18:16.764 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_with_caps": 0, 2024-09-11T01:18:16.764 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": 0, 2024-09-11T01:18:16.764 INFO:teuthology.orchestra.run.smithi117.stdout: "subtrees": 1, 2024-09-11T01:18:16.764 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse": 0, 2024-09-11T01:18:16.764 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_hit": 0, 2024-09-11T01:18:16.764 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_forward": 0, 2024-09-11T01:18:16.764 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_discover": 0, 2024-09-11T01:18:16.764 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_dir_fetch": 0, 2024-09-11T01:18:16.764 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_remote_ino": 0, 2024-09-11T01:18:16.764 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_lock": 0, 2024-09-11T01:18:16.765 INFO:teuthology.orchestra.run.smithi117.stdout: "load_cent": 0, 2024-09-11T01:18:16.765 INFO:teuthology.orchestra.run.smithi117.stdout: "q": 0, 2024-09-11T01:18:16.765 INFO:teuthology.orchestra.run.smithi117.stdout: "exported": 0, 2024-09-11T01:18:16.765 INFO:teuthology.orchestra.run.smithi117.stdout: "exported_inodes": 0, 2024-09-11T01:18:16.765 INFO:teuthology.orchestra.run.smithi117.stdout: "imported": 0, 2024-09-11T01:18:16.765 INFO:teuthology.orchestra.run.smithi117.stdout: "imported_inodes": 0, 2024-09-11T01:18:16.765 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_dir_fetch": 0, 2024-09-11T01:18:16.765 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_backtrace_fetch": 0, 2024-09-11T01:18:16.765 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_peer_discover": 0, 2024-09-11T01:18:16.765 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rfiles": 0, 2024-09-11T01:18:16.765 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rbytes": 0, 2024-09-11T01:18:16.765 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rsnaps": 0, 2024-09-11T01:18:16.765 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_set_tag": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_inotable_repaired": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_inodes": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_file_inodes": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_inode_file_caps": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_grant": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps": 0, 2024-09-11T01:18:16.766 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps_dirty": 0, 2024-09-11T01:18:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_cap_release": 0, 2024-09-11T01:18:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: "process_request_cap_release": 0 2024-09-11T01:18:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache": { 2024-09-11T01:18:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update": 0, 2024-09-11T01:18:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update_receipt": 0, 2024-09-11T01:18:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_try_discover": 0, 2024-09-11T01:18:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_send_discover": 0, 2024-09-11T01:18:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_handle_discover": 0, 2024-09-11T01:18:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays": 0, 2024-09-11T01:18:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_delayed": 0, 2024-09-11T01:18:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_enqueuing": 0, 2024-09-11T01:18:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_created": 0, 2024-09-11T01:18:16.767 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_enqueued": 0, 2024-09-11T01:18:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_reintegrated": 0, 2024-09-11T01:18:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_migrated": 0, 2024-09-11T01:18:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_processing": 0, 2024-09-11T01:18:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_enqueued": 0, 2024-09-11T01:18:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_prioritized": 0, 2024-09-11T01:18:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_started": 0, 2024-09-11T01:18:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_completed": 0, 2024-09-11T01:18:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_path": 0, 2024-09-11T01:18:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_inode": 0, 2024-09-11T01:18:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T01:18:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_exportdir": 0, 2024-09-11T01:18:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_flush": 0, 2024-09-11T01:18:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragmentdir": 0, 2024-09-11T01:18:16.768 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragstats": 0, 2024-09-11T01:18:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_inodestats": 0, 2024-09-11T01:18:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: "uninline_started": 0, 2024-09-11T01:18:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: "uninline_succeeded": 0, 2024-09-11T01:18:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: "uninline_write_failed": 0 2024-09-11T01:18:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log": { 2024-09-11T01:18:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: "evlrg": 0, 2024-09-11T01:18:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: "evadd": 0, 2024-09-11T01:18:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: "evex": 0, 2024-09-11T01:18:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: "evtrm": 0, 2024-09-11T01:18:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: "ev": 438, 2024-09-11T01:18:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: "evexg": 0, 2024-09-11T01:18:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: "evexd": 0, 2024-09-11T01:18:16.769 INFO:teuthology.orchestra.run.smithi117.stdout: "segadd": 0, 2024-09-11T01:18:16.770 INFO:teuthology.orchestra.run.smithi117.stdout: "segex": 0, 2024-09-11T01:18:16.770 INFO:teuthology.orchestra.run.smithi117.stdout: "segtrm": 0, 2024-09-11T01:18:16.770 INFO:teuthology.orchestra.run.smithi117.stdout: "seg": 2, 2024-09-11T01:18:16.770 INFO:teuthology.orchestra.run.smithi117.stdout: "segmjr": 2, 2024-09-11T01:18:16.770 INFO:teuthology.orchestra.run.smithi117.stdout: "segexg": 0, 2024-09-11T01:18:16.770 INFO:teuthology.orchestra.run.smithi117.stdout: "segexd": 0, 2024-09-11T01:18:16.770 INFO:teuthology.orchestra.run.smithi117.stdout: "expos": 4194304, 2024-09-11T01:18:16.770 INFO:teuthology.orchestra.run.smithi117.stdout: "wrpos": 5390081, 2024-09-11T01:18:16.770 INFO:teuthology.orchestra.run.smithi117.stdout: "rdpos": 5388430, 2024-09-11T01:18:16.770 INFO:teuthology.orchestra.run.smithi117.stdout: "jlat": { 2024-09-11T01:18:16.770 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.770 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.770 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.770 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.771 INFO:teuthology.orchestra.run.smithi117.stdout: "replayed": 438 2024-09-11T01:18:16.771 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.771 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_mem": { 2024-09-11T01:18:16.771 INFO:teuthology.orchestra.run.smithi117.stdout: "ino": 4, 2024-09-11T01:18:16.771 INFO:teuthology.orchestra.run.smithi117.stdout: "ino+": 129, 2024-09-11T01:18:16.771 INFO:teuthology.orchestra.run.smithi117.stdout: "ino-": 125, 2024-09-11T01:18:16.771 INFO:teuthology.orchestra.run.smithi117.stdout: "dir": 2, 2024-09-11T01:18:16.771 INFO:teuthology.orchestra.run.smithi117.stdout: "dir+": 73, 2024-09-11T01:18:16.771 INFO:teuthology.orchestra.run.smithi117.stdout: "dir-": 71, 2024-09-11T01:18:16.771 INFO:teuthology.orchestra.run.smithi117.stdout: "dn": 115, 2024-09-11T01:18:16.771 INFO:teuthology.orchestra.run.smithi117.stdout: "dn+": 298, 2024-09-11T01:18:16.771 INFO:teuthology.orchestra.run.smithi117.stdout: "dn-": 183, 2024-09-11T01:18:16.771 INFO:teuthology.orchestra.run.smithi117.stdout: "cap": 0, 2024-09-11T01:18:16.771 INFO:teuthology.orchestra.run.smithi117.stdout: "cap+": 0, 2024-09-11T01:18:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: "cap-": 0, 2024-09-11T01:18:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: "rss": 50284, 2024-09-11T01:18:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: "heap": 250343424 2024-09-11T01:18:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_server": { 2024-09-11T01:18:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_client_request": 0, 2024-09-11T01:18:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_server_request": 0, 2024-09-11T01:18:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_request": 0, 2024-09-11T01:18:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_session": 0, 2024-09-11T01:18:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_peer_request": 0, 2024-09-11T01:18:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: "req_create_latency": { 2024-09-11T01:18:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.772 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getattr_latency": { 2024-09-11T01:18:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getfilelock_latency": { 2024-09-11T01:18:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: "req_link_latency": { 2024-09-11T01:18:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.773 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.774 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.774 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookup_latency": { 2024-09-11T01:18:16.774 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.774 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.774 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.774 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookuphash_latency": { 2024-09-11T01:18:16.774 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.774 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.774 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.774 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupino_latency": { 2024-09-11T01:18:16.774 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupname_latency": { 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupparent_latency": { 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupsnap_latency": { 2024-09-11T01:18:16.775 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lssnap_latency": { 2024-09-11T01:18:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.776 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mkdir_latency": { 2024-09-11T01:18:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mknod_latency": { 2024-09-11T01:18:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.777 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mksnap_latency": { 2024-09-11T01:18:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: "req_open_latency": { 2024-09-11T01:18:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: "req_readdir_latency": { 2024-09-11T01:18:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rename_latency": { 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: "req_renamesnap_latency": { 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: "req_snapdiff_latency": { 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.779 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmdir_latency": { 2024-09-11T01:18:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmsnap_latency": { 2024-09-11T01:18:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmxattr_latency": { 2024-09-11T01:18:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.780 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setattr_latency": { 2024-09-11T01:18:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setdirlayout_latency": { 2024-09-11T01:18:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.781 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setfilelock_latency": { 2024-09-11T01:18:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setlayout_latency": { 2024-09-11T01:18:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setxattr_latency": { 2024-09-11T01:18:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.782 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: "req_symlink_latency": { 2024-09-11T01:18:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: "req_unlink_latency": { 2024-09-11T01:18:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.783 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_revoke_eviction": 0, 2024-09-11T01:18:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_acquisition_throttle": 0, 2024-09-11T01:18:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getvxattr_latency": { 2024-09-11T01:18:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_sessions": { 2024-09-11T01:18:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: "session_count": 1, 2024-09-11T01:18:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: "session_add": 2, 2024-09-11T01:18:16.784 INFO:teuthology.orchestra.run.smithi117.stdout: "session_remove": 1, 2024-09-11T01:18:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_open": 1, 2024-09-11T01:18:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_stale": 0, 2024-09-11T01:18:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: "total_load": 0, 2024-09-11T01:18:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: "average_load": 0, 2024-09-11T01:18:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: "avg_session_uptime": 2056, 2024-09-11T01:18:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: "mdthresh_evicted": 0 2024-09-11T01:18:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: "mempool": { 2024-09-11T01:18:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_bytes": 0, 2024-09-11T01:18:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_items": 0, 2024-09-11T01:18:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T01:18:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_items": 0, 2024-09-11T01:18:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T01:18:16.785 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_items": 0, 2024-09-11T01:18:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T01:18:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T01:18:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T01:18:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T01:18:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T01:18:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_items": 0, 2024-09-11T01:18:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T01:18:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T01:18:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_bytes": 0, 2024-09-11T01:18:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_items": 0, 2024-09-11T01:18:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_bytes": 0, 2024-09-11T01:18:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_items": 0, 2024-09-11T01:18:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T01:18:16.786 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_items": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_bytes": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_items": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_bytes": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_items": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_bytes": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_items": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_items": 0, 2024-09-11T01:18:16.787 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T01:18:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_items": 0, 2024-09-11T01:18:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_bytes": 181343, 2024-09-11T01:18:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_items": 47, 2024-09-11T01:18:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_bytes": 0, 2024-09-11T01:18:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_items": 0, 2024-09-11T01:18:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bytes": 0, 2024-09-11T01:18:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_items": 0, 2024-09-11T01:18:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_bytes": 0, 2024-09-11T01:18:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_items": 0, 2024-09-11T01:18:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_bytes": 0, 2024-09-11T01:18:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_items": 0, 2024-09-11T01:18:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_bytes": 8952, 2024-09-11T01:18:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_items": 168, 2024-09-11T01:18:16.788 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T01:18:16.789 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_items": 0, 2024-09-11T01:18:16.789 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_bytes": 0, 2024-09-11T01:18:16.789 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_items": 0, 2024-09-11T01:18:16.789 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_bytes": 90448, 2024-09-11T01:18:16.789 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_items": 488, 2024-09-11T01:18:16.789 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_bytes": 0, 2024-09-11T01:18:16.789 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_items": 0, 2024-09-11T01:18:16.789 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_bytes": 0, 2024-09-11T01:18:16.789 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_items": 0 2024-09-11T01:18:16.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.789 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter": { 2024-09-11T01:18:16.789 INFO:teuthology.orchestra.run.smithi117.stdout: "op_active": 0, 2024-09-11T01:18:16.789 INFO:teuthology.orchestra.run.smithi117.stdout: "op_laggy": 0, 2024-09-11T01:18:16.789 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send": 2082, 2024-09-11T01:18:16.790 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send_bytes": 21, 2024-09-11T01:18:16.790 INFO:teuthology.orchestra.run.smithi117.stdout: "op_resend": 3, 2024-09-11T01:18:16.790 INFO:teuthology.orchestra.run.smithi117.stdout: "op_reply": 2082, 2024-09-11T01:18:16.790 INFO:teuthology.orchestra.run.smithi117.stdout: "op_latency": { 2024-09-11T01:18:16.790 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 2082, 2024-09-11T01:18:16.790 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 5.689892711, 2024-09-11T01:18:16.790 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.002732897 2024-09-11T01:18:16.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.790 INFO:teuthology.orchestra.run.smithi117.stdout: "op_inflight": 0, 2024-09-11T01:18:16.790 INFO:teuthology.orchestra.run.smithi117.stdout: "oplen_avg": { 2024-09-11T01:18:16.790 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 2082, 2024-09-11T01:18:16.790 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 2083 2024-09-11T01:18:16.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.790 INFO:teuthology.orchestra.run.smithi117.stdout: "op": 2082, 2024-09-11T01:18:16.791 INFO:teuthology.orchestra.run.smithi117.stdout: "op_r": 2082, 2024-09-11T01:18:16.791 INFO:teuthology.orchestra.run.smithi117.stdout: "op_w": 0, 2024-09-11T01:18:16.791 INFO:teuthology.orchestra.run.smithi117.stdout: "op_rmw": 0, 2024-09-11T01:18:16.791 INFO:teuthology.orchestra.run.smithi117.stdout: "op_pg": 0, 2024-09-11T01:18:16.791 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_stat": 1347, 2024-09-11T01:18:16.791 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_create": 0, 2024-09-11T01:18:16.791 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_read": 733, 2024-09-11T01:18:16.791 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_write": 0, 2024-09-11T01:18:16.791 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writefull": 0, 2024-09-11T01:18:16.791 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writesame": 0, 2024-09-11T01:18:16.791 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_append": 0, 2024-09-11T01:18:16.792 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_zero": 0, 2024-09-11T01:18:16.792 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_truncate": 0, 2024-09-11T01:18:16.792 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_delete": 0, 2024-09-11T01:18:16.792 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_mapext": 0, 2024-09-11T01:18:16.792 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_sparse_read": 0, 2024-09-11T01:18:16.792 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_clonerange": 0, 2024-09-11T01:18:16.792 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_getxattr": 1, 2024-09-11T01:18:16.792 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_setxattr": 0, 2024-09-11T01:18:16.792 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_cmpxattr": 0, 2024-09-11T01:18:16.792 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_rmxattr": 0, 2024-09-11T01:18:16.792 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_resetxattrs": 0, 2024-09-11T01:18:16.792 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_call": 0, 2024-09-11T01:18:16.792 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_watch": 0, 2024-09-11T01:18:16.792 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_notify": 0, 2024-09-11T01:18:16.793 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T01:18:16.793 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls": 0, 2024-09-11T01:18:16.793 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls_filter": 0, 2024-09-11T01:18:16.793 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_other": 0, 2024-09-11T01:18:16.793 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_active": 0, 2024-09-11T01:18:16.793 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_send": 0, 2024-09-11T01:18:16.793 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_resend": 0, 2024-09-11T01:18:16.793 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_ping": 0, 2024-09-11T01:18:16.793 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_active": 0, 2024-09-11T01:18:16.793 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_send": 0, 2024-09-11T01:18:16.793 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_resend": 0, 2024-09-11T01:18:16.793 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_active": 0, 2024-09-11T01:18:16.793 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_send": 0, 2024-09-11T01:18:16.793 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_resend": 0, 2024-09-11T01:18:16.794 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_active": 0, 2024-09-11T01:18:16.794 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_send": 0, 2024-09-11T01:18:16.794 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_resend": 0, 2024-09-11T01:18:16.794 INFO:teuthology.orchestra.run.smithi117.stdout: "command_active": 0, 2024-09-11T01:18:16.794 INFO:teuthology.orchestra.run.smithi117.stdout: "command_send": 0, 2024-09-11T01:18:16.794 INFO:teuthology.orchestra.run.smithi117.stdout: "command_resend": 0, 2024-09-11T01:18:16.794 INFO:teuthology.orchestra.run.smithi117.stdout: "map_epoch": 89, 2024-09-11T01:18:16.794 INFO:teuthology.orchestra.run.smithi117.stdout: "map_full": 0, 2024-09-11T01:18:16.794 INFO:teuthology.orchestra.run.smithi117.stdout: "map_inc": 2, 2024-09-11T01:18:16.794 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_sessions": 4, 2024-09-11T01:18:16.794 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_open": 4, 2024-09-11T01:18:16.794 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_close": 0, 2024-09-11T01:18:16.794 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_laggy": 0, 2024-09-11T01:18:16.794 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_wr": 0, 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_rd": 2, 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_del": 0 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: "oft": { 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_objs": 0, 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_kv_pairs": 0, 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_updates": 0, 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_removes": 0 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: "purge_queue": { 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops": 0, 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing": 0, 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_high_water": 0, 2024-09-11T01:18:16.795 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed_ops": 0, 2024-09-11T01:18:16.796 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed": 0, 2024-09-11T01:18:16.796 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_item_in_journal": 0 2024-09-11T01:18:16.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.796 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T01:18:16.796 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:16.796 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-11T01:18:16.796 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:16.796 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 2318, 2024-09-11T01:18:16.796 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 2448708, 2024-09-11T01:18:16.796 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:16.796 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 2318, 2024-09-11T01:18:16.796 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-11T01:18:16.796 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-11T01:18:16.796 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 2318, 2024-09-11T01:18:16.797 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 2448708, 2024-09-11T01:18:16.797 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:16.797 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.797 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.797 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.797 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:16.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.797 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_bytes": { 2024-09-11T01:18:16.797 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:16.797 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-11T01:18:16.797 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:16.797 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-11T01:18:16.797 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-11T01:18:16.797 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:16.798 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:16.798 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 2082, 2024-09-11T01:18:16.798 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 1195782, 2024-09-11T01:18:16.798 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 2082, 2024-09-11T01:18:16.798 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 1195782, 2024-09-11T01:18:16.798 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:16.798 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.798 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.798 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.798 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:16.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.798 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_ops": { 2024-09-11T01:18:16.798 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:16.798 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 1024, 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 2082, 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 2082, 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 2082, 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 2082, 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:16.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.800 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle": { 2024-09-11T01:18:16.800 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:16.800 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-11T01:18:16.800 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:16.800 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-11T01:18:16.800 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-11T01:18:16.800 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:16.800 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:16.800 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-11T01:18:16.800 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-11T01:18:16.801 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 0, 2024-09-11T01:18:16.801 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 0, 2024-09-11T01:18:16.801 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:16.801 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.801 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.801 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.801 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:16.801 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.801 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle-0x55bcce171180": { 2024-09-11T01:18:16.801 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:16.801 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-11T01:18:16.801 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 0, 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 0, 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:16.802 INFO:teuthology.orchestra.run.smithi117.stdout: "trackedop": { 2024-09-11T01:18:16.803 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_ops_count": 0 2024-09-11T01:18:16.803 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:16.803 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-11T01:18:16.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:16 smithi103 ceph-mon[30562]: pgmap v698: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-11T01:18:16.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:16 smithi183 ceph-mon[34992]: pgmap v698: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 938 B/s wr, 7 op/s 2024-09-11T01:18:17.997 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-11T01:18:17.997 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-11T01:18:17.997 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-11T01:18:17.997 DEBUG:tasks.check_counter:Getting stats from h 2024-09-11T01:18:17.998 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-11T01:18:18.259 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T01:18:18.662 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:18 smithi117 ceph-mon[35358]: pgmap v699: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T01:18:18.771 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-11T01:18:18.771 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T01:18:18.771 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 499, 2024-09-11T01:18:18.771 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 553, 2024-09-11T01:18:18.771 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 969432, 2024-09-11T01:18:18.771 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 284167, 2024-09-11T01:18:18.772 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 11, 2024-09-11T01:18:18.772 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 5, 2024-09-11T01:18:18.772 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.058811354, 2024-09-11T01:18:18.772 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.025820157, 2024-09-11T01:18:18.772 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.038043889, 2024-09-11T01:18:18.772 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.002310335, 2024-09-11T01:18:18.772 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:18.772 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 550, 2024-09-11T01:18:18.772 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.040789626, 2024-09-11T01:18:18.772 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000074162 2024-09-11T01:18:18.772 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.772 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:18.772 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 375, 2024-09-11T01:18:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000061374, 2024-09-11T01:18:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000163 2024-09-11T01:18:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 898720, 2024-09-11T01:18:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 137600 2024-09-11T01:18:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T01:18:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 2325, 2024-09-11T01:18:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 3050, 2024-09-11T01:18:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 783085, 2024-09-11T01:18:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 2493351, 2024-09-11T01:18:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 10, 2024-09-11T01:18:18.773 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 7, 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.199884367, 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.114171348, 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.084622115, 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.009530520, 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 3050, 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.126908325, 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000041609 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 4571, 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000730198, 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000159 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.774 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T01:18:18.775 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 355728 2024-09-11T01:18:18.775 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.775 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T01:18:18.775 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 701, 2024-09-11T01:18:18.775 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 1264, 2024-09-11T01:18:18.775 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 243937, 2024-09-11T01:18:18.775 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 660442, 2024-09-11T01:18:18.775 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 13, 2024-09-11T01:18:18.775 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 6, 2024-09-11T01:18:18.775 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.061895180, 2024-09-11T01:18:18.775 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.033168395, 2024-09-11T01:18:18.775 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.030010802, 2024-09-11T01:18:18.775 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.002352416, 2024-09-11T01:18:18.775 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:18.776 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 1263, 2024-09-11T01:18:18.776 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.065655001, 2024-09-11T01:18:18.776 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000051983 2024-09-11T01:18:18.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.776 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:18.776 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 892, 2024-09-11T01:18:18.776 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000197578, 2024-09-11T01:18:18.776 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000221 2024-09-11T01:18:18.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.776 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 3920, 2024-09-11T01:18:18.776 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 1184 2024-09-11T01:18:18.776 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.776 INFO:teuthology.orchestra.run.smithi117.stdout: "cct": { 2024-09-11T01:18:18.776 INFO:teuthology.orchestra.run.smithi117.stdout: "total_workers": 1, 2024-09-11T01:18:18.777 INFO:teuthology.orchestra.run.smithi117.stdout: "unhealthy_workers": 0 2024-09-11T01:18:18.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.777 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-MDSRank": { 2024-09-11T01:18:18.777 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-11T01:18:18.777 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-11T01:18:18.777 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 409, 2024-09-11T01:18:18.777 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.205966877, 2024-09-11T01:18:18.777 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000503586 2024-09-11T01:18:18.777 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:18.777 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.777 INFO:teuthology.orchestra.run.smithi117.stdout: "finisher-PurgeQueue": { 2024-09-11T01:18:18.777 INFO:teuthology.orchestra.run.smithi117.stdout: "queue_len": 0, 2024-09-11T01:18:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: "complete_latency": { 2024-09-11T01:18:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 208, 2024-09-11T01:18:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.017516301, 2024-09-11T01:18:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000084212 2024-09-11T01:18:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: "mds": { 2024-09-11T01:18:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: "request": 315, 2024-09-11T01:18:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: "reply": 286, 2024-09-11T01:18:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: "reply_latency": { 2024-09-11T01:18:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 286, 2024-09-11T01:18:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.584351544, 2024-09-11T01:18:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.002043187 2024-09-11T01:18:18.778 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.779 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_reply": 0, 2024-09-11T01:18:18.779 INFO:teuthology.orchestra.run.smithi117.stdout: "forward": 29, 2024-09-11T01:18:18.779 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_complete": 0, 2024-09-11T01:18:18.779 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_fetch_keys": 0, 2024-09-11T01:18:18.779 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_commit": 11, 2024-09-11T01:18:18.779 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_split": 0, 2024-09-11T01:18:18.779 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_merge": 0, 2024-09-11T01:18:18.779 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes": 16, 2024-09-11T01:18:18.779 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_top": 0, 2024-09-11T01:18:18.779 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_bottom": 2, 2024-09-11T01:18:18.779 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pin_tail": 14, 2024-09-11T01:18:18.779 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_pinned": 14, 2024-09-11T01:18:18.779 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_expired": 71, 2024-09-11T01:18:18.779 INFO:teuthology.orchestra.run.smithi117.stdout: "inodes_with_caps": 1, 2024-09-11T01:18:18.780 INFO:teuthology.orchestra.run.smithi117.stdout: "caps": 1, 2024-09-11T01:18:18.780 INFO:teuthology.orchestra.run.smithi117.stdout: "subtrees": 3, 2024-09-11T01:18:18.780 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse": 565, 2024-09-11T01:18:18.780 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_hit": 377, 2024-09-11T01:18:18.780 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_forward": 16, 2024-09-11T01:18:18.780 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_discover": 58, 2024-09-11T01:18:18.780 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_dir_fetch": 0, 2024-09-11T01:18:18.780 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_remote_ino": 0, 2024-09-11T01:18:18.780 INFO:teuthology.orchestra.run.smithi117.stdout: "traverse_lock": 0, 2024-09-11T01:18:18.780 INFO:teuthology.orchestra.run.smithi117.stdout: "load_cent": 0, 2024-09-11T01:18:18.780 INFO:teuthology.orchestra.run.smithi117.stdout: "q": 0, 2024-09-11T01:18:18.780 INFO:teuthology.orchestra.run.smithi117.stdout: "exported": 3, 2024-09-11T01:18:18.780 INFO:teuthology.orchestra.run.smithi117.stdout: "exported_inodes": 61, 2024-09-11T01:18:18.781 INFO:teuthology.orchestra.run.smithi117.stdout: "imported": 62, 2024-09-11T01:18:18.781 INFO:teuthology.orchestra.run.smithi117.stdout: "imported_inodes": 172, 2024-09-11T01:18:18.781 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_dir_fetch": 0, 2024-09-11T01:18:18.781 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_backtrace_fetch": 0, 2024-09-11T01:18:18.781 INFO:teuthology.orchestra.run.smithi117.stdout: "openino_peer_discover": 0, 2024-09-11T01:18:18.781 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rfiles": 321, 2024-09-11T01:18:18.781 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rbytes": 12433862710, 2024-09-11T01:18:18.781 INFO:teuthology.orchestra.run.smithi117.stdout: "root_rsnaps": 0, 2024-09-11T01:18:18.781 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T01:18:18.781 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_set_tag": 0, 2024-09-11T01:18:18.781 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T01:18:18.781 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_inotable_repaired": 0, 2024-09-11T01:18:18.781 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_inodes": 0, 2024-09-11T01:18:18.781 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T01:18:18.782 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T01:18:18.782 INFO:teuthology.orchestra.run.smithi117.stdout: "scrub_file_inodes": 0, 2024-09-11T01:18:18.782 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_inode_file_caps": 24, 2024-09-11T01:18:18.782 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_revoke": 243, 2024-09-11T01:18:18.782 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_grant": 359, 2024-09-11T01:18:18.782 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T01:18:18.782 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T01:18:18.782 INFO:teuthology.orchestra.run.smithi117.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T01:18:18.782 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps": 259, 2024-09-11T01:18:18.782 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_caps_dirty": 0, 2024-09-11T01:18:18.782 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_cap_release": 2, 2024-09-11T01:18:18.782 INFO:teuthology.orchestra.run.smithi117.stdout: "process_request_cap_release": 340 2024-09-11T01:18:18.782 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.783 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_cache": { 2024-09-11T01:18:18.783 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update": 0, 2024-09-11T01:18:18.783 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_update_receipt": 3, 2024-09-11T01:18:18.783 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_try_discover": 2, 2024-09-11T01:18:18.783 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_send_discover": 66, 2024-09-11T01:18:18.783 INFO:teuthology.orchestra.run.smithi117.stdout: "dir_handle_discover": 0, 2024-09-11T01:18:18.783 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays": 0, 2024-09-11T01:18:18.783 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_delayed": 0, 2024-09-11T01:18:18.783 INFO:teuthology.orchestra.run.smithi117.stdout: "num_strays_enqueuing": 0, 2024-09-11T01:18:18.783 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_created": 114, 2024-09-11T01:18:18.783 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_enqueued": 114, 2024-09-11T01:18:18.783 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_reintegrated": 0, 2024-09-11T01:18:18.783 INFO:teuthology.orchestra.run.smithi117.stdout: "strays_migrated": 0, 2024-09-11T01:18:18.783 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_processing": 0, 2024-09-11T01:18:18.784 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_enqueued": 0, 2024-09-11T01:18:18.784 INFO:teuthology.orchestra.run.smithi117.stdout: "num_recovering_prioritized": 0, 2024-09-11T01:18:18.784 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_started": 0, 2024-09-11T01:18:18.784 INFO:teuthology.orchestra.run.smithi117.stdout: "recovery_completed": 0, 2024-09-11T01:18:18.784 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_path": 5, 2024-09-11T01:18:18.784 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_quiesce_inode": 385, 2024-09-11T01:18:18.784 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T01:18:18.784 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_exportdir": 3, 2024-09-11T01:18:18.784 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_flush": 0, 2024-09-11T01:18:18.784 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragmentdir": 0, 2024-09-11T01:18:18.784 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_fragstats": 0, 2024-09-11T01:18:18.784 INFO:teuthology.orchestra.run.smithi117.stdout: "ireq_inodestats": 0, 2024-09-11T01:18:18.784 INFO:teuthology.orchestra.run.smithi117.stdout: "uninline_started": 0, 2024-09-11T01:18:18.785 INFO:teuthology.orchestra.run.smithi117.stdout: "uninline_succeeded": 0, 2024-09-11T01:18:18.785 INFO:teuthology.orchestra.run.smithi117.stdout: "uninline_write_failed": 0 2024-09-11T01:18:18.785 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.785 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_log": { 2024-09-11T01:18:18.785 INFO:teuthology.orchestra.run.smithi117.stdout: "evlrg": 0, 2024-09-11T01:18:18.785 INFO:teuthology.orchestra.run.smithi117.stdout: "evadd": 438, 2024-09-11T01:18:18.785 INFO:teuthology.orchestra.run.smithi117.stdout: "evex": 0, 2024-09-11T01:18:18.785 INFO:teuthology.orchestra.run.smithi117.stdout: "evtrm": 0, 2024-09-11T01:18:18.785 INFO:teuthology.orchestra.run.smithi117.stdout: "ev": 438, 2024-09-11T01:18:18.785 INFO:teuthology.orchestra.run.smithi117.stdout: "evexg": 0, 2024-09-11T01:18:18.785 INFO:teuthology.orchestra.run.smithi117.stdout: "evexd": 0, 2024-09-11T01:18:18.785 INFO:teuthology.orchestra.run.smithi117.stdout: "segadd": 2, 2024-09-11T01:18:18.785 INFO:teuthology.orchestra.run.smithi117.stdout: "segex": 0, 2024-09-11T01:18:18.785 INFO:teuthology.orchestra.run.smithi117.stdout: "segtrm": 0, 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: "seg": 2, 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: "segmjr": 2, 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: "segexg": 0, 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: "segexd": 0, 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: "expos": 4194304, 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: "wrpos": 5390081, 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: "rdpos": 0, 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: "jlat": { 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 201, 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.619854142, 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.003083851 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: "replayed": 0 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_mem": { 2024-09-11T01:18:18.786 INFO:teuthology.orchestra.run.smithi117.stdout: "ino": 20, 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "ino+": 139, 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "ino-": 119, 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "dir": 19, 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "dir+": 84, 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "dir-": 65, 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "dn": 16, 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "dn+": 312, 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "dn-": 296, 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "cap": 1, 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "cap+": 228, 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "cap-": 227, 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "rss": 55172, 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "heap": 262922240 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_server": { 2024-09-11T01:18:18.787 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_client_request": 819, 2024-09-11T01:18:18.788 INFO:teuthology.orchestra.run.smithi117.stdout: "dispatch_server_request": 13, 2024-09-11T01:18:18.788 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_request": 315, 2024-09-11T01:18:18.788 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_client_session": 12, 2024-09-11T01:18:18.788 INFO:teuthology.orchestra.run.smithi117.stdout: "handle_peer_request": 42, 2024-09-11T01:18:18.788 INFO:teuthology.orchestra.run.smithi117.stdout: "req_create_latency": { 2024-09-11T01:18:18.788 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.788 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.788 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.788 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getattr_latency": { 2024-09-11T01:18:18.788 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 6, 2024-09-11T01:18:18.788 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.004352250, 2024-09-11T01:18:18.788 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000725375 2024-09-11T01:18:18.788 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getfilelock_latency": { 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: "req_link_latency": { 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookup_latency": { 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 62, 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.020412210, 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000329229 2024-09-11T01:18:18.789 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookuphash_latency": { 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupino_latency": { 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupname_latency": { 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.790 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupparent_latency": { 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lookupsnap_latency": { 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: "req_lssnap_latency": { 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.791 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.792 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mkdir_latency": { 2024-09-11T01:18:18.792 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.792 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.792 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.792 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mknod_latency": { 2024-09-11T01:18:18.792 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.792 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.792 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.792 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.792 INFO:teuthology.orchestra.run.smithi117.stdout: "req_mksnap_latency": { 2024-09-11T01:18:18.792 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.792 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: "req_open_latency": { 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: "req_readdir_latency": { 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 104, 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.048951811, 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000470690 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rename_latency": { 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.793 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: "req_renamesnap_latency": { 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: "req_snapdiff_latency": { 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmdir_latency": { 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 59, 2024-09-11T01:18:18.794 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.435566515, 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.007382483 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmsnap_latency": { 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: "req_rmxattr_latency": { 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setattr_latency": { 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.795 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.796 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.796 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setdirlayout_latency": { 2024-09-11T01:18:18.796 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.796 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.796 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.796 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setfilelock_latency": { 2024-09-11T01:18:18.796 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.796 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.796 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.796 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.796 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setlayout_latency": { 2024-09-11T01:18:18.796 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: "req_setxattr_latency": { 2024-09-11T01:18:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: "req_symlink_latency": { 2024-09-11T01:18:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.797 INFO:teuthology.orchestra.run.smithi117.stdout: "req_unlink_latency": { 2024-09-11T01:18:18.798 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 55, 2024-09-11T01:18:18.798 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.075068758, 2024-09-11T01:18:18.798 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001364886 2024-09-11T01:18:18.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.798 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_revoke_eviction": 0, 2024-09-11T01:18:18.798 INFO:teuthology.orchestra.run.smithi117.stdout: "cap_acquisition_throttle": 0, 2024-09-11T01:18:18.798 INFO:teuthology.orchestra.run.smithi117.stdout: "req_getvxattr_latency": { 2024-09-11T01:18:18.798 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.798 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.798 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.798 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:18.798 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.798 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_sessions": { 2024-09-11T01:18:18.798 INFO:teuthology.orchestra.run.smithi117.stdout: "session_count": 1, 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: "session_add": 2, 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: "session_remove": 1, 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_open": 1, 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: "sessions_stale": 0, 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: "total_load": 227, 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: "average_load": 227, 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: "avg_session_uptime": 599, 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: "mdthresh_evicted": 0 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: "mempool": { 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_bytes": 0, 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_items": 0, 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_items": 0, 2024-09-11T01:18:18.799 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_items": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_items": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_bytes": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_items": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_bytes": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_items": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T01:18:18.800 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_items": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_bytes": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_items": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_bytes": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_items": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_bytes": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_items": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_items": 0, 2024-09-11T01:18:18.801 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_items": 0, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_bytes": 287429, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_items": 98, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_bytes": 0, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_items": 0, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bytes": 0, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_items": 0, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_bytes": 0, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_items": 0, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_bytes": 0, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_items": 0, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_bytes": 8952, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_items": 168, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T01:18:18.802 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_items": 0, 2024-09-11T01:18:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_bytes": 0, 2024-09-11T01:18:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_items": 0, 2024-09-11T01:18:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_bytes": 82293, 2024-09-11T01:18:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_items": 358, 2024-09-11T01:18:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_bytes": 0, 2024-09-11T01:18:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_items": 0, 2024-09-11T01:18:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_bytes": 0, 2024-09-11T01:18:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_items": 0 2024-09-11T01:18:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: "objecter": { 2024-09-11T01:18:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: "op_active": 0, 2024-09-11T01:18:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: "op_laggy": 0, 2024-09-11T01:18:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send": 445, 2024-09-11T01:18:18.803 INFO:teuthology.orchestra.run.smithi117.stdout: "op_send_bytes": 1235455, 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: "op_resend": 33, 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: "op_reply": 445, 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: "op_latency": { 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 445, 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 2.681949749, 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.006026853 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: "op_inflight": 0, 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: "oplen_avg": { 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 445, 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 481 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: "op": 445, 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: "op_r": 7, 2024-09-11T01:18:18.804 INFO:teuthology.orchestra.run.smithi117.stdout: "op_w": 438, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "op_rmw": 0, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "op_pg": 0, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_stat": 0, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_create": 10, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_read": 7, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_write": 208, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writefull": 14, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_writesame": 0, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_append": 0, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_zero": 0, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_truncate": 0, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_delete": 181, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_mapext": 0, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_sparse_read": 0, 2024-09-11T01:18:18.805 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_clonerange": 0, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_getxattr": 0, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_setxattr": 20, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_cmpxattr": 0, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_rmxattr": 0, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_resetxattrs": 0, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_call": 0, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_watch": 0, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_notify": 0, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls": 0, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_pgls_filter": 0, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "osdop_other": 0, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_active": 0, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_send": 0, 2024-09-11T01:18:18.806 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_resend": 0, 2024-09-11T01:18:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: "linger_ping": 0, 2024-09-11T01:18:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_active": 0, 2024-09-11T01:18:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_send": 0, 2024-09-11T01:18:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: "poolop_resend": 0, 2024-09-11T01:18:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_active": 0, 2024-09-11T01:18:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_send": 0, 2024-09-11T01:18:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: "poolstat_resend": 0, 2024-09-11T01:18:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_active": 0, 2024-09-11T01:18:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_send": 0, 2024-09-11T01:18:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: "statfs_resend": 0, 2024-09-11T01:18:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: "command_active": 0, 2024-09-11T01:18:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: "command_send": 0, 2024-09-11T01:18:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: "command_resend": 0, 2024-09-11T01:18:18.807 INFO:teuthology.orchestra.run.smithi117.stdout: "map_epoch": 89, 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: "map_full": 0, 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: "map_inc": 2, 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_sessions": 12, 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_open": 12, 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_session_close": 0, 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_laggy": 0, 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_wr": 34, 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_rd": 0, 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_del": 7 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: "oft": { 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_objs": 1, 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_kv_pairs": 0, 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_updates": 0, 2024-09-11T01:18:18.808 INFO:teuthology.orchestra.run.smithi117.stdout: "omap_total_removes": 0 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: "purge_queue": { 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops": 0, 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_ops_high_water": 17, 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing": 0, 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executing_high_water": 11, 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed_ops": 169, 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_executed": 114, 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: "pq_item_in_journal": 0 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:18.809 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 3521, 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 1672170, 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 3521, 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 3521, 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 1672170, 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_bytes": { 2024-09-11T01:18:18.810 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-11T01:18:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-11T01:18:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-11T01:18:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 445, 2024-09-11T01:18:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 1247409, 2024-09-11T01:18:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 445, 2024-09-11T01:18:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 1247409, 2024-09-11T01:18:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.811 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-objecter_ops": { 2024-09-11T01:18:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 1024, 2024-09-11T01:18:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 0, 2024-09-11T01:18:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 0, 2024-09-11T01:18:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 445, 2024-09-11T01:18:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 445, 2024-09-11T01:18:18.812 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 445, 2024-09-11T01:18:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 445, 2024-09-11T01:18:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle": { 2024-09-11T01:18:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-11T01:18:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 114, 2024-09-11T01:18:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 11954, 2024-09-11T01:18:18.813 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 114, 2024-09-11T01:18:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-11T01:18:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-11T01:18:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 7, 2024-09-11T01:18:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 11954, 2024-09-11T01:18:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-write_buf_throttle-0x5612f0d46dc0": { 2024-09-11T01:18:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:18.814 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 3758096384, 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 438, 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 1195777, 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 438, 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 201, 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 1195777, 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:18.815 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: "trackedop": { 2024-09-11T01:18:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: "slow_ops_count": 390 2024-09-11T01:18:18.816 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:18.816 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-11T01:18:18.831 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:18 smithi103 ceph-mon[30562]: pgmap v699: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T01:18:18.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:18 smithi183 ceph-mon[34992]: pgmap v699: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 6 op/s 2024-09-11T01:18:19.411 INFO:tasks.check_counter:Daemon mds.h mds.exported=3 2024-09-11T01:18:19.411 INFO:tasks.check_counter:Daemon mds.h mds.imported=62 2024-09-11T01:18:19.412 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-11T01:18:19.412 DEBUG:tasks.check_counter:Getting stats from k 2024-09-11T01:18:19.412 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-11T01:18:19.658 INFO:teuthology.orchestra.run.smithi117.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.b/config 2024-09-11T01:18:20.146 INFO:teuthology.orchestra.run.smithi117.stdout:{ 2024-09-11T01:18:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T01:18:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 4, 2024-09-11T01:18:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 4, 2024-09-11T01:18:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 2992, 2024-09-11T01:18:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 448, 2024-09-11T01:18:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 4, 2024-09-11T01:18:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 0, 2024-09-11T01:18:20.146 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.003232874, 2024-09-11T01:18:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.000044973, 2024-09-11T01:18:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.002322458, 2024-09-11T01:18:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 3, 2024-09-11T01:18:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.004146694, 2024-09-11T01:18:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.001382231 2024-09-11T01:18:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:20.147 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T01:18:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T01:18:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T01:18:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 1, 2024-09-11T01:18:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 166, 2024-09-11T01:18:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 160, 2024-09-11T01:18:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 109472, 2024-09-11T01:18:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 3, 2024-09-11T01:18:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 2, 2024-09-11T01:18:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.013483248, 2024-09-11T01:18:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.010520953, 2024-09-11T01:18:20.148 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.001047874, 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 164, 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.009630558, 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000058722 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 109472 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T01:18:20.149 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_messages": 222, 2024-09-11T01:18:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages": 217, 2024-09-11T01:18:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_bytes": 831552, 2024-09-11T01:18:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_bytes": 133664, 2024-09-11T01:18:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_created_connections": 2, 2024-09-11T01:18:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_active_connections": 1, 2024-09-11T01:18:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_total_time": 0.036898524, 2024-09-11T01:18:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_send_time": 0.017375459, 2024-09-11T01:18:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_recv_time": 0.026331929, 2024-09-11T01:18:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 216, 2024-09-11T01:18:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.017238227, 2024-09-11T01:18:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000079806 2024-09-11T01:18:20.150 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_recv_encrypted_bytes": 831552, 2024-09-11T01:18:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "msgr_send_encrypted_bytes": 133664 2024-09-11T01:18:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "cct": { 2024-09-11T01:18:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "total_workers": 0, 2024-09-11T01:18:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "unhealthy_workers": 0 2024-09-11T01:18:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:20.151 INFO:teuthology.orchestra.run.smithi117.stdout: "mempool": { 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_bytes": 0, 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bloom_filter_items": 0, 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_alloc_items": 0, 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_data_items": 0, 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_other_items": 0, 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T01:18:20.152 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_bytes": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_extent_items": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_bytes": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_blob_items": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_fsck_items": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_bytes": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_txc_items": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_bytes": 0, 2024-09-11T01:18:20.153 INFO:teuthology.orchestra.run.smithi117.stdout: "bluestore_writing_items": 0, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_bytes": 0, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_items": 0, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_reader_items": 0, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "bluefs_file_writer_items": 0, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_bytes": 148967, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_anon_items": 29, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_bytes": 0, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "buffer_meta_items": 0, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_bytes": 0, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_items": 0, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_bytes": 0, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_mapbl_items": 0, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_bytes": 0, 2024-09-11T01:18:20.154 INFO:teuthology.orchestra.run.smithi117.stdout: "osd_pglog_items": 0, 2024-09-11T01:18:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_bytes": 0, 2024-09-11T01:18:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_items": 0, 2024-09-11T01:18:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T01:18:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "osdmap_mapping_items": 0, 2024-09-11T01:18:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_bytes": 0, 2024-09-11T01:18:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "pgmap_items": 0, 2024-09-11T01:18:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_bytes": 968, 2024-09-11T01:18:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "mds_co_items": 2, 2024-09-11T01:18:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_bytes": 0, 2024-09-11T01:18:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_1_items": 0, 2024-09-11T01:18:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_bytes": 0, 2024-09-11T01:18:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "unittest_2_items": 0 2024-09-11T01:18:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: }, 2024-09-11T01:18:20.155 INFO:teuthology.orchestra.run.smithi117.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "val": 0, 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "max": 104857600, 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "get_started": 0, 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "get": 223, 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "get_sum": 800169, 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "get_or_fail_success": 223, 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "take": 0, 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "take_sum": 0, 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "put": 223, 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "put_sum": 800169, 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "wait": { 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "avgcount": 0, 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "sum": 0.000000000, 2024-09-11T01:18:20.156 INFO:teuthology.orchestra.run.smithi117.stdout: "avgtime": 0.000000000 2024-09-11T01:18:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:20.157 INFO:teuthology.orchestra.run.smithi117.stdout: } 2024-09-11T01:18:20.157 INFO:teuthology.orchestra.run.smithi117.stdout:} 2024-09-11T01:18:20.768 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:20 smithi117 ceph-mon[35358]: pgmap v700: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-11T01:18:20.797 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-11T01:18:20.797 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-11T01:18:20.797 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.k 2024-09-11T01:18:20.797 DEBUG:tasks.check_counter:Getting stats from c 2024-09-11T01:18:20.798 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-11T01:18:20.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:20 smithi103 ceph-mon[30562]: pgmap v700: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-11T01:18:20.837 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:20 smithi183 ceph-mon[34992]: pgmap v700: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-11T01:18:21.086 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T01:18:21.723 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-11T01:18:21.723 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T01:18:21.723 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 964, 2024-09-11T01:18:21.723 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 964, 2024-09-11T01:18:21.723 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 4501893, 2024-09-11T01:18:21.723 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 305738, 2024-09-11T01:18:21.723 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 6, 2024-09-11T01:18:21.723 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 2, 2024-09-11T01:18:21.723 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.118589839, 2024-09-11T01:18:21.723 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.049503450, 2024-09-11T01:18:21.723 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.030273968, 2024-09-11T01:18:21.724 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.029110123, 2024-09-11T01:18:21.724 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:21.724 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 963, 2024-09-11T01:18:21.724 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.053632233, 2024-09-11T01:18:21.724 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000055692 2024-09-11T01:18:21.724 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.724 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:21.724 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.724 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.724 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.724 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.724 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T01:18:21.724 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T01:18:21.725 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.725 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T01:18:21.725 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 510, 2024-09-11T01:18:21.725 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 672, 2024-09-11T01:18:21.725 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 126046, 2024-09-11T01:18:21.725 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 517832, 2024-09-11T01:18:21.725 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 5, 2024-09-11T01:18:21.725 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 4, 2024-09-11T01:18:21.725 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.063776978, 2024-09-11T01:18:21.725 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.031640041, 2024-09-11T01:18:21.725 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.010733762, 2024-09-11T01:18:21.725 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.016097285, 2024-09-11T01:18:21.725 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:21.726 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 670, 2024-09-11T01:18:21.726 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.029456036, 2024-09-11T01:18:21.726 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000043964 2024-09-11T01:18:21.726 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.726 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:21.726 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.726 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.726 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.726 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.726 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T01:18:21.726 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 355904 2024-09-11T01:18:21.726 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.726 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T01:18:21.726 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 1039, 2024-09-11T01:18:21.727 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 1025, 2024-09-11T01:18:21.727 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 5229308, 2024-09-11T01:18:21.727 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 388443, 2024-09-11T01:18:21.727 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 3, 2024-09-11T01:18:21.727 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 2, 2024-09-11T01:18:21.727 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.123223733, 2024-09-11T01:18:21.727 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.056278436, 2024-09-11T01:18:21.727 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.046551257, 2024-09-11T01:18:21.727 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.023127744, 2024-09-11T01:18:21.728 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:21.728 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1024, 2024-09-11T01:18:21.728 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.054227340, 2024-09-11T01:18:21.728 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000052956 2024-09-11T01:18:21.728 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.728 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:21.728 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.728 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.728 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.728 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.728 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 885152, 2024-09-11T01:18:21.729 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 133088 2024-09-11T01:18:21.729 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.729 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-09-11T01:18:21.729 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 1, 2024-09-11T01:18:21.729 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-09-11T01:18:21.729 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.729 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-MDSRank": { 2024-09-11T01:18:21.729 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-09-11T01:18:21.729 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-09-11T01:18:21.729 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 3753, 2024-09-11T01:18:21.729 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.112594584, 2024-09-11T01:18:21.729 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000030001 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-PurgeQueue": { 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: "mds": { 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: "request": 0, 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: "reply": 0, 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: "reply_latency": { 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.730 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_reply": 0, 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: "forward": 0, 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_complete": 0, 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_keys": 0, 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_commit": 0, 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_split": 0, 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_merge": 0, 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes": 705, 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_top": 485, 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_bottom": 220, 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pin_tail": 0, 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pinned": 12, 2024-09-11T01:18:21.731 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_expired": 0, 2024-09-11T01:18:21.732 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_with_caps": 0, 2024-09-11T01:18:21.732 INFO:teuthology.orchestra.run.smithi183.stdout: "caps": 0, 2024-09-11T01:18:21.732 INFO:teuthology.orchestra.run.smithi183.stdout: "subtrees": 2, 2024-09-11T01:18:21.732 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse": 0, 2024-09-11T01:18:21.732 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_hit": 0, 2024-09-11T01:18:21.732 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_forward": 0, 2024-09-11T01:18:21.732 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_discover": 0, 2024-09-11T01:18:21.732 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_dir_fetch": 0, 2024-09-11T01:18:21.732 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_remote_ino": 0, 2024-09-11T01:18:21.732 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_lock": 0, 2024-09-11T01:18:21.732 INFO:teuthology.orchestra.run.smithi183.stdout: "load_cent": 0, 2024-09-11T01:18:21.732 INFO:teuthology.orchestra.run.smithi183.stdout: "q": 0, 2024-09-11T01:18:21.732 INFO:teuthology.orchestra.run.smithi183.stdout: "exported": 0, 2024-09-11T01:18:21.732 INFO:teuthology.orchestra.run.smithi183.stdout: "exported_inodes": 0, 2024-09-11T01:18:21.733 INFO:teuthology.orchestra.run.smithi183.stdout: "imported": 0, 2024-09-11T01:18:21.733 INFO:teuthology.orchestra.run.smithi183.stdout: "imported_inodes": 0, 2024-09-11T01:18:21.733 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_dir_fetch": 0, 2024-09-11T01:18:21.733 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_backtrace_fetch": 0, 2024-09-11T01:18:21.733 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_peer_discover": 0, 2024-09-11T01:18:21.733 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rfiles": 4, 2024-09-11T01:18:21.733 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rbytes": 234, 2024-09-11T01:18:21.733 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rsnaps": 0, 2024-09-11T01:18:21.733 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T01:18:21.733 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_set_tag": 0, 2024-09-11T01:18:21.733 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T01:18:21.733 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_inotable_repaired": 0, 2024-09-11T01:18:21.733 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_inodes": 0, 2024-09-11T01:18:21.733 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_file_inodes": 0, 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_inode_file_caps": 0, 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_grant": 0, 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps": 0, 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps_dirty": 0, 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_cap_release": 0, 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: "process_request_cap_release": 0 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_cache": { 2024-09-11T01:18:21.734 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update": 0, 2024-09-11T01:18:21.735 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update_receipt": 0, 2024-09-11T01:18:21.735 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_try_discover": 0, 2024-09-11T01:18:21.735 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_send_discover": 0, 2024-09-11T01:18:21.735 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_handle_discover": 0, 2024-09-11T01:18:21.735 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays": 0, 2024-09-11T01:18:21.735 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_delayed": 0, 2024-09-11T01:18:21.735 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_enqueuing": 0, 2024-09-11T01:18:21.735 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_created": 0, 2024-09-11T01:18:21.735 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_enqueued": 0, 2024-09-11T01:18:21.735 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_reintegrated": 0, 2024-09-11T01:18:21.735 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_migrated": 0, 2024-09-11T01:18:21.735 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_processing": 0, 2024-09-11T01:18:21.735 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_enqueued": 0, 2024-09-11T01:18:21.736 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_prioritized": 0, 2024-09-11T01:18:21.736 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_started": 0, 2024-09-11T01:18:21.736 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_completed": 0, 2024-09-11T01:18:21.736 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_path": 0, 2024-09-11T01:18:21.736 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_inode": 0, 2024-09-11T01:18:21.736 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T01:18:21.736 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_exportdir": 0, 2024-09-11T01:18:21.736 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_flush": 0, 2024-09-11T01:18:21.736 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragmentdir": 0, 2024-09-11T01:18:21.736 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragstats": 0, 2024-09-11T01:18:21.736 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_inodestats": 0, 2024-09-11T01:18:21.736 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_started": 0, 2024-09-11T01:18:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_succeeded": 0, 2024-09-11T01:18:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_write_failed": 0 2024-09-11T01:18:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_log": { 2024-09-11T01:18:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: "evlrg": 0, 2024-09-11T01:18:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: "evadd": 0, 2024-09-11T01:18:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: "evex": 0, 2024-09-11T01:18:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: "evtrm": 0, 2024-09-11T01:18:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: "ev": 3387, 2024-09-11T01:18:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: "evexg": 0, 2024-09-11T01:18:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: "evexd": 0, 2024-09-11T01:18:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: "segadd": 0, 2024-09-11T01:18:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: "segex": 0, 2024-09-11T01:18:21.737 INFO:teuthology.orchestra.run.smithi183.stdout: "segtrm": 0, 2024-09-11T01:18:21.738 INFO:teuthology.orchestra.run.smithi183.stdout: "seg": 2, 2024-09-11T01:18:21.738 INFO:teuthology.orchestra.run.smithi183.stdout: "segmjr": 32, 2024-09-11T01:18:21.738 INFO:teuthology.orchestra.run.smithi183.stdout: "segexg": 0, 2024-09-11T01:18:21.738 INFO:teuthology.orchestra.run.smithi183.stdout: "segexd": 0, 2024-09-11T01:18:21.738 INFO:teuthology.orchestra.run.smithi183.stdout: "expos": 12524024, 2024-09-11T01:18:21.738 INFO:teuthology.orchestra.run.smithi183.stdout: "wrpos": 12526963, 2024-09-11T01:18:21.738 INFO:teuthology.orchestra.run.smithi183.stdout: "rdpos": 12526364, 2024-09-11T01:18:21.738 INFO:teuthology.orchestra.run.smithi183.stdout: "jlat": { 2024-09-11T01:18:21.738 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.738 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.738 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.738 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.738 INFO:teuthology.orchestra.run.smithi183.stdout: "replayed": 3387 2024-09-11T01:18:21.738 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.739 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_mem": { 2024-09-11T01:18:21.739 INFO:teuthology.orchestra.run.smithi183.stdout: "ino": 18, 2024-09-11T01:18:21.739 INFO:teuthology.orchestra.run.smithi183.stdout: "ino+": 778, 2024-09-11T01:18:21.739 INFO:teuthology.orchestra.run.smithi183.stdout: "ino-": 760, 2024-09-11T01:18:21.739 INFO:teuthology.orchestra.run.smithi183.stdout: "dir": 13, 2024-09-11T01:18:21.739 INFO:teuthology.orchestra.run.smithi183.stdout: "dir+": 116, 2024-09-11T01:18:21.739 INFO:teuthology.orchestra.run.smithi183.stdout: "dir-": 103, 2024-09-11T01:18:21.739 INFO:teuthology.orchestra.run.smithi183.stdout: "dn": 705, 2024-09-11T01:18:21.739 INFO:teuthology.orchestra.run.smithi183.stdout: "dn+": 1241, 2024-09-11T01:18:21.739 INFO:teuthology.orchestra.run.smithi183.stdout: "dn-": 536, 2024-09-11T01:18:21.739 INFO:teuthology.orchestra.run.smithi183.stdout: "cap": 0, 2024-09-11T01:18:21.739 INFO:teuthology.orchestra.run.smithi183.stdout: "cap+": 0, 2024-09-11T01:18:21.739 INFO:teuthology.orchestra.run.smithi183.stdout: "cap-": 0, 2024-09-11T01:18:21.739 INFO:teuthology.orchestra.run.smithi183.stdout: "rss": 52008, 2024-09-11T01:18:21.740 INFO:teuthology.orchestra.run.smithi183.stdout: "heap": 251650048 2024-09-11T01:18:21.740 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.740 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_server": { 2024-09-11T01:18:21.740 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_client_request": 0, 2024-09-11T01:18:21.740 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_server_request": 0, 2024-09-11T01:18:21.740 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_request": 0, 2024-09-11T01:18:21.740 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_session": 0, 2024-09-11T01:18:21.740 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_peer_request": 0, 2024-09-11T01:18:21.740 INFO:teuthology.orchestra.run.smithi183.stdout: "req_create_latency": { 2024-09-11T01:18:21.740 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.740 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.740 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.740 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getattr_latency": { 2024-09-11T01:18:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getfilelock_latency": { 2024-09-11T01:18:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: "req_link_latency": { 2024-09-11T01:18:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.741 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookup_latency": { 2024-09-11T01:18:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookuphash_latency": { 2024-09-11T01:18:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupino_latency": { 2024-09-11T01:18:21.742 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupname_latency": { 2024-09-11T01:18:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupparent_latency": { 2024-09-11T01:18:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.743 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupsnap_latency": { 2024-09-11T01:18:21.744 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.744 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.744 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.744 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.744 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lssnap_latency": { 2024-09-11T01:18:21.744 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.745 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.745 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.745 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.745 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mkdir_latency": { 2024-09-11T01:18:21.745 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.745 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.745 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.745 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.745 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mknod_latency": { 2024-09-11T01:18:21.745 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.745 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.746 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.746 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.746 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mksnap_latency": { 2024-09-11T01:18:21.746 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.746 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.746 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.746 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.746 INFO:teuthology.orchestra.run.smithi183.stdout: "req_open_latency": { 2024-09-11T01:18:21.746 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.746 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.746 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.746 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.747 INFO:teuthology.orchestra.run.smithi183.stdout: "req_readdir_latency": { 2024-09-11T01:18:21.747 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.747 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.747 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.747 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.747 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rename_latency": { 2024-09-11T01:18:21.747 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.747 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.747 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.747 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.747 INFO:teuthology.orchestra.run.smithi183.stdout: "req_renamesnap_latency": { 2024-09-11T01:18:21.747 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.748 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.748 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.748 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.748 INFO:teuthology.orchestra.run.smithi183.stdout: "req_snapdiff_latency": { 2024-09-11T01:18:21.748 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.748 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.748 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.748 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.748 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmdir_latency": { 2024-09-11T01:18:21.748 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.748 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.748 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.748 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.748 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmsnap_latency": { 2024-09-11T01:18:21.749 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.749 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.749 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.749 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.749 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmxattr_latency": { 2024-09-11T01:18:21.749 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.749 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.749 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.749 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.749 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setattr_latency": { 2024-09-11T01:18:21.749 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.749 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.749 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.750 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.750 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setdirlayout_latency": { 2024-09-11T01:18:21.750 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.750 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.750 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.750 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.750 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setfilelock_latency": { 2024-09-11T01:18:21.750 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.750 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.750 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.750 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.750 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setlayout_latency": { 2024-09-11T01:18:21.750 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.750 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.751 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.751 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.751 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setxattr_latency": { 2024-09-11T01:18:21.751 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.751 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.751 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.751 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.751 INFO:teuthology.orchestra.run.smithi183.stdout: "req_symlink_latency": { 2024-09-11T01:18:21.751 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.751 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.751 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.751 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.751 INFO:teuthology.orchestra.run.smithi183.stdout: "req_unlink_latency": { 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_revoke_eviction": 0, 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_acquisition_throttle": 0, 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getvxattr_latency": { 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_sessions": { 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: "session_count": 1, 2024-09-11T01:18:21.752 INFO:teuthology.orchestra.run.smithi183.stdout: "session_add": 4, 2024-09-11T01:18:21.753 INFO:teuthology.orchestra.run.smithi183.stdout: "session_remove": 3, 2024-09-11T01:18:21.753 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_open": 2, 2024-09-11T01:18:21.753 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_stale": 0, 2024-09-11T01:18:21.753 INFO:teuthology.orchestra.run.smithi183.stdout: "total_load": 0, 2024-09-11T01:18:21.753 INFO:teuthology.orchestra.run.smithi183.stdout: "average_load": 0, 2024-09-11T01:18:21.753 INFO:teuthology.orchestra.run.smithi183.stdout: "avg_session_uptime": 3525, 2024-09-11T01:18:21.753 INFO:teuthology.orchestra.run.smithi183.stdout: "mdthresh_evicted": 0 2024-09-11T01:18:21.753 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.753 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-09-11T01:18:21.753 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-09-11T01:18:21.753 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-09-11T01:18:21.753 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T01:18:21.754 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-09-11T01:18:21.754 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T01:18:21.754 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-09-11T01:18:21.754 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T01:18:21.754 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T01:18:21.754 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T01:18:21.754 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T01:18:21.754 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T01:18:21.754 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-09-11T01:18:21.754 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T01:18:21.754 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T01:18:21.754 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-09-11T01:18:21.754 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-09-11T01:18:21.755 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-09-11T01:18:21.755 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-09-11T01:18:21.755 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T01:18:21.755 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T01:18:21.755 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T01:18:21.755 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T01:18:21.755 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T01:18:21.755 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-09-11T01:18:21.755 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-09-11T01:18:21.755 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-09-11T01:18:21.755 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T01:18:21.755 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T01:18:21.755 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-09-11T01:18:21.755 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 189361, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 50, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-09-11T01:18:21.756 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-09-11T01:18:21.757 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-09-11T01:18:21.757 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 8952, 2024-09-11T01:18:21.757 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 168, 2024-09-11T01:18:21.757 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T01:18:21.757 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-09-11T01:18:21.757 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-09-11T01:18:21.757 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-09-11T01:18:21.757 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 537194, 2024-09-11T01:18:21.757 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 3058, 2024-09-11T01:18:21.757 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-09-11T01:18:21.757 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-09-11T01:18:21.758 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-09-11T01:18:21.758 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-09-11T01:18:21.758 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.758 INFO:teuthology.orchestra.run.smithi183.stdout: "objecter": { 2024-09-11T01:18:21.758 INFO:teuthology.orchestra.run.smithi183.stdout: "op_active": 0, 2024-09-11T01:18:21.758 INFO:teuthology.orchestra.run.smithi183.stdout: "op_laggy": 0, 2024-09-11T01:18:21.758 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send": 2272, 2024-09-11T01:18:21.758 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send_bytes": 26, 2024-09-11T01:18:21.758 INFO:teuthology.orchestra.run.smithi183.stdout: "op_resend": 4, 2024-09-11T01:18:21.758 INFO:teuthology.orchestra.run.smithi183.stdout: "op_reply": 2272, 2024-09-11T01:18:21.758 INFO:teuthology.orchestra.run.smithi183.stdout: "op_latency": { 2024-09-11T01:18:21.758 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2272, 2024-09-11T01:18:21.758 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 5.555844706, 2024-09-11T01:18:21.759 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.002445354 2024-09-11T01:18:21.759 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.759 INFO:teuthology.orchestra.run.smithi183.stdout: "op_inflight": 0, 2024-09-11T01:18:21.759 INFO:teuthology.orchestra.run.smithi183.stdout: "oplen_avg": { 2024-09-11T01:18:21.759 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2272, 2024-09-11T01:18:21.759 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 2273 2024-09-11T01:18:21.759 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.759 INFO:teuthology.orchestra.run.smithi183.stdout: "op": 2272, 2024-09-11T01:18:21.759 INFO:teuthology.orchestra.run.smithi183.stdout: "op_r": 2272, 2024-09-11T01:18:21.759 INFO:teuthology.orchestra.run.smithi183.stdout: "op_w": 0, 2024-09-11T01:18:21.759 INFO:teuthology.orchestra.run.smithi183.stdout: "op_rmw": 0, 2024-09-11T01:18:21.759 INFO:teuthology.orchestra.run.smithi183.stdout: "op_pg": 0, 2024-09-11T01:18:21.759 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_stat": 1432, 2024-09-11T01:18:21.760 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_create": 0, 2024-09-11T01:18:21.760 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_read": 837, 2024-09-11T01:18:21.760 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_write": 0, 2024-09-11T01:18:21.760 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writefull": 0, 2024-09-11T01:18:21.760 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writesame": 0, 2024-09-11T01:18:21.760 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_append": 0, 2024-09-11T01:18:21.760 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_zero": 0, 2024-09-11T01:18:21.761 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_truncate": 0, 2024-09-11T01:18:21.761 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_delete": 0, 2024-09-11T01:18:21.761 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_mapext": 0, 2024-09-11T01:18:21.761 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_sparse_read": 0, 2024-09-11T01:18:21.761 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_clonerange": 0, 2024-09-11T01:18:21.761 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_getxattr": 2, 2024-09-11T01:18:21.761 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_setxattr": 0, 2024-09-11T01:18:21.761 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_cmpxattr": 0, 2024-09-11T01:18:21.761 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_rmxattr": 0, 2024-09-11T01:18:21.761 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_resetxattrs": 0, 2024-09-11T01:18:21.761 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_call": 0, 2024-09-11T01:18:21.764 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_watch": 0, 2024-09-11T01:18:21.764 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_notify": 0, 2024-09-11T01:18:21.764 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T01:18:21.764 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls": 0, 2024-09-11T01:18:21.764 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls_filter": 0, 2024-09-11T01:18:21.764 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_other": 0, 2024-09-11T01:18:21.765 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_active": 0, 2024-09-11T01:18:21.765 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_send": 0, 2024-09-11T01:18:21.765 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_resend": 0, 2024-09-11T01:18:21.765 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_ping": 0, 2024-09-11T01:18:21.765 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_active": 0, 2024-09-11T01:18:21.765 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_send": 0, 2024-09-11T01:18:21.765 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_resend": 0, 2024-09-11T01:18:21.765 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_active": 0, 2024-09-11T01:18:21.765 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_send": 0, 2024-09-11T01:18:21.765 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_resend": 0, 2024-09-11T01:18:21.765 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_active": 0, 2024-09-11T01:18:21.765 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_send": 0, 2024-09-11T01:18:21.765 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_resend": 0, 2024-09-11T01:18:21.766 INFO:teuthology.orchestra.run.smithi183.stdout: "command_active": 0, 2024-09-11T01:18:21.766 INFO:teuthology.orchestra.run.smithi183.stdout: "command_send": 0, 2024-09-11T01:18:21.766 INFO:teuthology.orchestra.run.smithi183.stdout: "command_resend": 0, 2024-09-11T01:18:21.766 INFO:teuthology.orchestra.run.smithi183.stdout: "map_epoch": 89, 2024-09-11T01:18:21.766 INFO:teuthology.orchestra.run.smithi183.stdout: "map_full": 0, 2024-09-11T01:18:21.766 INFO:teuthology.orchestra.run.smithi183.stdout: "map_inc": 2, 2024-09-11T01:18:21.766 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_sessions": 5, 2024-09-11T01:18:21.766 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_open": 5, 2024-09-11T01:18:21.766 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_close": 0, 2024-09-11T01:18:21.766 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_laggy": 0, 2024-09-11T01:18:21.766 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_wr": 0, 2024-09-11T01:18:21.766 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_rd": 2, 2024-09-11T01:18:21.766 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_del": 0 2024-09-11T01:18:21.766 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.767 INFO:teuthology.orchestra.run.smithi183.stdout: "oft": { 2024-09-11T01:18:21.767 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_objs": 0, 2024-09-11T01:18:21.767 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_kv_pairs": 0, 2024-09-11T01:18:21.767 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_updates": 0, 2024-09-11T01:18:21.767 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_removes": 0 2024-09-11T01:18:21.767 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.767 INFO:teuthology.orchestra.run.smithi183.stdout: "purge_queue": { 2024-09-11T01:18:21.767 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops": 0, 2024-09-11T01:18:21.767 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T01:18:21.767 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing": 0, 2024-09-11T01:18:21.767 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_high_water": 0, 2024-09-11T01:18:21.767 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed_ops": 0, 2024-09-11T01:18:21.768 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed": 0, 2024-09-11T01:18:21.768 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_item_in_journal": 0 2024-09-11T01:18:21.768 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.768 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T01:18:21.768 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:21.768 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-09-11T01:18:21.768 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:21.768 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 2509, 2024-09-11T01:18:21.768 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 9616339, 2024-09-11T01:18:21.768 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:21.768 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 2509, 2024-09-11T01:18:21.768 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-09-11T01:18:21.768 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 2509, 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 9616339, 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_bytes": { 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-09-11T01:18:21.769 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 2272, 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 8332669, 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 2272, 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 8332669, 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_ops": { 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 1024, 2024-09-11T01:18:21.770 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 2272, 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 2272, 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 2272, 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 2272, 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle": { 2024-09-11T01:18:21.771 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 0, 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 0, 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:21.772 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle-0x563248f7d040": { 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 0, 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 0, 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:21.773 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:21.774 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:21.774 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:21.774 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:21.774 INFO:teuthology.orchestra.run.smithi183.stdout: "trackedop": { 2024-09-11T01:18:21.774 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_ops_count": 0 2024-09-11T01:18:21.774 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:21.774 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-11T01:18:22.556 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:22 smithi183 ceph-mon[34992]: pgmap v701: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-11T01:18:22.585 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-11T01:18:22.585 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-11T01:18:22.585 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-09-11T01:18:22.586 DEBUG:tasks.check_counter:Getting stats from f 2024-09-11T01:18:22.586 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-11T01:18:22.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:22 smithi103 ceph-mon[30562]: pgmap v701: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-11T01:18:22.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:22 smithi117 ceph-mon[35358]: pgmap v701: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-09-11T01:18:22.876 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T01:18:23.370 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-11T01:18:23.371 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T01:18:23.371 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 966, 2024-09-11T01:18:23.371 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 966, 2024-09-11T01:18:23.371 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 23961454, 2024-09-11T01:18:23.371 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 306427, 2024-09-11T01:18:23.371 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 7, 2024-09-11T01:18:23.371 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 3, 2024-09-11T01:18:23.371 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.105395756, 2024-09-11T01:18:23.371 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.038206948, 2024-09-11T01:18:23.371 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.036248717, 2024-09-11T01:18:23.371 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.024287945, 2024-09-11T01:18:23.371 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:23.371 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 965, 2024-09-11T01:18:23.372 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.049499062, 2024-09-11T01:18:23.372 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000051294 2024-09-11T01:18:23.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.372 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:23.372 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.372 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.372 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.372 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-09-11T01:18:23.372 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 448 2024-09-11T01:18:23.372 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.372 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T01:18:23.372 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 38, 2024-09-11T01:18:23.372 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 201, 2024-09-11T01:18:23.373 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 8398752, 2024-09-11T01:18:23.373 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 369484, 2024-09-11T01:18:23.373 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 6, 2024-09-11T01:18:23.373 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 5, 2024-09-11T01:18:23.373 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.020785655, 2024-09-11T01:18:23.373 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.010582817, 2024-09-11T01:18:23.373 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.007414103, 2024-09-11T01:18:23.373 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.001100769, 2024-09-11T01:18:23.373 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:23.373 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 199, 2024-09-11T01:18:23.373 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.018095570, 2024-09-11T01:18:23.373 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000090932 2024-09-11T01:18:23.373 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.373 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:23.374 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.374 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.374 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.374 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T01:18:23.374 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 357712 2024-09-11T01:18:23.374 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.374 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T01:18:23.374 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 1333, 2024-09-11T01:18:23.374 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 1319, 2024-09-11T01:18:23.374 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 18001065, 2024-09-11T01:18:23.374 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 482414, 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 5, 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 4, 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.182445408, 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.068367488, 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.074300892, 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.038859778, 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1318, 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.074073514, 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000056201 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.375 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 885264, 2024-09-11T01:18:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 133568 2024-09-11T01:18:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-09-11T01:18:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 1, 2024-09-11T01:18:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-09-11T01:18:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-MDSRank": { 2024-09-11T01:18:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-09-11T01:18:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-09-11T01:18:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 3536, 2024-09-11T01:18:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.088873299, 2024-09-11T01:18:23.376 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000025133 2024-09-11T01:18:23.377 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:23.377 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.377 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-PurgeQueue": { 2024-09-11T01:18:23.377 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-09-11T01:18:23.377 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-09-11T01:18:23.377 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.377 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.377 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.377 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:23.377 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.377 INFO:teuthology.orchestra.run.smithi183.stdout: "mds": { 2024-09-11T01:18:23.377 INFO:teuthology.orchestra.run.smithi183.stdout: "request": 0, 2024-09-11T01:18:23.377 INFO:teuthology.orchestra.run.smithi183.stdout: "reply": 0, 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: "reply_latency": { 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_reply": 0, 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: "forward": 0, 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_complete": 0, 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_keys": 0, 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_commit": 0, 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_split": 0, 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_merge": 0, 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes": 135, 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_top": 0, 2024-09-11T01:18:23.378 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_bottom": 135, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pin_tail": 0, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pinned": 135, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_expired": 0, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_with_caps": 0, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "caps": 0, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "subtrees": 1, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse": 0, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_hit": 0, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_forward": 0, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_discover": 0, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_dir_fetch": 0, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_remote_ino": 0, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_lock": 0, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "load_cent": 0, 2024-09-11T01:18:23.379 INFO:teuthology.orchestra.run.smithi183.stdout: "q": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "exported": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "exported_inodes": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "imported": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "imported_inodes": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_dir_fetch": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_backtrace_fetch": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_peer_discover": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rfiles": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rbytes": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rsnaps": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_set_tag": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_inotable_repaired": 0, 2024-09-11T01:18:23.380 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_inodes": 0, 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_file_inodes": 0, 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_inode_file_caps": 0, 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_revoke": 0, 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_grant": 0, 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps": 0, 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps_dirty": 0, 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_cap_release": 0, 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: "process_request_cap_release": 0 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.381 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_cache": { 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update_receipt": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_try_discover": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_send_discover": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_handle_discover": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_delayed": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_enqueuing": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_created": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_enqueued": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_reintegrated": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_migrated": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_processing": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_enqueued": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_prioritized": 0, 2024-09-11T01:18:23.382 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_started": 0, 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_completed": 0, 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_path": 0, 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_inode": 0, 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_exportdir": 0, 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_flush": 0, 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragmentdir": 0, 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragstats": 0, 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_inodestats": 0, 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_started": 0, 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_succeeded": 0, 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_write_failed": 0 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_log": { 2024-09-11T01:18:23.383 INFO:teuthology.orchestra.run.smithi183.stdout: "evlrg": 0, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "evadd": 0, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "evex": 0, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "evtrm": 0, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "ev": 23151, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "evexg": 0, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "evexd": 0, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "segadd": 0, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "segex": 0, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "segtrm": 0, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "seg": 26, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "segmjr": 3, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "segexg": 0, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "segexd": 0, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "expos": 4194304, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "wrpos": 53057561, 2024-09-11T01:18:23.384 INFO:teuthology.orchestra.run.smithi183.stdout: "rdpos": 53055277, 2024-09-11T01:18:23.385 INFO:teuthology.orchestra.run.smithi183.stdout: "jlat": { 2024-09-11T01:18:23.385 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.385 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.385 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.385 INFO:teuthology.orchestra.run.smithi183.stdout: "replayed": 23151 2024-09-11T01:18:23.385 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.385 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_mem": { 2024-09-11T01:18:23.385 INFO:teuthology.orchestra.run.smithi183.stdout: "ino": 5, 2024-09-11T01:18:23.385 INFO:teuthology.orchestra.run.smithi183.stdout: "ino+": 155, 2024-09-11T01:18:23.385 INFO:teuthology.orchestra.run.smithi183.stdout: "ino-": 150, 2024-09-11T01:18:23.385 INFO:teuthology.orchestra.run.smithi183.stdout: "dir": 3, 2024-09-11T01:18:23.385 INFO:teuthology.orchestra.run.smithi183.stdout: "dir+": 31, 2024-09-11T01:18:23.385 INFO:teuthology.orchestra.run.smithi183.stdout: "dir-": 28, 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "dn": 135, 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "dn+": 290, 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "dn-": 155, 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "cap": 0, 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "cap+": 0, 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "cap-": 0, 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "rss": 51760, 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "heap": 256778240 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_server": { 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_client_request": 0, 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_server_request": 0, 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_request": 0, 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_session": 0, 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_peer_request": 0, 2024-09-11T01:18:23.386 INFO:teuthology.orchestra.run.smithi183.stdout: "req_create_latency": { 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getattr_latency": { 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getfilelock_latency": { 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.387 INFO:teuthology.orchestra.run.smithi183.stdout: "req_link_latency": { 2024-09-11T01:18:23.388 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.388 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.388 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.388 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.388 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookup_latency": { 2024-09-11T01:18:23.388 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.388 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.388 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.388 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.388 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookuphash_latency": { 2024-09-11T01:18:23.388 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.388 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.388 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupino_latency": { 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupname_latency": { 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupparent_latency": { 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.389 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.390 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupsnap_latency": { 2024-09-11T01:18:23.390 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.390 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.390 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.390 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.390 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lssnap_latency": { 2024-09-11T01:18:23.390 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.390 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.391 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.391 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mkdir_latency": { 2024-09-11T01:18:23.391 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.391 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.391 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.391 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mknod_latency": { 2024-09-11T01:18:23.391 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.391 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.391 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.391 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.391 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mksnap_latency": { 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: "req_open_latency": { 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: "req_readdir_latency": { 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.392 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rename_latency": { 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: "req_renamesnap_latency": { 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: "req_snapdiff_latency": { 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.393 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmdir_latency": { 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmsnap_latency": { 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmxattr_latency": { 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setattr_latency": { 2024-09-11T01:18:23.394 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setdirlayout_latency": { 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setfilelock_latency": { 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setlayout_latency": { 2024-09-11T01:18:23.395 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.396 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.396 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.396 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setxattr_latency": { 2024-09-11T01:18:23.396 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.396 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.396 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.396 INFO:teuthology.orchestra.run.smithi183.stdout: "req_symlink_latency": { 2024-09-11T01:18:23.396 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.396 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.396 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.396 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.396 INFO:teuthology.orchestra.run.smithi183.stdout: "req_unlink_latency": { 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_revoke_eviction": 0, 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_acquisition_throttle": 0, 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getvxattr_latency": { 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_sessions": { 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: "session_count": 1, 2024-09-11T01:18:23.397 INFO:teuthology.orchestra.run.smithi183.stdout: "session_add": 2, 2024-09-11T01:18:23.398 INFO:teuthology.orchestra.run.smithi183.stdout: "session_remove": 1, 2024-09-11T01:18:23.398 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_open": 1, 2024-09-11T01:18:23.398 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_stale": 0, 2024-09-11T01:18:23.398 INFO:teuthology.orchestra.run.smithi183.stdout: "total_load": 0, 2024-09-11T01:18:23.398 INFO:teuthology.orchestra.run.smithi183.stdout: "average_load": 0, 2024-09-11T01:18:23.398 INFO:teuthology.orchestra.run.smithi183.stdout: "avg_session_uptime": 2064, 2024-09-11T01:18:23.398 INFO:teuthology.orchestra.run.smithi183.stdout: "mdthresh_evicted": 0 2024-09-11T01:18:23.398 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.398 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-09-11T01:18:23.398 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-09-11T01:18:23.400 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-09-11T01:18:23.400 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T01:18:23.400 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-09-11T01:18:23.400 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T01:18:23.400 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-09-11T01:18:23.400 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T01:18:23.400 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T01:18:23.400 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T01:18:23.401 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T01:18:23.401 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T01:18:23.401 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-09-11T01:18:23.401 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T01:18:23.401 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T01:18:23.401 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-09-11T01:18:23.401 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-09-11T01:18:23.401 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-09-11T01:18:23.401 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-09-11T01:18:23.401 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T01:18:23.401 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T01:18:23.401 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T01:18:23.401 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-09-11T01:18:23.402 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 222487, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 68, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 8952, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 168, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-09-11T01:18:23.403 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 107592, 2024-09-11T01:18:23.404 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 579, 2024-09-11T01:18:23.404 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-09-11T01:18:23.404 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-09-11T01:18:23.404 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-09-11T01:18:23.404 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-09-11T01:18:23.404 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.404 INFO:teuthology.orchestra.run.smithi183.stdout: "objecter": { 2024-09-11T01:18:23.404 INFO:teuthology.orchestra.run.smithi183.stdout: "op_active": 0, 2024-09-11T01:18:23.404 INFO:teuthology.orchestra.run.smithi183.stdout: "op_laggy": 0, 2024-09-11T01:18:23.404 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send": 2096, 2024-09-11T01:18:23.404 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send_bytes": 21, 2024-09-11T01:18:23.404 INFO:teuthology.orchestra.run.smithi183.stdout: "op_resend": 3, 2024-09-11T01:18:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: "op_reply": 2096, 2024-09-11T01:18:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: "op_latency": { 2024-09-11T01:18:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2096, 2024-09-11T01:18:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 62.566233251, 2024-09-11T01:18:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.029850302 2024-09-11T01:18:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: "op_inflight": 0, 2024-09-11T01:18:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: "oplen_avg": { 2024-09-11T01:18:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2096, 2024-09-11T01:18:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 2097 2024-09-11T01:18:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: "op": 2096, 2024-09-11T01:18:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: "op_r": 2096, 2024-09-11T01:18:23.405 INFO:teuthology.orchestra.run.smithi183.stdout: "op_w": 0, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "op_rmw": 0, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "op_pg": 0, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_stat": 1251, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_create": 0, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_read": 843, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_write": 0, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writefull": 0, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writesame": 0, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_append": 0, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_zero": 0, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_truncate": 0, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_delete": 0, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_mapext": 0, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_sparse_read": 0, 2024-09-11T01:18:23.406 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_clonerange": 0, 2024-09-11T01:18:23.407 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_getxattr": 1, 2024-09-11T01:18:23.407 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_setxattr": 0, 2024-09-11T01:18:23.407 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_cmpxattr": 0, 2024-09-11T01:18:23.407 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_rmxattr": 0, 2024-09-11T01:18:23.407 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_resetxattrs": 0, 2024-09-11T01:18:23.407 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_call": 0, 2024-09-11T01:18:23.407 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_watch": 0, 2024-09-11T01:18:23.407 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_notify": 0, 2024-09-11T01:18:23.407 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T01:18:23.407 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls": 0, 2024-09-11T01:18:23.407 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls_filter": 0, 2024-09-11T01:18:23.407 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_other": 0, 2024-09-11T01:18:23.407 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_active": 0, 2024-09-11T01:18:23.408 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_send": 0, 2024-09-11T01:18:23.408 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_resend": 0, 2024-09-11T01:18:23.408 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_ping": 0, 2024-09-11T01:18:23.408 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_active": 0, 2024-09-11T01:18:23.408 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_send": 0, 2024-09-11T01:18:23.408 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_resend": 0, 2024-09-11T01:18:23.408 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_active": 0, 2024-09-11T01:18:23.408 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_send": 0, 2024-09-11T01:18:23.408 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_resend": 0, 2024-09-11T01:18:23.408 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_active": 0, 2024-09-11T01:18:23.408 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_send": 0, 2024-09-11T01:18:23.408 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_resend": 0, 2024-09-11T01:18:23.408 INFO:teuthology.orchestra.run.smithi183.stdout: "command_active": 0, 2024-09-11T01:18:23.408 INFO:teuthology.orchestra.run.smithi183.stdout: "command_send": 0, 2024-09-11T01:18:23.409 INFO:teuthology.orchestra.run.smithi183.stdout: "command_resend": 0, 2024-09-11T01:18:23.409 INFO:teuthology.orchestra.run.smithi183.stdout: "map_epoch": 89, 2024-09-11T01:18:23.409 INFO:teuthology.orchestra.run.smithi183.stdout: "map_full": 0, 2024-09-11T01:18:23.409 INFO:teuthology.orchestra.run.smithi183.stdout: "map_inc": 2, 2024-09-11T01:18:23.409 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_sessions": 9, 2024-09-11T01:18:23.409 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_open": 9, 2024-09-11T01:18:23.409 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_close": 0, 2024-09-11T01:18:23.409 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_laggy": 0, 2024-09-11T01:18:23.409 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_wr": 0, 2024-09-11T01:18:23.409 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_rd": 2, 2024-09-11T01:18:23.409 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_del": 0 2024-09-11T01:18:23.409 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.409 INFO:teuthology.orchestra.run.smithi183.stdout: "oft": { 2024-09-11T01:18:23.409 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_objs": 0, 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_kv_pairs": 0, 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_updates": 0, 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_removes": 0 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: "purge_queue": { 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops": 0, 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops_high_water": 0, 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing": 0, 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_high_water": 0, 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed_ops": 0, 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed": 0, 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_item_in_journal": 0 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T01:18:23.410 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 2333, 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 50136197, 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 2333, 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 2333, 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 50136197, 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:23.411 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_bytes": { 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 2096, 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 48884943, 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 2096, 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 48884943, 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.412 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_ops": { 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 1024, 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 2096, 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 2096, 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 2096, 2024-09-11T01:18:23.413 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 2096, 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle": { 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-09-11T01:18:23.414 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-09-11T01:18:23.415 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 0, 2024-09-11T01:18:23.415 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 0, 2024-09-11T01:18:23.415 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:23.415 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.415 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.415 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.415 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:23.415 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.415 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle-0x55ac373ed040": { 2024-09-11T01:18:23.415 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:23.415 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-09-11T01:18:23.415 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:23.415 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-09-11T01:18:23.415 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 0, 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 0, 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: "trackedop": { 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_ops_count": 0 2024-09-11T01:18:23.416 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:23.417 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-11T01:18:24.178 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-11T01:18:24.178 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-11T01:18:24.178 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-11T01:18:24.178 DEBUG:tasks.check_counter:Getting stats from i 2024-09-11T01:18:24.178 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-11T01:18:24.424 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T01:18:24.697 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:24 smithi183 ceph-mon[34992]: pgmap v702: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-11T01:18:24.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:24 smithi103 ceph-mon[30562]: pgmap v702: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-11T01:18:24.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:24 smithi117 ceph-mon[35358]: pgmap v702: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-11T01:18:24.896 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-11T01:18:24.896 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T01:18:24.896 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 26473, 2024-09-11T01:18:24.897 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 28135, 2024-09-11T01:18:24.897 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 8789389, 2024-09-11T01:18:24.897 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 26062224, 2024-09-11T01:18:24.897 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 15, 2024-09-11T01:18:24.897 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 5, 2024-09-11T01:18:24.897 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 1.737147340, 2024-09-11T01:18:24.897 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.878887844, 2024-09-11T01:18:24.897 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 1.141354822, 2024-09-11T01:18:24.897 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.089239134, 2024-09-11T01:18:24.897 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:24.897 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 28132, 2024-09-11T01:18:24.897 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 4.879770989, 2024-09-11T01:18:24.897 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000173459 2024-09-11T01:18:24.897 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 17558, 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.005004869, 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000285 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 4576, 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 1888 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 2850, 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 2619, 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 1611603, 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 20485073, 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 7, 2024-09-11T01:18:24.898 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 5, 2024-09-11T01:18:24.899 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.332037259, 2024-09-11T01:18:24.899 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.157579660, 2024-09-11T01:18:24.899 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.110407866, 2024-09-11T01:18:24.899 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.071995288, 2024-09-11T01:18:24.899 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:24.899 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2620, 2024-09-11T01:18:24.899 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.171948904, 2024-09-11T01:18:24.899 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000065629 2024-09-11T01:18:24.899 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.899 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:24.899 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1824, 2024-09-11T01:18:24.899 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000377900, 2024-09-11T01:18:24.899 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000207 2024-09-11T01:18:24.899 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.900 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 895008, 2024-09-11T01:18:24.900 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 137904 2024-09-11T01:18:24.900 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.900 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T01:18:24.900 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 845, 2024-09-11T01:18:24.900 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 939, 2024-09-11T01:18:24.900 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 245805, 2024-09-11T01:18:24.900 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 3998712, 2024-09-11T01:18:24.900 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 12, 2024-09-11T01:18:24.900 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 8, 2024-09-11T01:18:24.900 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.106803414, 2024-09-11T01:18:24.900 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.055262112, 2024-09-11T01:18:24.900 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.024112662, 2024-09-11T01:18:24.900 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.024673205, 2024-09-11T01:18:24.901 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:24.901 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 937, 2024-09-11T01:18:24.901 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.074216271, 2024-09-11T01:18:24.901 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000079206 2024-09-11T01:18:24.901 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.901 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:24.901 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 365, 2024-09-11T01:18:24.901 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000044248, 2024-09-11T01:18:24.901 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000121 2024-09-11T01:18:24.901 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.901 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T01:18:24.901 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 357360 2024-09-11T01:18:24.901 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.901 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-09-11T01:18:24.902 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 1, 2024-09-11T01:18:24.902 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-09-11T01:18:24.902 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.902 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-MDSRank": { 2024-09-11T01:18:24.902 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-09-11T01:18:24.902 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-09-11T01:18:24.902 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2719, 2024-09-11T01:18:24.902 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 6.136169641, 2024-09-11T01:18:24.902 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.002256774 2024-09-11T01:18:24.902 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:24.902 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.902 INFO:teuthology.orchestra.run.smithi183.stdout: "finisher-PurgeQueue": { 2024-09-11T01:18:24.902 INFO:teuthology.orchestra.run.smithi183.stdout: "queue_len": 0, 2024-09-11T01:18:24.902 INFO:teuthology.orchestra.run.smithi183.stdout: "complete_latency": { 2024-09-11T01:18:24.903 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 3332, 2024-09-11T01:18:24.903 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.101698421, 2024-09-11T01:18:24.903 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000030521 2024-09-11T01:18:24.903 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:24.903 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.903 INFO:teuthology.orchestra.run.smithi183.stdout: "mds": { 2024-09-11T01:18:24.903 INFO:teuthology.orchestra.run.smithi183.stdout: "request": 500, 2024-09-11T01:18:24.903 INFO:teuthology.orchestra.run.smithi183.stdout: "reply": 494, 2024-09-11T01:18:24.903 INFO:teuthology.orchestra.run.smithi183.stdout: "reply_latency": { 2024-09-11T01:18:24.903 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 494, 2024-09-11T01:18:24.903 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.774122623, 2024-09-11T01:18:24.903 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.001567049 2024-09-11T01:18:24.903 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.903 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_reply": 0, 2024-09-11T01:18:24.904 INFO:teuthology.orchestra.run.smithi183.stdout: "forward": 6, 2024-09-11T01:18:24.904 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_complete": 0, 2024-09-11T01:18:24.904 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_fetch_keys": 0, 2024-09-11T01:18:24.904 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_commit": 20, 2024-09-11T01:18:24.904 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_split": 1, 2024-09-11T01:18:24.904 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_merge": 0, 2024-09-11T01:18:24.904 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes": 18, 2024-09-11T01:18:24.904 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_top": 2, 2024-09-11T01:18:24.904 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_bottom": 16, 2024-09-11T01:18:24.904 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pin_tail": 0, 2024-09-11T01:18:24.904 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_pinned": 13, 2024-09-11T01:18:24.904 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_expired": 18, 2024-09-11T01:18:24.904 INFO:teuthology.orchestra.run.smithi183.stdout: "inodes_with_caps": 0, 2024-09-11T01:18:24.904 INFO:teuthology.orchestra.run.smithi183.stdout: "caps": 0, 2024-09-11T01:18:24.905 INFO:teuthology.orchestra.run.smithi183.stdout: "subtrees": 4, 2024-09-11T01:18:24.905 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse": 665, 2024-09-11T01:18:24.905 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_hit": 640, 2024-09-11T01:18:24.905 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_forward": 4, 2024-09-11T01:18:24.905 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_discover": 8, 2024-09-11T01:18:24.905 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_dir_fetch": 0, 2024-09-11T01:18:24.905 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_remote_ino": 0, 2024-09-11T01:18:24.905 INFO:teuthology.orchestra.run.smithi183.stdout: "traverse_lock": 0, 2024-09-11T01:18:24.905 INFO:teuthology.orchestra.run.smithi183.stdout: "load_cent": 0, 2024-09-11T01:18:24.905 INFO:teuthology.orchestra.run.smithi183.stdout: "q": 0, 2024-09-11T01:18:24.905 INFO:teuthology.orchestra.run.smithi183.stdout: "exported": 4, 2024-09-11T01:18:24.905 INFO:teuthology.orchestra.run.smithi183.stdout: "exported_inodes": 0, 2024-09-11T01:18:24.905 INFO:teuthology.orchestra.run.smithi183.stdout: "imported": 4, 2024-09-11T01:18:24.905 INFO:teuthology.orchestra.run.smithi183.stdout: "imported_inodes": 19, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_dir_fetch": 0, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_backtrace_fetch": 0, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "openino_peer_discover": 1, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rfiles": 321, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rbytes": 12433862710, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "root_rsnaps": 0, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_fetch": 0, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_set_tag": 0, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_backtrace_repaired": 0, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_inotable_repaired": 0, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_inodes": 0, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dir_base_inodes": 0, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_dirfrag_rstats": 0, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "scrub_file_inodes": 0, 2024-09-11T01:18:24.906 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_inode_file_caps": 0, 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_revoke": 356, 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_grant": 1963, 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_trunc": 0, 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps": 23130, 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_caps_dirty": 22227, 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_cap_release": 21, 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: "process_request_cap_release": 149 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_cache": { 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update": 0, 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_update_receipt": 3, 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_try_discover": 2, 2024-09-11T01:18:24.907 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_send_discover": 8, 2024-09-11T01:18:24.908 INFO:teuthology.orchestra.run.smithi183.stdout: "dir_handle_discover": 3, 2024-09-11T01:18:24.908 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays": 0, 2024-09-11T01:18:24.908 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_delayed": 0, 2024-09-11T01:18:24.908 INFO:teuthology.orchestra.run.smithi183.stdout: "num_strays_enqueuing": 0, 2024-09-11T01:18:24.908 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_created": 133, 2024-09-11T01:18:24.908 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_enqueued": 133, 2024-09-11T01:18:24.908 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_reintegrated": 0, 2024-09-11T01:18:24.908 INFO:teuthology.orchestra.run.smithi183.stdout: "strays_migrated": 0, 2024-09-11T01:18:24.908 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_processing": 0, 2024-09-11T01:18:24.908 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_enqueued": 0, 2024-09-11T01:18:24.908 INFO:teuthology.orchestra.run.smithi183.stdout: "num_recovering_prioritized": 0, 2024-09-11T01:18:24.908 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_started": 0, 2024-09-11T01:18:24.909 INFO:teuthology.orchestra.run.smithi183.stdout: "recovery_completed": 0, 2024-09-11T01:18:24.909 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_path": 5, 2024-09-11T01:18:24.909 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_quiesce_inode": 374, 2024-09-11T01:18:24.909 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_enqueue_scrub": 0, 2024-09-11T01:18:24.909 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_exportdir": 4, 2024-09-11T01:18:24.909 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_flush": 0, 2024-09-11T01:18:24.909 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragmentdir": 1, 2024-09-11T01:18:24.909 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_fragstats": 0, 2024-09-11T01:18:24.909 INFO:teuthology.orchestra.run.smithi183.stdout: "ireq_inodestats": 0, 2024-09-11T01:18:24.909 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_started": 0, 2024-09-11T01:18:24.909 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_succeeded": 0, 2024-09-11T01:18:24.909 INFO:teuthology.orchestra.run.smithi183.stdout: "uninline_write_failed": 0 2024-09-11T01:18:24.909 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_log": { 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "evlrg": 0, 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "evadd": 23151, 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "evex": 0, 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "evtrm": 0, 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "ev": 23151, 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "evexg": 0, 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "evexd": 0, 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "segadd": 26, 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "segex": 0, 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "segtrm": 0, 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "seg": 26, 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "segmjr": 3, 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "segexg": 0, 2024-09-11T01:18:24.910 INFO:teuthology.orchestra.run.smithi183.stdout: "segexd": 0, 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: "expos": 4194304, 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: "wrpos": 53057561, 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: "rdpos": 0, 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: "jlat": { 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1311, 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 127.732860067, 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.097431624 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: "replayed": 0 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_mem": { 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: "ino": 23, 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: "ino+": 165, 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: "ino-": 142, 2024-09-11T01:18:24.911 INFO:teuthology.orchestra.run.smithi183.stdout: "dir": 22, 2024-09-11T01:18:24.912 INFO:teuthology.orchestra.run.smithi183.stdout: "dir+": 42, 2024-09-11T01:18:24.912 INFO:teuthology.orchestra.run.smithi183.stdout: "dir-": 20, 2024-09-11T01:18:24.912 INFO:teuthology.orchestra.run.smithi183.stdout: "dn": 18, 2024-09-11T01:18:24.912 INFO:teuthology.orchestra.run.smithi183.stdout: "dn+": 305, 2024-09-11T01:18:24.912 INFO:teuthology.orchestra.run.smithi183.stdout: "dn-": 287, 2024-09-11T01:18:24.912 INFO:teuthology.orchestra.run.smithi183.stdout: "cap": 0, 2024-09-11T01:18:24.912 INFO:teuthology.orchestra.run.smithi183.stdout: "cap+": 373, 2024-09-11T01:18:24.912 INFO:teuthology.orchestra.run.smithi183.stdout: "cap-": 373, 2024-09-11T01:18:24.912 INFO:teuthology.orchestra.run.smithi183.stdout: "rss": 67700, 2024-09-11T01:18:24.912 INFO:teuthology.orchestra.run.smithi183.stdout: "heap": 309190656 2024-09-11T01:18:24.912 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.912 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_server": { 2024-09-11T01:18:24.912 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_client_request": 517, 2024-09-11T01:18:24.913 INFO:teuthology.orchestra.run.smithi183.stdout: "dispatch_server_request": 5, 2024-09-11T01:18:24.913 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_request": 500, 2024-09-11T01:18:24.913 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_client_session": 12, 2024-09-11T01:18:24.913 INFO:teuthology.orchestra.run.smithi183.stdout: "handle_peer_request": 18, 2024-09-11T01:18:24.913 INFO:teuthology.orchestra.run.smithi183.stdout: "req_create_latency": { 2024-09-11T01:18:24.913 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 117, 2024-09-11T01:18:24.913 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.104248425, 2024-09-11T01:18:24.913 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000891012 2024-09-11T01:18:24.913 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.913 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getattr_latency": { 2024-09-11T01:18:24.913 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 1, 2024-09-11T01:18:24.913 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000198881, 2024-09-11T01:18:24.913 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000198881 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getfilelock_latency": { 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: "req_link_latency": { 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookup_latency": { 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 129, 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.036949871, 2024-09-11T01:18:24.914 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000286433 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookuphash_latency": { 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupino_latency": { 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupname_latency": { 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.915 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.916 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.916 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupparent_latency": { 2024-09-11T01:18:24.916 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.916 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.916 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.916 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.916 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lookupsnap_latency": { 2024-09-11T01:18:24.916 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.916 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.916 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.917 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.917 INFO:teuthology.orchestra.run.smithi183.stdout: "req_lssnap_latency": { 2024-09-11T01:18:24.917 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.917 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.917 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.917 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.917 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mkdir_latency": { 2024-09-11T01:18:24.917 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.917 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.917 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mknod_latency": { 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: "req_mksnap_latency": { 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: "req_open_latency": { 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 99, 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.381097433, 2024-09-11T01:18:24.918 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.003849469 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: "req_readdir_latency": { 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 15, 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.010392403, 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000692826 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rename_latency": { 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: "req_renamesnap_latency": { 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.919 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: "req_snapdiff_latency": { 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmdir_latency": { 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 2, 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.087911876, 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.043955938 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmsnap_latency": { 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.920 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: "req_rmxattr_latency": { 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setattr_latency": { 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setdirlayout_latency": { 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.921 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setfilelock_latency": { 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setlayout_latency": { 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: "req_setxattr_latency": { 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.922 INFO:teuthology.orchestra.run.smithi183.stdout: "req_symlink_latency": { 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: "req_unlink_latency": { 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 131, 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.153323734, 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.001170410 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_revoke_eviction": 0, 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: "cap_acquisition_throttle": 0, 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: "req_getvxattr_latency": { 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.923 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:24.924 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.924 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_sessions": { 2024-09-11T01:18:24.924 INFO:teuthology.orchestra.run.smithi183.stdout: "session_count": 1, 2024-09-11T01:18:24.924 INFO:teuthology.orchestra.run.smithi183.stdout: "session_add": 2, 2024-09-11T01:18:24.924 INFO:teuthology.orchestra.run.smithi183.stdout: "session_remove": 1, 2024-09-11T01:18:24.924 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_open": 1, 2024-09-11T01:18:24.924 INFO:teuthology.orchestra.run.smithi183.stdout: "sessions_stale": 0, 2024-09-11T01:18:24.924 INFO:teuthology.orchestra.run.smithi183.stdout: "total_load": 273, 2024-09-11T01:18:24.924 INFO:teuthology.orchestra.run.smithi183.stdout: "average_load": 273, 2024-09-11T01:18:24.924 INFO:teuthology.orchestra.run.smithi183.stdout: "avg_session_uptime": 586, 2024-09-11T01:18:24.924 INFO:teuthology.orchestra.run.smithi183.stdout: "mdthresh_evicted": 0 2024-09-11T01:18:24.924 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.924 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-09-11T01:18:24.925 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-09-11T01:18:24.925 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-09-11T01:18:24.925 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T01:18:24.925 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-09-11T01:18:24.925 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T01:18:24.925 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-09-11T01:18:24.925 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T01:18:24.925 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T01:18:24.925 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T01:18:24.925 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T01:18:24.925 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T01:18:24.925 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-09-11T01:18:24.925 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T01:18:24.926 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 279509, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 97, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-09-11T01:18:24.927 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-09-11T01:18:24.928 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-09-11T01:18:24.928 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-09-11T01:18:24.928 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 8952, 2024-09-11T01:18:24.928 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 168, 2024-09-11T01:18:24.928 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T01:18:24.928 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-09-11T01:18:24.928 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-09-11T01:18:24.928 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-09-11T01:18:24.928 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 93389, 2024-09-11T01:18:24.928 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 365, 2024-09-11T01:18:24.928 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-09-11T01:18:24.928 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-09-11T01:18:24.928 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-09-11T01:18:24.929 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-09-11T01:18:24.929 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.929 INFO:teuthology.orchestra.run.smithi183.stdout: "objecter": { 2024-09-11T01:18:24.929 INFO:teuthology.orchestra.run.smithi183.stdout: "op_active": 0, 2024-09-11T01:18:24.929 INFO:teuthology.orchestra.run.smithi183.stdout: "op_laggy": 0, 2024-09-11T01:18:24.929 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send": 4941, 2024-09-11T01:18:24.929 INFO:teuthology.orchestra.run.smithi183.stdout: "op_send_bytes": 49071602, 2024-09-11T01:18:24.929 INFO:teuthology.orchestra.run.smithi183.stdout: "op_resend": 33, 2024-09-11T01:18:24.929 INFO:teuthology.orchestra.run.smithi183.stdout: "op_reply": 4941, 2024-09-11T01:18:24.929 INFO:teuthology.orchestra.run.smithi183.stdout: "op_latency": { 2024-09-11T01:18:24.929 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 4941, 2024-09-11T01:18:24.929 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 224.646749815, 2024-09-11T01:18:24.929 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.045465846 2024-09-11T01:18:24.929 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.930 INFO:teuthology.orchestra.run.smithi183.stdout: "op_inflight": 0, 2024-09-11T01:18:24.930 INFO:teuthology.orchestra.run.smithi183.stdout: "oplen_avg": { 2024-09-11T01:18:24.930 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 4941, 2024-09-11T01:18:24.930 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 5179 2024-09-11T01:18:24.930 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.930 INFO:teuthology.orchestra.run.smithi183.stdout: "op": 4941, 2024-09-11T01:18:24.930 INFO:teuthology.orchestra.run.smithi183.stdout: "op_r": 3, 2024-09-11T01:18:24.930 INFO:teuthology.orchestra.run.smithi183.stdout: "op_w": 4938, 2024-09-11T01:18:24.930 INFO:teuthology.orchestra.run.smithi183.stdout: "op_rmw": 0, 2024-09-11T01:18:24.930 INFO:teuthology.orchestra.run.smithi183.stdout: "op_pg": 0, 2024-09-11T01:18:24.930 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_stat": 0, 2024-09-11T01:18:24.930 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_create": 10, 2024-09-11T01:18:24.930 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_read": 3, 2024-09-11T01:18:24.930 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_write": 1314, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writefull": 37, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_writesame": 0, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_append": 0, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_zero": 0, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_truncate": 1, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_delete": 3367, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_mapext": 0, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_sparse_read": 0, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_clonerange": 0, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_getxattr": 0, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_setxattr": 20, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_cmpxattr": 0, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_rmxattr": 0, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_resetxattrs": 0, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_call": 0, 2024-09-11T01:18:24.931 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_watch": 0, 2024-09-11T01:18:24.932 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_notify": 0, 2024-09-11T01:18:24.932 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_src_cmpxattr": 0, 2024-09-11T01:18:24.932 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls": 0, 2024-09-11T01:18:24.932 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_pgls_filter": 0, 2024-09-11T01:18:24.932 INFO:teuthology.orchestra.run.smithi183.stdout: "osdop_other": 0, 2024-09-11T01:18:24.932 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_active": 0, 2024-09-11T01:18:24.932 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_send": 0, 2024-09-11T01:18:24.932 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_resend": 0, 2024-09-11T01:18:24.932 INFO:teuthology.orchestra.run.smithi183.stdout: "linger_ping": 0, 2024-09-11T01:18:24.932 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_active": 0, 2024-09-11T01:18:24.932 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_send": 0, 2024-09-11T01:18:24.932 INFO:teuthology.orchestra.run.smithi183.stdout: "poolop_resend": 0, 2024-09-11T01:18:24.932 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_active": 0, 2024-09-11T01:18:24.933 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_send": 0, 2024-09-11T01:18:24.933 INFO:teuthology.orchestra.run.smithi183.stdout: "poolstat_resend": 0, 2024-09-11T01:18:24.933 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_active": 0, 2024-09-11T01:18:24.933 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_send": 0, 2024-09-11T01:18:24.933 INFO:teuthology.orchestra.run.smithi183.stdout: "statfs_resend": 0, 2024-09-11T01:18:24.933 INFO:teuthology.orchestra.run.smithi183.stdout: "command_active": 0, 2024-09-11T01:18:24.933 INFO:teuthology.orchestra.run.smithi183.stdout: "command_send": 0, 2024-09-11T01:18:24.933 INFO:teuthology.orchestra.run.smithi183.stdout: "command_resend": 0, 2024-09-11T01:18:24.933 INFO:teuthology.orchestra.run.smithi183.stdout: "map_epoch": 89, 2024-09-11T01:18:24.933 INFO:teuthology.orchestra.run.smithi183.stdout: "map_full": 0, 2024-09-11T01:18:24.933 INFO:teuthology.orchestra.run.smithi183.stdout: "map_inc": 2, 2024-09-11T01:18:24.933 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_sessions": 12, 2024-09-11T01:18:24.933 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_open": 12, 2024-09-11T01:18:24.933 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_session_close": 0, 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_laggy": 0, 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_wr": 307, 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_rd": 0, 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_del": 120 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: "oft": { 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_objs": 1, 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_kv_pairs": 0, 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_updates": 0, 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: "omap_total_removes": 0 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: "purge_queue": { 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops": 0, 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_ops_high_water": 27, 2024-09-11T01:18:24.934 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing": 0, 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executing_high_water": 4, 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed_ops": 3344, 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_executed": 133, 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "pq_item_in_journal": 0 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 30164, 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 8294096, 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 30164, 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-09-11T01:18:24.935 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 30164, 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 8294096, 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_bytes": { 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:24.936 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 4941, 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 49086091, 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 4941, 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 49086091, 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-objecter_ops": { 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 1024, 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 0, 2024-09-11T01:18:24.937 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 0, 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 0, 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 4941, 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 4941, 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 4941, 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 4941, 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle": { 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:24.938 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 133, 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 14489, 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 133, 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 3, 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 14489, 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.939 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-write_buf_throttle-0x563c49212dc0": { 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 3758096384, 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 23151, 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 48863257, 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 23151, 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 1311, 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 48863257, 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:24.940 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:24.941 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:24.941 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:24.941 INFO:teuthology.orchestra.run.smithi183.stdout: "trackedop": { 2024-09-11T01:18:24.941 INFO:teuthology.orchestra.run.smithi183.stdout: "slow_ops_count": 379 2024-09-11T01:18:24.941 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:24.941 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-11T01:18:25.771 INFO:tasks.check_counter:Daemon mds.i mds.exported=4 2024-09-11T01:18:25.771 INFO:tasks.check_counter:Daemon mds.i mds.imported=4 2024-09-11T01:18:25.771 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=1 2024-09-11T01:18:25.771 DEBUG:tasks.check_counter:Getting stats from l 2024-09-11T01:18:25.772 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-11T01:18:26.017 INFO:teuthology.orchestra.run.smithi183.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.c/config 2024-09-11T01:18:26.534 INFO:teuthology.orchestra.run.smithi183.stdout:{ 2024-09-11T01:18:26.534 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-0": { 2024-09-11T01:18:26.534 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 0, 2024-09-11T01:18:26.535 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 2, 2024-09-11T01:18:26.535 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 0, 2024-09-11T01:18:26.535 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 0, 2024-09-11T01:18:26.535 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 4, 2024-09-11T01:18:26.535 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 0, 2024-09-11T01:18:26.535 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.001073376, 2024-09-11T01:18:26.535 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.000000000, 2024-09-11T01:18:26.535 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.000200132, 2024-09-11T01:18:26.535 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:26.535 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:26.535 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:26.535 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:26.535 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:26.535 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:26.536 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:26.536 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:26.536 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:26.536 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:26.536 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:26.536 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-11T01:18:26.536 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 0 2024-09-11T01:18:26.536 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:26.536 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-1": { 2024-09-11T01:18:26.536 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 1, 2024-09-11T01:18:26.536 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 168, 2024-09-11T01:18:26.536 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 160, 2024-09-11T01:18:26.536 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 109824, 2024-09-11T01:18:26.536 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 3, 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 2, 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.012386031, 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.009934218, 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.000718797, 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 166, 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.009284381, 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000055930 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:26.537 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 109824 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "AsyncMessenger::Worker-2": { 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_messages": 230, 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages": 223, 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_bytes": 835696, 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_bytes": 136192, 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_created_connections": 2, 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_active_connections": 1, 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_total_time": 0.040660868, 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_send_time": 0.017994351, 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_recv_time": 0.030725403, 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_messages_queue_lat": { 2024-09-11T01:18:26.538 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 223, 2024-09-11T01:18:26.539 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.020030827, 2024-09-11T01:18:26.539 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000089824 2024-09-11T01:18:26.539 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:26.539 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_handle_ack_lat": { 2024-09-11T01:18:26.539 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:26.539 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:26.539 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:26.539 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:26.539 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_recv_encrypted_bytes": 835696, 2024-09-11T01:18:26.539 INFO:teuthology.orchestra.run.smithi183.stdout: "msgr_send_encrypted_bytes": 136192 2024-09-11T01:18:26.540 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:26.540 INFO:teuthology.orchestra.run.smithi183.stdout: "cct": { 2024-09-11T01:18:26.540 INFO:teuthology.orchestra.run.smithi183.stdout: "total_workers": 0, 2024-09-11T01:18:26.540 INFO:teuthology.orchestra.run.smithi183.stdout: "unhealthy_workers": 0 2024-09-11T01:18:26.540 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:26.540 INFO:teuthology.orchestra.run.smithi183.stdout: "mempool": { 2024-09-11T01:18:26.540 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_bytes": 0, 2024-09-11T01:18:26.540 INFO:teuthology.orchestra.run.smithi183.stdout: "bloom_filter_items": 0, 2024-09-11T01:18:26.540 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_bytes": 0, 2024-09-11T01:18:26.540 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_alloc_items": 0, 2024-09-11T01:18:26.540 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_bytes": 0, 2024-09-11T01:18:26.540 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_data_items": 0, 2024-09-11T01:18:26.540 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-11T01:18:26.540 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_onode_items": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_meta_items": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_bytes": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_other_items": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_cache_buffer_items": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_bytes": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_extent_items": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_bytes": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_blob_items": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_shared_blob_items": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_inline_bl_items": 0, 2024-09-11T01:18:26.541 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_bytes": 0, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_fsck_items": 0, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_bytes": 0, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_txc_items": 0, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_deferred_items": 0, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_bytes": 0, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "bluestore_writing_items": 0, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_bytes": 0, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_items": 0, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_bytes": 0, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_reader_items": 0, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_bytes": 0, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "bluefs_file_writer_items": 0, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_bytes": 148984, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_anon_items": 30, 2024-09-11T01:18:26.542 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_bytes": 0, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "buffer_meta_items": 0, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_bytes": 0, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_items": 0, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_bytes": 0, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_mapbl_items": 0, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_bytes": 0, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "osd_pglog_items": 0, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_bytes": 0, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_items": 0, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_bytes": 0, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "osdmap_mapping_items": 0, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_bytes": 0, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "pgmap_items": 0, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_bytes": 968, 2024-09-11T01:18:26.543 INFO:teuthology.orchestra.run.smithi183.stdout: "mds_co_items": 2, 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_bytes": 0, 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_1_items": 0, 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_bytes": 0, 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: "unittest_2_items": 0 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: }, 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: "val": 0, 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: "max": 104857600, 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: "get_started": 0, 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: "get": 227, 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: "get_sum": 800753, 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_fail": 0, 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: "get_or_fail_success": 227, 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: "take": 0, 2024-09-11T01:18:26.544 INFO:teuthology.orchestra.run.smithi183.stdout: "take_sum": 0, 2024-09-11T01:18:26.545 INFO:teuthology.orchestra.run.smithi183.stdout: "put": 227, 2024-09-11T01:18:26.545 INFO:teuthology.orchestra.run.smithi183.stdout: "put_sum": 800753, 2024-09-11T01:18:26.545 INFO:teuthology.orchestra.run.smithi183.stdout: "wait": { 2024-09-11T01:18:26.545 INFO:teuthology.orchestra.run.smithi183.stdout: "avgcount": 0, 2024-09-11T01:18:26.545 INFO:teuthology.orchestra.run.smithi183.stdout: "sum": 0.000000000, 2024-09-11T01:18:26.545 INFO:teuthology.orchestra.run.smithi183.stdout: "avgtime": 0.000000000 2024-09-11T01:18:26.545 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:26.545 INFO:teuthology.orchestra.run.smithi183.stdout: } 2024-09-11T01:18:26.545 INFO:teuthology.orchestra.run.smithi183.stdout:} 2024-09-11T01:18:26.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:26 smithi103 ceph-mon[30562]: pgmap v703: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T01:18:26.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:26 smithi117 ceph-mon[35358]: pgmap v703: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T01:18:26.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:26 smithi183 ceph-mon[34992]: pgmap v703: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T01:18:27.154 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-11T01:18:27.154 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-11T01:18:27.154 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.l 2024-09-11T01:18:27.154 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-11T01:18:27.165 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-11T01:18:27.165 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T01:18:27.165 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T01:18:27.223 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-11T01:18:27.223 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-11T01:18:27.302 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd blocklist ls 2024-09-11T01:18:27.716 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:18:28.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.296+0000 7fa47bc00640 1 -- 172.21.15.103:0/469740498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa474102dc0 msgr2=0x7fa4741031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:28.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.296+0000 7fa47bc00640 1 --2- 172.21.15.103:0/469740498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa474102dc0 0x7fa4741031a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa464009ca0 tx=0x7fa46402a8c0 comp rx=0 tx=0).stop 2024-09-11T01:18:28.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.296+0000 7fa47bc00640 1 -- 172.21.15.103:0/469740498 shutdown_connections 2024-09-11T01:18:28.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.296+0000 7fa47bc00640 1 --2- 172.21.15.103:0/469740498 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa474109150 0x7fa47410f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:28.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.296+0000 7fa47bc00640 1 --2- 172.21.15.103:0/469740498 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4741087d0 0x7fa474108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:28.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.296+0000 7fa47bc00640 1 --2- 172.21.15.103:0/469740498 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa474102dc0 0x7fa4741031a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:28.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.296+0000 7fa47bc00640 1 -- 172.21.15.103:0/469740498 >> 172.21.15.103:0/469740498 conn(0x7fa4740fe830 msgr2=0x7fa474100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:28.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.296+0000 7fa47bc00640 1 -- 172.21.15.103:0/469740498 shutdown_connections 2024-09-11T01:18:28.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.296+0000 7fa47bc00640 1 -- 172.21.15.103:0/469740498 wait complete. 2024-09-11T01:18:28.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.297+0000 7fa47bc00640 1 Processor -- start 2024-09-11T01:18:28.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.297+0000 7fa47bc00640 1 -- start start 2024-09-11T01:18:28.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.297+0000 7fa47bc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa474102dc0 0x7fa47419b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:28.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.297+0000 7fa47bc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4741087d0 0x7fa47419ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:28.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.297+0000 7fa47bc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa474109150 0x7fa4741a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:28.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.297+0000 7fa47bc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa474112e60 con 0x7fa474102dc0 2024-09-11T01:18:28.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.297+0000 7fa47bc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa474112ce0 con 0x7fa4741087d0 2024-09-11T01:18:28.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.297+0000 7fa47bc00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa474112fe0 con 0x7fa474109150 2024-09-11T01:18:28.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.297+0000 7fa479200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa474102dc0 0x7fa47419b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:28.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.298+0000 7fa479200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa474102dc0 0x7fa47419b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43852/0 (socket says 172.21.15.103:43852) 2024-09-11T01:18:28.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.298+0000 7fa479200640 1 -- 172.21.15.103:0/3352906492 learned_addr learned my addr 172.21.15.103:0/3352906492 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:28.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.298+0000 7fa473e00640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4741087d0 0x7fa47419ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:28.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.298+0000 7fa479c00640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa474109150 0x7fa4741a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:28.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.298+0000 7fa479200640 1 -- 172.21.15.103:0/3352906492 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa474109150 msgr2=0x7fa4741a0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:28.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.298+0000 7fa479200640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa474109150 0x7fa4741a0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:28.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.298+0000 7fa479200640 1 -- 172.21.15.103:0/3352906492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4741087d0 msgr2=0x7fa47419ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:28.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.298+0000 7fa479200640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4741087d0 0x7fa47419ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:28.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.298+0000 7fa479200640 1 -- 172.21.15.103:0/3352906492 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4741a15b0 con 0x7fa474102dc0 2024-09-11T01:18:28.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.298+0000 7fa473e00640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4741087d0 0x7fa47419ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:18:28.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.298+0000 7fa479200640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa474102dc0 0x7fa47419b500 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa464005e30 tx=0x7fa464031840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:28.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.299+0000 7fa471600640 1 -- 172.21.15.103:0/3352906492 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464003b70 con 0x7fa474102dc0 2024-09-11T01:18:28.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.299+0000 7fa471600640 1 -- 172.21.15.103:0/3352906492 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa464003d10 con 0x7fa474102dc0 2024-09-11T01:18:28.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.299+0000 7fa471600640 1 -- 172.21.15.103:0/3352906492 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46402fa50 con 0x7fa474102dc0 2024-09-11T01:18:28.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.299+0000 7fa47bc00640 1 -- 172.21.15.103:0/3352906492 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4741a1840 con 0x7fa474102dc0 2024-09-11T01:18:28.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.299+0000 7fa47bc00640 1 -- 172.21.15.103:0/3352906492 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4741a7f60 con 0x7fa474102dc0 2024-09-11T01:18:28.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.300+0000 7fa47bc00640 1 -- 172.21.15.103:0/3352906492 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4741031a0 con 0x7fa474102dc0 2024-09-11T01:18:28.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.302+0000 7fa471600640 1 -- 172.21.15.103:0/3352906492 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7fa46402fbf0 con 0x7fa474102dc0 2024-09-11T01:18:28.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.303+0000 7fa471600640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa4580b5360 0x7fa4580b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:28.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.304+0000 7fa471600640 1 -- 172.21.15.103:0/3352906492 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fa464107120 con 0x7fa474102dc0 2024-09-11T01:18:28.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.304+0000 7fa473e00640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa4580b5360 0x7fa4580b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:28.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.304+0000 7fa473e00640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa4580b5360 0x7fa4580b7820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa474108400 tx=0x7fa460005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:28.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.307+0000 7fa471600640 1 -- 172.21.15.103:0/3352906492 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa4640cdbd0 con 0x7fa474102dc0 2024-09-11T01:18:28.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.504+0000 7fa47bc00640 1 -- 172.21.15.103:0/3352906492 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa4741a82e0 con 0x7fa474102dc0 2024-09-11T01:18:28.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.504+0000 7fa471600640 1 -- 172.21.15.103:0/3352906492 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+597 (secure 0 0 0) 0x7fa4640cd4d0 con 0x7fa474102dc0 2024-09-11T01:18:28.507 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/366890372 2024-09-12T00:57:39.411408+0000 2024-09-11T01:18:28.507 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/115727473 2024-09-12T00:57:39.411408+0000 2024-09-11T01:18:28.507 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2372812363 2024-09-12T00:57:39.411408+0000 2024-09-11T01:18:28.507 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2844264136 2024-09-12T00:57:11.412015+0000 2024-09-11T01:18:28.507 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2046654364 2024-09-12T00:57:39.411408+0000 2024-09-11T01:18:28.507 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/115727473 2024-09-12T00:57:39.411408+0000 2024-09-11T01:18:28.508 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/211510947 2024-09-12T00:57:11.412015+0000 2024-09-11T01:18:28.508 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/2110498702 2024-09-12T00:57:11.412015+0000 2024-09-11T01:18:28.508 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/2110498702 2024-09-12T00:57:11.412015+0000 2024-09-11T01:18:28.508 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/189409602 2024-09-12T00:57:11.412015+0000 2024-09-11T01:18:28.508 INFO:teuthology.orchestra.run.smithi103.stderr:listed 10 entries 2024-09-11T01:18:28.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.506+0000 7fa47bc00640 1 -- 172.21.15.103:0/3352906492 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa4580b5360 msgr2=0x7fa4580b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:28.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.506+0000 7fa47bc00640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa4580b5360 0x7fa4580b7820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa474108400 tx=0x7fa460005f90 comp rx=0 tx=0).stop 2024-09-11T01:18:28.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.506+0000 7fa47bc00640 1 -- 172.21.15.103:0/3352906492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa474102dc0 msgr2=0x7fa47419b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.506+0000 7fa47bc00640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa474102dc0 0x7fa47419b500 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa464005e30 tx=0x7fa464031840 comp rx=0 tx=0).stop 2024-09-11T01:18:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.507+0000 7fa47bc00640 1 -- 172.21.15.103:0/3352906492 shutdown_connections 2024-09-11T01:18:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.507+0000 7fa47bc00640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa4580b5360 0x7fa4580b7820 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.507+0000 7fa47bc00640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa474109150 0x7fa4741a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.507+0000 7fa47bc00640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4741087d0 0x7fa47419ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.507+0000 7fa47bc00640 1 --2- 172.21.15.103:0/3352906492 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa474102dc0 0x7fa47419b500 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.507+0000 7fa47bc00640 1 -- 172.21.15.103:0/3352906492 >> 172.21.15.103:0/3352906492 conn(0x7fa4740fe830 msgr2=0x7fa474100010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.507+0000 7fa47bc00640 1 -- 172.21.15.103:0/3352906492 shutdown_connections 2024-09-11T01:18:28.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:28.507+0000 7fa47bc00640 1 -- 172.21.15.103:0/3352906492 wait complete. 2024-09-11T01:18:28.675 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:28 smithi117 ceph-mon[35358]: pgmap v704: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T01:18:28.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:28 smithi103 ceph-mon[30562]: pgmap v704: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T01:18:28.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:28 smithi183 ceph-mon[34992]: pgmap v704: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T01:18:29.264 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-11T01:18:29.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:18:29.264 DEBUG:teuthology.orchestra.run.smithi103:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-11T01:18:29.355 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T01:18:29.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:18:29.356 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-11T01:18:29.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:18:29.434 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-09-11T01:18:29.513 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-11T01:18:29.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:18:29.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-11T01:18:29.561 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:29 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3352906492' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T01:18:29.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-11T01:18:29.572 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-09-11T01:18:29.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:29 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3352906492' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T01:18:29.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:29 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3352906492' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-11T01:18:29.924 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-11T01:18:29.935 INFO:tasks.cephadm:Teardown begin 2024-09-11T01:18:29.935 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-11T01:18:29.935 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:18:30.325 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:18:30.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:30 smithi103 ceph-mon[30562]: pgmap v705: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T01:18:30.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:30 smithi117 ceph-mon[35358]: pgmap v705: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T01:18:30.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:30 smithi183 ceph-mon[34992]: pgmap v705: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-11T01:18:30.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.968+0000 7f7145600640 1 -- 172.21.15.103:0/3062473818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71400754c0 msgr2=0x7f71400758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:30.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.968+0000 7f7145600640 1 --2- 172.21.15.103:0/3062473818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71400754c0 0x7f71400758a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7130009900 tx=0x7f713002a410 comp rx=0 tx=0).stop 2024-09-11T01:18:30.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.968+0000 7f7145600640 1 -- 172.21.15.103:0/3062473818 shutdown_connections 2024-09-11T01:18:30.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.968+0000 7f7145600640 1 --2- 172.21.15.103:0/3062473818 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f714010f3d0 0x7f71401117c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:30.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.968+0000 7f7145600640 1 --2- 172.21.15.103:0/3062473818 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7140075de0 0x7f714010ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:30.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.968+0000 7f7145600640 1 --2- 172.21.15.103:0/3062473818 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71400754c0 0x7f71400758a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:30.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.968+0000 7f7145600640 1 -- 172.21.15.103:0/3062473818 >> 172.21.15.103:0/3062473818 conn(0x7f71400fe830 msgr2=0x7f7140100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:30.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.968+0000 7f7145600640 1 -- 172.21.15.103:0/3062473818 shutdown_connections 2024-09-11T01:18:30.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.968+0000 7f7145600640 1 -- 172.21.15.103:0/3062473818 wait complete. 2024-09-11T01:18:30.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.969+0000 7f7145600640 1 Processor -- start 2024-09-11T01:18:30.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.970+0000 7f7145600640 1 -- start start 2024-09-11T01:18:30.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.970+0000 7f7145600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71400754c0 0x7f714019b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:30.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.970+0000 7f7145600640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7140075de0 0x7f714019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:30.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.970+0000 7f7145600640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f714010f3d0 0x7f71401a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:30.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.970+0000 7f7145600640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7140114fa0 con 0x7f71400754c0 2024-09-11T01:18:30.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.970+0000 7f7145600640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f7140114e20 con 0x7f714010f3d0 2024-09-11T01:18:30.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.970+0000 7f7145600640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f7140115120 con 0x7f7140075de0 2024-09-11T01:18:30.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.970+0000 7f713ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71400754c0 0x7f714019b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:30.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.971+0000 7f713f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f714010f3d0 0x7f71401a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:30.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.971+0000 7f713ea00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71400754c0 0x7f714019b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55738/0 (socket says 172.21.15.103:55738) 2024-09-11T01:18:30.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.971+0000 7f713ea00640 1 -- 172.21.15.103:0/971807012 learned_addr learned my addr 172.21.15.103:0/971807012 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:30.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.971+0000 7f713e000640 1 --2- 172.21.15.103:0/971807012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7140075de0 0x7f714019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:30.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.971+0000 7f713ea00640 1 -- 172.21.15.103:0/971807012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7140075de0 msgr2=0x7f714019b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:30.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.971+0000 7f713ea00640 1 --2- 172.21.15.103:0/971807012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7140075de0 0x7f714019b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:30.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.971+0000 7f713ea00640 1 -- 172.21.15.103:0/971807012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f714010f3d0 msgr2=0x7f71401a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:30.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.971+0000 7f713ea00640 1 --2- 172.21.15.103:0/971807012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f714010f3d0 0x7f71401a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:30.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.971+0000 7f713ea00640 1 -- 172.21.15.103:0/971807012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71401a1520 con 0x7f71400754c0 2024-09-11T01:18:30.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.971+0000 7f713f400640 1 --2- 172.21.15.103:0/971807012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f714010f3d0 0x7f71401a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:18:30.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.971+0000 7f713ea00640 1 --2- 172.21.15.103:0/971807012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71400754c0 0x7f714019b470 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7130005940 tx=0x7f7130004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:30.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.972+0000 7f7137400640 1 -- 172.21.15.103:0/971807012 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713003f030 con 0x7f71400754c0 2024-09-11T01:18:30.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.972+0000 7f7137400640 1 -- 172.21.15.103:0/971807012 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7130003aa0 con 0x7f71400754c0 2024-09-11T01:18:30.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.972+0000 7f7145600640 1 -- 172.21.15.103:0/971807012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71401a17b0 con 0x7f71400754c0 2024-09-11T01:18:30.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.972+0000 7f7137400640 1 -- 172.21.15.103:0/971807012 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7130035070 con 0x7f71400754c0 2024-09-11T01:18:30.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.972+0000 7f7145600640 1 -- 172.21.15.103:0/971807012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71401a7ed0 con 0x7f71400754c0 2024-09-11T01:18:30.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.973+0000 7f7145600640 1 -- 172.21.15.103:0/971807012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71400758a0 con 0x7f71400754c0 2024-09-11T01:18:30.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.976+0000 7f7137400640 1 -- 172.21.15.103:0/971807012 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f713003bcc0 con 0x7f71400754c0 2024-09-11T01:18:30.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.977+0000 7f7137400640 1 --2- 172.21.15.103:0/971807012 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f71240b5360 0x7f71240b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:30.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.977+0000 7f7137400640 1 -- 172.21.15.103:0/971807012 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f7130106ab0 con 0x7f71400754c0 2024-09-11T01:18:30.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.977+0000 7f713e000640 1 --2- 172.21.15.103:0/971807012 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f71240b5360 0x7f71240b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:30.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.978+0000 7f713e000640 1 --2- 172.21.15.103:0/971807012 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f71240b5360 0x7f71240b7820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7140101070 tx=0x7f712c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:30.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:30.979+0000 7f7137400640 1 -- 172.21.15.103:0/971807012 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f71300ccf70 con 0x7f71400754c0 2024-09-11T01:18:31.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:31.211+0000 7f7145600640 1 -- 172.21.15.103:0/971807012 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f714019c5a0 con 0x7f71400754c0 2024-09-11T01:18:31.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:31.212+0000 7f7137400640 1 -- 172.21.15.103:0/971807012 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11935 (secure 0 0 0) 0x7f71300d19a0 con 0x7f71400754c0 2024-09-11T01:18:31.215 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:18:31.215 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":33,"btime":"2024-09-11T01:17:25:752182+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:17:25.170731+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24619,24629,24665]},"id":1}]} 2024-09-11T01:18:31.215 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 33 2024-09-11T01:18:31.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:31.214+0000 7f7145600640 1 -- 172.21.15.103:0/971807012 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f71240b5360 msgr2=0x7f71240b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:31.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:31.214+0000 7f7145600640 1 --2- 172.21.15.103:0/971807012 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f71240b5360 0x7f71240b7820 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7140101070 tx=0x7f712c00b390 comp rx=0 tx=0).stop 2024-09-11T01:18:31.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:31.214+0000 7f7145600640 1 -- 172.21.15.103:0/971807012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71400754c0 msgr2=0x7f714019b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:31.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:31.214+0000 7f7145600640 1 --2- 172.21.15.103:0/971807012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71400754c0 0x7f714019b470 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7130005940 tx=0x7f7130004270 comp rx=0 tx=0).stop 2024-09-11T01:18:31.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:31.214+0000 7f7145600640 1 -- 172.21.15.103:0/971807012 shutdown_connections 2024-09-11T01:18:31.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:31.214+0000 7f7145600640 1 --2- 172.21.15.103:0/971807012 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f71240b5360 0x7f71240b7820 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:31.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:31.214+0000 7f7145600640 1 --2- 172.21.15.103:0/971807012 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f714010f3d0 0x7f71401a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:31.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:31.214+0000 7f7145600640 1 --2- 172.21.15.103:0/971807012 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f7140075de0 0x7f714019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:31.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:31.215+0000 7f7145600640 1 --2- 172.21.15.103:0/971807012 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71400754c0 0x7f714019b470 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:31.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:31.215+0000 7f7145600640 1 -- 172.21.15.103:0/971807012 >> 172.21.15.103:0/971807012 conn(0x7f71400fe830 msgr2=0x7f71401115d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:31.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:31.215+0000 7f7145600640 1 -- 172.21.15.103:0/971807012 shutdown_connections 2024-09-11T01:18:31.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:31.215+0000 7f7145600640 1 -- 172.21.15.103:0/971807012 wait complete. 2024-09-11T01:18:31.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:31 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/971807012' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:18:31.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:31 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/971807012' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:18:31.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:31 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/971807012' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:18:32.016 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs dump --format=json 2024-09-11T01:18:32.392 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:18:32.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:32 smithi103 ceph-mon[30562]: pgmap v706: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-11T01:18:32.820 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:32 smithi183 ceph-mon[34992]: pgmap v706: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-11T01:18:32.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:32 smithi117 ceph-mon[35358]: pgmap v706: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 511 B/s wr, 7 op/s 2024-09-11T01:18:32.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.975+0000 7fb8acc00640 1 -- 172.21.15.103:0/320759626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a8104fa0 msgr2=0x7fb8a8105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:32.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.975+0000 7fb8acc00640 1 --2- 172.21.15.103:0/320759626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a8104fa0 0x7fb8a8105380 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fb898009900 tx=0x7fb89802a400 comp rx=0 tx=0).stop 2024-09-11T01:18:32.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.975+0000 7fb8acc00640 1 -- 172.21.15.103:0/320759626 shutdown_connections 2024-09-11T01:18:32.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.975+0000 7fb8acc00640 1 --2- 172.21.15.103:0/320759626 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8a810b330 0x7fb8a8111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:32.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.975+0000 7fb8acc00640 1 --2- 172.21.15.103:0/320759626 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8a810a9b0 0x7fb8a810adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:32.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.975+0000 7fb8acc00640 1 --2- 172.21.15.103:0/320759626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a8104fa0 0x7fb8a8105380 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:32.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.975+0000 7fb8acc00640 1 -- 172.21.15.103:0/320759626 >> 172.21.15.103:0/320759626 conn(0x7fb8a8100a50 msgr2=0x7fb8a8102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:32.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.975+0000 7fb8acc00640 1 -- 172.21.15.103:0/320759626 shutdown_connections 2024-09-11T01:18:32.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.975+0000 7fb8acc00640 1 -- 172.21.15.103:0/320759626 wait complete. 2024-09-11T01:18:32.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.976+0000 7fb8acc00640 1 Processor -- start 2024-09-11T01:18:32.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.976+0000 7fb8acc00640 1 -- start start 2024-09-11T01:18:32.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.976+0000 7fb8acc00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8a8104fa0 0x7fb8a819b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:32.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.976+0000 7fb8acc00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8a810a9b0 0x7fb8a819ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:32.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.976+0000 7fb8acc00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a810b330 0x7fb8a81a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:32.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.976+0000 7fb8acc00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a8114fb0 con 0x7fb8a810b330 2024-09-11T01:18:32.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.976+0000 7fb8acc00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a8114e30 con 0x7fb8a810a9b0 2024-09-11T01:18:32.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.976+0000 7fb8acc00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a8115130 con 0x7fb8a8104fa0 2024-09-11T01:18:32.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.977+0000 7fb8a5e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8a8104fa0 0x7fb8a819b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:32.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.977+0000 7fb8a5e00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8a8104fa0 0x7fb8a819b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.183:3300/0 says I am v2:172.21.15.103:43450/0 (socket says 172.21.15.103:43450) 2024-09-11T01:18:32.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.977+0000 7fb8a5e00640 1 -- 172.21.15.103:0/4283875835 learned_addr learned my addr 172.21.15.103:0/4283875835 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:32.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.977+0000 7fb8a6800640 1 --2- 172.21.15.103:0/4283875835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a810b330 0x7fb8a81a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:32.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.977+0000 7fb89fe00640 1 --2- 172.21.15.103:0/4283875835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8a810a9b0 0x7fb8a819ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:32.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.977+0000 7fb8a5e00640 1 -- 172.21.15.103:0/4283875835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8a810a9b0 msgr2=0x7fb8a819ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:32.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.977+0000 7fb8a5e00640 1 --2- 172.21.15.103:0/4283875835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8a810a9b0 0x7fb8a819ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:32.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.977+0000 7fb8a5e00640 1 -- 172.21.15.103:0/4283875835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a810b330 msgr2=0x7fb8a81a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:32.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.977+0000 7fb8a5e00640 1 --2- 172.21.15.103:0/4283875835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a810b330 0x7fb8a81a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:32.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.977+0000 7fb8a5e00640 1 -- 172.21.15.103:0/4283875835 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a81a1570 con 0x7fb8a8104fa0 2024-09-11T01:18:32.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.977+0000 7fb8a5e00640 1 --2- 172.21.15.103:0/4283875835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8a8104fa0 0x7fb8a819b4c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb898005ab0 tx=0x7fb898003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:32.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.978+0000 7fb89ea00640 1 -- 172.21.15.103:0/4283875835 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89803f070 con 0x7fb8a8104fa0 2024-09-11T01:18:32.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.978+0000 7fb8acc00640 1 -- 172.21.15.103:0/4283875835 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a81a1800 con 0x7fb8a8104fa0 2024-09-11T01:18:32.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.978+0000 7fb89ea00640 1 -- 172.21.15.103:0/4283875835 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb898031b60 con 0x7fb8a8104fa0 2024-09-11T01:18:32.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.978+0000 7fb89ea00640 1 -- 172.21.15.103:0/4283875835 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb898035030 con 0x7fb8a8104fa0 2024-09-11T01:18:32.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.978+0000 7fb8acc00640 1 -- 172.21.15.103:0/4283875835 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a81a7f20 con 0x7fb8a8104fa0 2024-09-11T01:18:32.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.979+0000 7fb8acc00640 1 -- 172.21.15.103:0/4283875835 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a8105380 con 0x7fb8a8104fa0 2024-09-11T01:18:32.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.981+0000 7fb89ea00640 1 -- 172.21.15.103:0/4283875835 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7fb89803b460 con 0x7fb8a8104fa0 2024-09-11T01:18:32.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.982+0000 7fb89ea00640 1 --2- 172.21.15.103:0/4283875835 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb88c0b52e0 0x7fb88c0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:32.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.982+0000 7fb89ea00640 1 -- 172.21.15.103:0/4283875835 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7fb898106be0 con 0x7fb8a8104fa0 2024-09-11T01:18:32.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.983+0000 7fb89fe00640 1 --2- 172.21.15.103:0/4283875835 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb88c0b52e0 0x7fb88c0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:32.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.983+0000 7fb89fe00640 1 --2- 172.21.15.103:0/4283875835 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb88c0b52e0 0x7fb88c0b77a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb8a810a150 tx=0x7fb890005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:32.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:32.984+0000 7fb89ea00640 1 -- 172.21.15.103:0/4283875835 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fb8980cd040 con 0x7fb8a8104fa0 2024-09-11T01:18:33.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:33.209+0000 7fb8acc00640 1 -- 172.21.15.103:0/4283875835 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8a819c5f0 con 0x7fb8a8104fa0 2024-09-11T01:18:33.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:33.209+0000 7fb89ea00640 1 -- 172.21.15.103:0/4283875835 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11935 (secure 0 0 0) 0x7fb8980d1a70 con 0x7fb8a8104fa0 2024-09-11T01:18:33.213 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:18:33.213 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":33,"btime":"2024-09-11T01:17:25:752182+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14598,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/556566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":556566266},{"type":"v1","addr":"172.21.15.103:6837","nonce":556566266}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14637,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/83536310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":83536310},{"type":"v1","addr":"172.21.15.103:6839","nonce":83536310}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14643,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/4189792187","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":4189792187},{"type":"v1","addr":"172.21.15.103:6841","nonce":4189792187}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24556,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.183:6833/3089120088","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6832","nonce":3089120088},{"type":"v1","addr":"172.21.15.183:6833","nonce":3089120088}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24572,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6833/3818376861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":3818376861},{"type":"v1","addr":"172.21.15.117:6833","nonce":3818376861}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24584,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1479863011","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1479863011},{"type":"v1","addr":"172.21.15.103:6835","nonce":1479863011}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-11T01:05:32.767364+0000","modified":"2024-09-11T01:17:25.170731+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24665,"mds_1":24629,"mds_2":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24595":{"gid":24595,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6835/2084396200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6834","nonce":2084396200},{"type":"v1","addr":"172.21.15.183:6835","nonce":2084396200}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24602":{"gid":24602,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.117:6835/3506900188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":3506900188},{"type":"v1","addr":"172.21.15.117:6835","nonce":3506900188}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24607":{"gid":24607,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.183:6837/1863510967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6836","nonce":1863510967},{"type":"v1","addr":"172.21.15.183:6837","nonce":1863510967}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"i","rank":2,"incarnation":22,"state":"up:active","state_seq":19,"addr":"172.21.15.183:6839/1006805616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6838","nonce":1006805616},{"type":"v1","addr":"172.21.15.183:6839","nonce":1006805616}]},"join_fscid":-1,"export_targets":[0,1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":19,"addr":"172.21.15.117:6837/294794871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":294794871},{"type":"v1","addr":"172.21.15.117:6837","nonce":294794871}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24665":{"gid":24665,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.117:6839/1820809235","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6838","nonce":1820809235},{"type":"v1","addr":"172.21.15.117:6839","nonce":1820809235}]},"join_fscid":-1,"export_targets":[1],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24665,"qdb_cluster":[24619,24629,24665]},"id":1}]} 2024-09-11T01:18:33.213 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 33 2024-09-11T01:18:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:33.212+0000 7fb8acc00640 1 -- 172.21.15.103:0/4283875835 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb88c0b52e0 msgr2=0x7fb88c0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:33.212+0000 7fb8acc00640 1 --2- 172.21.15.103:0/4283875835 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb88c0b52e0 0x7fb88c0b77a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb8a810a150 tx=0x7fb890005f90 comp rx=0 tx=0).stop 2024-09-11T01:18:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:33.212+0000 7fb8acc00640 1 -- 172.21.15.103:0/4283875835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8a8104fa0 msgr2=0x7fb8a819b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:33.212+0000 7fb8acc00640 1 --2- 172.21.15.103:0/4283875835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8a8104fa0 0x7fb8a819b4c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb898005ab0 tx=0x7fb898003c10 comp rx=0 tx=0).stop 2024-09-11T01:18:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:33.212+0000 7fb8acc00640 1 -- 172.21.15.103:0/4283875835 shutdown_connections 2024-09-11T01:18:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:33.212+0000 7fb8acc00640 1 --2- 172.21.15.103:0/4283875835 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fb88c0b52e0 0x7fb88c0b77a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:33.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:33.212+0000 7fb8acc00640 1 --2- 172.21.15.103:0/4283875835 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb8a810b330 0x7fb8a81a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:33.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:33.212+0000 7fb8acc00640 1 --2- 172.21.15.103:0/4283875835 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8a810a9b0 0x7fb8a819ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:33.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:33.212+0000 7fb8acc00640 1 --2- 172.21.15.103:0/4283875835 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fb8a8104fa0 0x7fb8a819b4c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:33.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:33.212+0000 7fb8acc00640 1 -- 172.21.15.103:0/4283875835 >> 172.21.15.103:0/4283875835 conn(0x7fb8a8100a50 msgr2=0x7fb8a8101330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:33.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:33.212+0000 7fb8acc00640 1 -- 172.21.15.103:0/4283875835 shutdown_connections 2024-09-11T01:18:33.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:33.212+0000 7fb8acc00640 1 -- 172.21.15.103:0/4283875835 wait complete. 2024-09-11T01:18:33.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:33 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/4283875835' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:18:33.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:33 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/4283875835' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:18:33.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:33 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/4283875835' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-11T01:18:34.064 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd dump --format=json 2024-09-11T01:18:34.435 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:18:34.764 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:34 smithi103 ceph-mon[30562]: pgmap v707: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T01:18:34.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:34 smithi117 ceph-mon[35358]: pgmap v707: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T01:18:34.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:34 smithi183 ceph-mon[34992]: pgmap v707: 129 pgs: 129 active+clean; 52 MiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T01:18:35.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.041+0000 7ff24aa00640 1 -- 172.21.15.103:0/709163428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244108fa0 msgr2=0x7ff24410f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:35.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.041+0000 7ff24aa00640 1 --2- 172.21.15.103:0/709163428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244108fa0 0x7ff24410f7a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff23c009900 tx=0x7ff23c02a410 comp rx=0 tx=0).stop 2024-09-11T01:18:35.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.041+0000 7ff24aa00640 1 -- 172.21.15.103:0/709163428 shutdown_connections 2024-09-11T01:18:35.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.041+0000 7ff24aa00640 1 --2- 172.21.15.103:0/709163428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244108fa0 0x7ff24410f7a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:35.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.041+0000 7ff24aa00640 1 --2- 172.21.15.103:0/709163428 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff244108620 0x7ff244108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:35.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.041+0000 7ff24aa00640 1 --2- 172.21.15.103:0/709163428 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff244102c10 0x7ff244102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:35.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.041+0000 7ff24aa00640 1 -- 172.21.15.103:0/709163428 >> 172.21.15.103:0/709163428 conn(0x7ff2440fe660 msgr2=0x7ff244100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:35.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.041+0000 7ff24aa00640 1 -- 172.21.15.103:0/709163428 shutdown_connections 2024-09-11T01:18:35.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.041+0000 7ff24aa00640 1 -- 172.21.15.103:0/709163428 wait complete. 2024-09-11T01:18:35.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.042+0000 7ff24aa00640 1 Processor -- start 2024-09-11T01:18:35.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.042+0000 7ff24aa00640 1 -- start start 2024-09-11T01:18:35.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.042+0000 7ff24aa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244102c10 0x7ff244198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:35.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.042+0000 7ff24aa00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff244108620 0x7ff244199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:35.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff24aa00640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff244108fa0 0x7ff24419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:35.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff24aa00640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff244112c60 con 0x7ff244102c10 2024-09-11T01:18:35.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff24aa00640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7ff244112ae0 con 0x7ff244108620 2024-09-11T01:18:35.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff24aa00640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7ff244112de0 con 0x7ff244108fa0 2024-09-11T01:18:35.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff249600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244102c10 0x7ff244198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:35.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff249600640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244102c10 0x7ff244198fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55778/0 (socket says 172.21.15.103:55778) 2024-09-11T01:18:35.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff249600640 1 -- 172.21.15.103:0/1460299747 learned_addr learned my addr 172.21.15.103:0/1460299747 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:35.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff248c00640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff244108620 0x7ff244199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:35.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff24a000640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff244108fa0 0x7ff24419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:35.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff249600640 1 -- 172.21.15.103:0/1460299747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff244108fa0 msgr2=0x7ff24419e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:35.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff249600640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff244108fa0 0x7ff24419e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:35.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff249600640 1 -- 172.21.15.103:0/1460299747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff244108620 msgr2=0x7ff244199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:35.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff249600640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff244108620 0x7ff244199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:35.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff249600640 1 -- 172.21.15.103:0/1460299747 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24419f080 con 0x7ff244102c10 2024-09-11T01:18:35.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff24a000640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff244108fa0 0x7ff24419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-11T01:18:35.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.043+0000 7ff249600640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244102c10 0x7ff244198fd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff23800eb90 tx=0x7ff23800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:35.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.044+0000 7ff242000640 1 -- 172.21.15.103:0/1460299747 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff238004d20 con 0x7ff244102c10 2024-09-11T01:18:35.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.044+0000 7ff242000640 1 -- 172.21.15.103:0/1460299747 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff23800ee90 con 0x7ff244102c10 2024-09-11T01:18:35.082 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.044+0000 7ff24aa00640 1 -- 172.21.15.103:0/1460299747 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff24419f370 con 0x7ff244102c10 2024-09-11T01:18:35.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.044+0000 7ff242000640 1 -- 172.21.15.103:0/1460299747 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff238010670 con 0x7ff244102c10 2024-09-11T01:18:35.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.044+0000 7ff24aa00640 1 -- 172.21.15.103:0/1460299747 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2441a5a30 con 0x7ff244102c10 2024-09-11T01:18:35.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.045+0000 7ff24aa00640 1 -- 172.21.15.103:0/1460299747 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff244102ff0 con 0x7ff244102c10 2024-09-11T01:18:35.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.047+0000 7ff242000640 1 -- 172.21.15.103:0/1460299747 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7ff238010850 con 0x7ff244102c10 2024-09-11T01:18:35.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.048+0000 7ff242000640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff22c0b5390 0x7ff22c0b7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:35.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.049+0000 7ff242000640 1 -- 172.21.15.103:0/1460299747 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7ff2380e68b0 con 0x7ff244102c10 2024-09-11T01:18:35.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.049+0000 7ff248c00640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff22c0b5390 0x7ff22c0b7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:35.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.049+0000 7ff248c00640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff22c0b5390 0x7ff22c0b7850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff2441081c0 tx=0x7ff230005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:35.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.050+0000 7ff242000640 1 -- 172.21.15.103:0/1460299747 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7ff238056220 con 0x7ff244102c10 2024-09-11T01:18:35.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.236+0000 7ff24aa00640 1 -- 172.21.15.103:0/1460299747 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2441a5d90 con 0x7ff244102c10 2024-09-11T01:18:35.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.238+0000 7ff242000640 1 -- 172.21.15.103:0/1460299747 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24984 (secure 0 0 0) 0x7ff2380ad360 con 0x7ff244102c10 2024-09-11T01:18:35.241 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-11T01:18:35.241 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"917288bc-6fd8-11ef-bcea-c7b262605968","created":"2024-09-11T00:56:46.242882+0000","modified":"2024-09-11T01:06:41.586918+0000","last_up_change":"2024-09-11T01:04:34.895368+0000","last_in_change":"2024-09-11T01:04:11.663436+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T01:00:33.745338+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-11T01:05:27.486014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-11T01:05:29.797513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-11T01:05:38.956635+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"1b3e4222-43fd-4af0-bf97-3ba1000221b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6803","nonce":1867193874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6805","nonce":1867193874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6809","nonce":1867193874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":1867193874},{"type":"v1","addr":"172.21.15.103:6807","nonce":1867193874}]},"public_addr":"172.21.15.103:6803/1867193874","cluster_addr":"172.21.15.103:6805/1867193874","heartbeat_back_addr":"172.21.15.103:6809/1867193874","heartbeat_front_addr":"172.21.15.103:6807/1867193874","state":["exists","up"]},{"osd":1,"uuid":"9a2b40da-7361-4c4f-a9dc-a769b427a0fc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6801","nonce":2629532556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6803","nonce":2629532556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6807","nonce":2629532556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":2629532556},{"type":"v1","addr":"172.21.15.117:6805","nonce":2629532556}]},"public_addr":"172.21.15.117:6801/2629532556","cluster_addr":"172.21.15.117:6803/2629532556","heartbeat_back_addr":"172.21.15.117:6807/2629532556","heartbeat_front_addr":"172.21.15.117:6805/2629532556","state":["exists","up"]},{"osd":2,"uuid":"5db919c1-90a7-4ba7-acf3-89eeb77ae131","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6800","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6801","nonce":3208966770}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6802","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6803","nonce":3208966770}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6806","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6807","nonce":3208966770}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6804","nonce":3208966770},{"type":"v1","addr":"172.21.15.183:6805","nonce":3208966770}]},"public_addr":"172.21.15.183:6801/3208966770","cluster_addr":"172.21.15.183:6803/3208966770","heartbeat_back_addr":"172.21.15.183:6807/3208966770","heartbeat_front_addr":"172.21.15.183:6805/3208966770","state":["exists","up"]},{"osd":3,"uuid":"bdc465f2-06a5-4667-9651-4e168700d674","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6811","nonce":2238128162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6813","nonce":2238128162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6817","nonce":2238128162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":2238128162},{"type":"v1","addr":"172.21.15.103:6815","nonce":2238128162}]},"public_addr":"172.21.15.103:6811/2238128162","cluster_addr":"172.21.15.103:6813/2238128162","heartbeat_back_addr":"172.21.15.103:6817/2238128162","heartbeat_front_addr":"172.21.15.103:6815/2238128162","state":["exists","up"]},{"osd":4,"uuid":"be86a5d2-5e86-4bf4-8464-9dff7a801e4e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6809","nonce":2368878504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6811","nonce":2368878504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6815","nonce":2368878504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":2368878504},{"type":"v1","addr":"172.21.15.117:6813","nonce":2368878504}]},"public_addr":"172.21.15.117:6809/2368878504","cluster_addr":"172.21.15.117:6811/2368878504","heartbeat_back_addr":"172.21.15.117:6815/2368878504","heartbeat_front_addr":"172.21.15.117:6813/2368878504","state":["exists","up"]},{"osd":5,"uuid":"090b20ec-d9ff-4e10-ad9f-52ab41dbf148","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6808","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6809","nonce":1668069547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6810","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6811","nonce":1668069547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6814","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6815","nonce":1668069547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6812","nonce":1668069547},{"type":"v1","addr":"172.21.15.183:6813","nonce":1668069547}]},"public_addr":"172.21.15.183:6809/1668069547","cluster_addr":"172.21.15.183:6811/1668069547","heartbeat_back_addr":"172.21.15.183:6815/1668069547","heartbeat_front_addr":"172.21.15.183:6813/1668069547","state":["exists","up"]},{"osd":6,"uuid":"19abe982-3522-40f9-a628-ddaef462cdb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6819","nonce":4203476972}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6821","nonce":4203476972}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6825","nonce":4203476972}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":4203476972},{"type":"v1","addr":"172.21.15.103:6823","nonce":4203476972}]},"public_addr":"172.21.15.103:6819/4203476972","cluster_addr":"172.21.15.103:6821/4203476972","heartbeat_back_addr":"172.21.15.103:6825/4203476972","heartbeat_front_addr":"172.21.15.103:6823/4203476972","state":["exists","up"]},{"osd":7,"uuid":"e875ff09-805a-40ff-9d6a-dd2607ce3432","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6817","nonce":1207680713}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6819","nonce":1207680713}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6823","nonce":1207680713}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":1207680713},{"type":"v1","addr":"172.21.15.117:6821","nonce":1207680713}]},"public_addr":"172.21.15.117:6817/1207680713","cluster_addr":"172.21.15.117:6819/1207680713","heartbeat_back_addr":"172.21.15.117:6823/1207680713","heartbeat_front_addr":"172.21.15.117:6821/1207680713","state":["exists","up"]},{"osd":8,"uuid":"2bdfc6b0-bac8-42e6-9c1a-7250334b0f2a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6816","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6817","nonce":2935820593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6818","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6819","nonce":2935820593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6822","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6823","nonce":2935820593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6820","nonce":2935820593},{"type":"v1","addr":"172.21.15.183:6821","nonce":2935820593}]},"public_addr":"172.21.15.183:6817/2935820593","cluster_addr":"172.21.15.183:6819/2935820593","heartbeat_back_addr":"172.21.15.183:6823/2935820593","heartbeat_front_addr":"172.21.15.183:6821/2935820593","state":["exists","up"]},{"osd":9,"uuid":"c36d17d2-0bc8-4322-a998-9c8eff970e58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6827","nonce":2104855877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6829","nonce":2104855877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6833","nonce":2104855877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2104855877},{"type":"v1","addr":"172.21.15.103:6831","nonce":2104855877}]},"public_addr":"172.21.15.103:6827/2104855877","cluster_addr":"172.21.15.103:6829/2104855877","heartbeat_back_addr":"172.21.15.103:6833/2104855877","heartbeat_front_addr":"172.21.15.103:6831/2104855877","state":["exists","up"]},{"osd":10,"uuid":"e71bc5f7-a829-43cf-a10b-b2444da1d773","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6825","nonce":3792981873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6827","nonce":3792981873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6831","nonce":3792981873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":3792981873},{"type":"v1","addr":"172.21.15.117:6829","nonce":3792981873}]},"public_addr":"172.21.15.117:6825/3792981873","cluster_addr":"172.21.15.117:6827/3792981873","heartbeat_back_addr":"172.21.15.117:6831/3792981873","heartbeat_front_addr":"172.21.15.117:6829/3792981873","state":["exists","up"]},{"osd":11,"uuid":"8f36697f-4d18-4efa-bf14-d68a13464958","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6824","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6825","nonce":1250387289}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6826","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6827","nonce":1250387289}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6830","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6831","nonce":1250387289}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.183:6828","nonce":1250387289},{"type":"v1","addr":"172.21.15.183:6829","nonce":1250387289}]},"public_addr":"172.21.15.183:6825/1250387289","cluster_addr":"172.21.15.183:6827/1250387289","heartbeat_back_addr":"172.21.15.183:6831/1250387289","heartbeat_front_addr":"172.21.15.183:6829/1250387289","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T00:59:39.916330+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:06.042858+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:30.703648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:00:59.493376+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:25.190299+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:01:50.480326+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:20.815441+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:02:46.398318+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:11.499922+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:03:41.895096+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:08.411538+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T01:04:32.943466+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":4,"to":8}]},{"pgid":"3.13","mappings":[{"from":4,"to":9}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"4.c","mappings":[{"from":9,"to":10}]},{"pgid":"4.14","mappings":[{"from":9,"to":8}]},{"pgid":"4.1b","mappings":[{"from":5,"to":8}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:0/366890372":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6800/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2372812363":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/2844264136":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/2046654364":"2024-09-12T00:57:39.411408+0000","172.21.15.103:6801/115727473":"2024-09-12T00:57:39.411408+0000","172.21.15.103:0/211510947":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6801/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:6800/2110498702":"2024-09-12T00:57:11.412015+0000","172.21.15.103:0/189409602":"2024-09-12T00:57:11.412015+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T01:18:35.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.240+0000 7ff24aa00640 1 -- 172.21.15.103:0/1460299747 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff22c0b5390 msgr2=0x7ff22c0b7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:35.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.240+0000 7ff24aa00640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff22c0b5390 0x7ff22c0b7850 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff2441081c0 tx=0x7ff230005f90 comp rx=0 tx=0).stop 2024-09-11T01:18:35.243 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.240+0000 7ff24aa00640 1 -- 172.21.15.103:0/1460299747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244102c10 msgr2=0x7ff244198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:35.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.240+0000 7ff24aa00640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244102c10 0x7ff244198fd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff23800eb90 tx=0x7ff23800c6a0 comp rx=0 tx=0).stop 2024-09-11T01:18:35.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.241+0000 7ff24aa00640 1 -- 172.21.15.103:0/1460299747 shutdown_connections 2024-09-11T01:18:35.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.241+0000 7ff24aa00640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7ff22c0b5390 0x7ff22c0b7850 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:35.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.241+0000 7ff24aa00640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7ff244108fa0 0x7ff24419e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:35.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.241+0000 7ff24aa00640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff244108620 0x7ff244199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:35.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.241+0000 7ff24aa00640 1 --2- 172.21.15.103:0/1460299747 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff244102c10 0x7ff244198fd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:35.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.241+0000 7ff24aa00640 1 -- 172.21.15.103:0/1460299747 >> 172.21.15.103:0/1460299747 conn(0x7ff2440fe660 msgr2=0x7ff244101b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:35.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.241+0000 7ff24aa00640 1 -- 172.21.15.103:0/1460299747 shutdown_connections 2024-09-11T01:18:35.244 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:35.241+0000 7ff24aa00640 1 -- 172.21.15.103:0/1460299747 wait complete. 2024-09-11T01:18:35.661 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:35 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1460299747' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:18:35.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:35 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1460299747' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:18:35.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:35 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1460299747' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-11T01:18:36.043 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs fail cephfs 2024-09-11T01:18:36.411 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:18:36.741 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:36 smithi103 ceph-mon[30562]: pgmap v708: 129 pgs: 129 active+clean; 52 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T01:18:36.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:36 smithi117 ceph-mon[35358]: pgmap v708: 129 pgs: 129 active+clean; 52 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T01:18:36.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:36 smithi183 ceph-mon[34992]: pgmap v708: 129 pgs: 129 active+clean; 52 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 7 op/s 2024-09-11T01:18:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.001+0000 7f95dd400640 1 -- 172.21.15.103:0/314689816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95d8102dc0 msgr2=0x7f95d81031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.001+0000 7f95dd400640 1 --2- 172.21.15.103:0/314689816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95d8102dc0 0x7f95d81031a0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f95c8009ca0 tx=0x7f95c802a8c0 comp rx=0 tx=0).stop 2024-09-11T01:18:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.001+0000 7f95dd400640 1 -- 172.21.15.103:0/314689816 shutdown_connections 2024-09-11T01:18:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.001+0000 7f95dd400640 1 --2- 172.21.15.103:0/314689816 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d8109150 0x7f95d810f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.002+0000 7f95dd400640 1 --2- 172.21.15.103:0/314689816 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d81087d0 0x7f95d8108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.002+0000 7f95dd400640 1 --2- 172.21.15.103:0/314689816 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95d8102dc0 0x7f95d81031a0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:37.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.002+0000 7f95dd400640 1 -- 172.21.15.103:0/314689816 >> 172.21.15.103:0/314689816 conn(0x7f95d80fe830 msgr2=0x7f95d8100c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.002+0000 7f95dd400640 1 -- 172.21.15.103:0/314689816 shutdown_connections 2024-09-11T01:18:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.002+0000 7f95dd400640 1 -- 172.21.15.103:0/314689816 wait complete. 2024-09-11T01:18:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.003+0000 7f95dd400640 1 Processor -- start 2024-09-11T01:18:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.003+0000 7f95dd400640 1 -- start start 2024-09-11T01:18:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.003+0000 7f95dd400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95d8102dc0 0x7f95d819b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.003+0000 7f95dd400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d81087d0 0x7f95d819b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.003+0000 7f95dd400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d8109150 0x7f95d81a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.003+0000 7f95dd400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f95d8112e10 con 0x7f95d8102dc0 2024-09-11T01:18:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.003+0000 7f95dd400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f95d8112c90 con 0x7f95d81087d0 2024-09-11T01:18:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.003+0000 7f95dd400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f95d8112f90 con 0x7f95d8109150 2024-09-11T01:18:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.003+0000 7f95d6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95d8102dc0 0x7f95d819b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.004+0000 7f95d5e00640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d81087d0 0x7f95d819b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.004+0000 7f95d6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95d8102dc0 0x7f95d819b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55804/0 (socket says 172.21.15.103:55804) 2024-09-11T01:18:37.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.004+0000 7f95d6800640 1 -- 172.21.15.103:0/3965391640 learned_addr learned my addr 172.21.15.103:0/3965391640 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.004+0000 7f95d7200640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d8109150 0x7f95d81a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.004+0000 7f95d5e00640 1 -- 172.21.15.103:0/3965391640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d8109150 msgr2=0x7f95d81a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.004+0000 7f95d5e00640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d8109150 0x7f95d81a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.004+0000 7f95d5e00640 1 -- 172.21.15.103:0/3965391640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95d8102dc0 msgr2=0x7f95d819b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.004+0000 7f95d5e00640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95d8102dc0 0x7f95d819b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.004+0000 7f95d5e00640 1 -- 172.21.15.103:0/3965391640 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d81a1560 con 0x7f95d81087d0 2024-09-11T01:18:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.004+0000 7f95d7200640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d8109150 0x7f95d81a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:18:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.004+0000 7f95d6800640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95d8102dc0 0x7f95d819b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:18:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.004+0000 7f95d5e00640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d81087d0 0x7f95d819b9f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f95c4005fd0 tx=0x7f95c400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.005+0000 7f95cf400640 1 -- 172.21.15.103:0/3965391640 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4009c30 con 0x7f95d81087d0 2024-09-11T01:18:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.005+0000 7f95cf400640 1 -- 172.21.15.103:0/3965391640 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95c4009dd0 con 0x7f95d81087d0 2024-09-11T01:18:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.005+0000 7f95dd400640 1 -- 172.21.15.103:0/3965391640 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d81a1850 con 0x7f95d81087d0 2024-09-11T01:18:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.005+0000 7f95cf400640 1 -- 172.21.15.103:0/3965391640 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4003e20 con 0x7f95d81087d0 2024-09-11T01:18:37.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.005+0000 7f95dd400640 1 -- 172.21.15.103:0/3965391640 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d81a7f10 con 0x7f95d81087d0 2024-09-11T01:18:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.006+0000 7f95dd400640 1 -- 172.21.15.103:0/3965391640 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95d81031a0 con 0x7f95d81087d0 2024-09-11T01:18:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.009+0000 7f95cf400640 1 -- 172.21.15.103:0/3965391640 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f95c4003fe0 con 0x7f95d81087d0 2024-09-11T01:18:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.010+0000 7f95cf400640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f95bc0b52e0 0x7f95bc0b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.011+0000 7f95cf400640 1 -- 172.21.15.103:0/3965391640 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9179+0+0 (secure 0 0 0) 0x7f95c40e5b00 con 0x7f95d81087d0 2024-09-11T01:18:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.011+0000 7f95d6800640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f95bc0b52e0 0x7f95bc0b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.011+0000 7f95cf400640 1 -- 172.21.15.103:0/3965391640 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f95c4017020 con 0x7f95d81087d0 2024-09-11T01:18:37.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.011+0000 7f95d6800640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f95bc0b52e0 0x7f95bc0b77a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f95c8033040 tx=0x7f95c8032eb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:37.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.234+0000 7f95dd400640 1 -- 172.21.15.103:0/3965391640 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f95d819c5e0 con 0x7f95d81087d0 2024-09-11T01:18:37.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.247+0000 7f95cf400640 1 -- 172.21.15.103:0/3965391640 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v34) ==== 161+0+0 (secure 0 0 0) 0x7f95d819c5e0 con 0x7f95d81087d0 2024-09-11T01:18:37.249 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-11T01:18:37.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.249+0000 7f95dd400640 1 -- 172.21.15.103:0/3965391640 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f95bc0b52e0 msgr2=0x7f95bc0b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:37.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.249+0000 7f95dd400640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f95bc0b52e0 0x7f95bc0b77a0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f95c8033040 tx=0x7f95c8032eb0 comp rx=0 tx=0).stop 2024-09-11T01:18:37.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.249+0000 7f95dd400640 1 -- 172.21.15.103:0/3965391640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d81087d0 msgr2=0x7f95d819b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:37.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.249+0000 7f95dd400640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d81087d0 0x7f95d819b9f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f95c4005fd0 tx=0x7f95c400dde0 comp rx=0 tx=0).stop 2024-09-11T01:18:37.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.249+0000 7f95dd400640 1 -- 172.21.15.103:0/3965391640 shutdown_connections 2024-09-11T01:18:37.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.249+0000 7f95dd400640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f95bc0b52e0 0x7f95bc0b77a0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:37.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.249+0000 7f95dd400640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f95d8109150 0x7f95d81a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:37.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.249+0000 7f95dd400640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95d81087d0 0x7f95d819b9f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:37.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.249+0000 7f95dd400640 1 --2- 172.21.15.103:0/3965391640 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f95d8102dc0 0x7f95d819b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:37.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.249+0000 7f95dd400640 1 -- 172.21.15.103:0/3965391640 >> 172.21.15.103:0/3965391640 conn(0x7f95d80fe830 msgr2=0x7f95d80fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:37.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.249+0000 7f95dd400640 1 -- 172.21.15.103:0/3965391640 shutdown_connections 2024-09-11T01:18:37.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:37.249+0000 7f95dd400640 1 -- 172.21.15.103:0/3965391640 wait complete. 2024-09-11T01:18:37.265 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:37 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a[30558]: 2024-09-11T01:18:37.236+0000 7f18faa00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T01:18:37.323 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-i[65599]: ignoring --setuser ceph since I am not root 2024-09-11T01:18:37.323 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-i[65599]: ignoring --setgroup ceph since I am not root 2024-09-11T01:18:37.323 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-mds[65603]: -- 172.21.15.183:0/3729763408 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ed22a27860 con 0x55ed22a05000 2024-09-11T01:18:37.324 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-c[65299]: ignoring --setuser ceph since I am not root 2024-09-11T01:18:37.324 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-c[65299]: ignoring --setgroup ceph since I am not root 2024-09-11T01:18:37.324 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-mds[65303]: -- 172.21.15.183:0/3535321133 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561631f9f860 con 0x561631f7c800 2024-09-11T01:18:37.324 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-c[65299]: starting mds.c at 2024-09-11T01:18:37.324 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-f[64997]: ignoring --setuser ceph since I am not root 2024-09-11T01:18:37.324 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-f[64997]: ignoring --setgroup ceph since I am not root 2024-09-11T01:18:37.324 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-mds[65001]: -- 172.21.15.183:0/2608964159 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e12db0d860 con 0x55e12daeb400 2024-09-11T01:18:37.324 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-f[64997]: starting mds.f at 2024-09-11T01:18:37.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:37 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/3965391640' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T01:18:37.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:37 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T01:18:37.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:37 smithi103 ceph-mon[30562]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T01:18:37.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:37 smithi103 ceph-mon[30562]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T01:18:37.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:37 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T01:18:37.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:37 smithi103 ceph-mon[30562]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T01:18:37.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:37 smithi103 ceph-mon[30562]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T01:18:37.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/3965391640' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T01:18:37.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T01:18:37.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-mon[35358]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T01:18:37.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-mon[35358]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T01:18:37.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T01:18:37.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-mon[35358]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T01:18:37.623 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-mon[35358]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T01:18:37.623 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-e[64394]: ignoring --setuser ceph since I am not root 2024-09-11T01:18:37.624 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-e[64394]: ignoring --setgroup ceph since I am not root 2024-09-11T01:18:37.624 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-mds[64398]: -- 172.21.15.117:0/275638623 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5617e4ac5860 con 0x5617e4aa3400 2024-09-11T01:18:37.624 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-e[64394]: starting mds.e at 2024-09-11T01:18:37.624 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-h[64697]: ignoring --setuser ceph since I am not root 2024-09-11T01:18:37.624 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-h[64697]: ignoring --setgroup ceph since I am not root 2024-09-11T01:18:37.624 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-mds[64701]: -- 172.21.15.117:0/1218694852 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557d1e12d860 con 0x557d1e10a800 2024-09-11T01:18:37.624 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-h[64697]: starting mds.h at 2024-09-11T01:18:37.624 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-b[65005]: ignoring --setuser ceph since I am not root 2024-09-11T01:18:37.624 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-b[65005]: ignoring --setgroup ceph since I am not root 2024-09-11T01:18:37.625 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-mds[65009]: -- 172.21.15.117:0/2768007627 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x55b29f0aeea0 con 0x55b29f083000 2024-09-11T01:18:37.625 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-mds[65009]: -- 172.21.15.117:0/2768007627 <== mon.2 v2:172.21.15.117:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b29f0a5860 con 0x55b29f083000 2024-09-11T01:18:37.625 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:18:37 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-b[65005]: starting mds.b at 2024-09-11T01:18:37.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/3965391640' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T01:18:37.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-11T01:18:37.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-mon[34992]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-11T01:18:37.668 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-mon[34992]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-11T01:18:37.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-11T01:18:37.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-mon[34992]: osdmap e90: 12 total, 12 up, 12 in 2024-09-11T01:18:37.669 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-mon[34992]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-11T01:18:37.669 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-i[65599]: starting mds.i at 2024-09-11T01:18:37.669 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:18:37 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-i[65599]: 2024-09-11T01:18:37.318+0000 7f83151fa640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-11T01:18:38.022 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-11T01:18:38.395 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:18:38.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:38 smithi103 ceph-mon[30562]: pgmap v710: 129 pgs: 129 active+clean; 52 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-11T01:18:38.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:38 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.117:6834/1639139234,v1:172.21.15.117:6837/1639139234] up:boot 2024-09-11T01:18:38.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:38 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.117:6836/3898161865,v1:172.21.15.117:6839/3898161865] up:boot 2024-09-11T01:18:38.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:38 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.117:6835/1700114906,v1:172.21.15.117:6838/1700114906] up:boot 2024-09-11T01:18:38.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:38 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.183:6834/3117537182,v1:172.21.15.183:6837/3117537182] up:boot 2024-09-11T01:18:38.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:38 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.183:6836/599159401,v1:172.21.15.183:6838/599159401] up:boot 2024-09-11T01:18:38.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:38 smithi103 ceph-mon[30562]: mds.? [v2:172.21.15.183:6835/1957745578,v1:172.21.15.183:6839/1957745578] up:boot 2024-09-11T01:18:38.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:38 smithi103 ceph-mon[30562]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T01:18:38.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T01:18:38.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T01:18:38.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T01:18:38.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T01:18:38.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T01:18:38.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:38 smithi103 ceph-mon[30562]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T01:18:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:38 smithi117 ceph-mon[35358]: pgmap v710: 129 pgs: 129 active+clean; 52 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-11T01:18:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:38 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.117:6834/1639139234,v1:172.21.15.117:6837/1639139234] up:boot 2024-09-11T01:18:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:38 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.117:6836/3898161865,v1:172.21.15.117:6839/3898161865] up:boot 2024-09-11T01:18:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:38 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.117:6835/1700114906,v1:172.21.15.117:6838/1700114906] up:boot 2024-09-11T01:18:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:38 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.183:6834/3117537182,v1:172.21.15.183:6837/3117537182] up:boot 2024-09-11T01:18:38.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:38 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.183:6836/599159401,v1:172.21.15.183:6838/599159401] up:boot 2024-09-11T01:18:38.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:38 smithi117 ceph-mon[35358]: mds.? [v2:172.21.15.183:6835/1957745578,v1:172.21.15.183:6839/1957745578] up:boot 2024-09-11T01:18:38.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:38 smithi117 ceph-mon[35358]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T01:18:38.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T01:18:38.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T01:18:38.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T01:18:38.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T01:18:38.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T01:18:38.874 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:38 smithi117 ceph-mon[35358]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T01:18:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:38 smithi183 ceph-mon[34992]: pgmap v710: 129 pgs: 129 active+clean; 52 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-11T01:18:38.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:38 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.117:6834/1639139234,v1:172.21.15.117:6837/1639139234] up:boot 2024-09-11T01:18:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:38 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.117:6836/3898161865,v1:172.21.15.117:6839/3898161865] up:boot 2024-09-11T01:18:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:38 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.117:6835/1700114906,v1:172.21.15.117:6838/1700114906] up:boot 2024-09-11T01:18:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:38 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.183:6834/3117537182,v1:172.21.15.183:6837/3117537182] up:boot 2024-09-11T01:18:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:38 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.183:6836/599159401,v1:172.21.15.183:6838/599159401] up:boot 2024-09-11T01:18:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:38 smithi183 ceph-mon[34992]: mds.? [v2:172.21.15.183:6835/1957745578,v1:172.21.15.183:6839/1957745578] up:boot 2024-09-11T01:18:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:38 smithi183 ceph-mon[34992]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-11T01:18:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-11T01:18:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-11T01:18:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-11T01:18:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-11T01:18:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-11T01:18:38.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:38 smithi183 ceph-mon[34992]: from='mgr.14150 172.21.15.103:0/1287483300' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-11T01:18:39.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.046+0000 7fa836400640 1 -- 172.21.15.103:0/2750575175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa830075e00 msgr2=0x7fa83010ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:39.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.046+0000 7fa836400640 1 --2- 172.21.15.103:0/2750575175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa830075e00 0x7fa83010ee50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa818009900 tx=0x7fa81802a3f0 comp rx=0 tx=0).stop 2024-09-11T01:18:39.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.046+0000 7fa836400640 1 -- 172.21.15.103:0/2750575175 shutdown_connections 2024-09-11T01:18:39.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.046+0000 7fa836400640 1 --2- 172.21.15.103:0/2750575175 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa83010f390 0x7fa830111780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:39.049 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.046+0000 7fa836400640 1 --2- 172.21.15.103:0/2750575175 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa830075e00 0x7fa83010ee50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:39.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.046+0000 7fa836400640 1 --2- 172.21.15.103:0/2750575175 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8300754e0 0x7fa8300758c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:39.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.046+0000 7fa836400640 1 -- 172.21.15.103:0/2750575175 >> 172.21.15.103:0/2750575175 conn(0x7fa8300fe810 msgr2=0x7fa830100c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:39.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.046+0000 7fa836400640 1 -- 172.21.15.103:0/2750575175 shutdown_connections 2024-09-11T01:18:39.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.046+0000 7fa836400640 1 -- 172.21.15.103:0/2750575175 wait complete. 2024-09-11T01:18:39.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.047+0000 7fa836400640 1 Processor -- start 2024-09-11T01:18:39.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.047+0000 7fa836400640 1 -- start start 2024-09-11T01:18:39.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa836400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8300754e0 0x7fa83019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:39.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa836400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa830075e00 0x7fa83019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:39.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa836400640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa83010f390 0x7fa8301a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:39.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa836400640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa830114fa0 con 0x7fa830075e00 2024-09-11T01:18:39.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa836400640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7fa830114e20 con 0x7fa8300754e0 2024-09-11T01:18:39.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa836400640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7fa830115120 con 0x7fa83010f390 2024-09-11T01:18:39.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa82f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8300754e0 0x7fa83019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa82f400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8300754e0 0x7fa83019b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.103:52966/0 (socket says 172.21.15.103:52966) 2024-09-11T01:18:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa82f400640 1 -- 172.21.15.103:0/2606421147 learned_addr learned my addr 172.21.15.103:0/2606421147 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa827e00640 1 --2- 172.21.15.103:0/2606421147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa830075e00 0x7fa83019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa82fe00640 1 --2- 172.21.15.103:0/2606421147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa83010f390 0x7fa8301a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa82f400640 1 -- 172.21.15.103:0/2606421147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa83010f390 msgr2=0x7fa8301a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa82f400640 1 --2- 172.21.15.103:0/2606421147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa83010f390 0x7fa8301a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa82f400640 1 -- 172.21.15.103:0/2606421147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa830075e00 msgr2=0x7fa83019b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa82f400640 1 --2- 172.21.15.103:0/2606421147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa830075e00 0x7fa83019b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:39.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.048+0000 7fa82f400640 1 -- 172.21.15.103:0/2606421147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8301a1560 con 0x7fa8300754e0 2024-09-11T01:18:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.049+0000 7fa82f400640 1 --2- 172.21.15.103:0/2606421147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8300754e0 0x7fa83019b4b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa82000d950 tx=0x7fa82000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.049+0000 7fa82cc00640 1 -- 172.21.15.103:0/2606421147 <== mon.2 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa820017070 con 0x7fa8300754e0 2024-09-11T01:18:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.049+0000 7fa836400640 1 -- 172.21.15.103:0/2606421147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8301a1850 con 0x7fa8300754e0 2024-09-11T01:18:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.049+0000 7fa82cc00640 1 -- 172.21.15.103:0/2606421147 <== mon.2 v2:172.21.15.117:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa820009c30 con 0x7fa8300754e0 2024-09-11T01:18:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.049+0000 7fa82cc00640 1 -- 172.21.15.103:0/2606421147 <== mon.2 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82000f620 con 0x7fa8300754e0 2024-09-11T01:18:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.049+0000 7fa836400640 1 -- 172.21.15.103:0/2606421147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8301a80e0 con 0x7fa8300754e0 2024-09-11T01:18:39.053 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.050+0000 7fa836400640 1 -- 172.21.15.103:0/2606421147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8300769f0 con 0x7fa8300754e0 2024-09-11T01:18:39.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.052+0000 7fa82cc00640 1 -- 172.21.15.103:0/2606421147 <== mon.2 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7fa820005030 con 0x7fa8300754e0 2024-09-11T01:18:39.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.054+0000 7fa82cc00640 1 --2- 172.21.15.103:0/2606421147 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa8140b5360 0x7fa8140b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:39.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.054+0000 7fa82cc00640 1 -- 172.21.15.103:0/2606421147 <== mon.2 v2:172.21.15.117:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9437+0+0 (secure 0 0 0) 0x7fa8200e5bd0 con 0x7fa8300754e0 2024-09-11T01:18:39.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.054+0000 7fa827e00640 1 --2- 172.21.15.103:0/2606421147 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa8140b5360 0x7fa8140b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:39.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.055+0000 7fa827e00640 1 --2- 172.21.15.103:0/2606421147 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa8140b5360 0x7fa8140b7820 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa818005ab0 tx=0x7fa818005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:39.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.055+0000 7fa82cc00640 1 -- 172.21.15.103:0/2606421147 <== mon.2 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7fa820009de0 con 0x7fa8300754e0 2024-09-11T01:18:39.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.278+0000 7fa836400640 1 -- 172.21.15.103:0/2606421147 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa8301a8340 con 0x7fa8300754e0 2024-09-11T01:18:39.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.489+0000 7fa82cc00640 1 -- 172.21.15.103:0/2606421147 <== mon.2 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) ==== 104+0+0 (secure 0 0 0) 0x7fa8200abfb0 con 0x7fa8300754e0 2024-09-11T01:18:39.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.491+0000 7fa836400640 1 -- 172.21.15.103:0/2606421147 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa8140b5360 msgr2=0x7fa8140b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:39.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.491+0000 7fa836400640 1 --2- 172.21.15.103:0/2606421147 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa8140b5360 0x7fa8140b7820 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa818005ab0 tx=0x7fa818005a20 comp rx=0 tx=0).stop 2024-09-11T01:18:39.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.491+0000 7fa836400640 1 -- 172.21.15.103:0/2606421147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8300754e0 msgr2=0x7fa83019b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:39.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.491+0000 7fa836400640 1 --2- 172.21.15.103:0/2606421147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8300754e0 0x7fa83019b4b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa82000d950 tx=0x7fa82000de10 comp rx=0 tx=0).stop 2024-09-11T01:18:39.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.491+0000 7fa836400640 1 -- 172.21.15.103:0/2606421147 shutdown_connections 2024-09-11T01:18:39.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.491+0000 7fa836400640 1 --2- 172.21.15.103:0/2606421147 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7fa8140b5360 0x7fa8140b7820 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:39.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.491+0000 7fa836400640 1 --2- 172.21.15.103:0/2606421147 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7fa83010f390 0x7fa8301a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:39.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.491+0000 7fa836400640 1 --2- 172.21.15.103:0/2606421147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa830075e00 0x7fa83019b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:39.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.491+0000 7fa836400640 1 --2- 172.21.15.103:0/2606421147 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa8300754e0 0x7fa83019b4b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:39.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.491+0000 7fa836400640 1 -- 172.21.15.103:0/2606421147 >> 172.21.15.103:0/2606421147 conn(0x7fa8300fe810 msgr2=0x7fa830111550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:39.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.491+0000 7fa836400640 1 -- 172.21.15.103:0/2606421147 shutdown_connections 2024-09-11T01:18:39.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:39.491+0000 7fa836400640 1 -- 172.21.15.103:0/2606421147 wait complete. 2024-09-11T01:18:39.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:39 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2606421147' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T01:18:39.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:39 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T01:18:39.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:39 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2606421147' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T01:18:39.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:39 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T01:18:39.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:39 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2606421147' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T01:18:39.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:39 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-11T01:18:40.248 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-11T01:18:40.623 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:18:40.762 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:40 smithi103 ceph-mon[30562]: pgmap v711: 129 pgs: 129 active+clean; 52 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-11T01:18:40.762 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:40 smithi103 ceph-mon[30562]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T01:18:40.762 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:40 smithi103 ceph-mon[30562]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T01:18:40.762 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:40 smithi103 ceph-mon[30562]: Cluster is now healthy 2024-09-11T01:18:40.762 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:40 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T01:18:40.762 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:40 smithi103 ceph-mon[30562]: fsmap 12 up:standby 2024-09-11T01:18:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:40 smithi117 ceph-mon[35358]: pgmap v711: 129 pgs: 129 active+clean; 52 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-11T01:18:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:40 smithi117 ceph-mon[35358]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T01:18:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:40 smithi117 ceph-mon[35358]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T01:18:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:40 smithi117 ceph-mon[35358]: Cluster is now healthy 2024-09-11T01:18:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:40 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T01:18:40.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:40 smithi117 ceph-mon[35358]: fsmap 12 up:standby 2024-09-11T01:18:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:40 smithi183 ceph-mon[34992]: pgmap v711: 129 pgs: 129 active+clean; 52 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 818 B/s wr, 7 op/s 2024-09-11T01:18:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:40 smithi183 ceph-mon[34992]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-11T01:18:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:40 smithi183 ceph-mon[34992]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-11T01:18:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:40 smithi183 ceph-mon[34992]: Cluster is now healthy 2024-09-11T01:18:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:40 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-11T01:18:40.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:40 smithi183 ceph-mon[34992]: fsmap 12 up:standby 2024-09-11T01:18:41.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.215+0000 7f8bf9000640 1 -- 172.21.15.103:0/2062697178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf40776d0 msgr2=0x7f8bf4077ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:41.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.215+0000 7f8bf9000640 1 --2- 172.21.15.103:0/2062697178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf40776d0 0x7f8bf4077ab0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009ca0 tx=0x7f8be402a8c0 comp rx=0 tx=0).stop 2024-09-11T01:18:41.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.216+0000 7f8bf9000640 1 -- 172.21.15.103:0/2062697178 shutdown_connections 2024-09-11T01:18:41.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.216+0000 7f8bf9000640 1 --2- 172.21.15.103:0/2062697178 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bf41137e0 0x7f8bf4115bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:41.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.216+0000 7f8bf9000640 1 --2- 172.21.15.103:0/2062697178 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bf4077ff0 0x7f8bf41132a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:41.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.216+0000 7f8bf9000640 1 --2- 172.21.15.103:0/2062697178 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf40776d0 0x7f8bf4077ab0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:41.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.216+0000 7f8bf9000640 1 -- 172.21.15.103:0/2062697178 >> 172.21.15.103:0/2062697178 conn(0x7f8bf4100840 msgr2=0x7f8bf4102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:41.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.216+0000 7f8bf9000640 1 -- 172.21.15.103:0/2062697178 shutdown_connections 2024-09-11T01:18:41.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.216+0000 7f8bf9000640 1 -- 172.21.15.103:0/2062697178 wait complete. 2024-09-11T01:18:41.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.217+0000 7f8bf9000640 1 Processor -- start 2024-09-11T01:18:41.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.217+0000 7f8bf9000640 1 -- start start 2024-09-11T01:18:41.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.217+0000 7f8bf9000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bf40776d0 0x7f8bf419f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:41.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.217+0000 7f8bf9000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf4077ff0 0x7f8bf419fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:41.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.217+0000 7f8bf9000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bf41137e0 0x7f8bf41a4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:41.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.217+0000 7f8bf9000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf41191e0 con 0x7f8bf4077ff0 2024-09-11T01:18:41.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.217+0000 7f8bf9000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf4119060 con 0x7f8bf40776d0 2024-09-11T01:18:41.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.217+0000 7f8bf9000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf4119360 con 0x7f8bf41137e0 2024-09-11T01:18:41.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.217+0000 7f8beaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf4077ff0 0x7f8bf419fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:41.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.218+0000 7f8beaa00640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf4077ff0 0x7f8bf419fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55766/0 (socket says 172.21.15.103:55766) 2024-09-11T01:18:41.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.218+0000 7f8beaa00640 1 -- 172.21.15.103:0/658919819 learned_addr learned my addr 172.21.15.103:0/658919819 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:41.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.217+0000 7f8bf3400640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bf40776d0 0x7f8bf419f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:41.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.218+0000 7f8bf3e00640 1 --2- 172.21.15.103:0/658919819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bf41137e0 0x7f8bf41a4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:41.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.218+0000 7f8beaa00640 1 -- 172.21.15.103:0/658919819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bf41137e0 msgr2=0x7f8bf41a4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:41.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.218+0000 7f8beaa00640 1 --2- 172.21.15.103:0/658919819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bf41137e0 0x7f8bf41a4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:41.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.218+0000 7f8beaa00640 1 -- 172.21.15.103:0/658919819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bf40776d0 msgr2=0x7f8bf419f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:41.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.218+0000 7f8beaa00640 1 --2- 172.21.15.103:0/658919819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bf40776d0 0x7f8bf419f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:41.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.218+0000 7f8beaa00640 1 -- 172.21.15.103:0/658919819 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf41a56a0 con 0x7f8bf4077ff0 2024-09-11T01:18:41.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.218+0000 7f8bf3400640 1 --2- 172.21.15.103:0/658919819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bf40776d0 0x7f8bf419f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:18:41.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.218+0000 7f8beaa00640 1 --2- 172.21.15.103:0/658919819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf4077ff0 0x7f8bf419fb30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00e9f0 tx=0x7f8bdc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:41.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.219+0000 7f8bf0c00640 1 -- 172.21.15.103:0/658919819 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc00cd80 con 0x7f8bf4077ff0 2024-09-11T01:18:41.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.219+0000 7f8bf0c00640 1 -- 172.21.15.103:0/658919819 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8bdc0108e0 con 0x7f8bf4077ff0 2024-09-11T01:18:41.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.219+0000 7f8bf9000640 1 -- 172.21.15.103:0/658919819 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf41a5990 con 0x7f8bf4077ff0 2024-09-11T01:18:41.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.219+0000 7f8bf0c00640 1 -- 172.21.15.103:0/658919819 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc018980 con 0x7f8bf4077ff0 2024-09-11T01:18:41.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.219+0000 7f8bf9000640 1 -- 172.21.15.103:0/658919819 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf41ac220 con 0x7f8bf4077ff0 2024-09-11T01:18:41.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.220+0000 7f8bf9000640 1 -- 172.21.15.103:0/658919819 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf4078be0 con 0x7f8bf4077ff0 2024-09-11T01:18:41.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.222+0000 7f8bf0c00640 1 -- 172.21.15.103:0/658919819 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f8bdc010430 con 0x7f8bf4077ff0 2024-09-11T01:18:41.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.224+0000 7f8bf0c00640 1 --2- 172.21.15.103:0/658919819 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8bd80b5410 0x7f8bd80b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:41.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.224+0000 7f8bf0c00640 1 -- 172.21.15.103:0/658919819 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9437+0+0 (secure 0 0 0) 0x7f8bdc0e6830 con 0x7f8bf4077ff0 2024-09-11T01:18:41.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.225+0000 7f8bf3400640 1 --2- 172.21.15.103:0/658919819 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8bd80b5410 0x7f8bd80b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:41.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.225+0000 7f8bf3400640 1 --2- 172.21.15.103:0/658919819 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8bd80b5410 0x7f8bd80b78d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009430 tx=0x7f8be4009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:41.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.225+0000 7f8bf0c00640 1 -- 172.21.15.103:0/658919819 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f8bdc0acb90 con 0x7f8bf4077ff0 2024-09-11T01:18:41.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.410+0000 7f8bf9000640 1 -- 172.21.15.103:0/658919819 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8bf4077ab0 con 0x7f8bf4077ff0 2024-09-11T01:18:41.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.489+0000 7f8bf0c00640 1 -- 172.21.15.103:0/658919819 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) ==== 181+0+0 (secure 0 0 0) 0x7f8bf4077ab0 con 0x7f8bf4077ff0 2024-09-11T01:18:41.492 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2024-09-11T01:18:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.493+0000 7f8bf9000640 1 -- 172.21.15.103:0/658919819 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8bd80b5410 msgr2=0x7f8bd80b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:41.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.493+0000 7f8bf9000640 1 --2- 172.21.15.103:0/658919819 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8bd80b5410 0x7f8bd80b78d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009430 tx=0x7f8be4009360 comp rx=0 tx=0).stop 2024-09-11T01:18:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.493+0000 7f8bf9000640 1 -- 172.21.15.103:0/658919819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf4077ff0 msgr2=0x7f8bf419fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:41.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.493+0000 7f8bf9000640 1 --2- 172.21.15.103:0/658919819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf4077ff0 0x7f8bf419fb30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00e9f0 tx=0x7f8bdc00eeb0 comp rx=0 tx=0).stop 2024-09-11T01:18:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.494+0000 7f8bf9000640 1 -- 172.21.15.103:0/658919819 shutdown_connections 2024-09-11T01:18:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.494+0000 7f8bf9000640 1 --2- 172.21.15.103:0/658919819 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f8bd80b5410 0x7f8bd80b78d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.494+0000 7f8bf9000640 1 --2- 172.21.15.103:0/658919819 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f8bf41137e0 0x7f8bf41a4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.494+0000 7f8bf9000640 1 --2- 172.21.15.103:0/658919819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8bf4077ff0 0x7f8bf419fb30 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.494+0000 7f8bf9000640 1 --2- 172.21.15.103:0/658919819 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8bf40776d0 0x7f8bf419f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.494+0000 7f8bf9000640 1 -- 172.21.15.103:0/658919819 >> 172.21.15.103:0/658919819 conn(0x7f8bf4100840 msgr2=0x7f8bf4102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.494+0000 7f8bf9000640 1 -- 172.21.15.103:0/658919819 shutdown_connections 2024-09-11T01:18:41.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:41.494+0000 7f8bf9000640 1 -- 172.21.15.103:0/658919819 wait complete. 2024-09-11T01:18:41.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:41 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/658919819' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T01:18:41.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:41 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/658919819' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T01:18:41.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:41 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/658919819' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T01:18:42.331 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-11T01:18:42.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:42 smithi103 ceph-mon[30562]: pgmap v712: 129 pgs: 129 active+clean; 52 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 307 B/s wr, 5 op/s 2024-09-11T01:18:42.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:42 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/658919819' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T01:18:42.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:42 smithi103 ceph-mon[30562]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T01:18:42.705 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:18:42.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:42 smithi117 ceph-mon[35358]: pgmap v712: 129 pgs: 129 active+clean; 52 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 307 B/s wr, 5 op/s 2024-09-11T01:18:42.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:42 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/658919819' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T01:18:42.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:42 smithi117 ceph-mon[35358]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T01:18:42.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:42 smithi183 ceph-mon[34992]: pgmap v712: 129 pgs: 129 active+clean; 52 MiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 307 B/s wr, 5 op/s 2024-09-11T01:18:42.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:42 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/658919819' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T01:18:42.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:42 smithi183 ceph-mon[34992]: osdmap e91: 12 total, 12 up, 12 in 2024-09-11T01:18:43.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.291+0000 7f9fd8800640 1 -- 172.21.15.103:0/1431152166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd0104fb0 msgr2=0x7f9fd0105390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:43.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.291+0000 7f9fd8800640 1 --2- 172.21.15.103:0/1431152166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd0104fb0 0x7f9fd0105390 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4009900 tx=0x7f9fc402a3f0 comp rx=0 tx=0).stop 2024-09-11T01:18:43.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.291+0000 7f9fd8800640 1 -- 172.21.15.103:0/1431152166 shutdown_connections 2024-09-11T01:18:43.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.291+0000 7f9fd8800640 1 --2- 172.21.15.103:0/1431152166 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fd010b340 0x7f9fd0111b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:43.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.291+0000 7f9fd8800640 1 --2- 172.21.15.103:0/1431152166 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fd010a9c0 0x7f9fd010ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:43.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.291+0000 7f9fd8800640 1 --2- 172.21.15.103:0/1431152166 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd0104fb0 0x7f9fd0105390 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:43.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.291+0000 7f9fd8800640 1 -- 172.21.15.103:0/1431152166 >> 172.21.15.103:0/1431152166 conn(0x7f9fd0100a20 msgr2=0x7f9fd0102e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:43.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.291+0000 7f9fd8800640 1 -- 172.21.15.103:0/1431152166 shutdown_connections 2024-09-11T01:18:43.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.291+0000 7f9fd8800640 1 -- 172.21.15.103:0/1431152166 wait complete. 2024-09-11T01:18:43.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.292+0000 7f9fd8800640 1 Processor -- start 2024-09-11T01:18:43.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.292+0000 7f9fd8800640 1 -- start start 2024-09-11T01:18:43.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.293+0000 7f9fd8800640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fd0104fb0 0x7f9fd019b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:43.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.293+0000 7f9fd8800640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fd010a9c0 0x7f9fd019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:43.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.293+0000 7f9fd8800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd010b340 0x7f9fd01a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:43.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.293+0000 7f9fd8800640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0114fc0 con 0x7f9fd010b340 2024-09-11T01:18:43.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.293+0000 7f9fd8800640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0114e40 con 0x7f9fd0104fb0 2024-09-11T01:18:43.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.293+0000 7f9fd8800640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0115140 con 0x7f9fd010a9c0 2024-09-11T01:18:43.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.293+0000 7f9fd6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd010b340 0x7f9fd01a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:43.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.293+0000 7f9fd6800640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd010b340 0x7f9fd01a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55776/0 (socket says 172.21.15.103:55776) 2024-09-11T01:18:43.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.293+0000 7f9fd6800640 1 -- 172.21.15.103:0/2553124269 learned_addr learned my addr 172.21.15.103:0/2553124269 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:43.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.293+0000 7f9fd5400640 1 --2- 172.21.15.103:0/2553124269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fd010a9c0 0x7f9fd019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:43.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.293+0000 7f9fd5e00640 1 --2- 172.21.15.103:0/2553124269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fd0104fb0 0x7f9fd019b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:43.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.294+0000 7f9fd6800640 1 -- 172.21.15.103:0/2553124269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fd010a9c0 msgr2=0x7f9fd019ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:43.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.294+0000 7f9fd6800640 1 --2- 172.21.15.103:0/2553124269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fd010a9c0 0x7f9fd019ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:43.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.294+0000 7f9fd6800640 1 -- 172.21.15.103:0/2553124269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fd0104fb0 msgr2=0x7f9fd019b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:43.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.294+0000 7f9fd6800640 1 --2- 172.21.15.103:0/2553124269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fd0104fb0 0x7f9fd019b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:43.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.294+0000 7f9fd6800640 1 -- 172.21.15.103:0/2553124269 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd01a15a0 con 0x7f9fd010b340 2024-09-11T01:18:43.324 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.294+0000 7f9fd6800640 1 --2- 172.21.15.103:0/2553124269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd010b340 0x7f9fd01a0dd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00eaa0 tx=0x7f9fcc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:43.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.294+0000 7f9fcaa00640 1 -- 172.21.15.103:0/2553124269 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc00cdb0 con 0x7f9fd010b340 2024-09-11T01:18:43.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.294+0000 7f9fcaa00640 1 -- 172.21.15.103:0/2553124269 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fcc005020 con 0x7f9fd010b340 2024-09-11T01:18:43.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.294+0000 7f9fd8800640 1 -- 172.21.15.103:0/2553124269 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd01a1890 con 0x7f9fd010b340 2024-09-11T01:18:43.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.294+0000 7f9fcaa00640 1 -- 172.21.15.103:0/2553124269 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0116d0 con 0x7f9fd010b340 2024-09-11T01:18:43.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.294+0000 7f9fd8800640 1 -- 172.21.15.103:0/2553124269 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd01a7f50 con 0x7f9fd010b340 2024-09-11T01:18:43.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.295+0000 7f9fd8800640 1 -- 172.21.15.103:0/2553124269 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fd0105390 con 0x7f9fd010b340 2024-09-11T01:18:43.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.297+0000 7f9fcaa00640 1 -- 172.21.15.103:0/2553124269 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f9fcc00f040 con 0x7f9fd010b340 2024-09-11T01:18:43.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.299+0000 7f9fcaa00640 1 --2- 172.21.15.103:0/2553124269 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9fb80b52e0 0x7f9fb80b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:43.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.299+0000 7f9fcaa00640 1 -- 172.21.15.103:0/2553124269 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 8912+0+0 (secure 0 0 0) 0x7f9fcc0e5c30 con 0x7f9fd010b340 2024-09-11T01:18:43.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.299+0000 7f9fd5e00640 1 --2- 172.21.15.103:0/2553124269 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9fb80b52e0 0x7f9fb80b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:43.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.300+0000 7f9fd5e00640 1 --2- 172.21.15.103:0/2553124269 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9fb80b52e0 0x7f9fb80b77a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4005ab0 tx=0x7f9fc4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:43.325 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.303+0000 7f9fcaa00640 1 -- 172.21.15.103:0/2553124269 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f9fcc016030 con 0x7f9fd010b340 2024-09-11T01:18:43.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.488+0000 7f9fd8800640 1 -- 172.21.15.103:0/2553124269 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9fd002e5c0 con 0x7f9fd010b340 2024-09-11T01:18:43.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.502+0000 7f9fcaa00640 1 -- 172.21.15.103:0/2553124269 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) ==== 169+0+0 (secure 0 0 0) 0x7f9fcc0ac1c0 con 0x7f9fd010b340 2024-09-11T01:18:43.505 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2024-09-11T01:18:43.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.505+0000 7f9fd8800640 1 -- 172.21.15.103:0/2553124269 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9fb80b52e0 msgr2=0x7f9fb80b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:43.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.505+0000 7f9fd8800640 1 --2- 172.21.15.103:0/2553124269 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9fb80b52e0 0x7f9fb80b77a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9fc4005ab0 tx=0x7f9fc4005a20 comp rx=0 tx=0).stop 2024-09-11T01:18:43.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.505+0000 7f9fd8800640 1 -- 172.21.15.103:0/2553124269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd010b340 msgr2=0x7f9fd01a0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:43.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.505+0000 7f9fd8800640 1 --2- 172.21.15.103:0/2553124269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd010b340 0x7f9fd01a0dd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc00eaa0 tx=0x7f9fcc00ef60 comp rx=0 tx=0).stop 2024-09-11T01:18:43.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.505+0000 7f9fd8800640 1 -- 172.21.15.103:0/2553124269 shutdown_connections 2024-09-11T01:18:43.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.505+0000 7f9fd8800640 1 --2- 172.21.15.103:0/2553124269 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f9fb80b52e0 0x7f9fb80b77a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:43.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.505+0000 7f9fd8800640 1 --2- 172.21.15.103:0/2553124269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd010b340 0x7f9fd01a0dd0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:43.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.505+0000 7f9fd8800640 1 --2- 172.21.15.103:0/2553124269 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f9fd010a9c0 0x7f9fd019ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:43.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.505+0000 7f9fd8800640 1 --2- 172.21.15.103:0/2553124269 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9fd0104fb0 0x7f9fd019b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:43.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.505+0000 7f9fd8800640 1 -- 172.21.15.103:0/2553124269 >> 172.21.15.103:0/2553124269 conn(0x7f9fd0100a20 msgr2=0x7f9fd0102e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:43.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.505+0000 7f9fd8800640 1 -- 172.21.15.103:0/2553124269 shutdown_connections 2024-09-11T01:18:43.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:43.505+0000 7f9fd8800640 1 -- 172.21.15.103:0/2553124269 wait complete. 2024-09-11T01:18:43.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:43 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2553124269' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T01:18:43.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:43 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2553124269' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T01:18:43.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:43 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2553124269' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T01:18:44.325 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30 shell --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-11T01:18:44.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:44 smithi103 ceph-mon[30562]: pgmap v714: 97 pgs: 97 active+clean; 577 KiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:18:44.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:44 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/2553124269' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T01:18:44.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:44 smithi103 ceph-mon[30562]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T01:18:44.693 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/mon.a/config 2024-09-11T01:18:44.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:44 smithi117 ceph-mon[35358]: pgmap v714: 97 pgs: 97 active+clean; 577 KiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:18:44.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:44 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/2553124269' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T01:18:44.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:44 smithi117 ceph-mon[35358]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T01:18:44.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:44 smithi183 ceph-mon[34992]: pgmap v714: 97 pgs: 97 active+clean; 577 KiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:18:44.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:44 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/2553124269' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T01:18:44.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:44 smithi183 ceph-mon[34992]: osdmap e92: 12 total, 12 up, 12 in 2024-09-11T01:18:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.300+0000 7f28a6000640 1 -- 172.21.15.103:0/1463227562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28a0104fa0 msgr2=0x7f28a0105380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.300+0000 7f28a6000640 1 --2- 172.21.15.103:0/1463227562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28a0104fa0 0x7f28a0105380 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2890009900 tx=0x7f289002a410 comp rx=0 tx=0).stop 2024-09-11T01:18:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.300+0000 7f28a6000640 1 -- 172.21.15.103:0/1463227562 shutdown_connections 2024-09-11T01:18:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.300+0000 7f28a6000640 1 --2- 172.21.15.103:0/1463227562 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28a010b330 0x7f28a0111b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.300+0000 7f28a6000640 1 --2- 172.21.15.103:0/1463227562 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28a010a9b0 0x7f28a010adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:45.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.300+0000 7f28a6000640 1 --2- 172.21.15.103:0/1463227562 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28a0104fa0 0x7f28a0105380 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.300+0000 7f28a6000640 1 -- 172.21.15.103:0/1463227562 >> 172.21.15.103:0/1463227562 conn(0x7f28a0100a50 msgr2=0x7f28a0102e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.300+0000 7f28a6000640 1 -- 172.21.15.103:0/1463227562 shutdown_connections 2024-09-11T01:18:45.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.300+0000 7f28a6000640 1 -- 172.21.15.103:0/1463227562 wait complete. 2024-09-11T01:18:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.301+0000 7f28a6000640 1 Processor -- start 2024-09-11T01:18:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.301+0000 7f28a6000640 1 -- start start 2024-09-11T01:18:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f28a6000640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28a0104fa0 0x7f28a019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f28a6000640 1 --2- >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28a010a9b0 0x7f28a019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f28a6000640 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28a010b330 0x7f28a01a0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f28a6000640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0114f90 con 0x7f28a0104fa0 2024-09-11T01:18:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f28a6000640 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0114e10 con 0x7f28a010b330 2024-09-11T01:18:45.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f28a6000640 1 -- --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_getmap magic: 0 -- 0x7f28a0115110 con 0x7f28a010a9b0 2024-09-11T01:18:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f289f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28a0104fa0 0x7f28a019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f289f400640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28a0104fa0 0x7f28a019b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55792/0 (socket says 172.21.15.103:55792) 2024-09-11T01:18:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f289f400640 1 -- 172.21.15.103:0/1303079701 learned_addr learned my addr 172.21.15.103:0/1303079701 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-09-11T01:18:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f2897e00640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28a010a9b0 0x7f28a019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f289fe00640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28a010b330 0x7f28a01a0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f2897e00640 1 -- 172.21.15.103:0/1303079701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28a010b330 msgr2=0x7f28a01a0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f2897e00640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28a010b330 0x7f28a01a0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f2897e00640 1 -- 172.21.15.103:0/1303079701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28a0104fa0 msgr2=0x7f28a019b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f2897e00640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28a0104fa0 0x7f28a019b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f2897e00640 1 -- 172.21.15.103:0/1303079701 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a01a1560 con 0x7f28a010a9b0 2024-09-11T01:18:45.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.302+0000 7f289f400640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28a0104fa0 0x7f28a019b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-11T01:18:45.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.303+0000 7f2897e00640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28a010a9b0 0x7f28a019b9f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f288800e9f0 tx=0x7f288800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:45.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.303+0000 7f289cc00640 1 -- 172.21.15.103:0/1303079701 <== mon.1 v2:172.21.15.183:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288800ccc0 con 0x7f28a010a9b0 2024-09-11T01:18:45.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.303+0000 7f28a6000640 1 -- 172.21.15.103:0/1303079701 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a01a1850 con 0x7f28a010a9b0 2024-09-11T01:18:45.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.303+0000 7f289cc00640 1 -- 172.21.15.103:0/1303079701 <== mon.1 v2:172.21.15.183:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28880108e0 con 0x7f28a010a9b0 2024-09-11T01:18:45.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.303+0000 7f28a6000640 1 -- 172.21.15.103:0/1303079701 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a01a7f10 con 0x7f28a010a9b0 2024-09-11T01:18:45.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.303+0000 7f289cc00640 1 -- 172.21.15.103:0/1303079701 <== mon.1 v2:172.21.15.183:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2888018750 con 0x7f28a010a9b0 2024-09-11T01:18:45.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.304+0000 7f28a6000640 1 -- 172.21.15.103:0/1303079701 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f287c0052c0 con 0x7f28a010a9b0 2024-09-11T01:18:45.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.307+0000 7f289cc00640 1 -- 172.21.15.103:0/1303079701 <== mon.1 v2:172.21.15.183:3300/0 4 ==== mgrmap(e 20) ==== 153251+0+0 (secure 0 0 0) 0x7f2888010430 con 0x7f28a010a9b0 2024-09-11T01:18:45.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.308+0000 7f289cc00640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f28840b52e0 0x7f28840b77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-11T01:18:45.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.309+0000 7f289cc00640 1 -- 172.21.15.103:0/1303079701 <== mon.1 v2:172.21.15.183:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8324+0+0 (secure 0 0 0) 0x7f28880e5e30 con 0x7f28a010a9b0 2024-09-11T01:18:45.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.309+0000 7f289f400640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f28840b52e0 0x7f28840b77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-11T01:18:45.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.309+0000 7f289f400640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f28840b52e0 0x7f28840b77a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f28900096c0 tx=0x7f2890005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-11T01:18:45.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.310+0000 7f289cc00640 1 -- 172.21.15.103:0/1303079701 <== mon.1 v2:172.21.15.183:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+197130 (secure 0 0 0) 0x7f28880ac5e0 con 0x7f28a010a9b0 2024-09-11T01:18:45.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.494+0000 7f28a6000640 1 -- 172.21.15.103:0/1303079701 --> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f287c0055b0 con 0x7f28a010a9b0 2024-09-11T01:18:45.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.516+0000 7f289cc00640 1 -- 172.21.15.103:0/1303079701 <== mon.1 v2:172.21.15.183:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v93) ==== 178+0+0 (secure 0 0 0) 0x7f28880b1010 con 0x7f28a010a9b0 2024-09-11T01:18:45.519 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data_ec' removed 2024-09-11T01:18:45.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.520+0000 7f28a6000640 1 -- 172.21.15.103:0/1303079701 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f28840b52e0 msgr2=0x7f28840b77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:45.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.520+0000 7f28a6000640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f28840b52e0 0x7f28840b77a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f28900096c0 tx=0x7f2890005a20 comp rx=0 tx=0).stop 2024-09-11T01:18:45.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.520+0000 7f28a6000640 1 -- 172.21.15.103:0/1303079701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28a010a9b0 msgr2=0x7f28a019b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-11T01:18:45.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.520+0000 7f28a6000640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28a010a9b0 0x7f28a019b9f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f288800e9f0 tx=0x7f288800eeb0 comp rx=0 tx=0).stop 2024-09-11T01:18:45.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.520+0000 7f28a6000640 1 -- 172.21.15.103:0/1303079701 shutdown_connections 2024-09-11T01:18:45.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.520+0000 7f28a6000640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.103:6800/3230239737,v1:172.21.15.103:6801/3230239737] conn(0x7f28840b52e0 0x7f28840b77a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:45.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.520+0000 7f28a6000640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28a010b330 0x7f28a01a0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:45.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.520+0000 7f28a6000640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.183:3300/0,v1:172.21.15.183:6789/0] conn(0x7f28a010a9b0 0x7f28a019b9f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:45.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.520+0000 7f28a6000640 1 --2- 172.21.15.103:0/1303079701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f28a0104fa0 0x7f28a019b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-11T01:18:45.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.520+0000 7f28a6000640 1 -- 172.21.15.103:0/1303079701 >> 172.21.15.103:0/1303079701 conn(0x7f28a0100a50 msgr2=0x7f28a01013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-11T01:18:45.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.521+0000 7f28a6000640 1 -- 172.21.15.103:0/1303079701 shutdown_connections 2024-09-11T01:18:45.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-11T01:18:45.521+0000 7f28a6000640 1 -- 172.21.15.103:0/1303079701 wait complete. 2024-09-11T01:18:45.832 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:45 smithi103 ceph-mon[30562]: from='client.? 172.21.15.103:0/1303079701' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T01:18:45.833 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:45 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T01:18:45.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:45 smithi117 ceph-mon[35358]: from='client.? 172.21.15.103:0/1303079701' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T01:18:45.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:45 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T01:18:45.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:45 smithi183 ceph-mon[34992]: from='client.? 172.21.15.103:0/1303079701' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T01:18:45.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:45 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-11T01:18:46.368 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T01:18:46.429 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T01:18:46.474 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T01:18:46.514 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-11T01:18:46.515 DEBUG:teuthology.orchestra.run.smithi103:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T01:18:46.551 DEBUG:teuthology.orchestra.run.smithi117:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T01:18:46.566 DEBUG:teuthology.orchestra.run.smithi183:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-11T01:18:46.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:46 smithi103 ceph-mon[30562]: pgmap v716: 33 pgs: 33 active+clean; 577 KiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:18:46.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:46 smithi103 ceph-mon[30562]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T01:18:46.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:46 smithi103 ceph-mon[30562]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T01:18:46.582 INFO:tasks.cephadm:Stopping all daemons... 2024-09-11T01:18:46.583 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-11T01:18:46.583 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.a 2024-09-11T01:18:46.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:46 smithi117 ceph-mon[35358]: pgmap v716: 33 pgs: 33 active+clean; 577 KiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:18:46.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:46 smithi117 ceph-mon[35358]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T01:18:46.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:46 smithi117 ceph-mon[35358]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T01:18:46.918 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:46 smithi183 ceph-mon[34992]: pgmap v716: 33 pgs: 33 active+clean; 577 KiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-11T01:18:46.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:46 smithi183 ceph-mon[34992]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-11T01:18:46.919 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:46 smithi183 ceph-mon[34992]: osdmap e93: 12 total, 12 up, 12 in 2024-09-11T01:18:47.071 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:46 smithi103 systemd[1]: Stopping Ceph mon.a for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:18:47.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:47 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a[30558]: 2024-09-11T01:18:47.067+0000 7f1901800640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:18:47.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:47 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a[30558]: 2024-09-11T01:18:47.067+0000 7f1901800640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-11T01:18:47.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:47 smithi103 podman[100044]: 2024-09-11 01:18:47.325201586 +0000 UTC m=+0.445703033 container died 9ef09c26e51e62cf9225a1b2257e3051c0a2ecb2fc2227af9f8dc2a74f511975 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T01:18:48.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:47 smithi103 podman[100044]: 2024-09-11 01:18:47.849555185 +0000 UTC m=+0.970056631 container cleanup 9ef09c26e51e62cf9225a1b2257e3051c0a2ecb2fc2227af9f8dc2a74f511975 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-11T01:18:48.082 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:47 smithi103 bash[100044]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a 2024-09-11T01:18:48.380 INFO:journalctl@ceph.mon.a.smithi103.stdout:Sep 11 01:18:48 smithi103 podman[100055]: 2024-09-11 01:18:48.11035833 +0000 UTC m=+0.772636355 container remove 9ef09c26e51e62cf9225a1b2257e3051c0a2ecb2fc2227af9f8dc2a74f511975 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-a, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T01:18:48.401 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.a.service' 2024-09-11T01:18:48.517 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:18:48.517 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-11T01:18:48.518 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-11T01:18:48.518 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.b 2024-09-11T01:18:48.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:48 smithi117 systemd[1]: Stopping Ceph mon.b for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:18:49.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:48 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-b[35354]: 2024-09-11T01:18:48.883+0000 7fe3090a3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:18:49.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:48 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-b[35354]: 2024-09-11T01:18:48.883+0000 7fe3090a3640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-11T01:18:49.373 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:48 smithi117 podman[69368]: 2024-09-11 01:18:48.986731114 +0000 UTC m=+0.221491924 container died 27fec113e201a8efbf810aa6375067ff549be645f7b3574282e78e55033b344d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-11T01:18:49.872 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:49 smithi117 podman[69368]: 2024-09-11 01:18:49.542928772 +0000 UTC m=+0.777689585 container cleanup 27fec113e201a8efbf810aa6375067ff549be645f7b3574282e78e55033b344d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-11T01:18:49.873 INFO:journalctl@ceph.mon.b.smithi117.stdout:Sep 11 01:18:49 smithi117 bash[69368]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-b 2024-09-11T01:18:50.003 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.b.service' 2024-09-11T01:18:50.053 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:18:50.054 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-11T01:18:50.054 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-11T01:18:50.054 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.c 2024-09-11T01:18:50.418 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:50 smithi183 systemd[1]: Stopping Ceph mon.c for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:18:50.694 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:50 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-c[34988]: 2024-09-11T01:18:50.437+0000 7fe86654b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:18:50.720 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:50 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-c[34988]: 2024-09-11T01:18:50.437+0000 7fe86654b640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-11T01:18:50.998 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:50 smithi183 podman[70141]: 2024-09-11 01:18:50.693087994 +0000 UTC m=+0.403938782 container died 379c184a15d3a70857ce2ce1af6a923bdcfba1bcfa7f14105d41b93d485124aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True) 2024-09-11T01:18:51.349 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:51 smithi183 podman[70141]: 2024-09-11 01:18:51.096195907 +0000 UTC m=+0.807046693 container cleanup 379c184a15d3a70857ce2ce1af6a923bdcfba1bcfa7f14105d41b93d485124aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T01:18:51.349 INFO:journalctl@ceph.mon.c.smithi183.stdout:Sep 11 01:18:51 smithi183 bash[70141]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mon-c 2024-09-11T01:18:51.473 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mon.c.service' 2024-09-11T01:18:51.522 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:18:51.522 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-11T01:18:51.523 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-11T01:18:51.523 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mgr.x 2024-09-11T01:18:51.832 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:18:51 smithi103 systemd[1]: Stopping Ceph mgr.x for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:18:52.332 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:18:51 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x[30797]: 2024-09-11T01:18:51.940+0000 7f2086000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:18:52.332 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:18:52 smithi103 podman[100160]: 2024-09-11 01:18:52.022965213 +0000 UTC m=+0.214445709 container died f460f1556e77ed13ba2e20ef73cd90e052bd162ebccff957076aab084d0a9bd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-11T01:18:52.926 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:18:52 smithi103 podman[100160]: 2024-09-11 01:18:52.672648733 +0000 UTC m=+0.864129238 container cleanup f460f1556e77ed13ba2e20ef73cd90e052bd162ebccff957076aab084d0a9bd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T01:18:52.926 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:18:52 smithi103 bash[100160]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x 2024-09-11T01:18:53.186 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Sep 11 01:18:52 smithi103 podman[100173]: 2024-09-11 01:18:52.924892761 +0000 UTC m=+0.871788202 container remove f460f1556e77ed13ba2e20ef73cd90e052bd162ebccff957076aab084d0a9bd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8f219c476cb4f26fc5719c661c0323719a45cb30, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-x, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-11T01:18:53.195 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mgr.x.service' 2024-09-11T01:18:53.271 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:18:53.271 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-11T01:18:53.272 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-11T01:18:53.272 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mgr.y 2024-09-11T01:18:53.595 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 11 01:18:53 smithi117 systemd[1]: Stopping Ceph mgr.y for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:18:53.873 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 11 01:18:53 smithi117 podman[69492]: 2024-09-11 01:18:53.593597936 +0000 UTC m=+0.131666768 container died fff15aaaeebd3e9d52aaa1e470452bdd98989f632ade5e0ad3ae88ecda862ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-y, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731) 2024-09-11T01:18:54.251 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 11 01:18:53 smithi117 podman[69492]: 2024-09-11 01:18:53.989787946 +0000 UTC m=+0.527856774 container cleanup fff15aaaeebd3e9d52aaa1e470452bdd98989f632ade5e0ad3ae88ecda862ade (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-y, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-11T01:18:54.251 INFO:journalctl@ceph.mgr.y.smithi117.stdout:Sep 11 01:18:53 smithi117 bash[69492]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-y 2024-09-11T01:18:54.422 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mgr.y.service' 2024-09-11T01:18:54.457 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:18:54.457 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-11T01:18:54.457 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-11T01:18:54.457 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mgr.z 2024-09-11T01:18:54.790 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Sep 11 01:18:54 smithi183 systemd[1]: Stopping Ceph mgr.z for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:18:55.111 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Sep 11 01:18:54 smithi183 podman[70263]: 2024-09-11 01:18:54.788305392 +0000 UTC m=+0.135192478 container died 0fca92bf242e5953ee8ca9dc70a77ac064dcbd6ec0e5e719e25ab7b651d2ad12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-z, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T01:18:55.418 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Sep 11 01:18:55 smithi183 podman[70263]: 2024-09-11 01:18:55.209683632 +0000 UTC m=+0.556570707 container cleanup 0fca92bf242e5953ee8ca9dc70a77ac064dcbd6ec0e5e719e25ab7b651d2ad12 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T01:18:55.419 INFO:journalctl@ceph.mgr.z.smithi183.stdout:Sep 11 01:18:55 smithi183 bash[70263]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mgr-z 2024-09-11T01:18:55.690 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mgr.z.service' 2024-09-11T01:18:55.724 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:18:55.725 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-11T01:18:55.725 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-11T01:18:55.725 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.0 2024-09-11T01:18:56.082 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:18:55 smithi103 systemd[1]: Stopping Ceph osd.0 for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:18:56.582 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:18:56 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0[47006]: 2024-09-11T01:18:56.147+0000 7f97f3a00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:18:56.582 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:18:56 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0[47006]: 2024-09-11T01:18:56.147+0000 7f97f3a00640 -1 osd.0 93 *** Got signal Terminated *** 2024-09-11T01:18:56.582 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:18:56 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0[47006]: 2024-09-11T01:18:56.147+0000 7f97f3a00640 -1 osd.0 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:19:02.066 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:19:01 smithi103 podman[100283]: 2024-09-11 01:19:01.724501516 +0000 UTC m=+5.709732073 container died 1d19dde10ef328cbc2eead106fe72e0c9095001b9d85b336e869e935ed858ecd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-11T01:19:02.332 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:19:02 smithi103 podman[100283]: 2024-09-11 01:19:02.194930483 +0000 UTC m=+6.180161040 container cleanup 1d19dde10ef328cbc2eead106fe72e0c9095001b9d85b336e869e935ed858ecd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-11T01:19:02.332 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:19:02 smithi103 bash[100283]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0 2024-09-11T01:19:03.082 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:19:02 smithi103 podman[100302]: 2024-09-11 01:19:02.613634602 +0000 UTC m=+0.872173402 container remove 1d19dde10ef328cbc2eead106fe72e0c9095001b9d85b336e869e935ed858ecd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T01:19:03.552 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:19:03 smithi103 podman[100387]: 2024-09-11 01:19:03.114681939 +0000 UTC m=+0.026705780 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:19:03.553 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:19:03 smithi103 podman[100387]: 2024-09-11 01:19:03.23109335 +0000 UTC m=+0.143117154 container create 38bb49032b8b2f9103b6f6e0c830ee512392d5544ac8cb04f141c88cc99ec18d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-11T01:19:03.553 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:19:03 smithi103 podman[100387]: 2024-09-11 01:19:03.550562959 +0000 UTC m=+0.462586786 container init 38bb49032b8b2f9103b6f6e0c830ee512392d5544ac8cb04f141c88cc99ec18d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T01:19:03.832 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:19:03 smithi103 podman[100387]: 2024-09-11 01:19:03.557862414 +0000 UTC m=+0.469886225 container start 38bb49032b8b2f9103b6f6e0c830ee512392d5544ac8cb04f141c88cc99ec18d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T01:19:03.832 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:19:03 smithi103 podman[100387]: 2024-09-11 01:19:03.65051037 +0000 UTC m=+0.562534206 container attach 38bb49032b8b2f9103b6f6e0c830ee512392d5544ac8cb04f141c88cc99ec18d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T01:19:04.332 INFO:journalctl@ceph.osd.0.smithi103.stdout:Sep 11 01:19:04 smithi103 podman[100419]: 2024-09-11 01:19:04.110665931 +0000 UTC m=+0.027132076 container died 38bb49032b8b2f9103b6f6e0c830ee512392d5544ac8cb04f141c88cc99ec18d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T01:19:04.883 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.0.service' 2024-09-11T01:19:04.963 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:19:04.963 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-11T01:19:04.963 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-11T01:19:04.963 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.1 2024-09-11T01:19:05.263 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:05 smithi117 systemd[1]: Stopping Ceph osd.1 for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:19:05.622 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:05 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1[39850]: 2024-09-11T01:19:05.260+0000 7f84d71a5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:19:05.623 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:05 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1[39850]: 2024-09-11T01:19:05.260+0000 7f84d71a5640 -1 osd.1 93 *** Got signal Terminated *** 2024-09-11T01:19:05.623 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:05 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1[39850]: 2024-09-11T01:19:05.260+0000 7f84d71a5640 -1 osd.1 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:19:11.044 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:10 smithi117 podman[69628]: 2024-09-11 01:19:10.747062778 +0000 UTC m=+5.589885360 container died cd8a1df76a8fadddc6e0b2cf1c418a312624861a3822fefbd7a486050db74fd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-11T01:19:11.363 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:11 smithi117 podman[69628]: 2024-09-11 01:19:11.135450777 +0000 UTC m=+5.978273357 container cleanup cd8a1df76a8fadddc6e0b2cf1c418a312624861a3822fefbd7a486050db74fd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-11T01:19:11.363 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:11 smithi117 bash[69628]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1 2024-09-11T01:19:11.622 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:11 smithi117 podman[69644]: 2024-09-11 01:19:11.361997354 +0000 UTC m=+0.609482231 container remove cd8a1df76a8fadddc6e0b2cf1c418a312624861a3822fefbd7a486050db74fd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-11T01:19:11.941 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:11 smithi117 podman[69733]: 2024-09-11 01:19:11.571932216 +0000 UTC m=+0.015793181 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:19:11.942 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:11 smithi117 podman[69733]: 2024-09-11 01:19:11.679610813 +0000 UTC m=+0.123471805 container create 584e7f20d2650abb8b0d29ce793de072e1f578d88f270be20dd3ade2ffd13ef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-11T01:19:12.223 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:11 smithi117 podman[69733]: 2024-09-11 01:19:11.940658549 +0000 UTC m=+0.384519497 container init 584e7f20d2650abb8b0d29ce793de072e1f578d88f270be20dd3ade2ffd13ef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-11T01:19:12.223 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:11 smithi117 podman[69733]: 2024-09-11 01:19:11.944182271 +0000 UTC m=+0.388043218 container start 584e7f20d2650abb8b0d29ce793de072e1f578d88f270be20dd3ade2ffd13ef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T01:19:12.223 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:11 smithi117 podman[69733]: 2024-09-11 01:19:11.999021629 +0000 UTC m=+0.442882575 container attach 584e7f20d2650abb8b0d29ce793de072e1f578d88f270be20dd3ade2ffd13ef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-11T01:19:12.537 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:12 smithi117 podman[69733]: 2024-09-11 01:19:12.222093801 +0000 UTC m=+0.665954749 container died 584e7f20d2650abb8b0d29ce793de072e1f578d88f270be20dd3ade2ffd13ef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T01:19:12.825 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:12 smithi117 podman[69755]: 2024-09-11 01:19:12.794805524 +0000 UTC m=+0.566394461 container remove 584e7f20d2650abb8b0d29ce793de072e1f578d88f270be20dd3ade2ffd13ef2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T01:19:12.825 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:12 smithi117 systemd[1]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-11T01:19:12.826 INFO:journalctl@ceph.osd.1.smithi117.stdout:Sep 11 01:19:12 smithi117 systemd[1]: Stopped Ceph osd.1 for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T01:19:12.827 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.1.service' 2024-09-11T01:19:12.868 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:19:12.869 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-11T01:19:12.869 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-11T01:19:12.869 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.2 2024-09-11T01:19:13.168 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:19:12 smithi183 systemd[1]: Stopping Ceph osd.2 for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:19:13.668 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:19:13 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2[39961]: 2024-09-11T01:19:13.179+0000 7f25cb4ba640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:19:13.669 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:19:13 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2[39961]: 2024-09-11T01:19:13.179+0000 7f25cb4ba640 -1 osd.2 93 *** Got signal Terminated *** 2024-09-11T01:19:13.669 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:19:13 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2[39961]: 2024-09-11T01:19:13.179+0000 7f25cb4ba640 -1 osd.2 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:19:19.066 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:19:18 smithi183 podman[70404]: 2024-09-11 01:19:18.742105846 +0000 UTC m=+5.680991678 container died 94b2527928240f3db2525a93ac5714c314e2d9c5ae7b6db00bab770d34f07f19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T01:19:19.408 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:19:19 smithi183 podman[70404]: 2024-09-11 01:19:19.163461532 +0000 UTC m=+6.102347373 container cleanup 94b2527928240f3db2525a93ac5714c314e2d9c5ae7b6db00bab770d34f07f19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-11T01:19:19.408 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:19:19 smithi183 bash[70404]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2 2024-09-11T01:19:19.668 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:19:19 smithi183 podman[70421]: 2024-09-11 01:19:19.406600929 +0000 UTC m=+0.667538291 container remove 94b2527928240f3db2525a93ac5714c314e2d9c5ae7b6db00bab770d34f07f19 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731) 2024-09-11T01:19:20.086 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:19:19 smithi183 podman[70511]: 2024-09-11 01:19:19.72345471 +0000 UTC m=+0.015914003 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:19:20.086 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:19:19 smithi183 podman[70511]: 2024-09-11 01:19:19.832569569 +0000 UTC m=+0.125028903 container create 5d4f6a25cff933d357310ab3f3674d95685e324eb99e6836b69738bb8ab6e11e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-11T01:19:20.418 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:19:20 smithi183 podman[70511]: 2024-09-11 01:19:20.084885487 +0000 UTC m=+0.377344776 container init 5d4f6a25cff933d357310ab3f3674d95685e324eb99e6836b69738bb8ab6e11e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS) 2024-09-11T01:19:20.419 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:19:20 smithi183 podman[70511]: 2024-09-11 01:19:20.088321174 +0000 UTC m=+0.380780478 container start 5d4f6a25cff933d357310ab3f3674d95685e324eb99e6836b69738bb8ab6e11e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T01:19:20.419 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:19:20 smithi183 podman[70511]: 2024-09-11 01:19:20.185050368 +0000 UTC m=+0.477509667 container attach 5d4f6a25cff933d357310ab3f3674d95685e324eb99e6836b69738bb8ab6e11e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-11T01:19:20.714 INFO:journalctl@ceph.osd.2.smithi183.stdout:Sep 11 01:19:20 smithi183 podman[70511]: 2024-09-11 01:19:20.454672795 +0000 UTC m=+0.747132085 container died 5d4f6a25cff933d357310ab3f3674d95685e324eb99e6836b69738bb8ab6e11e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-11T01:19:21.063 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.2.service' 2024-09-11T01:19:21.103 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:19:21.103 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-11T01:19:21.103 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-11T01:19:21.103 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.3 2024-09-11T01:19:21.522 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:19:21 smithi103 systemd[1]: Stopping Ceph osd.3 for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:19:21.832 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:19:21 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3[53918]: 2024-09-11T01:19:21.518+0000 7f510bc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:19:21.832 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:19:21 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3[53918]: 2024-09-11T01:19:21.519+0000 7f510bc00640 -1 osd.3 93 *** Got signal Terminated *** 2024-09-11T01:19:21.832 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:19:21 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3[53918]: 2024-09-11T01:19:21.519+0000 7f510bc00640 -1 osd.3 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:19:27.542 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:19:27 smithi103 podman[100505]: 2024-09-11 01:19:27.197625042 +0000 UTC m=+5.799673397 container died 0d243a2fc2c7f31625034a87d7c5acca56b8b68674e193d35a64b2909fc0de09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T01:19:27.832 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:19:27 smithi103 podman[100505]: 2024-09-11 01:19:27.658730838 +0000 UTC m=+6.260779201 container cleanup 0d243a2fc2c7f31625034a87d7c5acca56b8b68674e193d35a64b2909fc0de09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T01:19:27.832 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:19:27 smithi103 bash[100505]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3 2024-09-11T01:19:28.332 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:19:27 smithi103 podman[100521]: 2024-09-11 01:19:27.92719621 +0000 UTC m=+0.716325626 container remove 0d243a2fc2c7f31625034a87d7c5acca56b8b68674e193d35a64b2909fc0de09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T01:19:28.799 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:19:28 smithi103 podman[100608]: 2024-09-11 01:19:28.368049504 +0000 UTC m=+0.026979228 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:19:28.799 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:19:28 smithi103 podman[100608]: 2024-09-11 01:19:28.503102637 +0000 UTC m=+0.162032360 container create 11a3de78c3604bc152985d123e57b3f032fb5c6558163010cf8e33852634aa83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-11T01:19:28.799 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:19:28 smithi103 podman[100608]: 2024-09-11 01:19:28.797817359 +0000 UTC m=+0.456747083 container init 11a3de78c3604bc152985d123e57b3f032fb5c6558163010cf8e33852634aa83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-11T01:19:29.071 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:19:28 smithi103 podman[100608]: 2024-09-11 01:19:28.80503296 +0000 UTC m=+0.463962685 container start 11a3de78c3604bc152985d123e57b3f032fb5c6558163010cf8e33852634aa83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-11T01:19:29.071 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:19:28 smithi103 podman[100608]: 2024-09-11 01:19:28.897497656 +0000 UTC m=+0.556427395 container attach 11a3de78c3604bc152985d123e57b3f032fb5c6558163010cf8e33852634aa83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-11T01:19:29.332 INFO:journalctl@ceph.osd.3.smithi103.stdout:Sep 11 01:19:29 smithi103 podman[100608]: 2024-09-11 01:19:29.069513754 +0000 UTC m=+0.728443489 container died 11a3de78c3604bc152985d123e57b3f032fb5c6558163010cf8e33852634aa83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731) 2024-09-11T01:19:29.857 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.3.service' 2024-09-11T01:19:29.935 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:19:29.936 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-11T01:19:29.936 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-11T01:19:29.936 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.4 2024-09-11T01:19:30.232 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:19:29 smithi117 systemd[1]: Stopping Ceph osd.4 for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:19:30.623 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:19:30 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4[46606]: 2024-09-11T01:19:30.229+0000 7f6100373640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:19:30.623 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:19:30 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4[46606]: 2024-09-11T01:19:30.229+0000 7f6100373640 -1 osd.4 93 *** Got signal Terminated *** 2024-09-11T01:19:30.623 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:19:30 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4[46606]: 2024-09-11T01:19:30.229+0000 7f6100373640 -1 osd.4 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:19:35.964 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:19:35 smithi117 podman[69833]: 2024-09-11 01:19:35.676753942 +0000 UTC m=+5.550228697 container died df5ed8cca470fa2f3e3ef7ac56f44be3a1dab8e291bae66352afe8a415e62f2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T01:19:36.357 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:19:36 smithi117 podman[69833]: 2024-09-11 01:19:36.062491103 +0000 UTC m=+5.935965856 container cleanup df5ed8cca470fa2f3e3ef7ac56f44be3a1dab8e291bae66352afe8a415e62f2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-11T01:19:36.357 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:19:36 smithi117 bash[69833]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4 2024-09-11T01:19:36.622 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:19:36 smithi117 podman[69852]: 2024-09-11 01:19:36.355691807 +0000 UTC m=+0.672145619 container remove df5ed8cca470fa2f3e3ef7ac56f44be3a1dab8e291bae66352afe8a415e62f2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-09-11T01:19:36.994 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:19:36 smithi117 podman[69940]: 2024-09-11 01:19:36.563856799 +0000 UTC m=+0.016313525 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:19:36.994 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:19:36 smithi117 podman[69940]: 2024-09-11 01:19:36.681570672 +0000 UTC m=+0.134027388 container create 3fa0f0946a3698c26cbe24927cb7a7e953ed064cf17f1a36c35f31bb950bf1f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T01:19:36.994 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:19:36 smithi117 podman[69940]: 2024-09-11 01:19:36.900633345 +0000 UTC m=+0.353090066 container init 3fa0f0946a3698c26cbe24927cb7a7e953ed064cf17f1a36c35f31bb950bf1f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-11T01:19:36.994 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:19:36 smithi117 podman[69940]: 2024-09-11 01:19:36.903909208 +0000 UTC m=+0.356365936 container start 3fa0f0946a3698c26cbe24927cb7a7e953ed064cf17f1a36c35f31bb950bf1f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-11T01:19:36.994 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:19:36 smithi117 podman[69940]: 2024-09-11 01:19:36.992540041 +0000 UTC m=+0.444996761 container attach 3fa0f0946a3698c26cbe24927cb7a7e953ed064cf17f1a36c35f31bb950bf1f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-11T01:19:37.372 INFO:journalctl@ceph.osd.4.smithi117.stdout:Sep 11 01:19:37 smithi117 podman[69963]: 2024-09-11 01:19:37.122425435 +0000 UTC m=+0.016947381 container died 3fa0f0946a3698c26cbe24927cb7a7e953ed064cf17f1a36c35f31bb950bf1f9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-11T01:19:37.687 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.4.service' 2024-09-11T01:19:37.727 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:19:37.728 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-11T01:19:37.728 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-11T01:19:37.728 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.5 2024-09-11T01:19:38.059 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:19:37 smithi183 systemd[1]: Stopping Ceph osd.5 for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:19:38.418 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:19:38 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5[46826]: 2024-09-11T01:19:38.056+0000 7f1c0dd67640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:19:38.418 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:19:38 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5[46826]: 2024-09-11T01:19:38.056+0000 7f1c0dd67640 -1 osd.5 93 *** Got signal Terminated *** 2024-09-11T01:19:38.418 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:19:38 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5[46826]: 2024-09-11T01:19:38.056+0000 7f1c0dd67640 -1 osd.5 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:19:43.919 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:19:43 smithi183 podman[70625]: 2024-09-11 01:19:43.598736862 +0000 UTC m=+5.670507220 container died 9c4fe80551ffbf2c34b8d0db362782beb8c026ef3dda4f04f49c30526e18e2f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD) 2024-09-11T01:19:44.418 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:19:43 smithi183 podman[70625]: 2024-09-11 01:19:43.932475971 +0000 UTC m=+6.004246339 container cleanup 9c4fe80551ffbf2c34b8d0db362782beb8c026ef3dda4f04f49c30526e18e2f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-11T01:19:44.419 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:19:43 smithi183 bash[70625]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5 2024-09-11T01:19:44.419 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:19:44 smithi183 podman[70642]: 2024-09-11 01:19:44.125743215 +0000 UTC m=+0.520819235 container remove 9c4fe80551ffbf2c34b8d0db362782beb8c026ef3dda4f04f49c30526e18e2f3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T01:19:44.813 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:19:44 smithi183 podman[70729]: 2024-09-11 01:19:44.446027268 +0000 UTC m=+0.015846110 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:19:44.813 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:19:44 smithi183 podman[70729]: 2024-09-11 01:19:44.543158421 +0000 UTC m=+0.112977293 container create e072195ea8dc2dd750d69ab2c279d3f4f7a35a52e71a6c294acd2983c989236d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=) 2024-09-11T01:19:44.814 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:19:44 smithi183 podman[70729]: 2024-09-11 01:19:44.812266227 +0000 UTC m=+0.382085053 container init e072195ea8dc2dd750d69ab2c279d3f4f7a35a52e71a6c294acd2983c989236d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T01:19:45.168 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:19:44 smithi183 podman[70729]: 2024-09-11 01:19:44.815712558 +0000 UTC m=+0.385531384 container start e072195ea8dc2dd750d69ab2c279d3f4f7a35a52e71a6c294acd2983c989236d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T01:19:45.169 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:19:44 smithi183 podman[70729]: 2024-09-11 01:19:44.903877115 +0000 UTC m=+0.473695949 container attach e072195ea8dc2dd750d69ab2c279d3f4f7a35a52e71a6c294acd2983c989236d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5-deactivate, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-11T01:19:45.169 INFO:journalctl@ceph.osd.5.smithi183.stdout:Sep 11 01:19:45 smithi183 podman[70729]: 2024-09-11 01:19:45.00998663 +0000 UTC m=+0.579805471 container died e072195ea8dc2dd750d69ab2c279d3f4f7a35a52e71a6c294acd2983c989236d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-11T01:19:45.640 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.5.service' 2024-09-11T01:19:45.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:19:45.680 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-11T01:19:45.681 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-11T01:19:45.681 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.6 2024-09-11T01:19:46.082 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:19:45 smithi103 systemd[1]: Stopping Ceph osd.6 for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:19:46.582 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:19:46 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6[60567]: 2024-09-11T01:19:46.107+0000 7ff07d400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:19:46.582 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:19:46 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6[60567]: 2024-09-11T01:19:46.107+0000 7ff07d400640 -1 osd.6 93 *** Got signal Terminated *** 2024-09-11T01:19:46.582 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:19:46 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6[60567]: 2024-09-11T01:19:46.107+0000 7ff07d400640 -1 osd.6 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:19:52.081 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:19:51 smithi103 podman[100709]: 2024-09-11 01:19:51.74911834 +0000 UTC m=+5.786994709 container died 3cd3f5f00439c9e36a31621abe1103abfde6b166748c40880425cc8a8b3c3cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-11T01:19:52.332 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:19:52 smithi103 podman[100709]: 2024-09-11 01:19:52.195784122 +0000 UTC m=+6.233660490 container cleanup 3cd3f5f00439c9e36a31621abe1103abfde6b166748c40880425cc8a8b3c3cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-11T01:19:52.332 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:19:52 smithi103 bash[100709]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6 2024-09-11T01:19:52.832 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:19:52 smithi103 podman[100739]: 2024-09-11 01:19:52.464110112 +0000 UTC m=+0.703662506 container remove 3cd3f5f00439c9e36a31621abe1103abfde6b166748c40880425cc8a8b3c3cbd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-11T01:19:53.303 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:19:53 smithi103 podman[100827]: 2024-09-11 01:19:52.910070741 +0000 UTC m=+0.027132731 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:19:53.303 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:19:53 smithi103 podman[100827]: 2024-09-11 01:19:53.044553604 +0000 UTC m=+0.161615571 container create 012e68ce84897ae69d0e38c1a7b0cae75dec04a36124737bbae126650456266d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-11T01:19:53.303 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:19:53 smithi103 podman[100827]: 2024-09-11 01:19:53.301371174 +0000 UTC m=+0.418433157 container init 012e68ce84897ae69d0e38c1a7b0cae75dec04a36124737bbae126650456266d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-11T01:19:53.568 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:19:53 smithi103 podman[100827]: 2024-09-11 01:19:53.308702828 +0000 UTC m=+0.425764803 container start 012e68ce84897ae69d0e38c1a7b0cae75dec04a36124737bbae126650456266d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-11T01:19:53.568 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:19:53 smithi103 podman[100827]: 2024-09-11 01:19:53.467560774 +0000 UTC m=+0.584622751 container attach 012e68ce84897ae69d0e38c1a7b0cae75dec04a36124737bbae126650456266d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T01:19:53.832 INFO:journalctl@ceph.osd.6.smithi103.stdout:Sep 11 01:19:53 smithi103 podman[100827]: 2024-09-11 01:19:53.566943614 +0000 UTC m=+0.684005601 container died 012e68ce84897ae69d0e38c1a7b0cae75dec04a36124737bbae126650456266d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-11T01:19:54.322 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.6.service' 2024-09-11T01:19:54.401 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:19:54.401 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-11T01:19:54.402 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-11T01:19:54.402 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.7 2024-09-11T01:19:54.699 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:19:54 smithi117 systemd[1]: Stopping Ceph osd.7 for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:19:55.122 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:19:54 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7[53093]: 2024-09-11T01:19:54.696+0000 7f64d4ed4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:19:55.123 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:19:54 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7[53093]: 2024-09-11T01:19:54.696+0000 7f64d4ed4640 -1 osd.7 93 *** Got signal Terminated *** 2024-09-11T01:19:55.123 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:19:54 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7[53093]: 2024-09-11T01:19:54.696+0000 7f64d4ed4640 -1 osd.7 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:20:00.372 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:20:00 smithi117 podman[70043]: 2024-09-11 01:20:00.283692577 +0000 UTC m=+5.689537242 container died 0c23d47d6687548b4e0ef8742ad18ab38823d92e70a19df87404a1d84e7ed961 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-11T01:20:00.798 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:20:00 smithi117 podman[70043]: 2024-09-11 01:20:00.612811075 +0000 UTC m=+6.018655773 container cleanup 0c23d47d6687548b4e0ef8742ad18ab38823d92e70a19df87404a1d84e7ed961 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-11T01:20:00.799 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:20:00 smithi117 bash[70043]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7 2024-09-11T01:20:01.122 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:20:00 smithi117 podman[70059]: 2024-09-11 01:20:00.797340731 +0000 UTC m=+0.507794889 container remove 0c23d47d6687548b4e0ef8742ad18ab38823d92e70a19df87404a1d84e7ed961 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-11T01:20:01.468 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:20:01 smithi117 podman[70143]: 2024-09-11 01:20:01.19793298 +0000 UTC m=+0.085122613 container create 7bf0f22d996c8206d02331061bfc18dd9e9b2457316eea82c1cc681fdb74ef1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-11T01:20:01.468 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:20:01 smithi117 podman[70143]: 2024-09-11 01:20:01.128514024 +0000 UTC m=+0.015703671 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:20:01.873 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:20:01 smithi117 podman[70143]: 2024-09-11 01:20:01.467161693 +0000 UTC m=+0.354351325 container init 7bf0f22d996c8206d02331061bfc18dd9e9b2457316eea82c1cc681fdb74ef1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-09-11T01:20:01.873 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:20:01 smithi117 podman[70143]: 2024-09-11 01:20:01.471050276 +0000 UTC m=+0.358239909 container start 7bf0f22d996c8206d02331061bfc18dd9e9b2457316eea82c1cc681fdb74ef1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T01:20:01.873 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:20:01 smithi117 podman[70143]: 2024-09-11 01:20:01.558684357 +0000 UTC m=+0.445874003 container attach 7bf0f22d996c8206d02331061bfc18dd9e9b2457316eea82c1cc681fdb74ef1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T01:20:01.873 INFO:journalctl@ceph.osd.7.smithi117.stdout:Sep 11 01:20:01 smithi117 podman[70166]: 2024-09-11 01:20:01.68596868 +0000 UTC m=+0.016253819 container died 7bf0f22d996c8206d02331061bfc18dd9e9b2457316eea82c1cc681fdb74ef1f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-7-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T01:20:02.215 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.7.service' 2024-09-11T01:20:02.255 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:20:02.256 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-11T01:20:02.256 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-11T01:20:02.256 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.8 2024-09-11T01:20:02.577 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:20:02 smithi183 systemd[1]: Stopping Ceph osd.8 for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:20:02.578 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:02 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:02.170+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:02.872 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:02 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:02.443+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:02.918 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:20:02 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8[53465]: 2024-09-11T01:20:02.575+0000 7f9b5f4ea640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:20:02.918 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:20:02 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8[53465]: 2024-09-11T01:20:02.575+0000 7f9b5f4ea640 -1 osd.8 93 *** Got signal Terminated *** 2024-09-11T01:20:02.918 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:20:02 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8[53465]: 2024-09-11T01:20:02.575+0000 7f9b5f4ea640 -1 osd.8 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:20:03.597 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:03 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:03.208+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:03.872 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:03 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:03.422+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:04.419 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:04 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:04.165+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:04.582 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:04 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:04.276+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:19:00.945551+0000 front 2024-09-11T01:19:00.945752+0000 (oldest deadline 2024-09-11T01:20:03.845760+0000) 2024-09-11T01:20:04.873 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:04 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:04.414+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:05.582 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:05 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:05.281+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:19:00.945551+0000 front 2024-09-11T01:19:00.945752+0000 (oldest deadline 2024-09-11T01:20:03.845760+0000) 2024-09-11T01:20:05.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:05 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:05.176+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:05.774 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:05 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:05.395+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:06.418 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:06 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:06.156+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:06.582 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:06 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:06.288+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:19:00.945551+0000 front 2024-09-11T01:19:00.945752+0000 (oldest deadline 2024-09-11T01:20:03.845760+0000) 2024-09-11T01:20:06.872 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:06 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:06.415+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:07.676 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:07 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:07.182+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:07.832 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:07 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:07.331+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:19:00.945551+0000 front 2024-09-11T01:19:00.945752+0000 (oldest deadline 2024-09-11T01:20:03.845760+0000) 2024-09-11T01:20:07.873 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:07 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:07.432+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:08.303 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:20:08 smithi183 podman[70833]: 2024-09-11 01:20:07.999815509 +0000 UTC m=+5.549860934 container died 88e852390928cbbd52a6623948097900276dd7bf51e8acc80a6bfcb7d4b9844f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-11T01:20:08.303 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:08 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:08.222+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:08.661 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:20:08 smithi183 podman[70833]: 2024-09-11 01:20:08.40034866 +0000 UTC m=+5.950394078 container cleanup 88e852390928cbbd52a6623948097900276dd7bf51e8acc80a6bfcb7d4b9844f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-09-11T01:20:08.661 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:20:08 smithi183 bash[70833]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8 2024-09-11T01:20:08.832 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:08 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:08.373+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:19:00.945551+0000 front 2024-09-11T01:19:00.945752+0000 (oldest deadline 2024-09-11T01:20:03.845760+0000) 2024-09-11T01:20:08.872 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:08 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:08.425+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:08.918 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:20:08 smithi183 podman[70860]: 2024-09-11 01:20:08.659997806 +0000 UTC m=+0.659953657 container remove 88e852390928cbbd52a6623948097900276dd7bf51e8acc80a6bfcb7d4b9844f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T01:20:09.305 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:09 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:09.224+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:09.306 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:20:08 smithi183 podman[70947]: 2024-09-11 01:20:08.994134718 +0000 UTC m=+0.095744894 container create 4c5282b96ff9cf9c27cf56bf7a00b29b42e1239ae3542df1eeedd66888b21c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-11T01:20:09.306 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:20:09 smithi183 podman[70947]: 2024-09-11 01:20:08.914574626 +0000 UTC m=+0.016184813 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:20:09.306 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:20:09 smithi183 podman[70947]: 2024-09-11 01:20:09.221262538 +0000 UTC m=+0.322872718 container init 4c5282b96ff9cf9c27cf56bf7a00b29b42e1239ae3542df1eeedd66888b21c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-11T01:20:09.306 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:20:09 smithi183 podman[70947]: 2024-09-11 01:20:09.225264483 +0000 UTC m=+0.326874665 container start 4c5282b96ff9cf9c27cf56bf7a00b29b42e1239ae3542df1eeedd66888b21c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-11T01:20:09.306 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:20:09 smithi183 podman[70947]: 2024-09-11 01:20:09.304535378 +0000 UTC m=+0.406145555 container attach 4c5282b96ff9cf9c27cf56bf7a00b29b42e1239ae3542df1eeedd66888b21c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-11T01:20:09.668 INFO:journalctl@ceph.osd.8.smithi183.stdout:Sep 11 01:20:09 smithi183 podman[70947]: 2024-09-11 01:20:09.412366484 +0000 UTC m=+0.513976662 container died 4c5282b96ff9cf9c27cf56bf7a00b29b42e1239ae3542df1eeedd66888b21c4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T01:20:09.832 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:09 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:09.347+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:19:00.945551+0000 front 2024-09-11T01:19:00.945752+0000 (oldest deadline 2024-09-11T01:20:03.845760+0000) 2024-09-11T01:20:09.872 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:09 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:09.429+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:10.003 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.8.service' 2024-09-11T01:20:10.043 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:20:10.044 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-11T01:20:10.044 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-11T01:20:10.044 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.9 2024-09-11T01:20:10.512 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:10 smithi103 systemd[1]: Stopping Ceph osd.9 for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:20:10.512 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:10 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:10.297+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:19:00.945551+0000 front 2024-09-11T01:19:00.945752+0000 (oldest deadline 2024-09-11T01:20:03.845760+0000) 2024-09-11T01:20:10.512 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:10 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:10.510+0000 7f2390400640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:20:10.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:10 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:10.247+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:10.832 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:10 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:10.510+0000 7f2390400640 -1 osd.9 93 *** Got signal Terminated *** 2024-09-11T01:20:10.832 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:10 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:10.510+0000 7f2390400640 -1 osd.9 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:20:10.872 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:10 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:10.427+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:11.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:11 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:11.217+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:11.832 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:11 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:11.338+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:19:00.945551+0000 front 2024-09-11T01:19:00.945752+0000 (oldest deadline 2024-09-11T01:20:03.845760+0000) 2024-09-11T01:20:11.872 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:11 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:11.411+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:12.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:12 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:12.232+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:12.832 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:12 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:12.331+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:19:00.945551+0000 front 2024-09-11T01:19:00.945752+0000 (oldest deadline 2024-09-11T01:20:03.845760+0000) 2024-09-11T01:20:12.832 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:12 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:12.331+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-11T01:19:05.547356+0000 front 2024-09-11T01:19:05.547337+0000 (oldest deadline 2024-09-11T01:20:11.447434+0000) 2024-09-11T01:20:12.873 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:12 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:12.387+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:13.582 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:13.303+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:19:00.945551+0000 front 2024-09-11T01:19:00.945752+0000 (oldest deadline 2024-09-11T01:20:03.845760+0000) 2024-09-11T01:20:13.582 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:13 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:13.303+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-11T01:19:05.547356+0000 front 2024-09-11T01:19:05.547337+0000 (oldest deadline 2024-09-11T01:20:11.447434+0000) 2024-09-11T01:20:13.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:13 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:13.262+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:13.873 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:13 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:13.413+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:14.582 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:14 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:14.272+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:19:00.945551+0000 front 2024-09-11T01:19:00.945752+0000 (oldest deadline 2024-09-11T01:20:03.845760+0000) 2024-09-11T01:20:14.582 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:14 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:14.272+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-11T01:19:05.547356+0000 front 2024-09-11T01:19:05.547337+0000 (oldest deadline 2024-09-11T01:20:11.447434+0000) 2024-09-11T01:20:14.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:14 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:14.246+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:14.873 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:14 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:14.399+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:15.582 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:15 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:15.246+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:19:00.945551+0000 front 2024-09-11T01:19:00.945752+0000 (oldest deadline 2024-09-11T01:20:03.845760+0000) 2024-09-11T01:20:15.582 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:15 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9[67402]: 2024-09-11T01:20:15.246+0000 7f2386e00640 -1 osd.9 93 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-11T01:19:05.547356+0000 front 2024-09-11T01:19:05.547337+0000 (oldest deadline 2024-09-11T01:20:11.447434+0000) 2024-09-11T01:20:15.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:15 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:15.253+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:15.872 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:15 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:15.406+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:16.484 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:16 smithi103 podman[100928]: 2024-09-11 01:20:16.186265219 +0000 UTC m=+5.861913284 container died d8cb9fe390f12599da2f412d5f2a7187166176558362530a26e6088902f90d30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-11T01:20:16.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:16 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:16.226+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:16.832 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:16 smithi103 podman[100928]: 2024-09-11 01:20:16.665508887 +0000 UTC m=+6.341156952 container cleanup d8cb9fe390f12599da2f412d5f2a7187166176558362530a26e6088902f90d30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-11T01:20:16.832 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:16 smithi103 bash[100928]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9 2024-09-11T01:20:16.872 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:16 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:16.425+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:16.873 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:16 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:16.425+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-11T01:19:09.931718+0000 front 2024-09-11T01:19:09.931838+0000 (oldest deadline 2024-09-11T01:20:15.831921+0000) 2024-09-11T01:20:17.332 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:16 smithi103 podman[100944]: 2024-09-11 01:20:16.900042711 +0000 UTC m=+0.689076516 container remove d8cb9fe390f12599da2f412d5f2a7187166176558362530a26e6088902f90d30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-11T01:20:17.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:17 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:17.260+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:17.771 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:17 smithi103 podman[101033]: 2024-09-11 01:20:17.385168364 +0000 UTC m=+0.027860351 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:20:17.771 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:17 smithi103 podman[101033]: 2024-09-11 01:20:17.520319953 +0000 UTC m=+0.163011932 container create 9611f810c5280f69abd5f2ddc1fae5bfbe7faf0c97e03502ebba491ed6a4081d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-11T01:20:17.772 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:17 smithi103 podman[101033]: 2024-09-11 01:20:17.770422866 +0000 UTC m=+0.413114853 container init 9611f810c5280f69abd5f2ddc1fae5bfbe7faf0c97e03502ebba491ed6a4081d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-11T01:20:17.872 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:17 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:17.385+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:17.873 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:17 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:17.385+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-11T01:19:09.931718+0000 front 2024-09-11T01:19:09.931838+0000 (oldest deadline 2024-09-11T01:20:15.831921+0000) 2024-09-11T01:20:18.048 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:17 smithi103 podman[101033]: 2024-09-11 01:20:17.777118505 +0000 UTC m=+0.419810493 container start 9611f810c5280f69abd5f2ddc1fae5bfbe7faf0c97e03502ebba491ed6a4081d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-11T01:20:18.048 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:17 smithi103 podman[101033]: 2024-09-11 01:20:17.900544508 +0000 UTC m=+0.543236504 container attach 9611f810c5280f69abd5f2ddc1fae5bfbe7faf0c97e03502ebba491ed6a4081d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-11T01:20:18.332 INFO:journalctl@ceph.osd.9.smithi103.stdout:Sep 11 01:20:18 smithi103 podman[101056]: 2024-09-11 01:20:18.087234617 +0000 UTC m=+0.026480058 container died 9611f810c5280f69abd5f2ddc1fae5bfbe7faf0c97e03502ebba491ed6a4081d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-11T01:20:18.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:18 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:18.221+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:18.755 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.9.service' 2024-09-11T01:20:18.834 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:20:18.834 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-11T01:20:18.834 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-11T01:20:18.834 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.10 2024-09-11T01:20:18.862 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:18 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:18.374+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:18.862 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:18 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:18.374+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-11T01:19:09.931718+0000 front 2024-09-11T01:19:09.931838+0000 (oldest deadline 2024-09-11T01:20:15.831921+0000) 2024-09-11T01:20:19.122 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:18 smithi117 systemd[1]: Stopping Ceph osd.10 for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:20:19.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:19 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:19.121+0000 7efe479f0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:20:19.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:19 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:19.121+0000 7efe479f0640 -1 osd.10 93 *** Got signal Terminated *** 2024-09-11T01:20:19.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:19 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:19.121+0000 7efe479f0640 -1 osd.10 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:20:19.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:19 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:19.327+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:19.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:19 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:19.327+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-11T01:19:09.931718+0000 front 2024-09-11T01:19:09.931838+0000 (oldest deadline 2024-09-11T01:20:15.831921+0000) 2024-09-11T01:20:19.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:19 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:19.195+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:19.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:19 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:19.195+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.645041+0000 front 2024-09-11T01:19:15.645100+0000 (oldest deadline 2024-09-11T01:20:19.145186+0000) 2024-09-11T01:20:20.622 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:20 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:20.351+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:20.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:20 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:20.351+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-11T01:19:09.931718+0000 front 2024-09-11T01:19:09.931838+0000 (oldest deadline 2024-09-11T01:20:15.831921+0000) 2024-09-11T01:20:20.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:20 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:20.213+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:20.669 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:20 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:20.213+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.645041+0000 front 2024-09-11T01:19:15.645100+0000 (oldest deadline 2024-09-11T01:20:19.145186+0000) 2024-09-11T01:20:21.418 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:21 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:21.165+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:21.419 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:21 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:21.165+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.645041+0000 front 2024-09-11T01:19:15.645100+0000 (oldest deadline 2024-09-11T01:20:19.145186+0000) 2024-09-11T01:20:21.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:21 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:21.342+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:21.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:21 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:21.342+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-11T01:19:09.931718+0000 front 2024-09-11T01:19:09.931838+0000 (oldest deadline 2024-09-11T01:20:15.831921+0000) 2024-09-11T01:20:21.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:21 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:21.342+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.832426+0000 front 2024-09-11T01:19:15.832490+0000 (oldest deadline 2024-09-11T01:20:21.132515+0000) 2024-09-11T01:20:22.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:22 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:22.361+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:22.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:22 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:22.361+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-11T01:19:09.931718+0000 front 2024-09-11T01:19:09.931838+0000 (oldest deadline 2024-09-11T01:20:15.831921+0000) 2024-09-11T01:20:22.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:22 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:22.361+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.832426+0000 front 2024-09-11T01:19:15.832490+0000 (oldest deadline 2024-09-11T01:20:21.132515+0000) 2024-09-11T01:20:22.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:22 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:22.213+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:22.669 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:22 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:22.213+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.645041+0000 front 2024-09-11T01:19:15.645100+0000 (oldest deadline 2024-09-11T01:20:19.145186+0000) 2024-09-11T01:20:23.622 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:23 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:23.315+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.830601+0000 front 2024-09-11T01:18:58.830712+0000 (oldest deadline 2024-09-11T01:20:01.730346+0000) 2024-09-11T01:20:23.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:23 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:23.315+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.117:6804 osd.1 since back 2024-09-11T01:19:09.931718+0000 front 2024-09-11T01:19:09.931838+0000 (oldest deadline 2024-09-11T01:20:15.831921+0000) 2024-09-11T01:20:23.623 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:23 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10[59650]: 2024-09-11T01:20:23.315+0000 7efe44005640 -1 osd.10 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.832426+0000 front 2024-09-11T01:19:15.832490+0000 (oldest deadline 2024-09-11T01:20:21.132515+0000) 2024-09-11T01:20:23.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:23 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:23.193+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:23.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:23 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:23.193+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.645041+0000 front 2024-09-11T01:19:15.645100+0000 (oldest deadline 2024-09-11T01:20:19.145186+0000) 2024-09-11T01:20:24.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:24 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:24.194+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:24.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:24 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:24.194+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.645041+0000 front 2024-09-11T01:19:15.645100+0000 (oldest deadline 2024-09-11T01:20:19.145186+0000) 2024-09-11T01:20:24.819 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:24 smithi117 podman[70258]: 2024-09-11 01:20:24.558434134 +0000 UTC m=+5.536166814 container died cfc822145279b866be20ac8b4fd2b66524c4544727c40627156f4ccb6666893e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T01:20:25.089 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:24 smithi117 podman[70258]: 2024-09-11 01:20:24.89566798 +0000 UTC m=+5.873400702 container cleanup cfc822145279b866be20ac8b4fd2b66524c4544727c40627156f4ccb6666893e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-11T01:20:25.090 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:24 smithi117 bash[70258]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10 2024-09-11T01:20:25.372 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:25 smithi117 podman[70274]: 2024-09-11 01:20:25.088451003 +0000 UTC m=+0.526456726 container remove cfc822145279b866be20ac8b4fd2b66524c4544727c40627156f4ccb6666893e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-11T01:20:25.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:25 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:25.209+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:25.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:25 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:25.209+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.645041+0000 front 2024-09-11T01:19:15.645100+0000 (oldest deadline 2024-09-11T01:20:19.145186+0000) 2024-09-11T01:20:25.776 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:25 smithi117 podman[70361]: 2024-09-11 01:20:25.480812506 +0000 UTC m=+0.107277515 container create 044848c414460196a51c6b499a9ed0cfca774667e18511020602ecc35db0f3c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10-deactivate, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T01:20:25.776 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:25 smithi117 podman[70361]: 2024-09-11 01:20:25.389424336 +0000 UTC m=+0.015889353 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:20:25.776 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:25 smithi117 podman[70361]: 2024-09-11 01:20:25.699987947 +0000 UTC m=+0.326452958 container init 044848c414460196a51c6b499a9ed0cfca774667e18511020602ecc35db0f3c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-09-11T01:20:25.776 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:25 smithi117 podman[70361]: 2024-09-11 01:20:25.703355045 +0000 UTC m=+0.329820055 container start 044848c414460196a51c6b499a9ed0cfca774667e18511020602ecc35db0f3c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-11T01:20:25.776 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:25 smithi117 podman[70361]: 2024-09-11 01:20:25.774782581 +0000 UTC m=+0.401247596 container attach 044848c414460196a51c6b499a9ed0cfca774667e18511020602ecc35db0f3c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-11T01:20:26.122 INFO:journalctl@ceph.osd.10.smithi117.stdout:Sep 11 01:20:25 smithi117 podman[70361]: 2024-09-11 01:20:25.891142284 +0000 UTC m=+0.517607304 container died 044848c414460196a51c6b499a9ed0cfca774667e18511020602ecc35db0f3c1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-11T01:20:26.503 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.10.service' 2024-09-11T01:20:26.583 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:20:26.583 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-11T01:20:26.584 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-11T01:20:26.584 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.11 2024-09-11T01:20:26.610 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:26 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:26.183+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:26.611 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:26 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:26.183+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.645041+0000 front 2024-09-11T01:19:15.645100+0000 (oldest deadline 2024-09-11T01:20:19.145186+0000) 2024-09-11T01:20:26.886 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:26 smithi183 systemd[1]: Stopping Ceph osd.11 for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:20:27.168 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:26 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:26.884+0000 7fd8ad489640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:20:27.168 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:26 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:26.884+0000 7fd8ad489640 -1 osd.11 93 *** Got signal Terminated *** 2024-09-11T01:20:27.169 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:26 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:26.884+0000 7fd8ad489640 -1 osd.11 93 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-11T01:20:27.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:27 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:27.176+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:27.669 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:27 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:27.176+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.645041+0000 front 2024-09-11T01:19:15.645100+0000 (oldest deadline 2024-09-11T01:20:19.145186+0000) 2024-09-11T01:20:28.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:28 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:28.178+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:28.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:28 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:28.178+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.645041+0000 front 2024-09-11T01:19:15.645100+0000 (oldest deadline 2024-09-11T01:20:19.145186+0000) 2024-09-11T01:20:29.418 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:29 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:29.151+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:29.418 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:29 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:29.151+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.645041+0000 front 2024-09-11T01:19:15.645100+0000 (oldest deadline 2024-09-11T01:20:19.145186+0000) 2024-09-11T01:20:30.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:30 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:30.170+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:30.669 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:30 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:30.170+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.645041+0000 front 2024-09-11T01:19:15.645100+0000 (oldest deadline 2024-09-11T01:20:19.145186+0000) 2024-09-11T01:20:31.668 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:31 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:31.204+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-09-11T01:18:58.341331+0000 front 2024-09-11T01:18:58.341364+0000 (oldest deadline 2024-09-11T01:20:01.841386+0000) 2024-09-11T01:20:31.669 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:31 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11[60330]: 2024-09-11T01:20:31.204+0000 7fd8a5a96640 -1 osd.11 93 heartbeat_check: no reply from 172.21.15.183:6804 osd.2 since back 2024-09-11T01:19:15.645041+0000 front 2024-09-11T01:19:15.645100+0000 (oldest deadline 2024-09-11T01:20:19.145186+0000) 2024-09-11T01:20:32.570 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:32 smithi183 podman[71046]: 2024-09-11 01:20:32.307627969 +0000 UTC m=+5.522021501 container died c4206e04fd766ea20d5d39ff8fd1a3e3b32417de1b44036e45dea41d26d80824 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-11T01:20:32.849 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:32 smithi183 podman[71046]: 2024-09-11 01:20:32.625449734 +0000 UTC m=+5.839843265 container cleanup c4206e04fd766ea20d5d39ff8fd1a3e3b32417de1b44036e45dea41d26d80824 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-11T01:20:32.849 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:32 smithi183 bash[71046]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11 2024-09-11T01:20:33.169 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:32 smithi183 podman[71061]: 2024-09-11 01:20:32.845375923 +0000 UTC m=+0.534843765 container remove c4206e04fd766ea20d5d39ff8fd1a3e3b32417de1b44036e45dea41d26d80824 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-11T01:20:33.509 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:33 smithi183 podman[71150]: 2024-09-11 01:20:33.147986985 +0000 UTC m=+0.016144772 image pull 589dd18248e494ba411dc838aa4ae0e5e569213f08fcd7a2cf22cd3ef7e3c480 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e 2024-09-11T01:20:33.509 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:33 smithi183 podman[71150]: 2024-09-11 01:20:33.254410222 +0000 UTC m=+0.122568008 container create dbc2d3a9674ad2466322f88e857742ac971d4ccfb776cc30682a6fb1d951490e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-11T01:20:33.509 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:33 smithi183 podman[71150]: 2024-09-11 01:20:33.431762808 +0000 UTC m=+0.299920595 container init dbc2d3a9674ad2466322f88e857742ac971d4ccfb776cc30682a6fb1d951490e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-11T01:20:33.509 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:33 smithi183 podman[71150]: 2024-09-11 01:20:33.435321614 +0000 UTC m=+0.303479403 container start dbc2d3a9674ad2466322f88e857742ac971d4ccfb776cc30682a6fb1d951490e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-11T01:20:33.509 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:33 smithi183 podman[71150]: 2024-09-11 01:20:33.506640334 +0000 UTC m=+0.374798134 container attach dbc2d3a9674ad2466322f88e857742ac971d4ccfb776cc30682a6fb1d951490e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T01:20:33.918 INFO:journalctl@ceph.osd.11.smithi183.stdout:Sep 11 01:20:33 smithi183 podman[71150]: 2024-09-11 01:20:33.62460221 +0000 UTC m=+0.492760004 container died dbc2d3a9674ad2466322f88e857742ac971d4ccfb776cc30682a6fb1d951490e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-11T01:20:34.204 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@osd.11.service' 2024-09-11T01:20:34.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:20:34.284 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-11T01:20:34.284 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-11T01:20:34.284 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.a 2024-09-11T01:20:34.689 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 11 01:20:34 smithi103 systemd[1]: Stopping Ceph mds.a for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:20:35.082 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 11 01:20:34 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-a[74467]: 2024-09-11T01:20:34.686+0000 7fd3c7000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:20:35.082 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 11 01:20:34 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-a[74467]: 2024-09-11T01:20:34.686+0000 7fd3c7000640 -1 mds.a *** got signal Terminated *** 2024-09-11T01:20:37.704 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 11 01:20:37 smithi103 podman[101146]: 2024-09-11 01:20:37.393598626 +0000 UTC m=+2.815273109 container died 8a9d96eff071134c385a97e0b4315d0f23d84f07dddc058c3cf66d08d4024272 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-a, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T01:20:38.078 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 11 01:20:37 smithi103 podman[101146]: 2024-09-11 01:20:37.834032474 +0000 UTC m=+3.255706957 container cleanup 8a9d96eff071134c385a97e0b4315d0f23d84f07dddc058c3cf66d08d4024272 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T01:20:38.078 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 11 01:20:37 smithi103 bash[101146]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-a 2024-09-11T01:20:38.332 INFO:journalctl@ceph.mds.a.smithi103.stdout:Sep 11 01:20:38 smithi103 podman[101157]: 2024-09-11 01:20:38.077100919 +0000 UTC m=+0.669027615 container remove 8a9d96eff071134c385a97e0b4315d0f23d84f07dddc058c3cf66d08d4024272 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-11T01:20:38.366 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.a.service' 2024-09-11T01:20:38.440 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:20:38.441 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-11T01:20:38.441 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-11T01:20:38.441 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.d 2024-09-11T01:20:38.826 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 11 01:20:38 smithi103 systemd[1]: Stopping Ceph mds.d for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:20:39.082 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 11 01:20:38 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-d[73356]: 2024-09-11T01:20:38.824+0000 7fd39fc00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:20:39.082 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 11 01:20:38 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-d[73356]: 2024-09-11T01:20:38.824+0000 7fd39fc00640 -1 mds.d *** got signal Terminated *** 2024-09-11T01:20:40.832 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 11 01:20:40 smithi103 podman[101263]: 2024-09-11 01:20:40.561552984 +0000 UTC m=+1.851290737 container died 4fab1b12de5f8f4c3be9564b2198508ebcbfe74cba57ff255221ca4a1c4061d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-d, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-11T01:20:41.174 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 11 01:20:40 smithi103 podman[101263]: 2024-09-11 01:20:40.971256921 +0000 UTC m=+2.260994673 container cleanup 4fab1b12de5f8f4c3be9564b2198508ebcbfe74cba57ff255221ca4a1c4061d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-d, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2) 2024-09-11T01:20:41.174 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 11 01:20:40 smithi103 bash[101263]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-d 2024-09-11T01:20:41.433 INFO:journalctl@ceph.mds.d.smithi103.stdout:Sep 11 01:20:41 smithi103 podman[101275]: 2024-09-11 01:20:41.172428524 +0000 UTC m=+0.596391508 container remove 4fab1b12de5f8f4c3be9564b2198508ebcbfe74cba57ff255221ca4a1c4061d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-d, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T01:20:41.467 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.d.service' 2024-09-11T01:20:41.539 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:20:41.539 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-11T01:20:41.539 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-11T01:20:41.539 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.g 2024-09-11T01:20:41.832 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:20:41 smithi103 systemd[1]: Stopping Ceph mds.g for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:20:42.332 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:20:41 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-g[74122]: 2024-09-11T01:20:41.928+0000 7fdbda000640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:20:42.332 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:20:41 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-g[74122]: 2024-09-11T01:20:41.928+0000 7fdbda000640 -1 mds.g *** got signal Terminated *** 2024-09-11T01:20:46.269 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:20:45 smithi103 podman[101384]: 2024-09-11 01:20:45.945268443 +0000 UTC m=+4.135724821 container died 9cf641a7d7ac647e159e40b6f04002c7042ccacc9bb871b7eb0b280c154a7b42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-11T01:20:46.584 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:20:46 smithi103 podman[101384]: 2024-09-11 01:20:46.38374446 +0000 UTC m=+4.574200837 container cleanup 9cf641a7d7ac647e159e40b6f04002c7042ccacc9bb871b7eb0b280c154a7b42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-g, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-11T01:20:46.584 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:20:46 smithi103 bash[101384]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-g 2024-09-11T01:20:46.903 INFO:journalctl@ceph.mds.g.smithi103.stdout:Sep 11 01:20:46 smithi103 podman[101396]: 2024-09-11 01:20:46.635269127 +0000 UTC m=+0.682287333 container remove 9cf641a7d7ac647e159e40b6f04002c7042ccacc9bb871b7eb0b280c154a7b42 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-11T01:20:46.932 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.g.service' 2024-09-11T01:20:47.002 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:20:47.002 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-11T01:20:47.002 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-11T01:20:47.002 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.j 2024-09-11T01:20:47.332 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:20:47 smithi103 systemd[1]: Stopping Ceph mds.j for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:20:47.832 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:20:47 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-j[72953]: 2024-09-11T01:20:47.415+0000 7ff158e00640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:20:47.832 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:20:47 smithi103 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-j[72953]: 2024-09-11T01:20:47.416+0000 7ff158e00640 -1 mds.j *** got signal Terminated *** 2024-09-11T01:20:48.969 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:20:48 smithi103 podman[101504]: 2024-09-11 01:20:48.654558923 +0000 UTC m=+1.380404155 container died a4e62f8d4046cbfb4baba83a2d72182521616642a249e0aa6698ea3b570a7c26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-j, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T01:20:49.315 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:20:49 smithi103 podman[101504]: 2024-09-11 01:20:49.129758076 +0000 UTC m=+1.855603298 container cleanup a4e62f8d4046cbfb4baba83a2d72182521616642a249e0aa6698ea3b570a7c26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-j, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-11T01:20:49.315 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:20:49 smithi103 bash[101504]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-j 2024-09-11T01:20:49.582 INFO:journalctl@ceph.mds.j.smithi103.stdout:Sep 11 01:20:49 smithi103 podman[101521]: 2024-09-11 01:20:49.314126307 +0000 UTC m=+0.650453882 container remove a4e62f8d4046cbfb4baba83a2d72182521616642a249e0aa6698ea3b570a7c26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-j, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, io.buildah.version=1.37.2) 2024-09-11T01:20:49.592 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.j.service' 2024-09-11T01:20:49.664 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:20:49.665 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-11T01:20:49.665 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-11T01:20:49.665 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.b 2024-09-11T01:20:49.945 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:20:49 smithi117 systemd[1]: Stopping Ceph mds.b for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:20:50.201 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:20:49 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-b[65005]: 2024-09-11T01:20:49.943+0000 7fb49d9c0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:20:50.201 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:20:49 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-b[65005]: 2024-09-11T01:20:49.943+0000 7fb49d9c0640 -1 mds.b *** got signal Terminated *** 2024-09-11T01:20:53.603 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:20:53 smithi117 podman[70463]: 2024-09-11 01:20:53.335487145 +0000 UTC m=+3.485416016 container died 5b9ffb307d24ca1215c1c4185592db8d984aa5c3ac769c073ed3da6e52fc6ab8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-11T01:20:53.873 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:20:53 smithi117 podman[70463]: 2024-09-11 01:20:53.676530165 +0000 UTC m=+3.826459036 container cleanup 5b9ffb307d24ca1215c1c4185592db8d984aa5c3ac769c073ed3da6e52fc6ab8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-11T01:20:53.937 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:20:53 smithi117 bash[70463]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-b 2024-09-11T01:20:53.938 INFO:journalctl@ceph.mds.b.smithi117.stdout:Sep 11 01:20:53 smithi117 podman[70488]: 2024-09-11 01:20:53.844362592 +0000 UTC m=+0.508246535 container remove 5b9ffb307d24ca1215c1c4185592db8d984aa5c3ac769c073ed3da6e52fc6ab8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-11T01:20:54.097 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.b.service' 2024-09-11T01:20:54.133 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:20:54.133 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-11T01:20:54.133 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-11T01:20:54.133 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.e 2024-09-11T01:20:54.372 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:20:54 smithi117 systemd[1]: Stopping Ceph mds.e for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:20:54.872 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:20:54 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-e[64394]: 2024-09-11T01:20:54.480+0000 7f6e48d36640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:20:54.873 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:20:54 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-e[64394]: 2024-09-11T01:20:54.480+0000 7f6e48d36640 -1 mds.e *** got signal Terminated *** 2024-09-11T01:20:57.582 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:20:57 smithi117 podman[70597]: 2024-09-11 01:20:57.328690549 +0000 UTC m=+2.980086013 container died 4421820a92d18a5ca7b2c6142daca7ef44aee23fd36542ed9d907fc4f7707cfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-e, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T01:20:57.852 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:20:57 smithi117 podman[70597]: 2024-09-11 01:20:57.654877609 +0000 UTC m=+3.306273076 container cleanup 4421820a92d18a5ca7b2c6142daca7ef44aee23fd36542ed9d907fc4f7707cfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-e, maintainer=Guillaume Abrioux , RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-11T01:20:57.852 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:20:57 smithi117 bash[70597]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-e 2024-09-11T01:20:58.087 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.e.service' 2024-09-11T01:20:58.109 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:20:57 smithi117 podman[70609]: 2024-09-11 01:20:57.847935735 +0000 UTC m=+0.513631857 container remove 4421820a92d18a5ca7b2c6142daca7ef44aee23fd36542ed9d907fc4f7707cfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-11T01:20:58.109 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:20:58 smithi117 systemd[1]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.e.service: Deactivated successfully. 2024-09-11T01:20:58.109 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:20:58 smithi117 systemd[1]: Stopped Ceph mds.e for 917288bc-6fd8-11ef-bcea-c7b262605968. 2024-09-11T01:20:58.109 INFO:journalctl@ceph.mds.e.smithi117.stdout:Sep 11 01:20:58 smithi117 systemd[1]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.e.service: Consumed 2.039s CPU time. 2024-09-11T01:20:58.121 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:20:58.121 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-11T01:20:58.121 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-11T01:20:58.121 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.h 2024-09-11T01:20:58.372 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:20:58 smithi117 systemd[1]: Stopping Ceph mds.h for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:20:58.872 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:20:58 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-h[64697]: 2024-09-11T01:20:58.450+0000 7f8376ede640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:20:58.873 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:20:58 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-h[64697]: 2024-09-11T01:20:58.450+0000 7f8376ede640 -1 mds.h *** got signal Terminated *** 2024-09-11T01:21:01.568 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:21:01 smithi117 podman[70717]: 2024-09-11 01:21:01.329025006 +0000 UTC m=+2.995367623 container died 6add133a429adbc02d76b6fe41a0b863cbb2f3950a9999749c1aa4262a8738a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-h, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-11T01:21:01.827 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:21:01 smithi117 podman[70717]: 2024-09-11 01:21:01.658592128 +0000 UTC m=+3.324934743 container cleanup 6add133a429adbc02d76b6fe41a0b863cbb2f3950a9999749c1aa4262a8738a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-h, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-11T01:21:01.828 INFO:journalctl@ceph.mds.h.smithi117.stdout:Sep 11 01:21:01 smithi117 bash[70717]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-h 2024-09-11T01:21:02.042 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.h.service' 2024-09-11T01:21:02.075 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:21:02.075 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-11T01:21:02.075 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-11T01:21:02.076 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.k 2024-09-11T01:21:02.389 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 11 01:21:02 smithi117 systemd[1]: Stopping Ceph mds.k for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:21:02.872 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 11 01:21:02 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-k[64085]: 2024-09-11T01:21:02.387+0000 7fe11ee0d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:21:02.873 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 11 01:21:02 smithi117 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-k[64085]: 2024-09-11T01:21:02.387+0000 7fe11ee0d640 -1 mds.k *** got signal Terminated *** 2024-09-11T01:21:05.080 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 11 01:21:04 smithi117 podman[70839]: 2024-09-11 01:21:04.78491964 +0000 UTC m=+2.496732160 container died 90b23bd49b2bf76ab0e1cddf21e65ddd2870e17f014e97d30291d52b53b6f820 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-k, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-11T01:21:05.373 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 11 01:21:05 smithi117 podman[70839]: 2024-09-11 01:21:05.170595843 +0000 UTC m=+2.882408360 container cleanup 90b23bd49b2bf76ab0e1cddf21e65ddd2870e17f014e97d30291d52b53b6f820 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-k, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-11T01:21:05.373 INFO:journalctl@ceph.mds.k.smithi117.stdout:Sep 11 01:21:05 smithi117 bash[70839]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-k 2024-09-11T01:21:05.594 DEBUG:teuthology.orchestra.run.smithi117:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.k.service' 2024-09-11T01:21:05.627 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:21:05.628 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-11T01:21:05.628 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-11T01:21:05.628 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.c 2024-09-11T01:21:05.918 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:21:05 smithi183 systemd[1]: Stopping Ceph mds.c for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:21:06.213 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:21:05 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-c[65299]: 2024-09-11T01:21:05.925+0000 7f3bbea42640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:21:06.213 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:21:05 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-c[65299]: 2024-09-11T01:21:05.925+0000 7f3bbea42640 -1 mds.c *** got signal Terminated *** 2024-09-11T01:21:09.595 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:21:09 smithi183 podman[71265]: 2024-09-11 01:21:09.338657646 +0000 UTC m=+3.508960198 container died adefb5b2ca3fbc8968525331894dd3a5bb6dcb2f214b23975dbdedc4f119a3e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, CEPH_POINT_RELEASE=) 2024-09-11T01:21:09.918 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:21:09 smithi183 podman[71265]: 2024-09-11 01:21:09.692285724 +0000 UTC m=+3.862588268 container cleanup adefb5b2ca3fbc8968525331894dd3a5bb6dcb2f214b23975dbdedc4f119a3e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-c, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-11T01:21:09.919 INFO:journalctl@ceph.mds.c.smithi183.stdout:Sep 11 01:21:09 smithi183 bash[71265]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-c 2024-09-11T01:21:10.118 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.c.service' 2024-09-11T01:21:10.155 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:21:10.156 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-11T01:21:10.156 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-11T01:21:10.156 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.f 2024-09-11T01:21:10.668 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:21:10 smithi183 systemd[1]: Stopping Ceph mds.f for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:21:10.669 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:21:10 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-f[64997]: 2024-09-11T01:21:10.470+0000 7f6ae25d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:21:10.669 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:21:10 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-f[64997]: 2024-09-11T01:21:10.470+0000 7f6ae25d6640 -1 mds.f *** got signal Terminated *** 2024-09-11T01:21:13.631 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:21:13 smithi183 podman[71398]: 2024-09-11 01:21:13.33723528 +0000 UTC m=+2.967019015 container died 8cc09629b9d1b1be8a646bd226c02ee602535d6c8ce0dac1f27590721f63ea9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-f, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-11T01:21:13.918 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:21:13 smithi183 podman[71398]: 2024-09-11 01:21:13.712554734 +0000 UTC m=+3.342338471 container cleanup 8cc09629b9d1b1be8a646bd226c02ee602535d6c8ce0dac1f27590721f63ea9c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-f, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T01:21:13.918 INFO:journalctl@ceph.mds.f.smithi183.stdout:Sep 11 01:21:13 smithi183 bash[71398]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-f 2024-09-11T01:21:14.150 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.f.service' 2024-09-11T01:21:14.184 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:21:14.184 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-11T01:21:14.184 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-11T01:21:14.184 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.i 2024-09-11T01:21:14.668 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:21:14 smithi183 systemd[1]: Stopping Ceph mds.i for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:21:14.668 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:21:14 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-i[65599]: 2024-09-11T01:21:14.507+0000 7f83131f6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:21:14.668 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:21:14 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-i[65599]: 2024-09-11T01:21:14.507+0000 7f83131f6640 -1 mds.i *** got signal Terminated *** 2024-09-11T01:21:17.609 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:21:17 smithi183 podman[71520]: 2024-09-11 01:21:17.34081994 +0000 UTC m=+2.933444739 container died 41a1d2a651bd918286dc1e7476a9029b08e4061adb6c95da237d16016cc60165 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-09-11T01:21:17.609 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:21:17 smithi183 podman[71520]: 2024-09-11 01:21:17.608040236 +0000 UTC m=+3.200665032 container cleanup 41a1d2a651bd918286dc1e7476a9029b08e4061adb6c95da237d16016cc60165 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-i, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-11T01:21:17.918 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:21:17 smithi183 bash[71520]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-i 2024-09-11T01:21:17.918 INFO:journalctl@ceph.mds.i.smithi183.stdout:Sep 11 01:21:17 smithi183 podman[71532]: 2024-09-11 01:21:17.776026639 +0000 UTC m=+0.433311284 container remove 41a1d2a651bd918286dc1e7476a9029b08e4061adb6c95da237d16016cc60165 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-i, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4) 2024-09-11T01:21:18.032 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.i.service' 2024-09-11T01:21:18.064 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:21:18.064 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-11T01:21:18.064 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-11T01:21:18.065 DEBUG:teuthology.orchestra.run.smithi183:> sudo systemctl stop ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.l 2024-09-11T01:21:18.388 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:21:18 smithi183 systemd[1]: Stopping Ceph mds.l for 917288bc-6fd8-11ef-bcea-c7b262605968... 2024-09-11T01:21:18.668 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:21:18 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-l[64686]: 2024-09-11T01:21:18.386+0000 7f22a02ca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-11T01:21:18.668 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:21:18 smithi183 ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-l[64686]: 2024-09-11T01:21:18.386+0000 7f22a02ca640 -1 mds.l *** got signal Terminated *** 2024-09-11T01:21:22.497 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:21:22 smithi183 podman[71640]: 2024-09-11 01:21:22.226478025 +0000 UTC m=+3.946169666 container died dc6e3960506289f25359bdf6a3f4127b92bee2fe7cbeef4fbcf343972806bb82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-l, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD) 2024-09-11T01:21:22.869 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:21:22 smithi183 podman[71640]: 2024-09-11 01:21:22.586218787 +0000 UTC m=+4.305910425 container cleanup dc6e3960506289f25359bdf6a3f4127b92bee2fe7cbeef4fbcf343972806bb82 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:15494b9bca13f9d7088cd5c92cad00398197153ea02321fd69a7c31aa379887e, name=ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-l, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-hemanth-testing-2024-09-10-0723-8f219c4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-11T01:21:22.869 INFO:journalctl@ceph.mds.l.smithi183.stdout:Sep 11 01:21:22 smithi183 bash[71640]: ceph-917288bc-6fd8-11ef-bcea-c7b262605968-mds-l 2024-09-11T01:21:23.014 DEBUG:teuthology.orchestra.run.smithi183:> sudo pkill -f 'journalctl -f -n 0 -u ceph-917288bc-6fd8-11ef-bcea-c7b262605968@mds.l.service' 2024-09-11T01:21:23.046 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-11T01:21:23.046 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-11T01:21:23.047 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T01:21:23.318 INFO:teuthology.orchestra.run.smithi103.stdout:Deleting cluster with fsid: 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T01:21:27.241 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T01:21:27.442 INFO:teuthology.orchestra.run.smithi117.stdout:Deleting cluster with fsid: 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T01:21:29.991 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 --force --keep-logs 2024-09-11T01:21:30.193 INFO:teuthology.orchestra.run.smithi183.stdout:Deleting cluster with fsid: 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T01:21:32.636 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T01:21:32.699 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T01:21:32.732 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-11T01:21:32.759 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-11T01:21:32.761 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865/remote/smithi103/crash 2024-09-11T01:21:32.762 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/crash -- . 2024-09-11T01:21:32.834 INFO:teuthology.orchestra.run.smithi103.stderr:tar: /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T01:21:32.834 INFO:teuthology.orchestra.run.smithi103.stderr:tar: Error is not recoverable: exiting now 2024-09-11T01:21:32.837 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865/remote/smithi117/crash 2024-09-11T01:21:32.838 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/crash -- . 2024-09-11T01:21:32.906 INFO:teuthology.orchestra.run.smithi117.stderr:tar: /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T01:21:32.906 INFO:teuthology.orchestra.run.smithi117.stderr:tar: Error is not recoverable: exiting now 2024-09-11T01:21:32.908 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/crash to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865/remote/smithi183/crash 2024-09-11T01:21:32.909 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/crash -- . 2024-09-11T01:21:32.943 INFO:teuthology.orchestra.run.smithi183.stderr:tar: /var/lib/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/crash: Cannot open: No such file or directory 2024-09-11T01:21:32.943 INFO:teuthology.orchestra.run.smithi183.stderr:tar: Error is not recoverable: exiting now 2024-09-11T01:21:32.944 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-11T01:21:32.945 DEBUG:teuthology.orchestra.run.smithi103:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T01:21:33.076 INFO:teuthology.orchestra.run.smithi103.stdout:2024-09-11T01:12:49.379939+0000 mon.a (mon.0) 1189 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-11T01:21:33.078 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-11T01:21:33.078 DEBUG:teuthology.orchestra.run.smithi103:> sudo egrep '\[SEC\]' /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T01:21:33.158 DEBUG:teuthology.orchestra.run.smithi103:> sudo egrep '\[ERR\]' /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T01:21:33.236 DEBUG:teuthology.orchestra.run.smithi103:> sudo egrep '\[WRN\]' /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-11T01:21:33.315 INFO:teuthology.orchestra.run.smithi103.stdout:2024-09-11T01:12:49.379939+0000 mon.a (mon.0) 1189 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-11T01:21:33.316 INFO:tasks.cephadm:Compressing logs... 2024-09-11T01:21:33.317 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T01:21:33.321 DEBUG:teuthology.orchestra.run.smithi117:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T01:21:33.324 DEBUG:teuthology.orchestra.run.smithi183:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T01:21:33.364 INFO:teuthology.orchestra.run.smithi117.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-11T01:21:33.364 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.10.log 2024-09-11T01:21:33.365 INFO:teuthology.orchestra.run.smithi117.stderr:gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.1.log 2024-09-11T01:21:33.367 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.7.log 2024-09-11T01:21:33.367 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T01:21:33.367 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.b.log 2024-09-11T01:21:33.367 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.k.log 2024-09-11T01:21:33.367 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.4.log 2024-09-11T01:21:33.367 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T01:21:33.371 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T01:21:33.371 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mgr.y.log 2024-09-11T01:21:33.371 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.log 2024-09-11T01:21:33.371 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.h.log 2024-09-11T01:21:33.371 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mon.b.log 2024-09-11T01:21:33.371 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.e.log 2024-09-11T01:21:33.371 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T01:21:33.374 INFO:teuthology.orchestra.run.smithi183.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-11T01:21:33.374 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T01:21:33.374 INFO:teuthology.orchestra.run.smithi183.stderr:gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T01:21:33.374 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.i.log 2024-09-11T01:21:33.374 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mon.c.log 2024-09-11T01:21:33.374 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T01:21:33.374 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.11.log 2024-09-11T01:21:33.374 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.2.log 2024-09-11T01:21:33.374 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.5.log 2024-09-11T01:21:33.374 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.log 2024-09-11T01:21:33.375 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.l.log 2024-09-11T01:21:33.375 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.8.log 2024-09-11T01:21:33.375 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mgr.z.log 2024-09-11T01:21:33.375 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.c.log 2024-09-11T01:21:33.375 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.f.log 2024-09-11T01:21:33.375 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T01:21:33.381 INFO:teuthology.orchestra.run.smithi103.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-11T01:21:33.384 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-11T01:21:33.385 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.0.log 2024-09-11T01:21:33.385 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.9.log 2024-09-11T01:21:33.386 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-volume.log 2024-09-11T01:21:33.387 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.audit.log 2024-09-11T01:21:33.388 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.a.log 2024-09-11T01:21:33.388 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.cephadm.log 2024-09-11T01:21:33.389 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mon.a.log 2024-09-11T01:21:33.390 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.g.log 2024-09-11T01:21:33.391 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.6.log 2024-09-11T01:21:33.391 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.log 2024-09-11T01:21:33.392 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.d.log 2024-09-11T01:21:33.393 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mgr.x.log 2024-09-11T01:21:33.394 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.d.log: 94.8% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.a.log.gz 2024-09-11T01:21:33.395 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.j.log 2024-09-11T01:21:33.396 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.3.log 2024-09-11T01:21:33.396 INFO:teuthology.orchestra.run.smithi103.stderr: 86.7% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T01:21:33.397 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.j.log: 94.9% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.g.log.gz 2024-09-11T01:21:33.397 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-11T01:21:33.398 INFO:teuthology.orchestra.run.smithi117.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 82.5% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T01:21:33.400 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 94.9% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.d.log.gz 2024-09-11T01:21:33.403 INFO:teuthology.orchestra.run.smithi103.stderr: 94.8% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.j.log.gz 2024-09-11T01:21:33.418 INFO:teuthology.orchestra.run.smithi103.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-11T01:21:33.442 INFO:teuthology.orchestra.run.smithi103.stderr: 82.5% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T01:21:33.449 INFO:teuthology.orchestra.run.smithi117.stderr: 92.5% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mgr.y.log.gz 2024-09-11T01:21:33.472 INFO:teuthology.orchestra.run.smithi183.stderr:/var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 82.4% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.cephadm.log.gz 2024-09-11T01:21:33.484 INFO:teuthology.orchestra.run.smithi117.stderr: 95.0% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.k.log.gz 2024-09-11T01:21:33.500 INFO:teuthology.orchestra.run.smithi117.stderr: 90.3% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T01:21:33.512 INFO:teuthology.orchestra.run.smithi117.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T01:21:33.551 INFO:teuthology.orchestra.run.smithi117.stderr: 86.7% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T01:21:33.578 INFO:teuthology.orchestra.run.smithi183.stderr: 92.6% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mgr.z.log.gz 2024-09-11T01:21:33.583 INFO:teuthology.orchestra.run.smithi183.stderr: 95.0% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.l.log.gz 2024-09-11T01:21:33.601 INFO:teuthology.orchestra.run.smithi183.stderr: 86.7% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.log.gz 2024-09-11T01:21:33.639 INFO:teuthology.orchestra.run.smithi103.stderr: 90.9% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T01:21:33.651 INFO:teuthology.orchestra.run.smithi103.stderr: 90.2% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T01:21:33.701 INFO:teuthology.orchestra.run.smithi103.stderr: 93.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T01:21:33.710 INFO:teuthology.orchestra.run.smithi183.stderr: 90.9% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T01:21:33.727 INFO:teuthology.orchestra.run.smithi117.stderr: 90.8% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-volume.log.gz 2024-09-11T01:21:33.891 INFO:teuthology.orchestra.run.smithi183.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-11T01:21:33.914 INFO:teuthology.orchestra.run.smithi183.stderr: 90.4% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph.audit.log.gz 2024-09-11T01:21:34.014 INFO:teuthology.orchestra.run.smithi117.stderr: 94.5% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.h.log.gz 2024-09-11T01:21:34.170 INFO:teuthology.orchestra.run.smithi117.stderr: 94.6% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.e.log.gz 2024-09-11T01:21:35.270 INFO:teuthology.orchestra.run.smithi117.stderr: 91.6% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mon.b.log.gz 2024-09-11T01:21:35.298 INFO:teuthology.orchestra.run.smithi103.stderr: 90.3% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mgr.x.log.gz 2024-09-11T01:21:35.407 INFO:teuthology.orchestra.run.smithi183.stderr: 94.5% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.c.log.gz 2024-09-11T01:21:36.221 INFO:teuthology.orchestra.run.smithi117.stderr: 93.5% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.b.log.gz 2024-09-11T01:21:37.570 INFO:teuthology.orchestra.run.smithi183.stderr: 91.6% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mon.c.log.gz 2024-09-11T01:21:40.984 INFO:teuthology.orchestra.run.smithi103.stderr: 90.4% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mon.a.log.gz 2024-09-11T01:22:09.458 INFO:teuthology.orchestra.run.smithi183.stderr: 96.6% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.f.log.gz 2024-09-11T01:22:33.148 INFO:teuthology.orchestra.run.smithi183.stderr: 95.7% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-mds.i.log.gz 2024-09-11T01:27:11.540 INFO:teuthology.orchestra.run.smithi183.stderr: 92.2% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.2.log.gz 2024-09-11T01:31:08.694 INFO:teuthology.orchestra.run.smithi183.stderr: 92.5% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.11.log.gz 2024-09-11T01:31:58.921 INFO:teuthology.orchestra.run.smithi183.stderr: 92.6% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.8.log.gz 2024-09-11T01:33:51.679 INFO:teuthology.orchestra.run.smithi183.stderr: 92.0% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.5.log.gz 2024-09-11T01:33:51.681 INFO:teuthology.orchestra.run.smithi183.stderr: 2024-09-11T01:33:51.681 INFO:teuthology.orchestra.run.smithi183.stderr:real 12m18.342s 2024-09-11T01:33:51.681 INFO:teuthology.orchestra.run.smithi183.stderr:user 7m19.876s 2024-09-11T01:33:51.681 INFO:teuthology.orchestra.run.smithi183.stderr:sys 0m17.687s 2024-09-11T01:34:26.085 INFO:teuthology.orchestra.run.smithi117.stderr: 92.8% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.10.log.gz 2024-09-11T01:37:35.389 INFO:teuthology.orchestra.run.smithi117.stderr: 92.6% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.1.log.gz 2024-09-11T01:37:52.364 INFO:teuthology.orchestra.run.smithi103.stderr: 92.3% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.0.log.gz 2024-09-11T01:39:43.191 INFO:teuthology.orchestra.run.smithi103.stderr: 92.4% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.3.log.gz 2024-09-11T01:39:58.706 INFO:teuthology.orchestra.run.smithi117.stderr: 92.5% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.7.log.gz 2024-09-11T01:40:41.777 INFO:teuthology.orchestra.run.smithi117.stderr: 92.1% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.4.log.gz 2024-09-11T01:40:41.780 INFO:teuthology.orchestra.run.smithi117.stderr: 2024-09-11T01:40:41.780 INFO:teuthology.orchestra.run.smithi117.stderr:real 19m8.441s 2024-09-11T01:40:41.780 INFO:teuthology.orchestra.run.smithi117.stderr:user 7m1.043s 2024-09-11T01:40:41.780 INFO:teuthology.orchestra.run.smithi117.stderr:sys 0m19.569s 2024-09-11T01:42:26.198 INFO:teuthology.orchestra.run.smithi103.stderr: 92.0% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.6.log.gz 2024-09-11T01:43:06.845 INFO:teuthology.orchestra.run.smithi103.stderr: 92.3% -- replaced with /var/log/ceph/917288bc-6fd8-11ef-bcea-c7b262605968/ceph-osd.9.log.gz 2024-09-11T01:43:06.847 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-11T01:43:06.847 INFO:teuthology.orchestra.run.smithi103.stderr:real 21m33.498s 2024-09-11T01:43:06.848 INFO:teuthology.orchestra.run.smithi103.stderr:user 8m36.732s 2024-09-11T01:43:06.848 INFO:teuthology.orchestra.run.smithi103.stderr:sys 1m7.620s 2024-09-11T01:43:06.849 INFO:tasks.cephadm:Archiving logs... 2024-09-11T01:43:06.850 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865/remote/smithi103/log 2024-09-11T01:43:06.851 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T01:44:26.879 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865/remote/smithi117/log 2024-09-11T01:44:26.880 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T01:45:33.455 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865/remote/smithi183/log 2024-09-11T01:45:33.456 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T01:46:42.629 INFO:tasks.cephadm:Removing cluster... 2024-09-11T01:46:42.630 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 --force 2024-09-11T01:46:43.227 INFO:teuthology.orchestra.run.smithi103.stdout:Deleting cluster with fsid: 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T01:46:45.308 DEBUG:teuthology.orchestra.run.smithi117:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 --force 2024-09-11T01:46:45.600 INFO:teuthology.orchestra.run.smithi117.stdout:Deleting cluster with fsid: 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T01:46:46.291 DEBUG:teuthology.orchestra.run.smithi183:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 917288bc-6fd8-11ef-bcea-c7b262605968 --force 2024-09-11T01:46:46.653 INFO:teuthology.orchestra.run.smithi183.stdout:Deleting cluster with fsid: 917288bc-6fd8-11ef-bcea-c7b262605968 2024-09-11T01:46:47.414 INFO:tasks.cephadm:Removing cephadm ... 2024-09-11T01:46:47.414 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T01:46:47.543 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T01:46:47.563 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-11T01:46:47.579 INFO:tasks.cephadm:Teardown complete 2024-09-11T01:46:47.579 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T01:46:47.596 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T01:46:47.597 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T01:46:47.602 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T01:46:47.605 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T01:46:47.769 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T01:46:47.781 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T01:46:47.782 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T01:46:47.786 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T01:46:47.788 DEBUG:teuthology.orchestra.run.smithi183:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T01:46:47.803 INFO:teuthology.orchestra.run.smithi183.stderr:bash: line 1: ntpq: command not found 2024-09-11T01:46:47.804 INFO:teuthology.orchestra.run.smithi117.stderr:bash: line 1: ntpq: command not found 2024-09-11T01:46:47.817 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-09-11T01:46:47.828 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T01:46:47.829 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-09-11T01:46:47.829 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 10 -674us[ -567us] +/- 65ms 2024-09-11T01:46:47.829 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv02.front.sepia.ceph.com 3 6 377 6 +952us[+1059us] +/- 39ms 2024-09-11T01:46:47.829 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 -984us[ -878us] +/- 80ms 2024-09-11T01:46:47.829 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T01:46:47.832 INFO:teuthology.orchestra.run.smithi183.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T01:46:47.832 INFO:teuthology.orchestra.run.smithi183.stdout:=============================================================================== 2024-09-11T01:46:47.832 INFO:teuthology.orchestra.run.smithi183.stdout:^* hv01.front.sepia.ceph.com 3 6 377 7 -527us[ -512us] +/- 65ms 2024-09-11T01:46:47.832 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 6 +1088us[+1088us] +/- 39ms 2024-09-11T01:46:47.832 INFO:teuthology.orchestra.run.smithi183.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -857us[ -842us] +/- 80ms 2024-09-11T01:46:47.832 INFO:teuthology.orchestra.run.smithi183.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T01:46:47.947 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-11T01:46:47.947 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-09-11T01:46:47.947 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 -541us[ -545us] +/- 65ms 2024-09-11T01:46:47.948 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 +1049us[+1049us] +/- 39ms 2024-09-11T01:46:47.948 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -867us[ -867us] +/- 80ms 2024-09-11T01:46:47.948 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-11T01:46:47.949 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T01:46:47.960 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T01:46:47.960 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T01:46:47.977 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T01:46:48.196 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T01:46:48.313 DEBUG:teuthology.orchestra.run.smithi183:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-11T01:46:48.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T01:46:48.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:46:48.466 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T01:46:48.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:46:48.497 DEBUG:teuthology.orchestra.run.smithi183:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-11T01:46:48.524 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:46:48.524 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T01:46:48.538 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T01:46:48.553 INFO:teuthology.task.internal:Duration was 3462.583058 seconds 2024-09-11T01:46:48.554 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T01:46:48.570 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T01:46:48.570 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T01:46:48.574 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T01:46:48.577 DEBUG:teuthology.orchestra.run.smithi183:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T01:46:48.638 INFO:teuthology.orchestra.run.smithi183.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T01:46:48.647 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T01:46:48.680 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-11T01:46:48.966 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T01:46:48.966 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-09-11T01:46:48.966 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T01:46:49.015 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-09-11T01:46:49.015 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T01:46:49.046 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi183.front.sepia.ceph.com 2024-09-11T01:46:49.047 DEBUG:teuthology.orchestra.run.smithi183:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T01:46:49.079 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T01:46:49.079 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T01:46:49.083 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T01:46:49.089 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T01:46:49.146 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T01:46:49.146 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T01:46:49.150 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T01:46:49.156 DEBUG:teuthology.orchestra.run.smithi183:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T01:46:49.861 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T01:46:49.875 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T01:46:49.875 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T01:46:49.932 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T01:46:49.977 DEBUG:teuthology.orchestra.run.smithi183:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T01:46:50.021 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T01:46:50.035 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T01:46:50.040 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T01:46:50.042 DEBUG:teuthology.orchestra.run.smithi183:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T01:46:50.068 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-09-11T01:46:50.077 INFO:teuthology.orchestra.run.smithi183.stdout:kernel.core_pattern = core 2024-09-11T01:46:50.139 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-09-11T01:46:50.175 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T01:46:50.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:46:50.209 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T01:46:50.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:46:50.225 DEBUG:teuthology.orchestra.run.smithi183:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T01:46:50.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T01:46:50.240 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T01:46:50.251 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T01:46:50.252 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865/remote/smithi103 2024-09-11T01:46:50.253 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T01:46:50.335 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865/remote/smithi117 2024-09-11T01:46:50.335 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T01:46:50.372 DEBUG:teuthology.misc:Transferring archived files from smithi183:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hyelloji-2024-09-10_16:59:47-fs-wip-hemanth-testing-2024-09-10-0723-testing-default-smithi/7899865/remote/smithi183 2024-09-11T01:46:50.372 DEBUG:teuthology.orchestra.run.smithi183:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T01:46:50.409 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T01:46:50.409 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T01:46:50.414 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T01:46:50.416 DEBUG:teuthology.orchestra.run.smithi183:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T01:46:50.459 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T01:46:50.472 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T01:46:50.472 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T01:46:50.488 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T01:46:50.488 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T01:46:50.492 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T01:46:50.495 DEBUG:teuthology.orchestra.run.smithi183:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T01:46:50.507 INFO:teuthology.orchestra.run.smithi117.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 01:46 /home/ubuntu/cephtest 2024-09-11T01:46:50.514 INFO:teuthology.orchestra.run.smithi183.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 01:46 /home/ubuntu/cephtest 2024-09-11T01:46:50.523 INFO:teuthology.orchestra.run.smithi103.stdout: 393233 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 01:46 /home/ubuntu/cephtest 2024-09-11T01:46:50.526 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T01:46:50.542 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T01:46:50.571 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/legacy wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/ffsb}} duration: 3462.58305811882 failure_reason: '"2024-09-11T01:12:49.379939+0000 mon.a (mon.0) 1189 : cluster [WRN] Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED)" in cluster log' flavor: default owner: scheduled_hyelloji@teuthology success: false 2024-09-11T01:46:50.571 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T01:46:50.660 INFO:teuthology.run:FAIL